TY - JOUR
T1 - Optical Coherence Tomography-Guided Robotic Ophthalmic Microsurgery via Reinforcement Learning from Demonstration
AU - Keller, Brenton
AU - Draelos, Mark
AU - Zhou, Kevin
AU - Qian, Ruobing
AU - Kuo, Anthony N.
AU - Konidaris, George
AU - Hauser, Kris
AU - Izatt, Joseph A.
N1 - Mr. Zhou was the recepient of the Goldwater Scholarship and the National Science Foundation (NSF) Graduate Research Fellowship.
Manuscript received October 15, 2019; accepted January 9, 2020. Date of publication April 16, 2020; date of current version August 5, 2020. This paper was recommended for publication by Associate Editor S. Oh and Editor P. Dupont upon evaluation of the reviewers’ comments. This work was supported in part by the National Institutes of Health under Grants R01 EY023039 and R21EY029877 and in part by the Duke Coulter Translational Partnership under Grant 2016–2018. (Corresponding author: Brenton Keller.) Brenton Keller, Mark Draelos, Kevin Zhou, Ruobing Qian, and Joseph A. Izatt are with the Department of Biomedical Engineering, Duke University, Durham, NC 27708 USA (e-mail: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]).
The authors would like to thank Miracles in Sight (Winston-Salem, NC) for the use of research donor corneal tissue. We acknowledge research support from the Coulter Foundation Translational Partnership.
PY - 2020/8
Y1 - 2020/8
N2 - Ophthalmic microsurgery is technically difficult because the scale of required surgical tool manipulations challenge the limits of the surgeon's visual acuity, sensory perception, and physical dexterity. Intraoperative optical coherence tomography (OCT) imaging with micrometer-scale resolution is increasingly being used to monitor and provide enhanced real-time visualization of ophthalmic surgical maneuvers, but surgeons still face physical limitations when manipulating instruments inside the eye. Autonomously controlled robots are one avenue for overcoming these physical limitations. In this article, we demonstrate the feasibility of using learning from demonstration and reinforcement learning with an industrial robot to perform OCT-guided corneal needle insertions in an ex vivo model of deep anterior lamellar keratoplasty (DALK) surgery. Our reinforcement learning agent trained on ex vivo human corneas, then outperformed surgical fellows in reaching a target needle insertion depth in mock corneal surgery trials. This article shows the combination of learning from demonstration and reinforcement learning is a viable option for performing OCT-guided robotic ophthalmic surgery.
AB - Ophthalmic microsurgery is technically difficult because the scale of required surgical tool manipulations challenge the limits of the surgeon's visual acuity, sensory perception, and physical dexterity. Intraoperative optical coherence tomography (OCT) imaging with micrometer-scale resolution is increasingly being used to monitor and provide enhanced real-time visualization of ophthalmic surgical maneuvers, but surgeons still face physical limitations when manipulating instruments inside the eye. Autonomously controlled robots are one avenue for overcoming these physical limitations. In this article, we demonstrate the feasibility of using learning from demonstration and reinforcement learning with an industrial robot to perform OCT-guided corneal needle insertions in an ex vivo model of deep anterior lamellar keratoplasty (DALK) surgery. Our reinforcement learning agent trained on ex vivo human corneas, then outperformed surgical fellows in reaching a target needle insertion depth in mock corneal surgery trials. This article shows the combination of learning from demonstration and reinforcement learning is a viable option for performing OCT-guided robotic ophthalmic surgery.
KW - Deep learning in robotics and automation
KW - learning from demonstration
KW - medical robots and systems
KW - microsurgery
UR - https://www.scopus.com/pages/publications/85092453227
UR - https://www.scopus.com/pages/publications/85092453227#tab=citedBy
U2 - 10.1109/TRO.2020.2980158
DO - 10.1109/TRO.2020.2980158
M3 - Article
AN - SCOPUS:85092453227
SN - 1552-3098
VL - 36
SP - 1207
EP - 1218
JO - IEEE Transactions on Robotics
JF - IEEE Transactions on Robotics
IS - 4
M1 - 9069310
ER -