Feature extraction of video data for automatic visual tool tracking in robot assisted surgery

J. Huang, X. Li, T. Kesavadas, L. Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The strong interest in data-driven surgical procedures has motivated the need for automatically analyzing instrument trajectories during surgical procedures to improve the efficacy of modern robot-assisted surgeries. We proposed a single view camera-based approach for automatic video analysis of surgical instruments during robot-assisted minimally invasive procedures. This video data-driven approach uses feature extraction for visual tracking of the surgical instrument, coupled with the kinematics of the pivoted motion in minimally invasive surgery for tool trajectory analysis. The self-contained nature of the approach enables the acquisition of trajectory information without any prior placement of markers or post storage of robot joint trajectories information. Based on visual inspection of the 2D localization results in the image frames, the proposed method demonstrated reasonable recovery of the 3D positional information of the surgical tools. Driven by the increasingly sophisticated interventional procedures of modern surgeries, this proposed trajectory tracking method provides a means for leveraging the wealth of surgical video data for data analytics in Surgical Data Science. The long-term goal of the study is to contribute towards the advancement of Surgical Data Science through the establishment of a video-based data acquisition technique.

Original languageEnglish (US)
Title of host publicationProceedings of the 2019 4th International Conference on Robotics, Control and Automation, ICRCA 2019 - Workshop 2019 the 4th International Conference on Robotics and Machine Vision, ICRMV 2019
PublisherAssociation for Computing Machinery
Pages121-127
Number of pages7
ISBN (Electronic)9781450371834
DOIs
StatePublished - Jul 26 2019
Event2019 4th International Conference on Robotics, Control and Automation, ICRCA 2019 and its Workshop of 2019 4th International Conference on Robotics and Machine Vision, ICRMV 2019 - Guangzhou, China
Duration: Jul 26 2019Jul 28 2019

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2019 4th International Conference on Robotics, Control and Automation, ICRCA 2019 and its Workshop of 2019 4th International Conference on Robotics and Machine Vision, ICRMV 2019
CountryChina
CityGuangzhou
Period7/26/197/28/19

Keywords

  • Feature Extraction
  • Surgical Data Science
  • Visual Tracking

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Feature extraction of video data for automatic visual tool tracking in robot assisted surgery'. Together they form a unique fingerprint.

  • Cite this

    Huang, J., Li, X., Kesavadas, T., & Yang, L. (2019). Feature extraction of video data for automatic visual tool tracking in robot assisted surgery. In Proceedings of the 2019 4th International Conference on Robotics, Control and Automation, ICRCA 2019 - Workshop 2019 the 4th International Conference on Robotics and Machine Vision, ICRMV 2019 (pp. 121-127). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3351180.3351185