title: Toward real-time endoscopically-guided robotic navigation based on a 3D virtual surgical field model.
abstract: The challenge is to accurately guide the surgical tool within the three-dimensional (3D) surgical field for robotically-assisted operations such as tumor margin removal from a debulked brain tumor cavity. The proposed technique is 3D image-guided surgical navigation based on matching intraoperative video frames to a 3D virtual model of the surgical field. A small laser-scanning endoscopic camera was attached to a mock minimally-invasive surgical tool that was manipulated toward a region of interest (residual tumor) within a phantom of a debulked brain tumor. Video frames from the endoscope provided features that were matched to the 3D virtual model, which were reconstructed earlier by raster scanning over the surgical field. Camera pose (position and orientation) is recovered by implementing a constrained bundle adjustment algorithm. Navigational error during the approach to fluorescence target (residual tumor) is determined by comparing the calculated camera pose to the measured camera pose using a micro-positioning stage. From these preliminary results, computation efficiency of the algorithm in MATLAB code is near real-time (2.5 sec for each estimation of pose), which can be improved by implementation in C++. Error analysis produced 3-mm distance error and 2.5 degree of orientation error on average. The sources of these errors come from 1) inaccuracy of the 3D virtual model, generated on a calibrated RAVEN robotic platform with stereo tracking; 2) inaccuracy of endoscope intrinsic parameters, such as focal length; and 3) any endoscopic image distortion from scanning irregularities. This work demonstrates feasibility of micro-camera 3D guidance of a robotic surgical tool.
authors.affiliation: Human Photonics Lab, Dept. of Mechanical Engineering, Univ. of Washington, Seattle, WA 98195.
authors.forename: Yuanzheng
authors.initials: Y
authors.lastname: Gong
authors.affiliation: Biorobotics Lab, Dept. of Electrical Engineering, Univ. of Washington, Seattle, WA 98195.
authors.forename: Danying
authors.initials: D
authors.lastname: Hu
authors.affiliation: Biorobotics Lab, Dept. of Electrical Engineering, Univ. of Washington, Seattle, WA 98195.
authors.forename: Blake
authors.initials: B
authors.lastname: Hannaford
authors.affiliation: Human Photonics Lab, Dept. of Mechanical Engineering, Univ. of Washington, Seattle, WA 98195.
authors.forename: Eric J
authors.initials: EJ
authors.lastname: Seibel
keywords: 3D surgical field; Image-guided surgery; keyhole surgery; machine vision; neurosurgery; robotic navigation
references.citation: J Med Imaging (Bellingham). 2014 Oct;1(3):035002
references.pmid: 26158071
references.citation: IEEE Trans Biomed Eng. 2014 Jun;61(6):1833-43
references.pmid: 24845293
references.citation: IEEE Trans Biomed Eng. 2013 Mar;60(3):674-81
references.pmid: 23372075
references.citation: Proc SPIE Int Soc Opt Eng. 2014 Feb;9036:
references.pmid: 34321710
references.citation: J Biomed Opt. 2014;19(7):76014
references.pmid: 25027002
references.citation: Opt Express. 2015 Apr 20;23(8):10771-85
references.pmid: 25969115
references.citation: IEEE Int Conf Robot Autom. 2015 May;2015:3868-3875
references.pmid: 26405563
references.citation: IEEE Trans Biomed Eng. 2013 Apr;60(4):954-9
references.pmid: 23204264
references.citation: Neurosurgery. 2014 Jul;75(1):61-71
references.pmid: 24618801