title: Efficient multi-organ segmentation in multi-view endoscopic videos using pre-operative priors.
abstract: Synergistic fusion of pre-operative (pre-op) and intraoperative (intra-op) imaging data provides surgeons with invaluable insightful information that can improve their decision-making during minimally invasive robotic surgery. In this paper, we propose an efficient technique to segment multiple objects in intra-op multi-view endoscopic videos based on priors captured from pre-op data. Our approach leverages information from 3D pre-op data into the analysis of visual cues in the 2D intra-op data by formulating the problem as one of finding the 3D pose and non-rigid deformations of tissue models driven by features from 2D images. We present a closed-form solution for our formulation and demonstrate how it allows for the inclusion of laparoscopic camera motion model. Our efficient method runs in real-time on a single core CPU making it practical even for robotic surgery systems with limited computational resources. We validate the utility of our technique on ex vivo data as well as in vivo clinical data from laparoscopic partial nephrectomy surgery and demonstrate its robustness in segmenting stereo endoscopic videos.
authors.forename: Masoud S
authors.initials: MS
authors.lastname: Nosrati
authors.forename: Jean-Marc
authors.initials: JM
authors.lastname: Peyrat
authors.forename: Julien
authors.initials: J
authors.lastname: Abinahed
authors.forename: Osama
authors.initials: O
authors.lastname: Al-Alao
authors.forename: Abdulla
authors.initials: A
authors.lastname: Al-Ansari
authors.forename: Rafeef
authors.initials: R
authors.lastname: Abugharbieh
authors.forename: Ghassan
authors.initials: G
authors.lastname: Hamarneh
mesh_terms: D000818:Animals; D053704:Capsule Endoscopy / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D021621:Imaging, Three-Dimensional / Q000379:methods*; D007680:Kidney Neoplasms / Q000473:pathology* / Q000601:surgery*; D009392:Nephrectomy / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D011300:Preoperative Care / Q000379:methods; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012756:Sheep; D013382:Subtraction Technique; D025321:Surgery, Computer-Assisted / Q000379:methods*; D014781:Viscera / Q000473:pathology / Q000601:surgery