title: Ultrasound and fluoroscopic images fusion by autonomous ultrasound probe detection.
abstract: New minimal-invasive interventions such as transcatheter valve procedures exploit multiple imaging modalities to guide tools (fluoroscopy) and visualize soft tissue (transesophageal echocardiography (TEE)). Currently, these complementary modalities are visualized in separate coordinate systems and on separate monitors creating a challenging clinical workflow. This paper proposes a novel framework for fusing TEE and fluoroscopy by detecting the pose of the TEE probe in the fluoroscopic image. Probe pose detection is challenging in fluoroscopy and conventional computer vision techniques are not well suited. Current research requires manual initialization or the addition of fiducials. The main contribution of this paper is autonomous six DoF pose detection by combining discriminative learning techniques with a fast binary template library. The pose estimation problem is reformulated to incrementally detect pose parameters by exploiting natural invariances in the image. The theoretical contribution of this paper is validated on synthetic, phantom and in vivo data. The practical application of this technique is supported by accurate results (< 5 mm in-plane error) and computation time of 0.5s.
authors.affiliation: Siemens Corporate Research & Technology, Princeton, USA.
authors.forename: Peter
authors.initials: P
authors.lastname: Mountney
authors.forename: Razvan
authors.initials: R
authors.lastname: Ionasec
authors.forename: Markus
authors.initials: M
authors.lastname: Kaizer
authors.forename: Sina
authors.initials: S
authors.lastname: Mamaghani
authors.forename: Wen
authors.initials: W
authors.lastname: Wu
authors.forename: Terrence
authors.initials: T
authors.lastname: Chen
authors.forename: Matthias
authors.initials: M
authors.lastname: John
authors.forename: Jan
authors.initials: J
authors.lastname: Boese
authors.forename: Dorin
authors.initials: D
authors.lastname: Comaniciu
mesh_terms: D000465:Algorithms; D057918:Fiducial Markers; D005471:Fluoroscopy / Q000295:instrumentation / Q000379:methods*; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D019047:Phantoms, Imaging; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique; D014463:Ultrasonography / Q000295:instrumentation / Q000379:methods*