title: Inverse visualization concept for RGB-D augmented C-arms.
abstract: X-ray is still the essential imaging for many minimally-invasive interventions. Overlaying X-ray images with an optical view of the surgery scene has been demonstrated to be an efficient way to reduce radiation exposure and surgery time. However, clinicians are recommended to place the X-ray source under the patient table while the optical view of the real scene must be captured from the top in order to see the patient, surgical tools, and the surgical site. With the help of a RGB-D (red-green-blue-depth) camera, which can measure depth in addition to color, the 3D model of the real scene is registered to the X-ray image. However, fusing two opposing viewpoints and visualizing them in the context of medical applications has never been attempted. In this paper, we propose first experiences of a novel inverse visualization technique for RGB-D augmented C-arms. A user study consisting of 16 participants demonstrated that our method shows a meaningful visualization with potential in providing clinicians multi-modal fused data in real-time during surgery.
authors.affiliation: School of Automation Science and Electrical Engineering, Beihang University, Beijing, China; Computer Aided Medical Procedures, Technische Universität München, Germany. Electronic address: wangxiang8602@126.com.
authors.forename: Xiang
authors.initials: X
authors.lastname: Wang
authors.affiliation: Computer Aided Medical Procedures, Technische Universität München, Germany.
authors.forename: Severine
authors.initials: S
authors.lastname: Habert
authors.affiliation: Computer Aided Medical Procedures, Technische Universität München, Germany.
authors.forename: Christian Schulte
authors.initials: CS
authors.lastname: Zu Berge
authors.affiliation: Computer Aided Medical Procedures, Technische Universität München, Germany.
authors.forename: Pascal
authors.initials: P
authors.lastname: Fallavollita
authors.affiliation: Computer Aided Medical Procedures, Technische Universität München, Germany; Johns Hopkins University, Baltimore, MD, USA.
authors.forename: Nassir
authors.initials: N
authors.lastname: Navab
mesh_terms: D003116:Color; D004867:Equipment Design; D006225:Hand / Q000000981:diagnostic imaging; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000295:instrumentation / Q000379:methods*; D019047:Phantoms, Imaging; D025321:Surgery, Computer-Assisted / Q000379:methods*; D014741:Video Recording
keywords: Augmented reality; C-arm fluoroscopy; RGB-D cameras; Video; Visualization; X-ray