title: Framework for 2D-3D image fusion of infrared thermography with preoperative MRI.
abstract: Multimodal medical image fusion combines information of one or more images in order to improve the diagnostic value. While previous applications mainly focus on merging images from computed tomography, magnetic resonance imaging (MRI), ultrasonic and single-photon emission computed tomography, we propose a novel approach for the registration and fusion of preoperative 3D MRI with intraoperative 2D infrared thermography. Image-guided neurosurgeries are based on neuronavigation systems, which further allow us track the position and orientation of arbitrary cameras. Hereby, we are able to relate the 2D coordinate system of the infrared camera with the 3D MRI coordinate system. The registered image data are now combined by calibration-based image fusion in order to map our intraoperative 2D thermographic images onto the respective brain surface recovered from preoperative MRI. In extensive accuracy measurements, we found that the proposed framework achieves a mean accuracy of 2.46 mm.
authors.affiliation: .
authors.forename: Nico
authors.initials: N
authors.lastname: Hoffmann
authors.affiliation: .
authors.forename: Florian
authors.initials: F
authors.lastname: Weidner
authors.affiliation: .
authors.forename: Peter
authors.initials: P
authors.lastname: Urban
authors.affiliation: .
authors.forename: Tobias
authors.initials: T
authors.lastname: Meyer
authors.affiliation: .
authors.forename: Christian
authors.initials: C
authors.lastname: Schnabel
authors.affiliation: .
authors.forename: Yordan
authors.initials: Y
authors.lastname: Radev
authors.affiliation: .
authors.forename: Gabriele
authors.initials: G
authors.lastname: Schackert
authors.affiliation: .
authors.forename: Uwe
authors.initials: U
authors.lastname: Petersohn
authors.affiliation: .
authors.forename: Edmund
authors.initials: E
authors.lastname: Koch
authors.affiliation: .
authors.forename: Stefan
authors.initials: S
authors.lastname: Gumhold
authors.affiliation: .
authors.forename: Gerald
authors.initials: G
authors.lastname: Steiner
authors.affiliation: .
authors.forename: Matthias
authors.initials: M
authors.lastname: Kirsch
mesh_terms: D001921:Brain / Q000473:pathology*; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008279:Magnetic Resonance Imaging; D038361:Neuronavigation; D013817:Thermography; D014057:Tomography, X-Ray Computed
keywords: image fusion; image-guided neurosurgery; infrared thermography; magnetic resonance imaging; neurosurgery