title: Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot study.
abstract: To evaluate the feasibility and accuracy of a three-dimensional augmented reality system incorporating integral videography for imaging oral and maxillofacial regions, based on preoperative computed tomography data. Three-dimensional surface models of the jawbones, based on the computed tomography data, were used to create the integral videography images of a subject's maxillofacial area. The three-dimensional augmented reality system (integral videography display, computed tomography, a position tracker and a computer) was used to generate a three-dimensional overlay that was projected on the surgical site via a half-silvered mirror. Thereafter, a feasibility study was performed on a volunteer. The accuracy of this system was verified on a solid model while simulating bone resection. Positional registration was attained by identifying and tracking the patient/surgical instrument's position. Thus, integral videography images of jawbones, teeth and the surgical tool were superimposed in the correct position. Stereoscopic images viewed from various angles were accurately displayed. Change in the viewing angle did not negatively affect the surgeon's ability to simultaneously observe the three-dimensional images and the patient, without special glasses. The difference in three-dimensional position of each measuring point on the solid model and augmented reality navigation was almost negligible (<1 mm); this indicates that the system was highly accurate. This augmented reality system was highly accurate and effective for surgical navigation and for overlaying a three-dimensional computed tomography image on a patient's surgical area, enabling the surgeon to understand the positional relationship between the preoperative image and the actual surgical site, with the naked eye.
authors.affiliation: Department of Oral-Maxillofacial Surgery, The University of Tokyo Hospital, Tokyo, Japan. suenaga-tky@umin.ac.jp
authors.forename: Hideyuki
authors.initials: H
authors.lastname: Suenaga
authors.forename: Huy
authors.initials: H
authors.lastname: Hoang Tran
authors.forename: Hongen
authors.initials: H
authors.lastname: Liao
authors.forename: Ken
authors.initials: K
authors.lastname: Masamune
authors.forename: Takeyoshi
authors.initials: T
authors.lastname: Dohi
authors.forename: Kazuto
authors.initials: K
authors.lastname: Hoshi
authors.forename: Yoshiyuki
authors.initials: Y
authors.lastname: Mori
authors.forename: Tsuyoshi
authors.initials: T
authors.lastname: Takato
mesh_terms: D002138:Calibration; D003626:Data Display; D005240:Feasibility Studies; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000295:instrumentation / Q000379:methods; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008334:Mandible / Q000033:anatomy & histology; D008437:Maxilla / Q000033:anatomy & histology; D008953:Models, Anatomic; D055096:Optical Devices; D019647:Oral Surgical Procedures / Q000295:instrumentation / Q000379:methods*; D010865:Pilot Projects; D013238:Stereotaxic Techniques / Q000295:instrumentation; D025321:Surgery, Computer-Assisted / Q000295:instrumentation / Q000379:methods*; D014057:Tomography, X-Ray Computed / Q000379:methods; D014070:Tooth / Q000033:anatomy & histology; D014584:User-Computer Interface; D014741:Video Recording / Q000295:instrumentation / Q000379:methods*