Video see-through augmented reality for oral and maxillofacial surgery.
BACKGROUND
Oral and maxillofacial surgery has not been benefitting from image guidance techniques owing to the limitations in image registration.


METHODS
A real-time markerless image registration method is proposed by integrating a shape matching method into a 2D tracking framework. The image registration is performed by matching the patient's teeth model with intraoperative video to obtain its pose. The resulting pose is used to overlay relevant models from the same CT space on the camera video for augmented reality.


RESULTS
The proposed system was evaluated on mandible/maxilla phantoms, a volunteer and clinical data. Experimental results show that the target overlay error is about 1 mm, and the frame rate of registration update yields 3-5 frames per second with a 4 K camera.


CONCLUSIONS
The significance of this work lies in its simplicity in clinical setting and the seamless integration into the current medical procedure with satisfactory response time and overlay accuracy. Copyright © 2016 John Wiley & Sons, Ltd.
School of Mechanical Engineering and Automation, Beihang University, Beijing, China.|Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
Junchen
J
Wang
Department of Oral-Maxillofacial Surgery, Dentistry and Orthodontics, The University of Tokyo Hospital, Tokyo, Japan.
Hideyuki
H
Suenaga
Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
Liangjing
http://orcid.org/0000-0002-3294-0879
L
Yang
Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
Etsuko
E
Kobayashi
Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
Ichiro
I
Sakuma
D006801:Humans; D007568:Jaw / Q000000981:diagnostic imaging*; D019647:Oral Surgical Procedures / Q000379:methods*; D056948:Orthognathic Surgical Procedures; D019047:Phantoms, Imaging; D011856:Radiographic Image Enhancement / Q000379:methods; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique; D025321:Surgery, Computer-Assisted / Q000379:methods*; D014057:Tomography, X-Ray Computed / Q000379:methods*; D014584:User-Computer Interface; D014741:Video Recording / Q000379:methods
3D-2D image registration; augmented reality; object tracking; oral and maxillofacial surgery