title: Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display.
abstract: The surgical navigation system has experienced tremendous development over the past decades for minimizing the risks and improving the precision of the surgery. Nowadays, Augmented Reality (AR)-based surgical navigation is a promising technology for clinical applications. In the AR system, virtual and actual reality are mixed, offering real-time, high-quality visualization of an extensive variety of information to the users (Moussa et al., 2012) [1]. For example, virtual anatomical structures such as soft tissues, blood vessels and nerves can be integrated with the real-world scenario in real time. In this study, an AR-based surgical navigation system (AR-SNS) is developed using an optical see-through HMD (head-mounted display), aiming at improving the safety and reliability of the surgery. With the use of this system, including the calibration of instruments, registration, and the calibration of HMD, the 3D virtual critical anatomical structures in the head-mounted display are aligned with the actual structures of patient in real-world scenario during the intra-operative motion tracking process. The accuracy verification experiment demonstrated that the mean distance and angular errors were respectively 0.809±0.05mm and 1.038°±0.05°, which was sufficient to meet the clinical requirements.
authors.affiliation: Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China. Electronic address: xiaojunchen@163.com.
authors.forename: Xiaojun
authors.initials: X
authors.lastname: Chen
authors.affiliation: Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China.
authors.forename: Lu
authors.initials: L
authors.lastname: Xu
authors.affiliation: Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China.
authors.forename: Yiping
authors.initials: Y
authors.lastname: Wang
authors.affiliation: Shanghai First People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
authors.forename: Huixiang
authors.initials: H
authors.lastname: Wang
authors.affiliation: Shanghai First People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
authors.forename: Fang
authors.initials: F
authors.lastname: Wang
authors.affiliation: Shanghai First People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
authors.forename: Xiangsen
authors.initials: X
authors.lastname: Zeng
authors.affiliation: Shanghai First People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
authors.forename: Qiugen
authors.initials: Q
authors.lastname: Wang
authors.affiliation: Faculty of Computer Science and Biomedical Engineering, Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria.
authors.forename: Jan
authors.initials: J
authors.lastname: Egger
mesh_terms: D003196:Computer Graphics / Q000295:instrumentation*; D004867:Equipment Design; D019544:Equipment Failure Analysis; D006257:Head; D006260:Head Protective Devices; D006801:Humans; D007089:Image Enhancement / Q000295:instrumentation*; D021621:Imaging, Three-Dimensional / Q000295:instrumentation*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D025321:Surgery, Computer-Assisted / Q000295:instrumentation*; D014584:User-Computer Interface
keywords: Augmented reality; Intra-operative motion tracking; Optical see-through HMD; Surgical navigation