title: Surgical navigation by autostereoscopic image overlay of integral videography.
abstract: This paper describes an autostereoscopic image overlay technique that is integrated into a surgical navigation system to superimpose a real three-dimensional (3-D) image onto the patient via a half-silvered mirror. The images are created by employing a modified version of integral videography (IV), which is an animated extension of integral photography. IV records and reproduces 3-D images using a microconvex lens array and flat display; it can display geometrically accurate 3-D autostereoscopic images and reproduce motion parallax without the need for special devices. The use of semitransparent display devices makes it appear that the 3-D image is inside the patient's body. This is the first report of applying an autostereoscopic display with an image overlay system in surgical navigation. Experiments demonstrated that the fast IV rendering technique and patient-image registration method produce an average registration accuracy of 1.13 mm. Experiments using a target in phantom agar showed that the system can guide a needle toward a target with an average error of 2.6 mm. Improvement in the quality of the IV display will make this system practical and its use will increase surgical accuracy and reduce invasiveness.
authors.affiliation: Graduate School of Information Technology Science, The University of Tokyo, Tokyo 113-8656, Japan. liao@miki.pe.u-tokyo.ac.jp
authors.forename: Hongen
authors.initials: H
authors.lastname: Liao
authors.forename: Nobuhiko
authors.initials: N
authors.lastname: Hata
authors.forename: Susumu
authors.initials: S
authors.lastname: Nakajima
authors.forename: Makoto
authors.initials: M
authors.lastname: Iwahara
authors.forename: Ichiro
authors.initials: I
authors.lastname: Sakuma
authors.forename: Takeyoshi
authors.initials: T
authors.lastname: Dohi
mesh_terms: D003867:Depth Perception; D004867:Equipment Design; D019544:Equipment Failure Analysis; D006801:Humans; D007089:Image Enhancement / Q000295:instrumentation / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000295:instrumentation / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D009862:Online Systems; D019047:Phantoms, Imaging; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique / Q000295:instrumentation*; D025321:Surgery, Computer-Assisted / Q000295:instrumentation / Q000379:methods*; D018511:Systems Integration; D014584:User-Computer Interface; D014741:Video Recording / Q000295:instrumentation / Q000379:methods*