title: Laparoscopic stereoscopic augmented reality: toward a clinically viable electromagnetic tracking solution.
abstract: The purpose of this work was to develop a clinically viable laparoscopic augmented reality (AR) system employing stereoscopic (3-D) vision, laparoscopic ultrasound (LUS), and electromagnetic (EM) tracking to achieve image registration. We investigated clinically feasible solutions to mount the EM sensors on the 3-D laparoscope and the LUS probe. This led to a solution of integrating an externally attached EM sensor near the imaging tip of the LUS probe, only slightly increasing the overall diameter of the probe. Likewise, a solution for mounting an EM sensor on the handle of the 3-D laparoscope was proposed. The spatial image-to-video registration accuracy of the AR system was measured to be [Formula: see text] and [Formula: see text] for the left- and right-eye channels, respectively. The AR system contributed 58-ms latency to stereoscopic visualization. We further performed an animal experiment to demonstrate the use of the system as a visualization approach for laparoscopic procedures. In conclusion, we have developed an integrated, compact, and EM tracking-based stereoscopic AR visualization system, which has the potential for clinical use. The system has been demonstrated to achieve clinically acceptable accuracy and latency. This work is a critical step toward clinical translation of AR visualization for laparoscopic procedures.
authors.affiliation: Sheikh Zayed Institute for Pediatric Surgical Innovation , Children's National Health System, 111 Michigan Avenue NW, Washington, DC 20010, United States.
authors.forename: Xinyang
authors.initials: X
authors.lastname: Liu
authors.affiliation: Sheikh Zayed Institute for Pediatric Surgical Innovation , Children's National Health System, 111 Michigan Avenue NW, Washington, DC 20010, United States.
authors.forename: Sukryool
authors.initials: S
authors.lastname: Kang
authors.affiliation: IGI Technologies, Inc. , 387 Technology Drive #3110D, College Park, Maryland 20742, United States.
authors.forename: William
authors.initials: W
authors.lastname: Plishker
authors.affiliation: IGI Technologies, Inc. , 387 Technology Drive #3110D, College Park, Maryland 20742, United States.
authors.forename: George
authors.initials: G
authors.lastname: Zaki
authors.affiliation: Sheikh Zayed Institute for Pediatric Surgical Innovation , Children's National Health System, 111 Michigan Avenue NW, Washington, DC 20010, United States.
authors.forename: Timothy D
authors.initials: TD
authors.lastname: Kane
authors.affiliation: Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Health System, 111 Michigan Avenue NW, Washington, DC 20010, United States; IGI Technologies, Inc., 387 Technology Drive #3110D, College Park, Maryland 20742, United States.
authors.forename: Raj
authors.initials: R
authors.lastname: Shekhar
keywords: augmented reality; camera calibration; electromagnetic tracking; stereoscopic laparoscopy; ultrasound calibration