title: Computer vision and augmented reality in gastrointestinal endoscopy.
abstract: Augmented reality (AR) is an environment-enhancing technology, widely applied in the computer sciences, which has only recently begun to permeate the medical field. Gastrointestinal endoscopy-which relies on the integration of high-definition video data with pathologic correlates-requires endoscopists to assimilate and process a tremendous amount of data in real time. We believe that AR is well positioned to provide computer-guided assistance with a wide variety of endoscopic applications, beginning with polyp detection. In this article, we review the principles of AR, describe its potential integration into an endoscopy set-up, and envisage a series of novel uses. With close collaboration between physicians and computer scientists, AR promises to contribute significant improvements to the field of endoscopy.
authors.affiliation: Department of Internal Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston MA, USA.
authors.forename: Nadim
authors.initials: N
authors.lastname: Mahmud
authors.affiliation: The Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston MA, USA.
authors.forename: Jonah
authors.initials: J
authors.lastname: Cohen
authors.affiliation: Brain and Cognitive Sciences, Massachusetts Institute of Technology, Boston MA, USA.
authors.forename: Kleovoulos
authors.initials: K
authors.lastname: Tsourides
authors.affiliation: The Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston MA, USA tberzin@bidmc.harvard.edu.
authors.forename: Tyler M
authors.initials: TM
authors.lastname: Berzin
keywords: augmented reality; colonoscopy; computer vision; gastrointestinal endoscopy