title: Immersive Learning Experiences for Surgical Procedures.
abstract: This paper introduces a computer-based system that is designed to record a surgical procedure with multiple depth cameras and reconstruct in three dimensions the dynamic geometry of the actions and events that occur during the procedure. The resulting 3D-plus-time data takes the form of dynamic, textured geometry and can be immersively examined at a later time; equipped with a Virtual Reality headset such as Oculus Rift DK2, a user can walk around the reconstruction of the procedure room while controlling playback of the recorded surgical procedure with simple VCR-like controls (play, pause, rewind, fast forward). The reconstruction can be annotated in space and time to provide more information of the scene to users. We expect such a system to be useful in applications such as training of medical students and nurses.
authors.affiliation: Department of Computer Science, University of North Carolina at Chapel Hill.
authors.forename: Young-Woon
authors.initials: YW
authors.lastname: Cha
authors.affiliation: Microsoft Research.
authors.forename: Mingsong
authors.initials: M
authors.lastname: Dou
authors.affiliation: Department of Computer Science, University of North Carolina at Chapel Hill.
authors.forename: Rohan
authors.initials: R
authors.lastname: Chabra
authors.affiliation: Department of Computer Science, University of North Carolina at Chapel Hill.
authors.forename: Federico
authors.initials: F
authors.lastname: Menozzi
authors.affiliation: Department of Computer Science, University of North Carolina at Chapel Hill.
authors.forename: Andrei
authors.initials: A
authors.lastname: State
authors.affiliation: Department of Urology, University of North Carolina at Chapel Hill.
authors.forename: Eric
authors.initials: E
authors.lastname: Wallen
authors.affiliation: Department of Computer Science, University of North Carolina at Chapel Hill.
authors.forename: Henry
authors.initials: H
authors.lastname: Fuchs
mesh_terms: D003194:Computer-Assisted Instruction; D004521:Educational Measurement / Q000379:methods*; D013502:General Surgery / Q000193:education*; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000295:instrumentation / Q000379:methods*; D009873:Operating Rooms / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods; D010781:Photography / Q000295:instrumentation / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012984:Software; D025321:Surgery, Computer-Assisted / Q000295:instrumentation / Q000379:methods*; D018511:Systems Integration; D018910:Video Games; D051598:Whole Body Imaging / Q000295:instrumentation / Q000379:methods