title: Gesture-controlled interactive three dimensional anatomy: a novel teaching tool in head and neck surgery.
abstract: BACKGROUND
  There is a need for innovative anatomic teaching tools. This paper describes a three dimensional (3D) tool employing the Microsoft Kinect™. Using this instrument, 3D temporal bone anatomy can be manipulated with the use of hand gestures, in the absence of mouse or keyboard.
  
  
  METHODS
  CT Temporal bone data is imported into an image processing program and segmented. This information is then exported in polygonal mesh format to an in-house designed 3D graphics engine with an integrated Microsoft Kinect™. Motion in the virtual environment is controlled by tracking hand position relative to the user's left shoulder.
  
  
  RESULTS
  The tool successfully tracked scene depth and user joint locations. This permitted gesture-based control over the entire 3D environment. Stereoscopy was deemed appropriate with significant object projection, while still maintaining the operator's ability to resolve image details. Specific anatomical structures can be selected from within the larger virtual environment. These structures can be extracted and rotated at the discretion of the user. Voice command employing the Kinect's™ intrinsic speech library was also implemented, but is easily confounded by environmental noise.
  
  
  CONCLUSIONS
  There is a need for the development of virtual anatomy models to complement traditional education. Initial development is time intensive. Nonetheless, our novel gesture-controlled interactive 3D model of the temporal bone represents a promising interactive teaching tool utilizing a novel interface.
authors.affiliation: Neurotologic Surgery, Department of Otolaryngology - Head and Neck Surgery, Faculty of Medicine, University of Manitoba, GB421, 820 Sherbrook Street, Winnipeg, Manitoba Canada.
authors.forename: Jordan B
authors.initials: JB
authors.lastname: Hochman
authors.affiliation: Clinical Learning and Simulation Facility, Department of Medical Education, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada.
authors.forename: Bertram
authors.initials: B
authors.lastname: Unger
authors.affiliation: Department of Medical Education, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada.
authors.forename: Jay
authors.initials: J
authors.lastname: Kraut
authors.affiliation: Department of Otolaryngology - Head and Neck Surgery, Health Sciences Centre, Surgical Hearing Implant Program, GB421, 820 Sherbrook Street, Winnipeg, Manitoba Canada.
authors.forename: Justyn
authors.initials: J
authors.lastname: Pisa
authors.affiliation: Department of Human Anatomy and Cell Science, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada.
authors.forename: Sabine
authors.initials: S
authors.lastname: Hombach-Klonisch
mesh_terms: D003051:Cochlea; D005868:Gestures; D006801:Humans; D007091:Image Processing, Computer-Assisted; D021621:Imaging, Three-Dimensional; D008953:Models, Anatomic; D013517:Otorhinolaryngologic Surgical Procedures / Q000193:education*; D013701:Temporal Bone; D014584:User-Computer Interface; D014722:Vestibule, Labyrinth
keywords: 3D model; Gesture controlled; Haptic; Interactive; Temporal bone; Virtual reality