title: Learning gestures for customizable human-computer interaction in the operating room.
abstract: Interaction with computer-based medical devices in the operating room is often challenging for surgeons due to sterility requirements and the complexity of interventional procedures. Typical solutions, such as delegating the interaction task to an assistant, can be inefficient. We propose a method for gesture-based interaction in the operating room that surgeons can customize to personal requirements and interventional workflow. Given training examples for each desired gesture, our system learns low-dimensional manifold models that enable recognizing gestures and tracking particular poses for fine-grained control. By capturing the surgeon's movements with a few wireless body-worn inertial sensors, we avoid issues of camera-based systems, such as sensitivity to illumination and occlusions. Using a component-based framework implementation, our method can easily be connected to different medical devices. Our experiments show that the approach is able to robustly recognize learned gestures and to distinguish these from other movements.
authors: Computer Aided Medical Procedures, Technische Universität München, Germany. schwarz@cs.tum.edu
authors: Loren Arthur
authors: LA
authors: Schwarz
authors: Ali
authors: A
authors: Bigdelou
authors: Nassir
authors: N
authors: Navab
mesh_terms: D000465:Algorithms; D003199:Computer Systems; D004867:Equipment Design; D005868:Gestures; D006801:Humans; D007858:Learning; D009068:Movement; D009873:Operating Rooms; D025321:Surgery, Computer-Assisted / Q000295:instrumentation* / Q000379:methods; D013514:Surgical Procedures, Operative / Q000379:methods*; D013647:Task Performance and Analysis; D014584:User-Computer Interface