title: Gesture-Controlled Interface for Contactless Control of Various Computer Programs with a Hooking-Based Keyboard and Mouse-Mapping Technique in the Operating Room.
abstract: We developed a contactless interface that exploits hand gestures to effectively control medical images in the operating room. We developed an in-house program called GestureHook that exploits message hooking techniques to convert gestures into specific functions. For quantitative evaluation of this program, we used gestures to control images of a dynamic biliary CT study and compared the results with those of a mouse (8.54 ± 1.77 s to 5.29 ± 1.00 s; p < 0.001) and measured the recognition rates of specific gestures and the success rates of tasks based on clinical scenarios. For clinical applications, this program was set up in the operating room to browse images for plastic surgery. A surgeon browsed images from three different programs: CT images from a PACS program, volume-rendered images from a 3D PACS program, and surgical planning photographs from a basic image viewing program. All programs could be seamlessly controlled by gestures and motions. This approach can control all operating room programs without source code modification and provide surgeons with a new way to safely browse through images and easily switch applications during surgical procedures.
authors.affiliation: Medical Information Development Team, Asan Medical Center, Seoul 05505, Republic of Korea.
authors.forename: Ben Joonyeon
authors.initials: BJ
authors.lastname: Park
authors.affiliation: Department of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul 05505, Republic of Korea.
authors.forename: Taekjin
authors.initials: T
authors.lastname: Jang
authors.affiliation: Department of Plastic and Reconstructive Surgery, University of Ulsan College of Medicine, Asan Medical Center, Seoul 05505, Republic of Korea.
authors.forename: Jong Woo
authors.initials: JW
authors.lastname: Choi
authors.affiliation: Department of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul 05505, Republic of Korea; Department of Convergence Medicine, University of Ulsan College of Medicine, Asan Medical Center, Seoul 05505, Republic of Korea.
authors.forename: Namkug
authors.initials: N
authors.lastname: Kim
mesh_terms: D000465:Algorithms; D003201:Computers; D004867:Equipment Design; D013502:General Surgery / Q000295:instrumentation*; D005868:Gestures; D006225:Hand; D006801:Humans; D021621:Imaging, Three-Dimensional; D009068:Movement; D009873:Operating Rooms; D012815:Signal Processing, Computer-Assisted; D012984:Software; D014057:Tomography, X-Ray Computed; D014584:User-Computer Interface