A gesture-based tool for sterile browsing of radiology images.
The use of doctor-computer interaction devices in the operation room (OR) requires new modalities that support medical imaging manipulation while allowing doctors' hands to remain sterile, supporting their focus of attention, and providing fast response times. This paper presents "Gestix," a vision-based hand gesture capture and recognition system that interprets in real-time the user's gestures for navigation and manipulation of images in an electronic medical record (EMR) database. Navigation and other gestures are translated to commands based on their temporal trajectories, through video capture. "Gestix" was tested during a brain biopsy procedure. In the in vivo experiment, this interface prevented the surgeon's focus shift and change of location while achieving a rapid intuitive reaction and easy interaction. Data from two usability tests provide insights and implications regarding human-computer interaction based on nonverbal conversational modalities.
Wachs
Juan P
JP
Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, Be'er-Sheva, Israel, 84105. juan@bgu.ac.il
Stern
Helman I
HI
Edan
Yael
Y
Gillam
Michael
M
Handler
Jon
J
Feied
Craig
C
Smith
Mark
M
D003258:Consumer Behavior; D004866:Equipment Contamination / Q000517:prevention & control; D005868:Gestures; D006801:Humans; D021621:Imaging, Three-Dimensional; D008279:Magnetic Resonance Imaging; D008328:Man-Machine Systems; D016347:Medical Records Systems, Computerized; D009493:Neurosurgery / Q000295:instrumentation; D011871:Radiology / Q000295:instrumentation; D011873:Radiology Information Systems; D014584:User-Computer Interface