title: A dual-mode human computer interface combining speech and tongue motion for people with severe disabilities.
abstract: We are presenting a new wireless and wearable human computer interface called the dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities to use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users' tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact and ergonomic wireless headset. It also captures the users' voice wirelessly using a small microphone embedded in the same headset. Preliminary evaluation results based on 14 able-bodied subjects and three individuals with high level spinal cord injuries at level C3-C5 indicated that the dTDS headset, combined with a commercially available speech recognition (SR) software, can provide end users with significantly higher performance than either unimodal forms based on the tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.
authors.forename: Xueliang
authors.initials: X
authors.lastname: Huo
authors.forename: Hangue
authors.initials: H
authors.lastname: Park
authors.forename: Jeonghee
authors.initials: J
authors.lastname: Kim
authors.forename: Maysam
authors.initials: M
authors.lastname: Ghovanloo
mesh_terms: D000328:Adult; D002574:Cervical Vertebrae / Q000293:injuries / Q000503:physiopathology; D004867:Equipment Design; D019544:Equipment Failure Analysis; D005260:Female; D006801:Humans; D008297:Male; D008904:Miniaturization; D009068:Movement; D012016:Reference Values; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013068:Speech Production Measurement / Q000295:instrumentation*; D049250:Speech Recognition Software; D013119:Spinal Cord Injuries / Q000503:physiopathology* / Q000534:rehabilitation*; D013647:Task Performance and Analysis; D013813:Therapy, Computer-Assisted / Q000295:instrumentation*; D014059:Tongue / Q000503:physiopathology*; D014584:User-Computer Interface; D059015:Wireless Technology / Q000295:instrumentation*; D015443:Word Processing / Q000295:instrumentation; D055815:Young Adult