title: Vowel generation for children with cerebral palsy using myocontrol of a speech synthesizer.
abstract: For children with severe cerebral palsy (CP), social and emotional interactions can be significantly limited due to impaired speech motor function. However, if it is possible to extract continuous voluntary control signals from the electromyograph (EMG) of limb muscles, then EMG may be used to drive the synthesis of intelligible speech with controllable speed, intonation and articulation. We report an important first step: the feasibility of controlling a vowel synthesizer using non-speech muscles. A classic formant-based speech synthesizer is adapted to allow the lowest two formants to be controlled by surface EMG from skeletal muscles. EMG signals are filtered using a non-linear Bayesian filtering algorithm that provides the high bandwidth and accuracy required for speech tasks. The frequencies of the first two formants determine points in a 2D plane, and vowels are targets on this plane. We focus on testing the overall feasibility of producing intelligible English vowels with myocontrol using two straightforward EMG-formant mappings. More mappings can be tested in the future to optimize the intelligibility. Vowel generation was tested on 10 healthy adults and 4 patients with dyskinetic CP. Five English vowels were generated by subjects in pseudo-random order, after only 10 min of device familiarization. The fraction of vowels correctly identified by 4 naive listeners exceeded 80% for the vowels generated by healthy adults and 57% for vowels generated by patients with CP. Our goal is a continuous "virtual voice" with personalized intonation and articulation that will restore not only the intellectual content but also the social and emotional content of speech for children and adults with severe movement disorders.
authors: Department of Rehabilitation, School of Medicine, Ruijin Hospital, Shanghai Jiao Tong University Shanghai, China.
authors: Chuanxin M
authors: CM
authors: Niu
authors: Department of Biomedical Engineering, University of Southern California Los Angeles, CA, USA.
authors: Kangwoo
authors: K
authors: Lee
authors: Department of Otolaryngology - Head and Neck Surgery, University of California, San Francisco San Francisco, CA, USA.
authors: John F
authors: JF
authors: Houde
authors: Department of Biomedical Engineering, University of Southern California Los Angeles, CA, USA ; Biokinesiology, University of Southern California Los Angeles, CA, USA ; Neurology, University of Southern California Los Angeles, CA, USA.
authors: Terence D
authors: TD
authors: Sanger
keywords: Cerebral Palsy; electromyography (EMG); non-linear Bayesian filtering; speech impairment; speech synthesis
references: Dev Med Child Neurol. 2005 Aug;47(8):571-6
references: 16108461
references: IEEE Trans Biomed Eng. 1984 Feb;31(2):207-11
references: 6706349
references: J Autism Dev Disord. 1979 Mar;9(1):11-29
references: 155684
references: J Speech Hear Res. 1980 Mar;23(1):28-40
references: 7442182
references: Dev Med Child Neurol. 2000 Dec;42(12):816-24
references: 11132255
references: IEEE Trans Biomed Eng. 1980 Jul;27(7):382-95
references: 7409804
references: Dev Med Child Neurol. 2004 Apr;46(4):253-66
references: 15077703
references: J Acoust Soc Am. 1992 Aug;92(2 Pt 1):736-57
references: 1506528
references: J Appl Physiol Respir Environ Exerc Physiol. 1981 Nov;51(5):1300-5
references: 7298467
references: IEEE Trans Biomed Eng. 1980 Jul;27(7):396-410
references: 7409805
references: Fam Med. 2005 May;37(5):360-3
references: 15883903
references: Pediatrics. 2003 Jan;111(1):e89-97
references: 12509602
references: J Child Neurol. 2006 Jul;21(7):551-7
references: 16970842
references: J Acoust Soc Am. 2000 Jan;107(1):559-64
references: 10641664
references: J Child Neurol. 2010 Dec;25(12):1480-4
references: 20525944
references: J Neurosci. 1985 Sep;5(9):2318-30
references: 4031998
references: IEEE Trans Neural Syst Rehabil Eng. 2007 Sep;15(3):458-68
references: 17894279
references: Mov Disord. 2011 Jun;26(7):1290-6
references: 21449015
references: J Child Neurol. 2005 Jun;20(6):489-96
references: 15996397
references: Clin Linguist Phon. 2007 Oct;21(10):833-48
references: 17882696
references: PLoS One. 2013;8(3):e59860
references: 23527278
references: Disabil Rehabil. 2006 Feb 28;28(4):183-91
references: 16467053
references: J Child Neurol. 2011 Jan;26(1):37-43
references: 20525943
references: J Neurophysiol. 2007 Feb;97(2):1839-45
references: 17182908
references: J Acoust Soc Am. 1995 May;97(5 Pt 1):3099-111
references: 7759650
references: J Neurophysiol. 2002 Nov;88(5):2329-40
references: 12424274
references: Biol Cybern. 1989;61(2):89-101
references: 2742921
references: J Speech Hear Disord. 1972 Feb;37(1):55-63
references: 5053945
references: Biometrics. 1977 Mar;33(1):159-74
references: 843571
references: IEEE Trans Neural Syst Rehabil Eng. 2009 Apr;17(2):146-55
references: 19304494
references: Exp Brain Res. 1997 Sep;116(2):299-308
references: 9348128