title: Development and evaluation of on/off control for electrolaryngeal speech via artificial neural network based on visual information of lips.
abstract: OBJECTIVE
  To realize an accurate and automatic on/off control of electrolarynx (EL), an artificial neural network (ANN) was introduced for switch identification based on visual information of lips and implemented by an experimental system (ANN-EL). The objective was to confirm the feasibility of the ANN method and evaluate the performance of ANN-EL in Mandarin speech.
  
  
  METHODS
  Totally five volunteers (one laryngectomee and four normal speakers) participated in the whole process of experiments. First, trained ANN was tested to assess switch identification performance of ANN method. Then, voice initiation/termination time, speech fluency, and word intelligibility were measured and compared with button-EL and video-EL to evaluate on/off control performance of ANN-EL.
  
  
  RESULTS
  The test showed that ANN method performed accurate switch identification (>99%). ANN-EL was as fast as normal voice and button-EL in onset control, but a little slower in offset control. ANN-EL could provide a fluent voice source with rare breaks (<1%) for a continuous speech. The results also indicated that on/off control performance of ANN-EL had a significant impact on perception, lowering the word intelligibility compared with button-EL. However, the words produced by ANN-EL were more intelligible than video-EL by approximately 20%.
  
  
  CONCLUSIONS
  The ANN method was proved feasible and effective for switch identification based on visual information of lips. The ANN-EL could provide an accurate on/off control for fluent Mandarin speech.
authors.affiliation: The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an 710049, PR China.
authors.forename: Liang
authors.initials: L
authors.lastname: Wu
authors.forename: Congying
authors.initials: C
authors.lastname: Wan
authors.forename: Supin
authors.initials: S
authors.lastname: Wang
authors.forename: Mingxi
authors.initials: M
authors.lastname: Wan
mesh_terms: D000328:Adult; D000368:Aged; D004867:Equipment Design; D005240:Feasibility Studies; D005260:Female; D006801:Humans; D007825:Laryngectomy / Q000534:rehabilitation*; D007831:Larynx, Artificial; D008046:Lip / Q000502:physiology*; D008297:Male; D009068:Movement; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated; D011930:Reaction Time; D012815:Signal Processing, Computer-Assisted; D013061:Speech Acoustics; D013065:Speech Intelligibility; D013068:Speech Production Measurement; D013071:Speech, Alaryngeal / Q000295:instrumentation*; D013997:Time Factors; D014741:Video Recording; D014833:Voice Quality; D055815:Young Adult