title: The role of binary mask patterns in automatic speech recognition in background noise.
abstract: Processing noisy signals using the ideal binary mask improves automatic speech recognition (ASR) performance. This paper presents the first study that investigates the role of binary mask patterns in ASR under various noises, signal-to-noise ratios (SNRs), and vocabulary sizes. Binary masks are computed either by comparing the SNR within a time-frequency unit of a mixture signal with a local criterion (LC), or by comparing the local target energy with the long-term average spectral energy of speech. ASR results show that (1) akin to human speech recognition, binary masking significantly improves ASR performance even when the SNR is as low as -60 dB; (2) the ASR performance profiles are qualitatively similar to those obtained in human intelligibility experiments; (3) the difference between the LC and mixture SNR is more correlated to the recognition accuracy than LC; (4) LC at which the performance peaks is lower than 0 dB, which is the threshold that maximizes the SNR gain of processed signals. This broad agreement with human performance is rather surprising. The results also indicate that maximizing the SNR gain is probably not an appropriate goal for improving either human or machine recognition of noisy speech.
authors: Department of Computer Science and Engineering and Center for Cognitive Science, The Ohio State University, Columbus, Ohio 43210, USA. narayaar@cse.ohio-state.edu
authors: Arun
authors: A
authors: Narayanan
authors: DeLiang
authors: D
authors: Wang
mesh_terms: D000162:Acoustics; D006801:Humans; D009622:Noise; D010363:Pattern Recognition, Automated; D010470:Perceptual Masking; D021641:Recognition, Psychology; D012815:Signal Processing, Computer-Assisted; D059629:Signal-To-Noise Ratio; D013018:Sound Spectrography; D013061:Speech Acoustics; D013065:Speech Intelligibility; D013067:Speech Perception; D013068:Speech Production Measurement; D014825:Vocabulary; D014833:Voice Quality
references: J Acoust Soc Am. 2011 Oct;130(4):2153-61
references: 21973369
references: J Acoust Soc Am. 2006 Mar;119(3):1562-73
references: 16583901
references: J Acoust Soc Am. 2013 May;133(5):3083-93
references: 23654411
references: J Acoust Soc Am. 2008 Nov;124(5):3213-24
references: 19045805
references: J Acoust Soc Am. 2009 Sep;126(3):1415-26
references: 19739755
references: J Acoust Soc Am. 2010 Nov;128(5):EL217-22
references: 21110529
references: J Acoust Soc Am. 2008 Oct;124(4):2303-7
references: 19062868
references: Ear Hear. 2006 Oct;27(5):480-92
references: 16957499
references: J Acoust Soc Am. 2006 Dec;120(6):4007-18
references: 17225427
references: Int J Audiol. 2003 Jan;42(1):10-7
references: 12564511
references: J Acoust Soc Am. 2008 Mar;123(3):1673-82
references: 18345855
references: J Acoust Soc Am. 2009 Apr;125(4):2336-47
references: 19354408
references: J Acoust Soc Am. 2011 Apr;129(4):2227-36
references: 21476677