Time-frequency masking for speech separation and its potential for hearing aid design.
A new approach to the separation of speech from speech-in-noise mixtures is the use of time-frequency (T-F) masking. Originated in the field of computational auditory scene analysis, T-F masking performs separation in the time-frequency domain. This article introduces the T-F masking concept and reviews T-F masking algorithms that separate target speech from either monaural or binaural mixtures, as well as microphone-array recordings. The review emphasizes techniques that are promising for hearing aid design. This article also surveys recent studies that evaluate the perceptual effects of T-F masking techniques, particularly their effectiveness in improving human speech recognition in noise. An assessment is made of the potential benefits of T-F masking methods for the hearing impaired in light of the processing constraints of hearing aids. Finally, several issues pertinent to T-F masking are discussed.
DeLiang Wang
Department of Computer Science & Engineering, Center for Cognitive Science, The Ohio State University, Columbus, OH 43210, USA. dwang@cse.ohio
D000465:Algorithms; D001309:Auditory Threshold; D012048:Correction of Hearing Impairment; D004867:Equipment Design; D006310:Hearing Aids; D034381:Hearing Loss / Q000503:physiopathology / Q000534:rehabilitation*; D006801:Humans; D008954:Models, Biological; D010470:Perceptual Masking; D019986:Persons with Hearing Disabilities; D010898:Pitch Perception; D012815:Signal Processing, Computer-Assisted; D013065:Speech Intelligibility; D013067:Speech Perception; D013998:Time Perception