Speech recognition with amplitude and frequency modulations.
Amplitude modulation (AM) and frequency modulation (FM) are commonly used in communication, but their relative contributions to speech recognition have not been fully explored. To bridge this gap, we derived slowly varying AM and FM from speech sounds and conducted listening tests using stimuli with different modulations in normal-hearing and cochlear-implant subjects. We found that although AM from a limited number of spectral bands may be sufficient for speech recognition in quiet, FM significantly enhances speech recognition in noise, as well as speaker and tone recognition. Additional speech reception threshold measures revealed that FM is particularly critical for speech recognition with a competing voice and is independent of spectral resolution and similarity. These results suggest that AM and FM provide independent yet complementary contributions to support robust speech recognition under realistic listening situations. Encoding FM may improve auditory scene analysis, cochlear-implant, and audiocoding performance.
Zeng
Fan-Gang
FG
Department of Anatomy and Neurobiology, University of California, Irvine, CA 92697, USA. fzeng@uci.edu
Nie
Kaibao
K
Stickney
Ginger S
GS
Kong
Ying-Yee
YY
Vongphoe
Michael
M
Bhargave
Ashish
A
Wei
Chaogang
C
Cao
Keli
K
D003054:Cochlear Implants; D003638:Deafness / Q000523:psychology / Q000628:therapy; D005260:Female; D006801:Humans; D008297:Male; D010470:Perceptual Masking; D013061:Speech Acoustics; D013067:Speech Perception