title: Nonnative audiovisual speech perception in noise: dissociable effects of the speaker and listener.
abstract: Nonnative speech poses a challenge to speech perception, especially in challenging listening environments. Audiovisual (AV) cues are known to improve native speech perception in noise. The extent to which AV cues benefit nonnative speech perception in noise, however, is much less well-understood. Here, we examined native American English-speaking and native Korean-speaking listeners' perception of English sentences produced by a native American English speaker and a native Korean speaker across a range of signal-to-noise ratios (SNRs;-4 to -20 dB) in audio-only and audiovisual conditions. We employed psychometric function analyses to characterize the pattern of AV benefit across SNRs. For native English speech, the largest AV benefit occurred at intermediate SNR (i.e. -12 dB); but for nonnative English speech, the largest AV benefit occurred at a higher SNR (-4 dB). The psychometric function analyses demonstrated that the AV benefit patterns were different between native and nonnative English speech. The nativeness of the listener exerted negligible effects on the AV benefit across SNRs. However, the nonnative listeners' ability to gain AV benefit in native English speech was related to their proficiency in English. These findings suggest that the native language background of both the speaker and listener clearly modulate the optimal use of AV cues in speech recognition.
authors.affiliation: Department of Communication Sciences and Disorders, The University of Texas at Austin, Austin, Texas, United States of America.
authors.forename: Zilong
authors.initials: Z
authors.lastname: Xie
authors.affiliation: Department of Communication Sciences and Disorders, The University of Texas at Austin, Austin, Texas, United States of America.
authors.forename: Han-Gyol
authors.initials: HG
authors.lastname: Yi
authors.affiliation: Department of Communication Sciences and Disorders, The University of Texas at Austin, Austin, Texas, United States of America; Institute for Neuroscience, The University of Texas at Austin, Austin, Texas, United States of America; Center for Perceptual Systems, The University of Texas at Austin, Austin, Texas, United States of America; Cognitive Neuroscience, The University of Texas at Austin, Austin, Texas, United States of America.
authors.forename: Bharath
authors.initials: B
authors.lastname: Chandrasekaran
mesh_terms: D000161:Acoustic Stimulation; D000293:Adolescent; D000328:Adult; D006801:Humans; D007723:Korea; D007802:Language; D008297:Male; D010775:Photic Stimulation; D059629:Signal-To-Noise Ratio; D013061:Speech Acoustics; D013065:Speech Intelligibility; D013067:Speech Perception; D014481:United States; D055815:Young Adult