title: Similar frequency of the McGurk effect in large samples of native Mandarin Chinese and American English speakers.
abstract: Humans combine visual information from mouth movements with auditory information from the voice to recognize speech. A common method for assessing multisensory speech perception is the McGurk effect: When presented with particular pairings of incongruent auditory and visual speech syllables (e.g., the auditory speech sounds for "ba" dubbed onto the visual mouth movements for "ga"), individuals perceive a third syllable, distinct from the auditory and visual components. Chinese and American cultures differ in the prevalence of direct facial gaze and in the auditory structure of their languages, raising the possibility of cultural- and language-related group differences in the McGurk effect. There is no consensus in the literature about the existence of these group differences, with some studies reporting less McGurk effect in native Mandarin Chinese speakers than in English speakers and others reporting no difference. However, these studies sampled small numbers of participants tested with a small number of stimuli. Therefore, we collected data on the McGurk effect from large samples of Mandarin-speaking individuals from China and English-speaking individuals from the USA (total n = 307) viewing nine different stimuli. Averaged across participants and stimuli, we found similar frequencies of the McGurk effect between Chinese and American participants (48 vs. 44 %). In both groups, we observed a large range of frequencies both across participants (range from 0 to 100 %) and stimuli (15 to 83 %) with the main effect of culture and language accounting for only 0.3 % of the variance in the data. High individual variability in perception of the McGurk effect necessitates the use of large sample sizes to accurately estimate group differences.
authors.affiliation: Department of Neurosurgery, Baylor College of Medicine, 1 Baylor Plaza, Suite 104, Houston, TX, USA, magnotti@bcm.edu.
authors.forename: John F
authors.initials: JF
authors.lastname: Magnotti
authors.forename: Debshila
authors.initials: D
authors.lastname: Basu Mallick
authors.forename: Guo
authors.initials: G
authors.lastname: Feng
authors.forename: Bin
authors.initials: B
authors.lastname: Zhou
authors.forename: Wen
authors.initials: W
authors.lastname: Zhou
authors.forename: Michael S
authors.initials: MS
authors.lastname: Beauchamp
mesh_terms: D000161:Acoustic Stimulation; D000293:Adolescent; D000328:Adult; D001288:Attention; D003431:Cross-Cultural Comparison; D005260:Female; D006801:Humans; D007802:Language; D008297:Male; D010700:Phonetics; D010775:Photic Stimulation; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult