title: On the variability of the McGurk effect: audiovisual integration depends on prestimulus brain states.
abstract: The McGurk effect demonstrates the influence of visual cues on auditory perception. Mismatching information from both sensory modalities can fuse to a novel percept that matches neither the auditory nor the visual stimulus. This illusion is reported in 60-80% of trials. We were interested in the impact of ongoing brain oscillations-indexed by fluctuating local excitability and interareal synchronization-on upcoming perception of identical stimuli. The perception of the McGurk effect is preceded by high beta activity in parietal, frontal, and temporal areas. Beta activity is pronounced in the left superior temporal gyrus (lSTG), which is considered as a site of multimodal integration. This area is functionally (de)coupled to distributed frontal and temporal regions in illusion trials. The disposition to fuse multisensory information is enhanced as the lSTG is more strongly coupled to frontoparietal regions. Illusory perception is accompanied by a decrease in poststimulus theta-band activity in the cuneus, precuneus, and left superior frontal gyrus. Event-related activity in the left middle temporal gyrus is pronounced during illusory perception. Thus, the McGurk effect depends on fluctuating brain states suggesting that functional connectedness of left STS at a prestimulus stage is crucial for an audiovisual percept.
authors.affiliation: Department of Psychology, University of Konstanz, Konstanz 78457, Germany.
authors.forename: Julian
authors.initials: J
authors.lastname: Keil
authors.forename: Nadia
authors.initials: N
authors.lastname: Müller
authors.forename: Niklas
authors.initials: N
authors.lastname: Ihssen
authors.forename: Nathan
authors.initials: N
authors.lastname: Weisz
mesh_terms: D000161:Acoustic Stimulation; D000222:Adaptation, Physiological / Q000502:physiology*; D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D001683:Biological Clocks; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D003463:Cues; D004569:Electroencephalography; D005071:Evoked Potentials / Q000502:physiology; D005260:Female; D006801:Humans; D007091:Image Processing, Computer-Assisted; D016014:Linear Models; D008279:Magnetic Resonance Imaging; D015225:Magnetoencephalography; D008297:Male; D010775:Photic Stimulation; D011601:Psychophysics; D011930:Reaction Time; D018709:Statistics, Nonparametric; D013997:Time Factors; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult