Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information.
Previous studies have shown that processing information in one sensory modality can either be enhanced or attenuated by concurrent stimulation of another modality. Here, we reconcile these apparently contradictory results by showing that the sign of cross-modal interactions depends on whether the content of two modalities is associated or not. When concurrently presented auditory and visual stimuli are paired by chance, cue-induced preparatory neural activity is strongly enhanced in the task-relevant sensory system and suppressed in the irrelevant system. Conversely, when information in the two modalities is reliably associated, activity is enhanced in both systems regardless of which modality is task relevant. Our findings illustrate an ecologically optimal flexibility of the neural mechanisms that govern multisensory processing: facilitation occurs when integration is expected, and suppression occurs when distraction is expected. Because thalamic structures were more active when the senses needed to operate separately, we propose them to serve gatekeeper functions in early cross-modal interactions.
Baier
Bernhard
B
Cognitive Neurology Unit and Brain Imaging Center, Clinic for Neurology, Johann Wolfgang Goethe-University, 60590 Frankfurt, Germany.
Kleinschmidt
Andreas
A
Müller
Notger G
NG
D000161:Acoustic Stimulation / Q000379:methods; D000328:Adult; D000344:Afferent Pathways / Q000098:blood supply / Q000502:physiology*; D001303:Auditory Cortex / Q000098:blood supply / Q000502:physiology*; D001931:Brain Mapping; D003463:Cues; D005260:Female; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000379:methods; D008279:Magnetic Resonance Imaging / Q000379:methods; D008297:Male; D010100:Oxygen / Q000097:blood; D010775:Photic Stimulation / Q000379:methods; D011930:Reaction Time / Q000502:physiology; D013788:Thalamus / Q000098:blood supply / Q000502:physiology; D014793:Visual Cortex / Q000098:blood supply / Q000502:physiology*
D010100:Oxygen