title: Neural correlates of cross-modal binding.
abstract: Little is known about how the brain binds together signals from multiple sensory modalities to produce unified percepts of objects and events in the external world. Using event-related functional magnetic resonance imaging (fMRI) in humans, we measured transient brain responses to auditory/visual binding, as evidenced by a sound-induced change in visual motion perception. Identical auditory and visual stimuli were presented in all trials, but in some trials they were perceived to be bound together and in others they were perceived as unbound unimodal events. Cross-modal binding was associated with higher activity in multimodal areas, but lower activity in predominantly unimodal areas. This activation pattern suggests that a reciprocal and 'competitive' interaction between multimodal and unimodal areas underlies the perceptual interpretation of simultaneous signals from multiple sensory modalities.
authors.affiliation: Neurology Service, Room 4B135, Minneapolis Veterans Affairs Medical Center, One Veterans Drive, Minneapolis, Minnesota 55417, USA. busha001@umn.edu
authors.forename: Khalafalla O
authors.initials: KO
authors.lastname: Bushara
authors.forename: Takashi
authors.initials: T
authors.lastname: Hanakawa
authors.forename: Ilka
authors.initials: I
authors.lastname: Immisch
authors.forename: Keiichiro
authors.initials: K
authors.lastname: Toma
authors.forename: Kenji
authors.initials: K
authors.lastname: Kansaku
authors.forename: Mark
authors.initials: M
authors.lastname: Hallett
mesh_terms: D000161:Acoustic Stimulation; D001307:Auditory Perception / Q000502:physiology*; D001921:Brain / Q000033:anatomy & histology / Q000502:physiology*; D001931:Brain Mapping; D005260:Female; D007839:Functional Laterality / Q000502:physiology; D006801:Humans; D008279:Magnetic Resonance Imaging; D008297:Male; D009039:Motion Perception / Q000502:physiology*; D009415:Nerve Net / Q000033:anatomy & histology / Q000502:physiology*; D009434:Neural Pathways / Q000502:physiology*; D009474:Neurons / Q000502:physiology*; D009483:Neuropsychological Tests; D010775:Photic Stimulation; D011597:Psychomotor Performance / Q000502:physiology