title: Onset timing of cross-sensory activations and multisensory interactions in auditory and visual sensory cortices.
abstract: Here we report early cross-sensory activations and audiovisual interactions at the visual and auditory cortices using magnetoencephalography (MEG) to obtain accurate timing information. Data from an identical fMRI experiment were employed to support MEG source localization results. Simple auditory and visual stimuli (300-ms noise bursts and checkerboards) were presented to seven healthy humans. MEG source analysis suggested generators in the auditory and visual sensory cortices for both within-modality and cross-sensory activations. fMRI cross-sensory activations were strong in the visual but almost absent in the auditory cortex; this discrepancy with MEG possibly reflects the influence of acoustical scanner noise in fMRI. In the primary auditory cortices (Heschl's gyrus) the onset of activity to auditory stimuli was observed at 23 ms in both hemispheres, and to visual stimuli at 82 ms in the left and at 75 ms in the right hemisphere. In the primary visual cortex (Calcarine fissure) the activations to visual stimuli started at 43 ms and to auditory stimuli at 53 ms. Cross-sensory activations thus started later than sensory-specific activations, by 55 ms in the auditory cortex and by 10 ms in the visual cortex, suggesting that the origins of the cross-sensory activations may be in the primary sensory cortices of the opposite modality, with conduction delays (from one sensory cortex to another) of 30-35 ms. Audiovisual interactions started at 85 ms in the left auditory, 80 ms in the right auditory and 74 ms in the visual cortex, i.e., 3-21 ms after inputs from the two modalities converged.
authors.affiliation: MGH/MIT/HMS Athinoula A. Martinos Center for Biomedical Imaging, Bldg 149, 13 St, Charlestown, MA, USA. raij@nmr.mgh.harvard.edu
authors.forename: Tommi
authors.initials: T
authors.lastname: Raij
authors.forename: Jyrki
authors.initials: J
authors.lastname: Ahveninen
authors.forename: Fa-Hsuan
authors.initials: FH
authors.lastname: Lin
authors.forename: Thomas
authors.initials: T
authors.lastname: Witzel
authors.forename: Iiro P
authors.initials: IP
authors.lastname: Jääskeläinen
authors.forename: Benjamin
authors.initials: B
authors.lastname: Letham
authors.forename: Emily
authors.initials: E
authors.lastname: Israeli
authors.forename: Cherif
authors.initials: C
authors.lastname: Sahyoun
authors.forename: Christos
authors.initials: C
authors.lastname: Vasios
authors.forename: Steven
authors.initials: S
authors.lastname: Stufflebeam
authors.forename: Matti
authors.initials: M
authors.lastname: Hämäläinen
authors.forename: John W
authors.initials: JW
authors.lastname: Belliveau
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001303:Auditory Cortex / Q000502:physiology*; D005071:Evoked Potentials / Q000502:physiology; D005260:Female; D007839:Functional Laterality / Q000502:physiology; D006801:Humans; D008279:Magnetic Resonance Imaging; D015225:Magnetoencephalography; D008297:Male; D010775:Photic Stimulation; D011930:Reaction Time; D013003:Somatosensory Cortex / Q000502:physiology*; D014793:Visual Cortex / Q000502:physiology*; D055815:Young Adult