Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions.
Processing of complex visual stimuli comprising facial movements, hand actions, and body movements is known to occur in the superior temporal sulcus (STS) of humans and nonhuman primates. The STS is also thought to play a role in the integration of multimodal sensory input. We investigated whether STS neurons coding the sight of actions also integrated the sound of those actions. For 23% of neurons responsive to the sight of an action, the sound of that action significantly modulated the visual response. The sound of the action increased or decreased the visually evoked response for an equal number of neurons. In the neurons whose visual response was increased by the addition of sound (but not those neurons whose responses were decreased), the audiovisual integration was dependent upon the sound of the action matching the sight of the action. These results suggest that neurons in the STS form multisensory representations of observed actions.
Barraclough
Nick E
NE
University of St Andrews, St Andrews, Scotland, UK.
Xiao
Dengke
D
Baker
Chris I
CI
Oram
Mike W
MW
Perrett
David I
DI
D000161:Acoustic Stimulation / Q000379:methods; D000704:Analysis of Variance; D000818:Animals; D001307:Auditory Perception / Q000502:physiology*; D001522:Behavior, Animal; D001931:Brain Mapping; D002452:Cell Count; D005073:Evoked Potentials, Somatosensory / Q000502:physiology; D008253:Macaca mulatta; D009474:Neurons / Q000502:physiology*; D010775:Photic Stimulation / Q000379:methods; D011930:Reaction Time / Q000502:physiology; D013702:Temporal Lobe / Q000166:cytology* / Q000502:physiology; D013997:Time Factors; D014796:Visual Perception / Q000502:physiology*