Neural processes underlying perceptual enhancement by visual speech gestures.
This fMRI study explores brain regions involved with perceptual enhancement afforded by observation of visual speech gesture information. Subjects passively identified words presented in the following conditions: audio-only, audiovisual, audio-only with noise, audiovisual with noise, and visual only. The brain may use concordant audio and visual information to enhance perception by integrating the information in a converging multisensory site. Consistent with response properties of multisensory integration sites, enhanced activity in middle and superior temporal gyrus/sulcus was greatest when concordant audiovisual stimuli were presented with acoustic noise. Activity found in brain regions involved with planning and execution of speech production in response to visual speech presented with degraded or absent auditory stimulation, is consistent with the use of an additional pathway through which speech perception is facilitated by a process of internally simulating the intended speech act of the observed speaker.
Callan
Daniel E
DE
Human Information Science Laboratories, ATR International, Kyoto, Japan. dcallan@atr.co.jp
Jones
Jeffery A
JA
Munhall
Kevin
K
Callan
Akiko M
AM
Kroos
Christian
C
Vatikiotis-Bateson
Eric
E
D000161:Acoustic Stimulation / Q000379:methods*; D000328:Adult; D001921:Brain / Q000502:physiology*; D006801:Humans; D008279:Magnetic Resonance Imaging / Q000379:methods; D008297:Male; D008875:Middle Aged; D009434:Neural Pathways / Q000502:physiology; D010775:Photic Stimulation / Q000379:methods*; D011597:Psychomotor Performance / Q000502:physiology; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*