Auditory event-related potentials (ERPs) in audiovisual speech perception.
OBJECTIVE
It has recently been reported (e.g., V. van Wassenhove, K. W. Grant, & D. Poeppel, 2005) that audiovisual (AV) presented speech is associated with an N1/P2 auditory event-related potential (ERP) response that is lower in peak amplitude compared with the responses associated with auditory only (AO) speech. This effect was replicated. Further comparisons were made between ERP responses to AV speech in which the visual and auditory components were in or out of synchrony, to test whether the effect is associated with the operation of integration mechanisms, as has been claimed, or occurs because of other factors such as attention.


METHODS
ERPs were recorded from participants presented with recordings of unimodal or AV speech syllables in a detection task.


RESULTS
Comparisons were made between AO and AV speech and between synchronous and asynchronous AV speech. Synchronous AV speech produced an N1/P2 with lower peak amplitudes than with AO speech, unaccounted for by linear superposition of visually evoked responses onto auditory-evoked responses. Asynchronous AV speech produced no amplitude reduction.


CONCLUSIONS
The dependence of N1/P2 amplitude reduction on AV synchrony validates it as an electrophysiological marker of AV integration.
Pilling
Michael
M
MRC Institute of Hearing Research, Nottingham, United Kingdom. mpilling@brookes.ac.uk
D000161:Acoustic Stimulation; D000293:Adolescent; D000328:Adult; D000704:Analysis of Variance; D001307:Auditory Perception / Q000502:physiology*; D001921:Brain / Q000502:physiology*; D004569:Electroencephalography; D005072:Evoked Potentials, Auditory / Q000502:physiology*; D005074:Evoked Potentials, Visual; D006801:Humans; D010775:Photic Stimulation; D017603:Signal Detection, Psychological / Q000502:physiology; D013060:Speech; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult