title: Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions.
abstract: A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruent audiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1 (Experiment 2).
authors.affiliation: Department of Cognitive Neuropsychology, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands. Electronic address: T.J.T.M.vanLaarhoven@TilburgUniversity.edu.
authors.forename: Thijs
authors.initials: T
authors.lastname: van Laarhoven
authors.affiliation: Department of Cognitive Neuropsychology, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands.
authors.forename: Jeroen J
authors.initials: JJ
authors.lastname: Stekelenburg
authors.affiliation: Department of Cognitive Neuropsychology, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands.
authors.forename: Jean
authors.initials: J
authors.lastname: Vroomen
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D004569:Electroencephalography; D055724:Electrophysiological Phenomena; D005260:Female; D006801:Humans; D008297:Male; D010465:Perception / Q000502:physiology*; D010775:Photic Stimulation; D011930:Reaction Time; D013016:Sound; D013997:Time Factors; D014796:Visual Perception / Q000502:physiology
keywords: Event-related potentials; Predictive coding; Stimulus omission; Visual-auditory