title: The role of emotion in dynamic audiovisual integration of faces and voices.
abstract: We used human electroencephalogram to study early audiovisual integration of dynamic angry and neutral expressions. An auditory-only condition served as a baseline for the interpretation of integration effects. In the audiovisual conditions, the validity of visual information was manipulated using facial expressions that were either emotionally congruent or incongruent with the vocal expressions. First, we report an N1 suppression effect for angry compared with neutral vocalizations in the auditory-only condition. Second, we confirm early integration of congruent visual and auditory information as indexed by a suppression of the auditory N1 and P2 components in the audiovisual compared with the auditory-only condition. Third, audiovisual N1 suppression was modulated by audiovisual congruency in interaction with emotion: for neutral vocalizations, there was N1 suppression in both the congruent and the incongruent audiovisual conditions. For angry vocalizations, there was N1 suppression only in the congruent but not in the incongruent condition. Extending previous findings of dynamic audiovisual integration, the current results suggest that audiovisual N1 suppression is congruency- and emotion-specific and indicate that dynamic emotional expressions compared with non-emotional expressions are preferentially processed in early audiovisual integration.
authors.affiliation: Institute of Psychology, University of Leipzig, 04109 Leipzig, Germany, Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, 04103 Leipzig, Germany, and School of Psychological Sciences, University of Manchester, Manchester, UK kokinous@uni-leipzig.de.
authors.forename: Jenny
authors.initials: J
authors.lastname: Kokinous
authors.affiliation: Institute of Psychology, University of Leipzig, 04109 Leipzig, Germany, Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, 04103 Leipzig, Germany, and School of Psychological Sciences, University of Manchester, Manchester, UK Institute of Psychology, University of Leipzig, 04109 Leipzig, Germany, Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, 04103 Leipzig, Germany, and School of Psychological Sciences, University of Manchester, Manchester, UK.
authors.forename: Sonja A
authors.initials: SA
authors.lastname: Kotz
authors.affiliation: Institute of Psychology, University of Leipzig, 04109 Leipzig, Germany, Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, 04103 Leipzig, Germany, and School of Psychological Sciences, University of Manchester, Manchester, UK.
authors.forename: Alessandro
authors.initials: A
authors.lastname: Tavano
authors.affiliation: Institute of Psychology, University of Leipzig, 04109 Leipzig, Germany, Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, 04103 Leipzig, Germany, and School of Psychological Sciences, University of Manchester, Manchester, UK.
authors.forename: Erich
authors.initials: E
authors.lastname: Schröger
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D000786:Anger / Q000502:physiology; D004569:Electroencephalography; D004644:Emotions / Q000502:physiology*; D005071:Evoked Potentials / Q000502:physiology; D005145:Face; D005149:Facial Expression; D005260:Female; D006801:Humans; D008297:Male; D010775:Photic Stimulation; D011597:Psychomotor Performance / Q000502:physiology; D012938:Social Perception; D014831:Voice; D055815:Young Adult
keywords: EEG; audiovisual; cross-modal prediction; emotion; incongruity