title: Perceptual integration of faces and voices depends on the interaction of emotional content and spatial frequency.
abstract: The role of spatial frequencies (SF) is highly debated in emotion perception, but previous work suggests the importance of low SFs for detecting emotion in faces. Furthermore, emotion perception essentially relies on the rapid integration of multimodal information from faces and voices. We used EEG to test the functional relevance of SFs in the integration of emotional and non-emotional audiovisual stimuli. While viewing dynamic face-voice pairs, participants were asked to identify auditory interjections, and the electroencephalogram (EEG) was recorded. Audiovisual integration was measured as auditory facilitation, indexed by the extent of the auditory N1 amplitude suppression in audiovisual compared to an auditory only condition. We found an interaction of SF filtering and emotion in the auditory response suppression. For neutral faces, larger N1 suppression ensued in the unfiltered and high SF conditions as compared to the low SF condition. Angry face perception led to a larger N1 suppression in the low SF condition. While the results for the neural faces indicate that perceptual quality in terms of SF content plays a major role in audiovisual integration, the results for angry faces suggest that early multisensory integration of emotional information favors low SF neural processing pathways, overruling the predictive value of the visual signal per se.
authors.affiliation: Institute of Psychology, Leipzig University, Germany. Electronic address: kokinous@uni-leipzig.de.
authors.forename: Jenny
authors.initials: J
authors.lastname: Kokinous
authors.affiliation: Institute of Psychology, Leipzig University, Germany; Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.
authors.forename: Alessandro
authors.initials: A
authors.lastname: Tavano
authors.affiliation: Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Faculty of Psychology and Neuroscience, Dept. of Neuropsychology and Psychopharmacology, Maastricht University, The Netherlands.
authors.forename: Sonja A
authors.initials: SA
authors.lastname: Kotz
authors.affiliation: Institute of Psychology, Leipzig University, Germany.
authors.forename: Erich
authors.initials: E
authors.lastname: Schröger
mesh_terms: D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D004569:Electroencephalography; D004644:Emotions / Q000502:physiology*; D005071:Evoked Potentials / Q000502:physiology*; D005149:Facial Expression; D000066499:Facial Recognition / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D011597:Psychomotor Performance / Q000502:physiology*; D055815:Young Adult
keywords: Audiovisual; EEG; Emotion; Prediction; Spatial frequency