title: A network analysis of audiovisual affective speech perception.
abstract: In this study we were interested in the neural system supporting the audiovisual (AV) integration of emotional expression and emotional prosody. To this end normal participants were exposed to short videos of a computer-animated face voicing emotionally positive or negative words with the appropriate prosody. Facial expression of the face was either neutral or emotionally appropriate. To reveal the neural network involved in affective AV integration, standard univariate analysis of functional magnetic resonance (fMRI) data was followed by a random-effects Granger causality mapping (RFX-GCM). The regions that distinguished emotional from neutral facial expressions in the univariate analysis were taken as seed regions. In trials showing emotional expressions compared to neutral trials univariate analysis showed activation primarily in bilateral amygdala, fusiform gyrus, middle temporal gyrus/superior temporal sulcus and inferior occipital gyrus. When employing either the left amygdala or the right amygdala as a seed region in RFX-GCM we found connectivity with the right hemispheric fusiform gyrus, with the indication that the fusiform gyrus sends information to the Amygdala. These results led to a working model for face perception in general and for AV-affective integration in particular which is an elaborated adaptation of existing models.
authors.affiliation: Department of Neurology, University of Lübeck, Lübeck, Germany; Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands.
authors.forename: H
authors.initials: H
authors.lastname: Jansma
authors.affiliation: Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands.
authors.forename: A
authors.initials: A
authors.lastname: Roebroeck
authors.affiliation: Department of Neurology, University of Lübeck, Lübeck, Germany. Electronic address: Thomas.muente@neuro.uni-luebeck.de.
authors.forename: T F
authors.initials: TF
authors.lastname: Münte
mesh_terms: D000679:Amygdala / Q000098:blood supply / Q000502:physiology*; D001931:Brain Mapping; D002540:Cerebral Cortex / Q000098:blood supply / Q000502:physiology*; D004644:Emotions / Q000502:physiology*; D005260:Female; D007839:Functional Laterality; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008279:Magnetic Resonance Imaging; D008297:Male; D009434:Neural Pathways / Q000098:blood supply / Q000502:physiology*; D010100:Oxygen / Q000097:blood; D010775:Photic Stimulation; D013067:Speech Perception / Q000502:physiology*
chemical_list: D010100:Oxygen
keywords: AV; BOLD; EMO; FOV; Granger causality; IFG; MTG; NEU; RFX-GCM; STS; V; VOI; amygdala; audiovisual; audiovisual speech; blood oxygen level dependent; emotion; emotional; fMRI; facial affect perception; field of view; functional magnetic resonance; inferior frontal gyrus; middle temporal gyrus; neutral; random effects Granger causality mapping; superior temporal sulcus; visual; volume of interest