title: Processing of audiovisual speech in Broca's area.
abstract: We investigated cerebral processing of audiovisual speech stimuli in humans using functional magnetic resonance imaging (fMRI). Ten healthy volunteers were scanned with a 'clustered volume acquisition' paradigm at 3 T during observation of phonetically matching (e.g., visual and acoustic /y/) and conflicting (e.g., visual /a/ and acoustic /y/) audiovisual vowels. Both stimuli activated the sensory-specific auditory and visual cortices, along with the superior temporal, inferior frontal (Broca's area), premotor, and visual-parietal regions bilaterally. Phonetically conflicting vowels, contrasted with matching ones, specifically increased activity in Broca's area. Activity during phonetically matching stimuli, contrasted with conflicting ones, was not enhanced in any brain region. We suggest that the increased activity in Broca's area reflects processing of conflicting visual and acoustic phonetic inputs in partly disparate neuron populations. On the other hand, matching acoustic and visual inputs would converge on the same neurons.
authors.affiliation: Laboratory of Computational Engineering, Helsinki University of Technology, P.O. Box 3000, FIN-02015 HUT, Helsinki, Finland. viloja@Ice.hut.fi
authors.forename: Ville
authors.initials: V
authors.lastname: Ojanen
authors.forename: Riikka
authors.initials: R
authors.lastname: Möttönen
authors.forename: Johanna
authors.initials: J
authors.lastname: Pekkola
authors.forename: Iiro P
authors.initials: IP
authors.lastname: Jääskeläinen
authors.forename: Raimo
authors.initials: R
authors.lastname: Joensuu
authors.forename: Taina
authors.initials: T
authors.lastname: Autti
authors.forename: Mikko
authors.initials: M
authors.lastname: Sams
mesh_terms: D000328:Adult; D001307:Auditory Perception / Q000502:physiology; D001931:Brain Mapping; D005260:Female; D005625:Frontal Lobe / Q000502:physiology*; D006801:Humans; D008297:Male; D013060:Speech / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology