title: Attention to visual speech gestures enhances hemodynamic activity in the left planum temporale.
abstract: Observing a speaker's articulatory gestures can contribute considerably to auditory speech perception. At the level of neural events, seen articulatory gestures can modify auditory cortex responses to speech sounds and modulate auditory cortex activity also in the absence of heard speech. However, possible effects of attention on this modulation have remained unclear. To investigate the effect of attention on visual speech-induced auditory cortex activity, we scanned 10 healthy volunteers with functional magnetic resonance imaging (fMRI) at 3 T during simultaneous presentation of visual speech gestures and moving geometrical forms, with the instruction to either focus on or ignore the seen articulations. Secondary auditory cortex areas in the bilateral posterior superior temporal gyrus and planum temporale were active both when the articulatory gestures were ignored and when they were attended to. However, attention to visual speech gestures enhanced activity in the left planum temporale compared to the situation when the subjects saw identical stimuli but engaged in a nonspeech motion discrimination task. These findings suggest that attention to visually perceived speech gestures modulates auditory cortex function and that this modulation takes place at a hierarchically relatively early processing level.
authors.affiliation: Laboratory of Computational Engineering, Helsinki University of Technology, Espoo, Finland. johanna.pekkola@fimnet.fi
authors.forename: Johanna
authors.initials: J
authors.lastname: Pekkola
authors.forename: Ville
authors.initials: V
authors.lastname: Ojanen
authors.forename: Taina
authors.initials: T
authors.lastname: Autti
authors.forename: Iiro P
authors.initials: IP
authors.lastname: Jääskeläinen
authors.forename: Riikka
authors.initials: R
authors.lastname: Möttönen
authors.forename: Mikko
authors.initials: M
authors.lastname: Sams
mesh_terms: D000328:Adult; D001288:Attention / Q000502:physiology*; D001303:Auditory Cortex / Q000502:physiology*; D001931:Brain Mapping; D005260:Female; D007839:Functional Laterality / Q000502:physiology; D005868:Gestures; D006801:Humans; D008085:Lipreading; D008279:Magnetic Resonance Imaging; D008297:Male; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*