title: Acoustic richness modulates the neural networks supporting intelligible speech processing.
abstract: The information contained in a sensory signal plays a critical role in determining what neural processes are engaged. Here we used interleaved silent steady-state (ISSS) functional magnetic resonance imaging (fMRI) to explore how human listeners cope with different degrees of acoustic richness during auditory sentence comprehension. Twenty-six healthy young adults underwent scanning while hearing sentences that varied in acoustic richness (high vs. low spectral detail) and syntactic complexity (subject-relative vs. object-relative center-embedded clause structures). We manipulated acoustic richness by presenting the stimuli as unprocessed full-spectrum speech, or noise-vocoded with 24 channels. Importantly, although the vocoded sentences were spectrally impoverished, all sentences were highly intelligible. These manipulations allowed us to test how intelligible speech processing was affected by orthogonal linguistic and acoustic demands. Acoustically rich speech showed stronger activation than acoustically less-detailed speech in a bilateral temporoparietal network with more pronounced activity in the right hemisphere. By contrast, listening to sentences with greater syntactic complexity resulted in increased activation of a left-lateralized network including left posterior lateral temporal cortex, left inferior frontal gyrus, and left dorsolateral prefrontal cortex. Significant interactions between acoustic richness and syntactic complexity occurred in left supramarginal gyrus, right superior temporal gyrus, and right inferior frontal gyrus, indicating that the regions recruited for syntactic challenge differed as a function of acoustic properties of the speech. Our findings suggest that the neural systems involved in speech perception are finely tuned to the type of information available, and that reducing the richness of the acoustic signal dramatically alters the brain's response to spoken language, even when intelligibility is high.
authors.affiliation: Department of Neurology and Penn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, USA. Electronic address: yslee@mail.med.upenn.edu.
authors.forename: Yune-Sang
authors.initials: YS
authors.lastname: Lee
authors.affiliation: Department of Neurology and Penn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, USA.
authors.forename: Nam Eun
authors.initials: NE
authors.lastname: Min
authors.affiliation: Volen National Center for Complex Systems, Brandeis University, Waltham, MA, USA.
authors.forename: Arthur
authors.initials: A
authors.lastname: Wingfield
authors.affiliation: Department of Neurology and Penn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, USA.
authors.forename: Murray
authors.initials: M
authors.lastname: Grossman
authors.affiliation: Department of Otolaryngology, Washington University in St. Louis, St. Louis, MO, USA. Electronic address: peellej@ent.wustl.edu.
authors.forename: Jonathan E
authors.initials: JE
authors.lastname: Peelle
mesh_terms: D000161:Acoustic Stimulation / Q000379:methods; D000162:Acoustics; D000328:Adult; D001302:Audiometry, Speech; D001306:Auditory Pathways / Q000502:physiology*; D001931:Brain Mapping / Q000379:methods; D005260:Female; D006801:Humans; D008279:Magnetic Resonance Imaging; D008297:Male; D009415:Nerve Net / Q000502:physiology*; D009622:Noise / Q000009:adverse effects; D010470:Perceptual Masking; D013018:Sound Spectrography; D013061:Speech Acoustics; D013065:Speech Intelligibility; D013067:Speech Perception; D014833:Voice Quality; D055815:Young Adult
keywords: Acoustic; Executive function; Hearing; Language; Listening effort; Speech; Vocoding; fMRI