title: When sentences live up to your expectations.
abstract: Speech recognition is rapid, automatic and amazingly robust. How the brain is able to decode speech from noisy acoustic inputs is unknown. We show that the brain recognizes speech by integrating bottom-up acoustic signals with top-down predictions. Subjects listened to intelligible normal and unintelligible fine structure speech that lacked the predictability of the temporal envelope and did not enable access to higher linguistic representations. Their top-down predictions were manipulated using priming. Activation for unintelligible fine structure speech was confined to primary auditory cortices, but propagated into posterior middle temporal areas when fine structure speech was made intelligible by top-down predictions. By contrast, normal speech engaged posterior middle temporal areas irrespective of subjects' predictions. Critically, when speech violated subjects' expectations, activation increases in anterior temporal gyri/sulci signalled a prediction error and the need for new semantic integration. In line with predictive coding, our findings compellingly demonstrate that top-down predictions determine whether and how the brain translates bottom-up acoustic inputs into intelligible speech.
authors.affiliation: Max-Planck-Institute for Biological Cybernetics, 72076 Tuebingen, Germany. Electronic address: johannes.tuennerhoff@tuebingen.mpg.de.
authors.forename: Johannes
authors.initials: J
authors.lastname: Tuennerhoff
authors.affiliation: Max-Planck-Institute for Biological Cybernetics, 72076 Tuebingen, Germany; Computational Neuroscience and Cognitive Robotics Centre, Department of Psychology, University of Birmingham, Birmingham B15 2TT, UK.
authors.forename: Uta
authors.initials: U
authors.lastname: Noppeney
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001303:Auditory Cortex; D001499:Bayes Theorem; D001931:Brain Mapping; D005260:Female; D006801:Humans; D008037:Linguistics; D008279:Magnetic Resonance Imaging; D008297:Male; D060865:Repetition Priming / Q000502:physiology; D013065:Speech Intelligibility / Q000502:physiology*; D013067:Speech Perception / Q000502:physiology*; D013702:Temporal Lobe / Q000502:physiology; D055815:Young Adult
keywords: Predictive coding; Priming; Speech intelligibility; Speech recognition