title: Brain-based translation: fMRI decoding of spoken words in bilinguals reveals language-independent semantic representations in anterior temporal lobe.
abstract: Bilinguals derive the same semantic concepts from equivalent, but acoustically different, words in their first and second languages. The neural mechanisms underlying the representation of language-independent concepts in the brain remain unclear. Here, we measured fMRI in human bilingual listeners and reveal that response patterns to individual spoken nouns in one language (e.g., "horse" in English) accurately predict the response patterns to equivalent nouns in the other language (e.g., "paard" in Dutch). Stimuli were four monosyllabic words in both languages, all from the category of "animal" nouns. For each word, pronunciations from three different speakers were included, allowing the investigation of speaker-independent representations of individual words. We used multivariate classifiers and a searchlight method to map the informative fMRI response patterns that enable decoding spoken words within languages (within-language discrimination) and across languages (across-language generalization). Response patterns discriminative of spoken words within language were distributed in multiple cortical regions, reflecting the complexity of the neural networks recruited during speech and language processing. Response patterns discriminative of spoken words across language were limited to localized clusters in the left anterior temporal lobe, the left angular gyrus and the posterior bank of the left postcentral gyrus, the right posterior superior temporal sulcus/superior temporal gyrus, the right medial anterior temporal lobe, the right anterior insula, and bilateral occipital cortex. These results corroborate the existence of "hub" regions organizing semantic-conceptual knowledge in abstract form at the fine-grained level of within semantic category discriminations.
authors.affiliation: Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University and Maastricht Brain Imaging Center, 6229 EV Maastricht, The Netherlands.
authors.forename: João
authors.initials: J
authors.lastname: Correia
authors.forename: Elia
authors.initials: E
authors.lastname: Formisano
authors.forename: Giancarlo
authors.initials: G
authors.lastname: Valente
authors.forename: Lars
authors.initials: L
authors.lastname: Hausfeld
authors.forename: Bernadette
authors.initials: B
authors.lastname: Jansma
authors.forename: Milene
authors.initials: M
authors.lastname: Bonte
mesh_terms: D000161:Acoustic Stimulation / Q000379:methods*; D000328:Adult; D005260:Female; D006801:Humans; D007802:Language; D008279:Magnetic Resonance Imaging / Q000379:methods*; D008297:Male; D019303:Multilingualism; D013060:Speech / Q000502:physiology; D013067:Speech Perception / Q000502:physiology*; D013702:Temporal Lobe / Q000502:physiology*; D055815:Young Adult