title: Visual and motor cortices differentially support the translation of foreign language words.
abstract: At present, it is largely unclear how the human brain optimally learns foreign languages. We investigated teaching strategies that utilize complementary information ("enrichment"), such as pictures or gestures, to optimize vocabulary learning outcome. We found that learning while performing gestures was more efficient than the common practice of learning with pictures and that both enrichment strategies were better than learning without enrichment ("verbal learning"). We tested the prediction of an influential cognitive neuroscience theory that provides explanations for the beneficial behavioral effects of enrichment: the "multisensory learning theory" attributes the benefits of enrichment to recruitment of brain areas specialized in processing the enrichment. To test this prediction, we asked participants to translate auditorily presented foreign words during fMRI. Multivariate pattern classification allowed us to decode from the brain activity under which enrichment condition the vocabulary had been learned. The visual-object-sensitive lateral occipital complex (LOC) represented auditory words that had been learned with pictures. The biological motion superior temporal sulcus (bmSTS) and motor areas represented auditory words that had been learned with gestures. Importantly, brain activity in these specialized visual and motor brain areas correlated with behavioral performance. The cortical activation pattern found in the present study strongly supports the multisensory learning theory in contrast to alternative explanations. In addition, the results highlight the importance of learning foreign language vocabulary with enrichment, particularly with self-performed gestures.
authors: Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany. Electronic address: katja.m.mayer@gmail.com.
authors: Katja M
authors: KM
authors: Mayer
authors: Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany; Group for Neural Theory, Departement d'Etudes Cognitives, Ecole Normale Superieure, 75005 Paris, France.
authors: Izzet B
authors: IB
authors: Yildiz
authors: Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany; Johannes Kepler University Linz, 4040 Linz, Austria.
authors: Manuela
authors: M
authors: Macedonia
authors: Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany; Humboldt University of Berlin, 10099 Berlin, Germany.
authors: Katharina
authors: K
authors: von Kriegstein
mesh_terms: D000328:Adult; D005260:Female; D005858:Germany; D005868:Gestures; D006801:Humans; D007802:Language; D007858:Learning; D008279:Magnetic Resonance Imaging; D008297:Male; D009044:Motor Cortex / Q000502:physiology*; D010775:Photic Stimulation; D014706:Verbal Learning; D014793:Visual Cortex / Q000502:physiology*; D055815:Young Adult