title: Beyond the word and image: characteristics of a common meaning system for language and vision revealed by functional and structural imaging.
abstract: This research tests the hypothesis that comprehension of human events will engage an extended semantic representation system, independent of the input modality (sentence vs. picture). To investigate this, we examined brain activation and connectivity in 19 subjects who read sentences and viewed pictures depicting everyday events, in a combined fMRI and DTI study. Conjunction of activity in understanding sentences and pictures revealed a common fronto-temporo-parietal network that included the middle and inferior frontal gyri, the parahippocampal-retrosplenial complex, the anterior and middle temporal gyri, the inferior parietal lobe in particular the temporo-parietal cortex. DTI tractography seeded from this temporo-parietal cortex hub revealed a multi-component network reaching into the temporal pole, the ventral frontal pole and premotor cortex. A significant correlation was found between the relative pathway density issued from the temporo-parietal cortex and the imageability of sentences for individual subjects, suggesting a potential functional link between comprehension and the temporo-parietal connectivity strength. These data help to define a "meaning" network that includes components of recently characterized systems for semantic memory, embodied simulation, and visuo-spatial scene representation. The network substantially overlaps with the "default mode" network implicated as part of a core network of semantic representation, along with brain systems related to the formation of mental models, and reasoning. These data are consistent with a model of real-world situational understanding that is highly embodied. Crucially, the neural basis of this embodied understanding is not limited to sensorimotor systems, but extends to the highest levels of cognition, including autobiographical memory, scene analysis, mental model formation, reasoning and theory of mind.
authors.affiliation: INSERM Stem Cell and Brain Research Institute U846, Bron, France.
authors.forename: A L
authors.initials: AL
authors.lastname: Jouen
authors.affiliation: Department of Psychology and Program in Cognitive Neuroscience, The City College and Graduate Center of the City, University of New York, New York, NY, USA.
authors.forename: T M
authors.initials: TM
authors.lastname: Ellmore
authors.affiliation: INSERM Stem Cell and Brain Research Institute U846, Bron, France.
authors.forename: C J
authors.initials: CJ
authors.lastname: Madden
authors.affiliation: Cognitive Neuroimaging Unit, INSERM-CEA, Gif-sur-Yvette, France.
authors.forename: C
authors.initials: C
authors.lastname: Pallier
authors.affiliation: INSERM Stem Cell and Brain Research Institute U846, Bron, France.
authors.forename: P F
authors.initials: PF
authors.lastname: Dominey
authors.affiliation: INSERM Stem Cell and Brain Research Institute U846, Bron, France. Electronic address: Jocelyne.ventre-dominey@inserm.fr.
authors.forename: J
authors.initials: J
authors.lastname: Ventre-Dominey
mesh_terms: D002540:Cerebral Cortex / Q000033:anatomy & histology* / Q000502:physiology*; D032882:Comprehension / Q000502:physiology*; D063132:Connectome / Q000379:methods*; D005260:Female; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D007802:Language; D008297:Male; D009415:Nerve Net / Q000502:physiology; D015203:Reproducibility of Results; D012660:Semantics; D012680:Sensitivity and Specificity; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: DTI; Human; Language; Semantic; Vision; fMRI