title: Unification of sentence processing via ear and eye: an fMRI study.
abstract: We present new evidence based on fMRI for the existence and neural architecture of an abstract supramodal language system that can integrate linguistic inputs arising from different modalities such that speech and print each activate a common code. Working with sentence material, our aim was to find out where the putative supramodal system is located and how it responds to comprehension challenges. To probe these questions we examined BOLD activity in experienced readers while they performed a semantic categorization task with matched written or spoken sentences that were either well-formed or contained anomalies of syntactic form or pragmatic content. On whole-brain scans, both anomalies increased net activity over non-anomalous baseline sentences, chiefly at left frontal and temporal regions of heteromodal cortex. The anomaly-sensitive sites correspond approximately to those that previous studies (Michael et al., 2001; Constable et al., 2004) have found to be sensitive to other differences in sentence complexity (object relative minus subject relative). Regions of interest (ROIs) were defined by peak response to anomaly averaging over modality conditions. Each anomaly-sensitive ROI showed the same pattern of response across sentence types in each modality. Voxel-by-voxel exploration over the whole brain based on a cosine similarity measure of common function confirmed the specificity of supramodal zones.
authors.affiliation: Haskins Laboratories, 300 George Street, New Haven, Connecticut 06511, USA. braze@haskins.yale.edu
authors.forename: David
authors.initials: D
authors.lastname: Braze
authors.forename: W Einar
authors.initials: WE
authors.lastname: Mencl
authors.forename: Whitney
authors.initials: W
authors.lastname: Tabor
authors.forename: Kenneth R
authors.initials: KR
authors.lastname: Pugh
authors.forename: R Todd
authors.initials: RT
authors.lastname: Constable
authors.forename: Robert K
authors.initials: RK
authors.lastname: Fulbright
authors.forename: James S
authors.initials: JS
authors.lastname: Magnuson
authors.forename: Julie A
authors.initials: JA
authors.lastname: Van Dyke
authors.forename: Donald P
authors.initials: DP
authors.lastname: Shankweiler
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001307:Auditory Perception / Q000502:physiology; D001931:Brain Mapping; D002540:Cerebral Cortex / Q000502:physiology*; D003071:Cognition / Q000502:physiology; D032882:Comprehension / Q000502:physiology*; D003210:Concept Formation / Q000502:physiology*; D004192:Discrimination, Psychological; D005071:Evoked Potentials / Q000502:physiology; D005260:Female; D006801:Humans; D007802:Language; D007807:Language Tests; D008279:Magnetic Resonance Imaging; D008297:Male; D009434:Neural Pathways / Q000502:physiology*; D010775:Photic Stimulation; D011932:Reading; D012016:Reference Values; D012660:Semantics; D055815:Young Adult