title: Simultaneous face and voice processing in schizophrenia.
abstract: While several studies have consistently demonstrated abnormalities in the unisensory processing of face and voice in schizophrenia (SZ), the extent of abnormalities in the simultaneous processing of both types of information remains unclear. To address this issue, we used event-related potentials (ERP) methodology to probe the multisensory integration of face and non-semantic sounds in schizophrenia. EEG was recorded from 18 schizophrenia patients and 19 healthy control (HC) subjects in three conditions: neutral faces (visual condition-VIS); neutral non-semantic sounds (auditory condition-AUD); neutral faces presented simultaneously with neutral non-semantic sounds (audiovisual condition-AUDVIS). When compared with HC, the schizophrenia group showed less negative N170 to both face and face-voice stimuli; later P270 peak latency in the multimodal condition of face-voice relative to unimodal condition of face (the reverse was true in HC); reduced P400 amplitude and earlier P400 peak latency in the face but not in the voice-face condition. Thus, the analysis of ERP components suggests that deficits in the encoding of facial information extend to multimodal face-voice stimuli and that delays exist in feature extraction from multimodal face-voice stimuli in schizophrenia. In contrast, categorization processes seem to benefit from the presentation of simultaneous face-voice information. Timepoint by timepoint tests of multimodal integration did not suggest impairment in the initial stages of processing in schizophrenia.
authors.affiliation: Department of Psychology, Second Military Medical University (SMMU), Shanghai, China; Department of Neurology, Changzheng Hospital, SMMU, Shanghai, China.
authors.forename: Taosheng
authors.initials: T
authors.lastname: Liu
authors.affiliation: Clinical Neuroscience Division, Laboratory of Neuroscience, Department of Psychiatry, Boston VA Healthcare System, Brockton Division and Harvard Medical School Boston, MA, United States; Neuropsychophysiology Laboratory, CIPsi, School of Psychology, University of Minho, Braga, Portugal.
authors.forename: Ana P
authors.initials: AP
authors.lastname: Pinheiro
authors.affiliation: Department of Neurology, Changzheng Hospital, SMMU, Shanghai, China.
authors.forename: Zhongxin
authors.initials: Z
authors.lastname: Zhao
authors.affiliation: Clinical Neuroscience Division, Laboratory of Neuroscience, Department of Psychiatry, Boston VA Healthcare System, Brockton Division and Harvard Medical School Boston, MA, United States; University of Massachusetts, Boston, MA, United States.
authors.forename: Paul G
authors.initials: PG
authors.lastname: Nestor
authors.affiliation: Clinical Neuroscience Division, Laboratory of Neuroscience, Department of Psychiatry, Boston VA Healthcare System, Brockton Division and Harvard Medical School Boston, MA, United States.
authors.forename: Robert W
authors.initials: RW
authors.lastname: McCarley
authors.affiliation: Clinical Neuroscience Division, Laboratory of Neuroscience, Department of Psychiatry, Boston VA Healthcare System, Brockton Division and Harvard Medical School Boston, MA, United States. Electronic address: margaret_niznikiewicz@hms.harvard.edu.
authors.forename: Margaret
authors.initials: M
authors.lastname: Niznikiewicz
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D016022:Case-Control Studies; D005071:Evoked Potentials / Q000502:physiology*; D005145:Face; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D010364:Pattern Recognition, Visual / Q000502:physiology*; D010775:Photic Stimulation; D012559:Schizophrenia / Q000503:physiopathology*; D014831:Voice / Q000502:physiology*
keywords: Face; Multimodal processing; N170; P270; P400; Schizophrenia; Voice