title: Auditory to Visual Cross-Modal Adaptation for Emotion: Psychophysical and Neural Correlates.
abstract: Adaptation is fundamental in sensory processing and has been studied extensively within the same sensory modality. However, little is known about adaptation across sensory modalities, especially in the context of high-level processing, such as the perception of emotion. Previous studies have shown that prolonged exposure to a face exhibiting one emotion, such as happiness, leads to contrastive biases in the perception of subsequently presented faces toward the opposite emotion, such as sadness. Such work has shown the importance of adaptation in calibrating face perception based on prior visual exposure. In the present study, we showed for the first time that emotion-laden sounds, like laughter, adapt the visual perception of emotional faces, that is, subjects more frequently perceived faces as sad after listening to a happy sound. Furthermore, via electroencephalography recordings and event-related potential analysis, we showed that there was a neural correlate underlying the perceptual bias: There was an attenuated response occurring at ∼ 400 ms to happy test faces and a quickened response to sad test faces, after exposure to a happy sound. Our results provide the first direct evidence for a behavioral cross-modal adaptation effect on the perception of facial emotion, and its neural correlate.
authors.affiliation: Center for Psychological Engineering, Faculty of Psychology, Southwest University, Chongqing 400715, China.|Division of Psychology, School of Humanities and Social Sciences, Nanyang Technological University, Singapore 637332, Singapore.
authors.forename: Xiaodong
authors.initials: X
authors.lastname: Wang
authors.affiliation: CAS Key Laboratory of Brain Function and Diseases, School of Life Sciences, University of Science and Technology of China, Hefei 230027, China.
authors.forename: Xiaotao
authors.initials: X
authors.lastname: Guo
authors.affiliation: CAS Key Laboratory of Brain Function and Diseases, School of Life Sciences, University of Science and Technology of China, Hefei 230027, China.
authors.forename: Lin
authors.initials: L
authors.lastname: Chen
authors.affiliation: Center for Psychological Engineering, Faculty of Psychology, Southwest University, Chongqing 400715, China.
authors.forename: Yijun
authors.initials: Y
authors.lastname: Liu
authors.affiliation: Departments of Neuroscience, Neurology, Psychiatry and Ophthalmology, and the Kavli Neuroscience Institute, Columbia University, New York, NY 10032, USA.|Mahoney-Keck Center for Brain and Behavior Research, New York State Psychiatric Institute, New York, NY 10032, USA.
authors.forename: Michael E
authors.initials: ME
authors.lastname: Goldberg
authors.affiliation: Division of Psychology, School of Humanities and Social Sciences, Nanyang Technological University, Singapore 637332, Singapore.
authors.forename: Hong
authors.initials: H
authors.lastname: Xu
mesh_terms: D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D004569:Electroencephalography / Q000379:methods; D004644:Emotions / Q000502:physiology*; D005071:Evoked Potentials / Q000502:physiology*; D005145:Face; D005149:Facial Expression; D005260:Female; D006801:Humans; D008297:Male; D011930:Reaction Time; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: aftereffect; laughter; neural attenuation; unimodal