title: How the human brain exchanges information across sensory modalities to recognize other people.
abstract: Recognizing the identity of other individuals across different sensory modalities is critical for successful social interaction. In the human brain, face- and voice-sensitive areas are separate, but structurally connected. What kind of information is exchanged between these specialized areas during cross-modal recognition of other individuals is currently unclear. For faces, specific areas are sensitive to identity and to physical properties. It is an open question whether voices activate representations of face identity or physical facial properties in these areas. To address this question, we used functional magnetic resonance imaging in humans and a voice-face priming design. In this design, familiar voices were followed by morphed faces that matched or mismatched with respect to identity or physical properties. The results showed that responses in face-sensitive regions were modulated when face identity or physical properties did not match to the preceding voice. The strength of this mismatch signal depended on the level of certainty the participant had about the voice identity. This suggests that both identity and physical property information was provided by the voice to face areas. The activity and connectivity profiles differed between face-sensitive areas: (i) the occipital face area seemed to receive information about both physical properties and identity, (ii) the fusiform face area seemed to receive identity, and (iii) the anterior temporal lobe seemed to receive predominantly identity information from the voice. We interpret these results within a prediction coding scheme in which both identity and physical property information is used across sensory modalities to recognize individuals.
authors.affiliation: Max Planck Institute for Human Cognitive and Brain Sciences, 04103, Leipzig, Germany; MRC Cognition and Brain Sciences Unit, Cambridge CB2 7EF, United Kingdom.
authors.forename: Helen
authors.initials: H
authors.lastname: Blank
authors.forename: Stefan J
authors.initials: SJ
authors.lastname: Kiebel
authors.forename: Katharina
authors.initials: K
authors.lastname: von Kriegstein
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D001921:Brain / Q000098:blood supply / Q000502:physiology*; D001931:Brain Mapping; D005260:Female; D007839:Functional Laterality; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008279:Magnetic Resonance Imaging; D008297:Male; D010100:Oxygen / Q000097:blood; D010364:Pattern Recognition, Visual / Q000502:physiology*; D010775:Photic Stimulation; D011601:Psychophysics; D011930:Reaction Time / Q000502:physiology; D021641:Recognition, Psychology; D012677:Sensation / Q000502:physiology*; D055815:Young Adult
chemical_list: D010100:Oxygen
keywords: cross-modal priming; face recognition; multisensory; person identity; voice recognition