title: Face-selective regions differ in their ability to classify facial expressions.
abstract: Recognition of facial expressions is crucial for effective social interactions. Yet, the extent to which the various face-selective regions in the human brain classify different facial expressions remains unclear. We used functional magnetic resonance imaging (fMRI) and support vector machine pattern classification analysis to determine how well face-selective brain regions are able to decode different categories of facial expression. Subjects participated in a slow event-related fMRI experiment in which they were shown 32 face pictures, portraying four different expressions: neutral, fearful, angry, and happy and belonging to eight different identities. Our results showed that only the amygdala and the posterior superior temporal sulcus (STS) were able to accurately discriminate between these expressions, albeit in different ways: the amygdala discriminated fearful faces from non-fearful faces, whereas STS discriminated neutral from emotional (fearful, angry and happy) faces. In contrast to these findings on the classification of emotional expression, only the fusiform face area (FFA) and anterior inferior temporal cortex (aIT) could discriminate among the various facial identities. Further, the amygdala and STS were better than FFA and aIT at classifying expression, while FFA and aIT were better than the amygdala and STS at classifying identity. Taken together, our findings indicate that the decoding of facial emotion and facial identity occurs in different neural substrates: the amygdala and STS for the former and FFA and aIT for the latter.
authors.affiliation: Laboratory of Brain and Cognition, NIMH, NIH, Bethesda, MD 20892, USA. Electronic address: hui.zhang@nih.gov.
authors.forename: Hui
authors.initials: H
authors.lastname: Zhang
authors.affiliation: Laboratory of Brain and Cognition, NIMH, NIH, Bethesda, MD 20892, USA.
authors.forename: Shruti
authors.initials: S
authors.lastname: Japee
authors.affiliation: Laboratory of Brain and Cognition, NIMH, NIH, Bethesda, MD 20892, USA.
authors.forename: Rachel
authors.initials: R
authors.lastname: Nolan
authors.affiliation: Laboratory of Brain and Cognition, NIMH, NIH, Bethesda, MD 20892, USA.
authors.forename: Carlton
authors.initials: C
authors.lastname: Chu
authors.affiliation: Laboratory of Brain and Cognition, NIMH, NIH, Bethesda, MD 20892, USA.
authors.forename: Ning
authors.initials: N
authors.lastname: Liu
authors.affiliation: Laboratory of Brain and Cognition, NIMH, NIH, Bethesda, MD 20892, USA.
authors.forename: Leslie G
authors.initials: LG
authors.lastname: Ungerleider
mesh_terms: D000328:Adult; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D004192:Discrimination, Psychological / Q000502:physiology*; D004644:Emotions / Q000502:physiology; D005149:Facial Expression; D005260:Female; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008279:Magnetic Resonance Imaging; D008297:Male; D010364:Pattern Recognition, Visual / Q000502:physiology*; D060388:Support Vector Machine
keywords: Amygdala; Emotional faces; STS; SVM; fMRI
references.citation: Cereb Cortex. 2006 Mar;16(3):366-75
references.pmid: 15930371
references.citation: Proc Natl Acad Sci U S A. 2002 Aug 20;99(17):11458-63
references.pmid: 12177449
references.citation: Neuropsychologia. 2007 Nov 5;45(14):3234-41
references.pmid: 17707444
references.citation: Front Syst Neurosci. 2010 Mar 15;4:6
references.pmid: 20305753
references.citation: Eur J Neurosci. 2008 Jun;27(11):3074-82
references.pmid: 18540880
references.citation: Cereb Cortex. 2014 Jun;24(6):1565-78
references.pmid: 23377287
references.citation: Proc Natl Acad Sci U S A. 2004 Jun 29;101(26):9827-32
references.pmid: 15210952
references.citation: Neuroimage. 2004 Nov;23(3):905-13
references.pmid: 15528090
references.citation: Soc Cogn Affect Neurosci. 2014 Sep;9(9):1372-8
references.pmid: 23887817
references.citation: Br J Psychol. 1990 Aug;81 ( Pt 3):361-80
references.pmid: 2224396
references.citation: Trends Cogn Sci. 2000 Jul;4(7):267-278
references.pmid: 10859571
references.citation: Neuroimage. 2010 Oct 15;53(1):103-18
references.pmid: 20580933
references.citation: Nature. 1994 Dec 15;372(6507):669-72
references.pmid: 7990957
references.citation: Proc Natl Acad Sci U S A. 2008 Apr 8;105(14):5591-6
references.pmid: 18375769
references.citation: Proc Natl Acad Sci U S A. 2012 Dec 26;109(52):E3640-8
references.pmid: 23184972
references.citation: Emotion. 2001 Mar;1(1):70-83
references.pmid: 12894812
references.citation: J Cogn Neurosci. 2012 Jun;24(6):1358-70
references.pmid: 22185494
references.citation: Neuroimage. 2009 Jan 15;44(2):569-80
references.pmid: 18852053
references.citation: Proc Natl Acad Sci U S A. 2006 Mar 7;103(10):3863-8
references.pmid: 16537458
references.citation: Trends Cogn Sci. 2000 Jun;4(6):223-233
references.pmid: 10827445
references.citation: J Neurosci. 2015 Feb 11;35(6):2791-802
references.pmid: 25673866
references.citation: J Neurosci. 2013 Oct 30;33(44):17435-43
references.pmid: 24174677
references.citation: Front Hum Neurosci. 2013 Oct 28;7:692
references.pmid: 24194707
references.citation: Trends Cogn Sci. 2015 May;19(5):240-1
references.pmid: 25840651
references.citation: Neuropsychologia. 2011 Oct;49(12):3188-200
references.pmid: 21807006
references.citation: J Neurosci Methods. 2015 Jul 30;250:126-36
references.pmid: 25596422
references.citation: J Neurophysiol. 2004 Sep;92(3):1830-9
references.pmid: 15115795
references.citation: Neuroimage. 2003 Sep;20(1):84-97
references.pmid: 14527572
references.citation: Brain Res Cogn Brain Res. 2001 Oct;12(2):225-31
references.pmid: 11587892
references.citation: Cereb Cortex. 2014 Aug;24(8):1988-95
references.pmid: 23463339
references.citation: J Neurosci. 1998 Jan 1;18(1):411-8
references.pmid: 9412517
references.citation: Neuroimage. 2011 Jan 15;54(2):1600-6
references.pmid: 20850548
references.citation: Proc Natl Acad Sci U S A. 2015 Jan 27;112(4):E361-70
references.pmid: 25583504
references.citation: J Cogn Neurosci. 1997 Fall;9(5):605-10
references.pmid: 23965119
references.citation: J Neurosci. 1995 Sep;15(9):5879-91
references.pmid: 7666173
references.citation: J Neurosci. 1997 Jun 1;17(11):4302-11
references.pmid: 9151747
references.citation: J Cogn Neurosci. 2010 May;22(5):903-17
references.pmid: 19320549
references.citation: Proc Natl Acad Sci U S A. 2011 Jun 14;108(24):9998-10003
references.pmid: 21628569
references.citation: Comput Biomed Res. 1996 Jun;29(3):162-73
references.pmid: 8812068
references.citation: Proc Natl Acad Sci U S A. 2007 Dec 18;104(51):20600-5
references.pmid: 18077383
references.citation: Neuropsychologia. 2014 Apr;56:47-52
references.pmid: 24447769
references.citation: Neuroreport. 2002 Oct 7;13(14):1737-41
references.pmid: 12395114
references.citation: J Neurosci. 2014 Nov 26;34(48):15997-6008
references.pmid: 25429141
references.citation: J Vis. 2010 May 01;10(5):11
references.pmid: 20616141
references.citation: Neuroimage. 2003 Aug;19(4):1317-28
references.pmid: 12948690
references.citation: Brain Imaging Behav. 2010 Jun;4(2):164-76
references.pmid: 20502991
references.citation: Proc Natl Acad Sci U S A. 2012 Dec 18;109(51):21164-9
references.pmid: 23213218
references.citation: Neuroimage. 2013 Nov 1;81:371-380
references.pmid: 23684864
references.citation: Neuroimage. 1996 Dec;4(3 Pt 1):194-200
references.pmid: 9345509
references.citation: Neuron. 1996 Nov;17(5):875-87
references.pmid: 8938120
references.citation: Nature. 1996 Oct 31;383(6603):812-5
references.pmid: 8893004
references.citation: J Neurosci. 2013 May 8;33(19):8549-58
references.pmid: 23658192
references.citation: Neurosci Biobehav Rev. 2015 Aug;55:536-46
references.pmid: 26067903
references.citation: Brain Res Cogn Brain Res. 2003 Jul;17(2):406-18
references.pmid: 12880911
references.citation: Brain. 1995 Feb;118 ( Pt 1):15-24
references.pmid: 7895001
references.citation: Psychol Med. 2009 Jul;39(7):1177-87
references.pmid: 19154647
references.citation: Trends Cogn Sci. 2007 Dec;11(12):499-500
references.pmid: 18024182
references.citation: Front Biosci (Elite Ed). 2014 Jun 01;6(2):236-57
references.pmid: 24896205
references.citation: Neuroimage. 2014 Aug 15;97:217-23
references.pmid: 24747739
references.citation: Brain. 1993 Aug;116 ( Pt 4):941-59
references.pmid: 8353717
references.citation: J Neurosci. 2014 Sep 17;34(38):12828-36
references.pmid: 25232118
references.citation: Nat Rev Neurosci. 2005 Aug;6(8):641-51
references.pmid: 16062171
references.citation: Neuron. 2001 Jun;30(3):829-41
references.pmid: 11430815
references.citation: J Neurosci. 2004 Mar 24;24(12):2898-904
references.pmid: 15044528
references.citation: J Vis. 2010 Dec 31;10(14):
references.pmid: 21196514
references.citation: J Neurosci. 2014 Jul 2;34(27):9173-7
references.pmid: 24990937
references.citation: Nat Neurosci. 2004 Nov;7(11):1271-8
references.pmid: 15494727
references.citation: PLoS One. 2015 Feb 25;10(2):e0117126
references.pmid: 25714434
references.citation: Neuropsychologia. 2005;43(11):1645-54
references.pmid: 16009246