title: Effects of speaker emotional facial expression and listener age on incremental sentence processing.
abstract: We report two visual-world eye-tracking experiments that investigated how and with which time course emotional information from a speaker's face affects younger (N = 32, Mean age  = 23) and older (N = 32, Mean age  = 64) listeners' visual attention and language comprehension as they processed emotional sentences in a visual context. The age manipulation tested predictions by socio-emotional selectivity theory of a positivity effect in older adults. After viewing the emotional face of a speaker (happy or sad) on a computer display, participants were presented simultaneously with two pictures depicting opposite-valence events (positive and negative; IAPS database) while they listened to a sentence referring to one of the events. Participants' eye fixations on the pictures while processing the sentence were increased when the speaker's face was (vs. wasn't) emotionally congruent with the sentence. The enhancement occurred from the early stages of referential disambiguation and was modulated by age. For the older adults it was more pronounced with positive faces, and for the younger ones with negative faces. These findings demonstrate for the first time that emotional facial expressions, similarly to previously-studied speaker cues such as eye gaze and gestures, are rapidly integrated into sentence processing. They also provide new evidence for positivity effects in older adults during situated sentence processing.
authors.affiliation: Department of Linguistics, University of Bielefeld, Bielefeld, Germany ; Language and Cognition Group, Cognitive Interaction Technology Excellence Cluster, University of Bielefeld, Bielefeld, Germany.
authors.forename: Maria Nella
authors.initials: MN
authors.lastname: Carminati
authors.forename: Pia
authors.initials: P
authors.lastname: Knoeferle
mesh_terms: D000328:Adult; D000367:Age Factors; D000368:Aged; D001288:Attention; D005149:Facial Expression; D005260:Female; D005403:Fixation, Ocular; D005868:Gestures; D006240:Happiness; D006801:Humans; D008297:Male; D008875:Middle Aged; D011930:Reaction Time; D013060:Speech; D013063:Speech Discrimination Tests; D014796:Visual Perception; D055815:Young Adult
references.citation: Psychol Sci. 2007 Jun;18(6):475-80
references.pmid: 17576257
references.citation: Cogn Sci. 2006 May 6;30(3):481-529
references.pmid: 21702823
references.citation: Psychol Sci. 2008 Sep;19(9):848-53
references.pmid: 18947348
references.citation: Proc Natl Acad Sci U S A. 2005 Nov 8;102(45):16518-23
references.pmid: 16260734
references.citation: Psychol Sci. 2003 Sep;14(5):409-15
references.pmid: 12930469
references.citation: Acta Psychol (Amst). 2011 Jun;137(2):151-71
references.pmid: 21288498
references.citation: Psychol Aging. 2006 Mar;21(1):40-8
references.pmid: 16594790
references.citation: Cogn Affect Behav Neurosci. 2008 Sep;8(3):264-72
references.pmid: 18814463
references.citation: Cognition. 2004 Sep;93(2):B79-87
references.pmid: 15147941
references.citation: Behav Res Methods Instrum Comput. 2004 Nov;36(4):634-8
references.pmid: 15641409
references.citation: J Exp Psychol Gen. 2003 Jun;132(2):310-24
references.pmid: 12825643
references.citation: J Exp Psychol Learn Mem Cogn. 1992 Mar;18(2):379-90
references.pmid: 1532823
references.citation: Behav Res Ther. 2005 Apr;43(4):533-51
references.pmid: 15701362
references.citation: Cognition. 2008 Mar;106(3):1465-77
references.pmid: 17617394
references.citation: J Neurosci Methods. 2002 Apr 15;115(2):137-43
references.pmid: 11992665
references.citation: Neuropsychologia. 2007 Jan 7;45(1):15-31
references.pmid: 16797614
references.citation: J Psycholinguist Res. 2000 Nov;29(6):557-80
references.pmid: 11196063
references.citation: Science. 1995 Jun 16;268(5217):1632-4
references.pmid: 7777863
references.citation: Psychol Sci. 2007 May;18(5):407-13
references.pmid: 17576280
references.citation: Psychol Aging. 2007 Sep;22(3):644-9
references.pmid: 17874962
references.citation: Front Psychol. 2011 Dec 23;2:376
references.pmid: 22207858
references.citation: Cogn Affect Behav Neurosci. 2004 Sep;4(3):294-306
references.pmid: 15535165
references.citation: J Exp Psychol Learn Mem Cogn. 2004 May;30(3):687-96
references.pmid: 15099136
references.citation: Psychol Sci. 2004 Mar;15(3):208-14
references.pmid: 15016294
references.citation: J Child Lang. 2011 Jun;38(3):579-605
references.pmid: 21040621
references.citation: Cogn Affect Behav Neurosci. 2008 Sep;8(3):282-92
references.pmid: 18814465
references.citation: Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2010 May;17(3):296-311
references.pmid: 19890752
references.citation: Front Psychol. 2012 Mar 19;3:74
references.pmid: 22457657
references.citation: J Pers Soc Psychol. 1986 Feb;50(2):229-38
references.pmid: 3701576
references.citation: Psychol Aging. 2006 Dec;21(4):821-5
references.pmid: 17201502
references.citation: J Gerontol B Psychol Sci Soc Sci. 2010 Mar;65B(2):135-44
references.pmid: 20054013
references.citation: Psychon Bull Rev. 2005 Jun;12(3):453-9
references.pmid: 16235628
references.citation: Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2008 Nov;15(6):725-43
references.pmid: 18819026
references.citation: Psychol Aging. 2009 Dec;24(4):989-94
references.pmid: 20025412
references.citation: Int J Psychophysiol. 2008 Feb;67(2):114-23
references.pmid: 18160161
references.citation: J Cogn Neurosci. 2007 Feb;19(2):237-48
references.pmid: 17280513
references.citation: Psychophysiology. 2005 Nov;42(6):654-67
references.pmid: 16364061
references.citation: Q J Exp Psychol A. 2005 Oct;58(7):1173-97
references.pmid: 16194954
references.citation: Neuropsychologia. 2001;39(9):910-20
references.pmid: 11516444
references.citation: Psychophysiology. 2011 Apr;48(4):495-506
references.pmid: 20701712
references.citation: J Int Neuropsychol Soc. 2010 Sep;16(5):754-60
references.pmid: 20673381
references.citation: Cognition. 1999 Jun 22;71(2):109-47
references.pmid: 10444906
references.citation: Psychol Aging. 2005 Dec;20(4):579-88
references.pmid: 16420133
references.citation: Front Psychol. 2012 Nov 02;3:471
references.pmid: 23130011
references.citation: Cogn Psychol. 2007 May;54(3):218-50
references.pmid: 16973144
references.citation: Front Psychol. 2012 Sep 27;3:339
references.pmid: 23060825
references.citation: Psychol Aging. 2005 Dec;20(4):554-70
references.pmid: 16420131
references.citation: Emotion. 2009 Jun;9(3):369-77
references.pmid: 19485614
references.citation: J Neurol Sci. 2005 Mar 15;229-230:109-16
references.pmid: 15760628
references.citation: Emotion. 2006 Aug;6(3):511-6
references.pmid: 16938091
references.citation: Front Psychol. 2012 Dec 05;3:538
references.pmid: 23227018
references.citation: J Exp Psychol Gen. 2008 Aug;137(3):471-94
references.pmid: 18729711
references.citation: Cogn Sci. 2005 Nov 12;29(6):1045-60
references.pmid: 21702802
references.citation: Emotion. 2007 Nov;7(4):705-14
references.pmid: 18039037
references.citation: Behav Res Methods. 2010 Feb;42(1):351-62
references.pmid: 20160315
references.citation: Cognition. 2005 Feb;95(1):95-127
references.pmid: 15629475
references.citation: J Mem Lang. 2008 Nov;59(4):434-446
references.pmid: 19884961
references.citation: Cognition. 1999 Dec 7;73(2):89-134
references.pmid: 10580160
references.citation: Neurosci Biobehav Rev. 2008;32(4):863-81
references.pmid: 18276008
references.citation: Neuropsychologia. 2007 Jan 7;45(1):75-92
references.pmid: 16797607
references.citation: Psychol Aging. 2007 Mar;22(1):147-59
references.pmid: 17385991
references.citation: Psychol Sci. 2007 Sep;18(9):838-43
references.pmid: 17760782
references.citation: PLoS One. 2012;7(1):e30740
references.pmid: 22303454
references.citation: J Pers Soc Psychol. 1988 Jul;55(1):102-11
references.pmid: 3418484
references.citation: J Exp Psychol Learn Mem Cogn. 2008 Sep;34(5):1098-110
references.pmid: 18763894