title: On the time course of vocal emotion recognition.
abstract: How quickly do listeners recognize emotions from a speaker's voice, and does the time course for recognition vary by emotion type? To address these questions, we adapted the auditory gating paradigm to estimate how much vocal information is needed for listeners to categorize five basic emotions (anger, disgust, fear, sadness, happiness) and neutral utterances produced by male and female speakers of English. Semantically-anomalous pseudo-utterances (e.g., The rivix jolled the silling) conveying each emotion were divided into seven gate intervals according to the number of syllables that listeners heard from sentence onset. Participants (n = 48) judged the emotional meaning of stimuli presented at each gate duration interval, in a successive, blocked presentation format. Analyses looked at how recognition of each emotion evolves as an utterance unfolds and estimated the "identification point" for each emotion. Results showed that anger, sadness, fear, and neutral expressions are recognized more accurately at short gate intervals than happiness, and particularly disgust; however, as speech unfolds, recognition of happiness improves significantly towards the end of the utterance (and fear is recognized more accurately than other emotions). When the gate associated with the emotion identification point of each stimulus was calculated, data indicated that fear (M = 517 ms), sadness (M = 576 ms), and neutral (M = 510 ms) expressions were identified from shorter acoustic events than the other emotions. These data reveal differences in the underlying time course for conscious recognition of basic emotions from vocal expressions, which should be accounted for in studies of emotional speech processing.
authors.affiliation: School of Communication Sciences and Disorders, McGill University, Montréal, Québec, Canada. marc.pell@mcgill.ca
authors.forename: Marc D
authors.initials: MD
authors.lastname: Pell
authors.forename: Sonja A
authors.initials: SA
authors.lastname: Kotz
mesh_terms: D000293:Adolescent; D000328:Adult; D000786:Anger; D001307:Auditory Perception; D004644:Emotions / Q000502:physiology*; D005239:Fear; D005260:Female; D006240:Happiness; D006801:Humans; D008297:Male; D021641:Recognition, Psychology; D013997:Time Factors; D014831:Voice; D055815:Young Adult
references.citation: Psychol Bull. 2003 Sep;129(5):770-814
references.pmid: 12956543
references.citation: J Mem Lang. 1985 Apr;24(2):210-231
references.pmid: 23226691
references.citation: Brain. 2004 Sep;127(Pt 9):1958-69
references.pmid: 15289264
references.citation: Brain Res. 2007 Jun 2;1151:107-18
references.pmid: 17445783
references.citation: Trends Cogn Sci. 2006 Jan;10(1):24-30
references.pmid: 16321562
references.citation: Neuroreport. 2004 Jan 19;15(1):211-6
references.pmid: 15106860
references.citation: Cognition. 1992 Sep;44(3):227-40
references.pmid: 1424493
references.citation: Clin Neurophysiol. 2000 Apr;111(4):694-705
references.pmid: 10727921
references.citation: Psychol Bull. 1986 Mar;99(2):143-65
references.pmid: 3515381
references.citation: Behav Res Ther. 1987;25(6):443-55
references.pmid: 3322254
references.citation: J Pers Soc Psychol. 1987 Oct;53(4):712-7
references.pmid: 3681648
references.citation: Proc Biol Sci. 1998 Oct 7;265(1408):1809-17
references.pmid: 9802236
references.citation: Cogn Affect Behav Neurosci. 2003 Jun;3(2):97-110
references.pmid: 12943325
references.citation: Percept Psychophys. 1980 Oct;28(4):267-83
references.pmid: 7465310
references.citation: Cogn Emot. 2011 Aug;25(5):834-53
references.pmid: 21824024
references.citation: Emotion. 2005 Sep;5(3):277-95
references.pmid: 16187864
references.citation: Neuroimage. 2005 Feb 15;24(4):1233-41
references.pmid: 15670701
references.citation: Neuropsychologia. 2009 Dec;47(14):3059-66
references.pmid: 19596021
references.citation: Behav Res Methods Instrum Comput. 2004 Nov;36(4):634-8
references.pmid: 15641409
references.citation: Am Psychol. 1981 Feb;36(2):129-48
references.pmid: 7224324
references.citation: J Pers Soc Psychol. 1975 Dec;32(6):1068-76
references.pmid: 1214214
references.citation: Brain Lang. 2006 Feb;96(2):221-34
references.pmid: 15913754
references.citation: Psychol Bull. 1994 Jan;115(1):102-41
references.pmid: 8202574
references.citation: Brain Res. 2006 Nov 29;1122(1):171-8
references.pmid: 17034768
references.citation: J Cogn Neurosci. 2009 Sep;21(9):1670-9
references.pmid: 18767920
references.citation: Cogn Affect Behav Neurosci. 2001 Dec;1(4):382-7
references.pmid: 12467089
references.citation: Emotion. 2009 Jun;9(3):293-305
references.pmid: 19485607
references.citation: Cogn Emot. 2009 Jun;23(4):675-687
references.pmid: 20589224
references.citation: Brain Lang. 2003 Sep;86(3):366-76
references.pmid: 12972367
references.citation: J Acoust Soc Am. 2001 Apr;109(4):1668-80
references.pmid: 11325135
references.citation: J Acoust Soc Am. 1993 Feb;93(2):1097-108
references.pmid: 8445120
references.citation: Percept Psychophys. 1987 Mar;41(3):262-75
references.pmid: 3575084
references.citation: J Commun Disord. 1990 Aug-Oct;23(4-5):247-71
references.pmid: 2246382
references.citation: Lang Speech. 2000 Oct-Dec;43(Pt 4):355-75
references.pmid: 11419222
references.citation: Neuroimage. 2004 Mar;21(3):1114-23
references.pmid: 15006679
references.citation: Psychophysiology. 2004 Mar;41(2):259-68
references.pmid: 15032991
references.citation: Emotion. 2008 Feb;8(1):81-95
references.pmid: 18266518
references.citation: Cogn Emot. 2009 Jan 1;24(7):1133-1152
references.pmid: 21552425
references.citation: Curr Biol. 2009 Jun 23;19(12):1028-33
references.pmid: 19446457
references.citation: J Exp Psychol Hum Percept Perform. 1983 Dec;9(6):864-81
references.pmid: 6227697
references.citation: Brain Cogn. 2009 Feb;69(1):121-6
references.pmid: 18644670
references.citation: Percept Psychophys. 1985 Oct;38(4):299-310
references.pmid: 3831907
references.citation: Psychol Bull. 1994 Mar;115(2):288-99
references.pmid: 8165273
references.citation: J Psycholinguist Res. 1999 Jul;28(4):347-65
references.pmid: 10380660
references.citation: Philos Trans R Soc Lond B Biol Sci. 2009 Dec 12;364(1535):3459-74
references.pmid: 19884141
references.citation: J Pers Soc Psychol. 1991 Sep;61(3):380-91
references.pmid: 1941510
references.citation: Cogn Affect Behav Neurosci. 2010 May;10(2):230-42
references.pmid: 20498347
references.citation: Neuroimage. 2008 Aug 15;42(2):919-27
references.pmid: 18586524
references.citation: Arch Gen Psychiatry. 1986 Mar;43(3):280-3
references.pmid: 3954549
references.citation: Percept Psychophys. 1985 Sep;38(3):217-22
references.pmid: 4088813
references.citation: Emotion. 2001 Dec;1(4):381-412
references.pmid: 12901399
references.citation: Brain Lang. 2004 May;89(2):267-76
references.pmid: 15068909
references.citation: Psychol Sci. 2003 Jan;14(1):39-46
references.pmid: 12564752
references.citation: J Abnorm Psychol. 1964 Apr;68:390-6
references.pmid: 14136778
references.citation: Trends Cogn Sci. 2004 Mar;8(3):129-35
references.pmid: 15301753
references.citation: Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):1071-86
references.pmid: 17890189
references.citation: Science. 1969 Apr 4;164(3875):86-8
references.pmid: 5773719
references.citation: Psychol Res. 2004 Dec;69(1-2):22-9
references.pmid: 14648224
references.citation: Phonetica. 1983;40(1):1-18
references.pmid: 6189135
references.citation: Psychol Bull. 1994 Mar;115(2):268-87
references.pmid: 8165272
references.citation: J Anxiety Disord. 2002;16(5):529-41
references.pmid: 12396210
references.citation: Emotion. 2009 Dec;9(6):838-46
references.pmid: 20001126
references.citation: Neuroreport. 2008 Jan 22;19(2):209-13
references.pmid: 18185110
references.citation: Neuroreport. 2009 Dec 9;20(18):1603-8
references.pmid: 19901857
references.citation: J Pers Soc Psychol. 1996 Mar;70(3):614-36
references.pmid: 8851745
references.citation: Nat Rev Neurosci. 2001 May;2(5):352-63
references.pmid: 11331919
references.citation: J Voice. 2007 Sep;21(5):531-40
references.pmid: 16647247
references.citation: Nat Neurosci. 2005 Feb;8(2):145-6
references.pmid: 15665880