title: The contribution of phonation type to the perception of vocal emotions in German: an articulatory synthesis study.
abstract: Vocal emotions are signaled by specific patterns of prosodic parameters, most notably pitch, phone duration, intensity, and phonation type. Phonation type was so far the least accessible parameter in emotion research, because it was difficult to extract from speech signals and difficult to manipulate in natural or synthetic speech. The present study built on recent advances in articulatory speech synthesis to exclusively control phonation type in re-synthesized German sentences spoken with seven different emotions. The goal was to find out to what extent the sole change of phonation type affects the perception of these emotions. Therefore, portrayed emotional utterances were re-synthesized with their original phonation type, as well as with each purely breathy, modal, and pressed phonation, and then rated by listeners with respect to the perceived emotions. Highly significant effects of phonation type on the recognition rates of the original emotions were found, except for disgust. While fear, anger, and the neutral emotion require specific phonation types for correct perception, sadness, happiness, boredom, and disgust primarily rely on other prosodic parameters. These results can help to improve the expression of emotions in synthesized speech and facilitate the robust automatic recognition of vocal emotions.
authors: Department of Phoniatrics, Pedaudiology and Communication Disorders, University Hospital Aachen and RWTH Aachen University, Pauwelsstr. 30, 52074 Aachen, Germany.
authors: Peter
authors: P
authors: Birkholz
authors: Department of Phoniatrics, Pedaudiology and Communication Disorders, University Hospital Aachen and RWTH Aachen University, Pauwelsstr. 30, 52074 Aachen, Germany.
authors: Lucia
authors: L
authors: Martin
authors: Section Neuropsychology, Department of Neurology, University Hospital Aachen and RWTH Aachen University, Pauwelsstr. 30, 52074 Aachen, Germany.
authors: Klaus
authors: K
authors: Willmes
authors: Department of Phoniatrics, Pedaudiology and Communication Disorders, University Hospital Aachen and RWTH Aachen University, Pauwelsstr. 30, 52074 Aachen, Germany.
authors: Bernd J
authors: BJ
authors: Kröger
authors: Department of Phoniatrics, Pedaudiology and Communication Disorders, University Hospital Aachen and RWTH Aachen University, Pauwelsstr. 30, 52074 Aachen, Germany.
authors: Christiane
authors: C
authors: Neuschaefer-Rube
mesh_terms: D000162:Acoustics; D000328:Adult; D004644:Emotions; D005260:Female; D006801:Humans; D008144:Loudness Perception; D008297:Male; D010363:Pattern Recognition, Automated; D010699:Phonation; D010700:Phonetics; D010898:Pitch Perception; D012815:Signal Processing, Computer-Assisted; D013018:Sound Spectrography; D013061:Speech Acoustics; D013067:Speech Perception; D013068:Speech Production Measurement; D013997:Time Factors; D014833:Voice Quality; D055815:Young Adult