title: DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech.
abstract: We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.
authors.affiliation: Science & Technology of Music and Sound (STMS), UMR 9912 (CNRS/IRCAM/UPMC), 1 place Stravinsky, 75004, Paris, France. rachman.laura@gmail.com.|Inserm U 1127, CNRS UMR 7225, Sorbonne Universités UPMC Univ Paris 06 UMR S 1127, Institut du Cerveau et de la Moelle épinière (ICM), Social and Affective Neuroscience (SAN) Laboratory, Paris, France. rachman.laura@gmail.com.
authors.forename: Laura
authors.initials: L
authors.lastname: Rachman
authors.affiliation: Science & Technology of Music and Sound (STMS), UMR 9912 (CNRS/IRCAM/UPMC), 1 place Stravinsky, 75004, Paris, France.
authors.forename: Marco
authors.initials: M
authors.lastname: Liuni
authors.affiliation: Science & Technology of Music and Sound (STMS), UMR 9912 (CNRS/IRCAM/UPMC), 1 place Stravinsky, 75004, Paris, France.
authors.forename: Pablo
authors.initials: P
authors.lastname: Arias
authors.affiliation: Lund University Cognitive Science, Lund University, Lund, Sweden.
authors.forename: Andreas
authors.initials: A
authors.lastname: Lind
authors.affiliation: Lund University Cognitive Science, Lund University, Lund, Sweden.|Swedish Collegium for Advanced Study, Uppsala, Sweden.
authors.forename: Petter
authors.initials: P
authors.lastname: Johansson
authors.affiliation: Lund University Cognitive Science, Lund University, Lund, Sweden.
authors.forename: Lars
authors.initials: L
authors.lastname: Hall
authors.affiliation: Department of Experimental Psychology, University College London, London, UK.
authors.forename: Daniel
authors.initials: D
authors.lastname: Richardson
authors.affiliation: Department of Intermedia Art and Science, Faculty of Science and Engineering, Waseda University, Tokyo, Japan.|Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo, Japan.
authors.forename: Katsumi
authors.initials: K
authors.lastname: Watanabe
authors.affiliation: Inserm U 1127, CNRS UMR 7225, Sorbonne Universités UPMC Univ Paris 06 UMR S 1127, Institut du Cerveau et de la Moelle épinière (ICM), Social and Affective Neuroscience (SAN) Laboratory, Paris, France.
authors.forename: Stéphanie
authors.initials: S
authors.lastname: Dubal
authors.affiliation: Science & Technology of Music and Sound (STMS), UMR 9912 (CNRS/IRCAM/UPMC), 1 place Stravinsky, 75004, Paris, France.
authors.forename: Jean-Julien
authors.initials: JJ
authors.lastname: Aucouturier
mesh_terms: D003198:Computer Simulation; D003463:Cues; D004644:Emotions; D005260:Female; D006801:Humans; D007398:Interpersonal Relations; D007802:Language; D008297:Male; D009633:Nonverbal Communication / Q000523:psychology*; D013060:Speech; D013067:Speech Perception; D014705:Verbal Behavior
keywords: Emotional transformations; Infra-segmental cues; Nonverbal behavior; Real-time; Software; Voice