title: A technology prototype system for rating therapist empathy from audio recordings in addiction counseling.
abstract: Scaling up psychotherapy services such as for addiction counseling is a critical societal need. One challenge is ensuring quality of therapy, due to the heavy cost of manual observational assessment. This work proposes a speech technology-based system to automate the assessment of therapist empathy-a key therapy quality index-from audio recordings of the psychotherapy interactions. We designed a speech processing system that includes voice activity detection and diarization modules, and an automatic speech recognizer plus a speaker role matching module to extract the therapist's language cues. We employed Maximum Entropy models, Maximum Likelihood language models, and a Lattice Rescoring method to characterize highvs.low empathic language. We estimated therapy-session level empathy codes using utterance level evidence obtained from these models. Our experiments showed that the fully automated system achieved a correlation of 0.643 between expert annotated empathy codes and machine-derived estimations, and an accuracy of 81% in classifying highvs.low empathy, in comparison to a 0.721 correlation and 86% accuracy in the oracle setting using manual transcripts. The results show that the system provides useful information that can contribute to automatic quality insurance and therapist training.
authors.affiliation: Department of Electrical Engineering, University of Southern California, Los Angeles, CA, United States.
authors.forename: Bo
authors.initials: B
authors.lastname: Xiao
authors.affiliation: Department of Electrical Engineering, University of Southern California, Los Angeles, CA, United States.
authors.forename: Chewei
authors.initials: C
authors.lastname: Huang
authors.affiliation: Department of Educational Psychology, University of Utah, Salt Lake City, UT, United States.
authors.forename: Zac E
authors.initials: ZE
authors.lastname: Imel
authors.affiliation: Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, United States.
authors.forename: David C
authors.initials: DC
authors.lastname: Atkins
authors.affiliation: Department of Electrical Engineering, University of Southern California, Los Angeles, CA, United States.
authors.forename: Panayiotis
authors.initials: P
authors.lastname: Georgiou
authors.affiliation: Department of Electrical Engineering, University of Southern California, Los Angeles, CA, United States.
authors.forename: Shrikanth S
authors.initials: SS
authors.lastname: Narayanan
keywords: Addiction counseling; Automatic speech recognition; Empathy modeling; Language modeling; Prototype system; Speech processing