title: Multimodal Detection of Depression in Clinical Interviews.
abstract: Current methods for depression assessment depend almost entirely on clinical interview or self-report ratings. Such measures lack systematic and efficient ways of incorporating behavioral observations that are strong indicators of psychological disorder. We compared a clinical interview of depression severity with automatic measurement in 48 participants undergoing treatment for depression. Interviews were obtained at 7-week intervals on up to four occasions. Following standard cut-offs, participants at each session were classified as remitted, intermediate, or depressed. Logistic regression classifiers using leave-one-out validation were compared for facial movement dynamics, head movement dynamics, and vocal prosody individually and in combination. Accuracy (remitted versus depressed) for facial movement dynamics was higher than that for head movement dynamics; and each was substantially higher than that for vocal prosody. Accuracy for all three modalities together reached 88.93%, exceeding that for any single modality or pair of modalities. These findings suggest that automatic detection of depression from behavioral indicators is feasible and that multimodal measures afford most powerful detection.
authors.affiliation: Pattern Recognition and Bioinformatics Group, Delft University of Technology, Delft, The Netherlands.
authors.forename: Hamdi
authors.initials: H
authors.lastname: Dibeklioğlu
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA.
authors.forename: Zakia
authors.initials: Z
authors.lastname: Hammal
authors.affiliation: Center for Cognitive Brain Imaging, Carnegie Mellon University, Pittsburgh, PA, USA.
authors.forename: Ying
authors.initials: Y
authors.lastname: Yang
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA; Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA.
authors.forename: Jeffrey F
authors.initials: JF
authors.lastname: Cohn
keywords: Depression; Facial Movement; Head Movement; Vocal Prosody