title: Head Motion Modeling for Human Behavior Analysis in Dyadic Interaction.
abstract: This paper presents a computational study of head motion in human interaction, notably of its role in conveying interlocutors' behavioral characteristics. Head motion is physically complex and carries rich information; current modeling approaches based on visual signals, however, are still limited in their ability to adequately capture these important properties. Guided by the methodology of kinesics, we propose a data driven approach to identify typical head motion patterns. The approach follows the steps of first segmenting motion events, then parametrically representing the motion by linear predictive features, and finally generalizing the motion types using Gaussian mixture models. The proposed approach is experimentally validated using video recordings of communication sessions from real couples involved in a couples therapy study. In particular we use the head motion model to classify binarized expert judgments of the interactants' specific behavioral characteristics where entrainment in head motion is hypothesized to play a role:Acceptance, Blame, Positive, andNegativebehavior. We achieve accuracies in the range of 60% to 70% for the various experimental settings and conditions. In addition, we describe a measure of motion similarity between the interaction partners based on the proposed model. We show that the relative change of head motion similarity during the interaction significantly correlates with the expert judgments of the interactants' behavioral characteristics. These findings demonstrate the effectiveness of the proposed head motion model, and underscore the promise of analyzing human behavioral characteristics through signal processing methods.
authors.affiliation: Signal and Image Processing Institute, Department of Electrical Engineering, University of Southern California, Los Angeles, CA, 90089 USA.
authors.forename: Bo
authors.initials: B
authors.lastname: Xiao
authors.affiliation: Signal and Image Processing Institute, Department of Electrical Engineering, University of Southern California, Los Angeles, CA, 90089 USA.
authors.forename: Panayiotis
authors.initials: P
authors.lastname: Georgiou
authors.affiliation: Department of Psychology, University of Utah, Salt Lack City, UT, 84112 USA.
authors.forename: Brian
authors.initials: B
authors.lastname: Baucom
authors.affiliation: Signal and Image Processing Institute, Department of Electrical Engineering, University of Southern California, Los Angeles, CA, 90089 USA.
authors.forename: Shrikanth S
authors.initials: SS
authors.lastname: Narayanan
keywords: Behavioral characteristics; Entrainment; Gaussian mixture model; Head motion; Kinesics; Linear predictive analysis