title: Unsupervised Synchrony Discovery in Human Interaction.
abstract: People are inherently social. Social interaction plays an important and natural role in human behavior. Most computational methods focus on individuals alone rather than in social context. They also require labelled training data. We present an unsupervised approach to discover interpersonal synchrony, referred as to two or more persons preforming common actions in overlapping video frames or segments. For computational efficiency, we develop a branch-and-bound (B&B) approach that affords exhaustive search while guaranteeing a globally optimal solution. The proposed method is entirely general. It takes from two or more videos any multi-dimensional signal that can be represented as a histogram. We derive three novel bounding functions and provide efficient extensions, including multi-synchrony detection and accelerated search, using a warm-start strategy and parallelism. We evaluate the effectiveness of our approach in multiple databases, including human actions using the CMU Mocap dataset [1], spontaneous facial behaviors using group-formation task dataset [37] and parent-infant interaction dataset [28].
authors.affiliation: Robotics Institute, Carnegie Mellon University.
authors.forename: Wen-Sheng
authors.initials: WS
authors.lastname: Chu
authors.affiliation: Beihang University, Beijing, China.
authors.forename: Jiabei
authors.initials: J
authors.lastname: Zeng
authors.affiliation: Robotics Institute, Carnegie Mellon University.
authors.forename: Fernando
authors.initials: F
authors.lastname: De la Torre
authors.affiliation: Robotics Institute, Carnegie Mellon University; University of Pittsburgh, USA.
authors.forename: Jeffrey F
authors.initials: JF
authors.lastname: Cohn
authors.affiliation: University of Miami, USA.
authors.forename: Daniel S
authors.initials: DS
authors.lastname: Messinger