title: IntraFace.
abstract: Within the last 20 years, there has been an increasing interest in the computer vision community in automated facial image analysis algorithms. This has been driven by applications in animation, market research, autonomous-driving, surveillance, and facial editing among others. To date, there exist several commercial packages for specific facial image analysis tasks such as facial expression recognition, facial attribute analysis or face tracking. However, free and easy-to-use software that incorporates all these functionalities is unavailable. This paper presents IntraFace (IF), a publicly-available software package for automated facial feature tracking, head pose estimation, facial attribute recognition, and facial expression analysis from video. In addition, IFincludes a newly develop technique for unsupervised synchrony detection to discover correlated facial behavior between two or more persons, a relatively unexplored problem in facial image analysis. In tests, IF achieved state-of-the-art results for emotion expression and action unit detection in three databases, FERA, CK+ and RU-FACS; measured audience reaction to a talk given by one of the authors; and discovered synchrony for smiling in videos of parent-infant interaction. IF is free of charge for academic use at http://www.humansensing.cs.cmu.edu/intraface/.
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
authors.forename: Fernando
authors.initials: F
authors.lastname: De la Torre
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
authors.forename: Wen-Sheng
authors.initials: WS
authors.lastname: Chu
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
authors.forename: Xuehan
authors.initials: X
authors.lastname: Xiong
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
authors.forename: Francisco
authors.initials: F
authors.lastname: Vicente
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
authors.forename: Xiaoyu
authors.initials: X
authors.lastname: Ding
authors.affiliation: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213; Department of Psychology, University of Pittsburgh, Pittsburgh, PA 15260.
authors.forename: Jeffrey
authors.initials: J
authors.lastname: Cohn