Emotion recognition using Kinect motion capture data of human gaits.
Automatic emotion recognition is of great value in many applications, however, to fully display the application value of emotion recognition, more portable, non-intrusive, inexpensive technologies need to be developed. Human gaits could reflect the walker's emotional state, and could be an information source for emotion recognition. This paper proposed a novel method to recognize emotional state through human gaits by using Microsoft Kinect, a low-cost, portable, camera-based sensor. Fifty-nine participants' gaits under neutral state, induced anger and induced happiness were recorded by two Kinect cameras, and the original data were processed through joint selection, coordinate system transformation, sliding window gauss filtering, differential operation, and data segmentation. Features of gait patterns were extracted from 3-dimentional coordinates of 14 main body joints by Fourier transformation and Principal Component Analysis (PCA). The classifiers NaiveBayes, RandomForests, LibSVM and SMO (Sequential Minimal Optimization) were trained and evaluated, and the accuracy of recognizing anger and happiness from neutral state achieved 80.5% and 75.4%. Although the results of distinguishing angry and happiness states were not ideal in current study, it showed the feasibility of automatically recognizing emotional states from gaits, with the characteristics meeting the application requirements.
Institute of Psychology, Chinese Academy of Sciences, Beijing, China; The 6th Research Institute of China Electronics Corporation, Beijing, China.
Shun
S
Li
Institute of Psychology, Chinese Academy of Sciences, Beijing, China; The 6th Research Institute of China Electronics Corporation, Beijing, China.
Liqing
L
Cui
School of Computer and Control, University of Chinese Academy of Sciences , Beijing , China.
Changye
C
Zhu
School of Computer and Control, University of Chinese Academy of Sciences , Beijing , China.
Baobin
B
Li
Institute of Psychology, Chinese Academy of Sciences , Beijing , China.
Nan
N
Zhao
Institute of Psychology, Chinese Academy of Sciences , Beijing , China.
Tingshao
T
Zhu
Affective computing; Emotion recognition; Gait; Kinect; Machine learning
World J Biol Psychiatry. 2015;16(8):587-601
26452584
Neural Netw. 2005 May;18(4):389-405
15921887
Cognition. 2001 Dec;82(2):B51-61
11716834
Nat Rev Neurosci. 2003 Mar;4(3):179-92
12612631
Biol Psychiatry. 1998 Dec 15;44(12):1248-63
9861468
Perception. 2004;33(6):717-46
15330366
IEEE Trans Syst Man Cybern B Cybern. 2010 Aug;40(4):1050-61
20350859
Gait Posture. 2014 Sep;40(4):532-8
25047828
Behav Processes. 2002 Nov;60(2):69-83
12426062
J Vis. 2002;2(5):371-87
12678652
Psychol Bull. 1995 Jan;117(1):39-66
7870863
Gait Posture. 2015 Jan;41(1):57-62
25245308
Hum Mov Sci. 2012 Feb;31(1):202-21
21835480
PLoS One. 2014 Jan 27;9(1):e86041
24475068
IEEE Trans Pattern Anal Mach Intell. 2001 Feb;23(2):97-115
25210210
Annu Int Conf IEEE Eng Med Biol Soc. 2011;2011:1831-4
22254685
Gait Posture. 2014 Apr;39(4):1062-8
24560691
Gait Posture. 2013 Sep;38(4):1064-6
23643880
World J Biol Psychiatry. 2013 Feb;14(1):57-70
21936768
PLoS One. 2014 Jan 22;9(1):e84997
24465462
Emotion. 2005 Mar;5(1):113-8
15755224
Gait Posture. 2015 Feb;41(2):722-5
25442670
J Vis. 2009 Jun 26;9(6):15.1-32
19761306