title: An Online Continuous Human Action Recognition Algorithm Based on the Kinect Sensor.
abstract: Continuous human action recognition (CHAR) is more practical in human-robot interactions. In this paper, an online CHAR algorithm is proposed based on skeletal data extracted from RGB-D images captured by Kinect sensors. Each human action is modeled by a sequence of key poses and atomic motions in a particular order. In order to extract key poses and atomic motions, feature sequences are divided into pose feature segments and motion feature segments, by use of the online segmentation method based on potential differences of features. Likelihood probabilities that each feature segment can be labeled as the extracted key poses or atomic motions, are computed in the online model matching process. An online classification method with variable-length maximal entropy Markov model (MEMM) is performed based on the likelihood probabilities, for recognizing continuous human actions. The variable-length MEMM method ensures the effectiveness and efficiency of the proposed CHAR method. Compared with the published CHAR methods, the proposed algorithm does not need to detect the start and end points of each human action in advance. The experimental results on public datasets show that the proposed algorithm is effective and highly-efficient for recognizing continuous human actions.
authors.affiliation: School of Software, Xidian University, Xi'an 710071, China. gmzhu@xidian.edu.cn.
authors.forename: Guangming
authors.initials: G
authors.lastname: Zhu
authors.affiliation: School of Software, Xidian University, Xi'an 710071, China. liangzhang@xidian.edu.cn.
authors.forename: Liang
authors.initials: L
authors.lastname: Zhang
authors.affiliation: School of Software, Xidian University, Xi'an 710071, China. pyshen@xidian.edu.cn.
authors.forename: Peiyi
authors.initials: P
authors.lastname: Shen
authors.affiliation: School of Software, Xidian University, Xi'an 710071, China. songjuan@mail.xidian.edu.cn.
authors.forename: Juan
authors.initials: J
authors.lastname: Song
keywords: Kinect; continuous human action recognition; maximum entropy Markov model; online segmentation
references.citation: Sensors (Basel). 2014;14(5):8895-925
references.pmid: 24854209
references.citation: IEEE Trans Cybern. 2013 Oct;43(5):1318-34
references.pmid: 23807480
references.citation: Sensors (Basel). 2015;15(3):5197-227
references.pmid: 25742172
references.citation: IEEE Trans Pattern Anal Mach Intell. 2014 May;36(5):914-27
references.pmid: 26353226
references.citation: IEEE Trans Pattern Anal Mach Intell. 2016 Jan;38(1):14-29
references.pmid: 26656575