title: Combined hand gesture--speech model for human action recognition.
abstract: This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions.
authors.forename: Sheng-Tzong
authors.initials: ST
authors.lastname: Cheng
authors.affiliation: Department of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, Taiwan. awei@ieee.org.
authors.forename: Chih-Wei
authors.initials: CW
authors.lastname: Hsu
authors.forename: Jian-Pan
authors.initials: JP
authors.lastname: Li
mesh_terms: D005868:Gestures; D006225:Hand; D006801:Humans; D008962:Models, Theoretical; D013060:Speech / Q000502:physiology*