title: Human-computer interaction based on hand gestures using RGB-D sensors.
abstract: In this paper we present a new method for hand gesture recognition based on an RGB-D sensor. The proposed approach takes advantage of depth information to cope with the most common problems of traditional video-based hand segmentation methods: cluttered backgrounds and occlusions. The algorithm also uses colour and semantic information to accurately identify any number of hands present in the image. Ten different static hand gestures are recognised, including all different combinations of spread fingers. Additionally, movements of an open hand are followed and 6 dynamic gestures are identified. The main advantage of our approach is the freedom of the user's hands to be at any position of the image without the need of wearing any specific clothing or additional devices. Besides, the whole method can be executed without any initial training or calibration. Experiments carried out with different users and in different environments prove the accuracy and robustness of the method which, additionally, can be run in real-time.
authors.affiliation: Departamento de Informática e Ingeniería de Sistemas (DIIS) and Instituto de Investigación en Ingeniería de Aragón (I3A), Universidad de Zaragoza, Zaragoza 50018, Spain. jmpala@unizar.es
authors.forename: José Manuel
authors.initials: JM
authors.lastname: Palacios
authors.forename: Carlos
authors.initials: C
authors.lastname: Sagüés
authors.forename: Eduardo
authors.initials: E
authors.lastname: Montijano
authors.forename: Sergio
authors.initials: S
authors.lastname: Llorente
mesh_terms: D000465:Algorithms; D003124:Colorimetry / Q000295:instrumentation* / Q000379:methods; D004867:Equipment Design; D019544:Equipment Failure Analysis; D005868:Gestures; D006225:Hand / Q000033:anatomy & histology / Q000502:physiology*; D006801:Humans; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014159:Transducers; D014584:User-Computer Interface
references.citation: Sensors (Basel). 2013 Feb 11;13(2):2384-98
references.pmid: 23435053
references.citation: Sensors (Basel). 2012;12(5):5775-90
references.pmid: 22778612
references.citation: Sensors (Basel). 2012;12(5):6695-711
references.pmid: 22778665
references.citation: Sensors (Basel). 2013 May 14;13(5):6380-93
references.pmid: 23673678
references.citation: Res Dev Disabil. 2011 Nov-Dec;32(6):2566-70
references.pmid: 21784612
references.citation: Sensors (Basel). 2010;10(2):1119-40
references.pmid: 22205860