title: Face localization and authentication using color and depth images.
abstract: This paper presents a complete face authentication system integrating both two-dimensional (color or intensity) and three-dimensional (3-D) range data, based on a low-cost 3-D sensor, capable of real-time acquisition of 3-D and color images. Novel algorithms are proposed that exploit depth information to achieve robust face detection and localization under conditions of background clutter, occlusion, face pose alteration, and harsh illumination. The well-known embedded hidden Markov model technique for face authentication is applied to depth maps and color images. To cope with pose and illumination variations, the enrichment of face databases with synthetically generated views is proposed. The performance of the proposed authentication scheme is tested thoroughly on two distinct face databases of significant size. Experimental results demonstrate significant gains resulting from the combined use of depth and color or intensity information.
authors.affiliation: Electrical and Computer Engineering Department, Aristotle University of Thessaloniki, Thessaloniki, Greece. filareti@iti.gr
authors.forename: Filareti
authors.initials: F
authors.lastname: Tsalakanidou
authors.forename: Sotiris
authors.initials: S
authors.lastname: Malassiotis
authors.forename: Michael G
authors.initials: MG
authors.lastname: Strintzis
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D016000:Cluster Analysis; D003116:Color; D005145:Face / Q000033:anatomy & histology*; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods; D009716:Numerical Analysis, Computer-Assisted; D010355:Patient Identification Systems / Q000379:methods; D010363:Pattern Recognition, Automated / Q000379:methods*; D010780:Photogrammetry / Q000379:methods*; D015203:Reproducibility of Results; D012637:Security Measures; D012680:Sensitivity and Specificity; D012815:Signal Processing, Computer-Assisted; D013382:Subtraction Technique