title: A multi-modal face recognition method using complete local derivative patterns and depth maps.
abstract: In this paper, we propose a multi-modal 2D + 3D face recognition method for a smart city application based on a Wireless Sensor Network (WSN) and various kinds of sensors. Depth maps are exploited for the 3D face representation. As for feature extraction, we propose a new feature called Complete Local Derivative Pattern (CLDP). It adopts the idea of layering and has four layers. In the whole system, we apply CLDP separately on Gabor features extracted from a 2D image and depth map. Then, we obtain two features: CLDP-Gabor and CLDP-Depth. The two features weighted by the corresponding coefficients are combined together in the decision level to compute the total classification distance. At last, the probe face is assigned the identity with the smallest classification distance. Extensive experiments are conducted on three different databases. The results demonstrate the robustness and superiority of the new approach. The experimental results also prove that the proposed multi-modal 2D + 3D method is superior to other multi-modal ones and CLDP performs better than other Local Binary Pattern (LBP) based features.
authors.affiliation: Institute of Microelectronics, Tsinghua University, Beijing 100084, China. yinsy@tsinghua.edu.cn.
authors.forename: Shouyi
authors.initials: S
authors.lastname: Yin
authors.affiliation: Institute of Microelectronics, Tsinghua University, Beijing 100084, China. daixu@gmail.com.
authors.forename: Xu
authors.initials: X
authors.lastname: Dai
authors.affiliation: Institute of Microelectronics, Tsinghua University, Beijing 100084, China. oyangpeng12@163.com.
authors.forename: Peng
authors.initials: P
authors.lastname: Ouyang
authors.affiliation: Institute of Microelectronics, Tsinghua University, Beijing 100084, China. liulb@tsinghua.edu.cn.
authors.forename: Leibo
authors.initials: L
authors.lastname: Liu
authors.affiliation: Institute of Microelectronics, Tsinghua University, Beijing 100084, China. wsj@tsinghua.edu.cn.
authors.forename: Shaojun
authors.initials: S
authors.lastname: Wei
mesh_terms: D000465:Algorithms; D001699:Biometry; D016208:Databases, Factual; D005145:Face; D006801:Humans; D007090:Image Interpretation, Computer-Assisted; D010363:Pattern Recognition, Automated