title: A general soft label based linear discriminant analysis for semi-supervised dimensionality reduction.
abstract: Dealing with high-dimensional data has always been a major problem in research of pattern recognition and machine learning, and Linear Discriminant Analysis (LDA) is one of the most popular methods for dimension reduction. However, it only uses labeled samples while neglecting unlabeled samples, which are abundant and can be easily obtained in the real world. In this paper, we propose a new dimension reduction method, called "SL-LDA", by using unlabeled samples to enhance the performance of LDA. The new method first propagates label information from the labeled set to the unlabeled set via a label propagation process, where the predicted labels of unlabeled samples, called "soft labels", can be obtained. It then incorporates the soft labels into the construction of scatter matrixes to find a transformed matrix for dimension reduction. In this way, the proposed method can preserve more discriminative information, which is preferable when solving the classification problem. We further propose an efficient approach for solving SL-LDA under a least squares framework, and a flexible method of SL-LDA (FSL-LDA) to better cope with datasets sampled from a nonlinear manifold. Extensive simulations are carried out on several datasets, and the results show the effectiveness of the proposed method.
authors.affiliation: Department of Electronic Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong Special Administrative Region. Electronic address: mbzhao4@gmail.com.
authors.forename: Mingbo
authors.initials: M
authors.lastname: Zhao
authors.affiliation: School of Compute Science and Technology, Soochow University, Suzhou 215006, China. Electronic address: cszzhang@gmail.com.
authors.forename: Zhao
authors.initials: Z
authors.lastname: Zhang
authors.affiliation: Department of Electronic Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong Special Administrative Region. Electronic address: eetchow@cityu.edu.hk.
authors.forename: Tommy W S
authors.initials: TW
authors.lastname: Chow
authors.affiliation: School of Economics, Wuhan University of Technology, Wuhan 430070, China. Electronic address: lib675@163.com.
authors.forename: Bing
authors.initials: B
authors.lastname: Li
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D056667:Biometric Identification / Q000379:methods; D016002:Discriminant Analysis; D006801:Humans; D016018:Least-Squares Analysis; D016014:Linear Models; D017711:Nonlinear Dynamics; D010363:Pattern Recognition, Automated / Q000379:methods
keywords: Label propagation; Linear Discriminant Analysis; Semi-supervised dimension reduction; Soft label