A Novel Graph Constructor for Semisupervised Discriminant Analysis: Combined Low-Rank andk-Nearest Neighbor Graph.
Semisupervised Discriminant Analysis (SDA) is a semisupervised dimensionality reduction algorithm, which can easily resolve the out-of-sample problem. Relative works usually focus on the geometric relationships of data points, which are not obvious, to enhance the performance of SDA. Different from these relative works, the regularized graph construction is researched here, which is important in the graph-based semisupervised learning methods. In this paper, we propose a novel graph for Semisupervised Discriminant Analysis, which is called combined low-rank andk-nearest neighbor (LRKNN) graph. In our LRKNN graph, we map the data to the LR feature space and then thekNN is adopted to satisfy the algorithmic requirements of SDA. Since the low-rank representation can capture the global structure and thek-nearest neighbor algorithm can maximally preserve the local geometrical structure of the data, the LRKNN graph can significantly improve the performance of SDA. Extensive experiments on several real-world databases show that the proposed LRKNN graph is an efficient graph constructor, which can largely outperform other commonly used baselines.
School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, China; Key Lab of Big Data Computation of Hebei Province, Tianjin 300401, China; Computer Science Department, Worcester Polytechnic Institute, Worcester, MA 01609, USA.
Baokai
0000-0001-7070-831X
B
Zu
School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, China; Key Lab of Big Data Computation of Hebei Province, Tianjin 300401, China.
Kewen
0000-0003-3968-481X
K
Xia
School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, China; Key Lab of Big Data Computation of Hebei Province, Tianjin 300401, China.
Yongke
Y
Pan
School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, China; Key Lab of Big Data Computation of Hebei Province, Tianjin 300401, China.
Wenjia
W
Niu
D000465:Algorithms; D002965:Classification; D016208:Databases, Factual; D016002:Discriminant Analysis; D005145:Face / Q000033:anatomy & histology; D006801:Humans; D010363:Pattern Recognition, Automated / Q000379:methods*; D000069553:Supervised Machine Learning