title: Generalized locality preserving Maxi-Min Margin Machine.
abstract: Research on large margin classifiers from the "local" and "global" view has become an active topic in machine learning and pattern recognition. Inspired from the typical local and global learning machine Maxi-Min Margin Machine (M⁴) and the idea of the Locality Preserving Projections (LPP), we propose a novel large margin classifier, the Generalized Locality Preserving Maxi-Min Margin Machine (GLPM), where the within-class matrices are constructed using the labeled training points in a supervised way, and then used to build the classifier. The within-class matrices of GLPM preserve the intra-class manifold in the training sets, as well as the covariance matrices which indicate the global projection direction in the M⁴ model. Moreover, the connections among GLPM, M⁴ and LFDA are theoretically analyzed, and we show that GLPM can be considered as a generalized M⁴ machine. The GLPM is also more robust since it requires no assumption on data distribution while Gaussian data distribution is assumed in the M⁴ machine. Experiments on data sets from the machine learning repository demonstrate its advantage over M⁴ in both local and global learning performance.
authors.affiliation: School of Digital Media, Jiangnan University, Wuxi 214122, PR China. cimszhang@163.com
authors.forename: Zhancheng
authors.initials: Z
authors.lastname: Zhang
authors.forename: Kup-Sze
authors.initials: KS
authors.lastname: Choi
authors.forename: Xiaoqing
authors.initials: X
authors.lastname: Luo
authors.forename: Shitong
authors.initials: S
authors.lastname: Wang
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D016002:Discriminant Analysis; D004194:Disease / Q000145:classification; D006801:Humans; D008962:Models, Theoretical; D016571:Neural Networks, Computer; D017711:Nonlinear Dynamics; D016011:Normal Distribution; D010363:Pattern Recognition, Automated; D060388:Support Vector Machine