On feature extraction via kernels.
Using the kernel trick idea and the kernels-as-features idea, we can construct two kinds of nonlinear feature spaces, where linear feature extraction algorithms can be employed to extract nonlinear features. In this correspondence, we study the relationship between the two kernel ideas applied to certain feature extraction algorithms such as linear discriminant analysis, principal component analysis, and canonical correlation analysis. We provide a rigorous theoretical analysis and show that they are equivalent up to different scalings on each feature. These results provide a better understanding of the kernel method.
Yang
Cheng
C
State Key Laboratory of Machine Perception, Department of Machine Intelligence, School of Electronics Engineering and Computer Sciences, Peking University, Beijing, China. yangch@cis.pku.edu.cn
Wang
Liwei
L
Feng
Jufu
J
D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D016002:Discriminant Analysis; D016247:Information Storage and Retrieval / Q000379:methods*; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D025341:Principal Component Analysis