Efficiently updating and tracking the dominant kernel principal components.
The dominant set of eigenvectors of the symmetrical kernel Gram matrix is used in many important kernel methods (like e.g. kernel Principal Component Analysis, feature approximation, denoising, compression, prediction) in the machine learning area. Yet in the case of dynamic and/or large-scale data, the batch calculation nature and computational demands of the eigenvector decomposition limit these methods in numerous applications. In this paper we present an efficient incremental approach for fast calculation of the dominant kernel eigenbasis, which allows us to track the kernel eigenspace dynamically. Experiments show that our updating scheme delivers a numerically stable and accurate approximation for eigenvalues and eigenvectors at every iteration in comparison to the batch algorithm.
Hoegaerts
L
L
Katholieke Universiteit Leuven, Department of Electrical Engineering, ESAT-SCD-SISTA, Kasteelpark Arenberg 10, B-3001 Leuven (Heverlee), Belgium. Luc.Hoegaerts@gmail.com
De Lathauwer
L
L
Goethals
I
I
Suykens
J A K
JA
Vandewalle
J
J
De Moor
B
B
D000465:Algorithms; D001185:Artificial Intelligence; D006801:Humans; D016247:Information Storage and Retrieval; D039703:Logical Observation Identifiers Names and Codes; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated; D025341:Principal Component Analysis