Stiefel-manifold learning by improved rigid-body theory applied to ICA.
In previous contributions we presented a new class of algorithms for orthonormal learning of a linear neural network with p inputs and m outputs, based on the equations describing the dynamics of a massive rigid frame in a submanifold of R(p). While exhibiting interesting features, such as intrinsic numerical stability, strongly binding to the orthonormal submanifolds, and good controllability of the learning dynamics, tested on principal/independent component analysis, the proposed algorithms were not completely satisfactory from a computational-complexity point of view. The main drawback was the need to repeatedly evaluate a matrix exponential map. With the aim to lessen the computational efforts pertaining to these algorithms, we propose here an improvement based on the closed-form Rodriguez formula for the exponential map. Such formula is available in the p = 3 and m = 3 case, which is discussed with details here. In particular, experimental results on independent component analysis (ICA), carried out with both synthetic and real-world data, help confirming the computational gain due to the proposed improvement.
Fiori
Simone
S
Faculty of Engineering, University of Perugia, Polo Didattico e Scientifico del Ternano, Loc. Pentima bassa, 21, I-05100 Terni, Italy. fiori@unipg.it
Rossi
Roberto
R
D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D006801:Humans; D007257:Information Theory; D007858:Learning; D016014:Linear Models; D008962:Models, Theoretical; D016571:Neural Networks, Computer; D017711:Nonlinear Dynamics; D012815:Signal Processing, Computer-Assisted; D018531:Spacecraft