Limited stochastic meta-descent for kernel-based online learning.
To improve the single-run performance of online learning and reinforce its stability, we consider online learning with limited adaptive learning rate in this letter. The letter extends convergence proofs for NORMA to a range of step sizes, then employs support vector learning with stochastic meta-descent (SVMD) limited to that range for step size adaptation, so as to obtain an online kernel algorithm that combines theoretical convergence guarantees with good practical performance. Experiments on different data sets corroborate theoretical results well and show that our method is another promising way for online learning.
He
Wenwu
W
Department of Mathematics and Physics, Fujian University of Technology, Fuzhou, Fujian 350108, China. hwwhbb@163.com
D000465:Algorithms; D003198:Computer Simulation; D003661:Decision Support Techniques; D006801:Humans; D007858:Learning / Q000502:physiology*; D016571:Neural Networks, Computer; D009862:Online Systems; D010363:Pattern Recognition, Automated