title: A study on the optimal double parameters for steepest descent with momentum.
abstract: This letter presents the stability analysis for two steepest descent algorithms with momentum for quadratic functions. The corresponding local optimal parameters in Torii and Hagan ( 2002 ) and Zhang ( 2013 ) are extended to the global optimal parameters, that is, both the optimal learning rates and the optimal momentum factors are obtained simultaneously which make for the fastest convergence.
authors.affiliation: School of Mathematics and Information Science, Wenzhou University, Wenzhou, 325035, P.R.C. nmzhang@wzu.edu.cn.
authors.forename: Naimin
authors.initials: N
authors.lastname: Zhang