title: Semistability of steepest descent with momentum for quadratic functions.
abstract: Two steepest-descent algorithms with momentum for quadratic functions are considered. For a given learning rate, the sufficient and necessary conditions for the semistability of the steepest-descent algorithms with momentum are established. Moreover, the optimal momentum factors that generally make for the fastest convergence are obtained.
authors.affiliation: School of Mathematics and Information Science, Wenzhou University, Wenzhou, 325035, PR China. naiminzhang@yahoo.com.cn
authors.forename: Naimin
authors.initials: N
authors.lastname: Zhang
mesh_terms: D000465:Algorithms; D016571:Neural Networks, Computer