title: Ranking Support Vector Machine with Kernel Approximation.
abstract: Learning to rank algorithm has become important in recent years due to its successful application in information retrieval, recommender system, and computational biology, and so forth. Ranking support vector machine (RankSVM) is one of the state-of-art ranking models and has been favorably used. Nonlinear RankSVM (RankSVM with nonlinear kernels) can give higher accuracy than linear RankSVM (RankSVM with a linear kernel) for complex nonlinear ranking problem. However, the learning methods for nonlinear RankSVM are still time-consuming because of the calculation of kernel matrix. In this paper, we propose a fast ranking algorithm based on kernel approximation to avoid computing the kernel matrix. We explore two types of kernel approximation methods, namely, the Nyström method and random Fourier features. Primal truncated Newton method is used to optimize the pairwise L2-loss (squared Hinge-loss) objective function of the ranking model after the nonlinear kernel approximation. Experimental results demonstrate that our proposed method gets a much faster training speed than kernel RankSVM and achieves comparable or better performance over state-of-the-art ranking algorithms.
authors.affiliation: National Laboratory for Parallel and Distributed Processing, National University of Defense Technology, Changsha, China.
authors.forename: Kai
authors.identifier: 0000-0003-4160-1024
authors.initials: K
authors.lastname: Chen
authors.affiliation: National Laboratory for Parallel and Distributed Processing, National University of Defense Technology, Changsha, China.
authors.forename: Rongchun
authors.identifier: 0000-0001-5922-7961
authors.initials: R
authors.lastname: Li
authors.affiliation: National Laboratory for Parallel and Distributed Processing, National University of Defense Technology, Changsha, China.
authors.forename: Yong
authors.initials: Y
authors.lastname: Dou
authors.affiliation: College of Computer, National University of Defense Technology, Changsha, China.
authors.forename: Zhengfa
authors.identifier: 0000-0001-7514-4250
authors.initials: Z
authors.lastname: Liang
authors.affiliation: National Laboratory for Parallel and Distributed Processing, National University of Defense Technology, Changsha, China.
authors.forename: Qi
authors.identifier: 0000-0003-4115-720X
authors.initials: Q
authors.lastname: Lv
mesh_terms: D001185:Artificial Intelligence; D019295:Computational Biology / Q000379:methods; D008962:Models, Theoretical; D060388:Support Vector Machine