title: A Novel Ensemble Method for Imbalanced Data Learning: Bagging of Extrapolation-SMOTE SVM.
abstract: Class imbalance ubiquitously exists in real life, which has attracted much interest from various domains. Direct learning from imbalanced dataset may pose unsatisfying results overfocusing on the accuracy of identification and deriving a suboptimal model. Various methodologies have been developed in tackling this problem including sampling, cost-sensitive, and other hybrid ones. However, the samples near the decision boundary which contain more discriminative information should be valued and the skew of the boundary would be corrected by constructing synthetic samples. Inspired by the truth and sense of geometry, we designed a new synthetic minority oversampling technique to incorporate the borderline information. What is more, ensemble model always tends to capture more complicated and robust decision boundary in practice. Taking these factors into considerations, a novel ensemble method, called Bagging of Extrapolation Borderline-SMOTE SVM (BEBS), has been proposed in dealing with imbalanced data learning (IDL) problems. Experiments on open access datasets showed significant superior performance using our model and a persuasive and intuitive explanation behind the method was illustrated. As far as we know, this is the first model combining ensemble of SVMs with borderline information for solving such condition.
authors.affiliation: Science and Technology on Information Systems Engineering Laboratory, College of Information System and Management, National University of Defense Technology, Changsha, Hunan, China.
authors.forename: Qi
authors.identifier: 0000-0001-6135-6965
authors.initials: Q
authors.lastname: Wang
authors.affiliation: Science and Technology on Information Systems Engineering Laboratory, College of Information System and Management, National University of Defense Technology, Changsha, Hunan, China.
authors.forename: ZhiHao
authors.identifier: 0000-0001-8664-228X
authors.initials: Z
authors.lastname: Luo
authors.affiliation: Science and Technology on Information Systems Engineering Laboratory, College of Information System and Management, National University of Defense Technology, Changsha, Hunan, China.
authors.forename: JinCai
authors.identifier: 0000-0003-4515-1518
authors.initials: J
authors.lastname: Huang
authors.affiliation: Science and Technology on Information Systems Engineering Laboratory, College of Information System and Management, National University of Defense Technology, Changsha, Hunan, China.
authors.forename: YangHe
authors.initials: Y
authors.lastname: Feng
authors.affiliation: Science and Technology on Information Systems Engineering Laboratory, College of Information System and Management, National University of Defense Technology, Changsha, Hunan, China.
authors.forename: Zhong
authors.initials: Z
authors.lastname: Liu
mesh_terms: D000465:Algorithms; D006801:Humans; D000069550:Machine Learning; D008962:Models, Theoretical