A Novel Classification Algorithm Based on Incremental Semi-Supervised Support Vector Machine.
For current computational intelligence techniques, a major challenge is how to learn new concepts in changing environment. Traditional learning schemes could not adequately address this problem due to a lack of dynamic data selection mechanism. In this paper, inspired by human learning process, a novel classification algorithm based on incremental semi-supervised support vector machine (SVM) is proposed. Through the analysis of prediction confidence of samples and data distribution in a changing environment, a "soft-start" approach, a data selection mechanism and a data cleaning mechanism are designed, which complete the construction of our incremental semi-supervised learning system. Noticeably, with the ingenious design procedure of our proposed algorithm, the computation complexity is reduced effectively. In addition, for the possible appearance of some new labeled samples in the learning process, a detailed analysis is also carried out. The results show that our algorithm does not rely on the model of sample distribution, has an extremely low rate of introducing wrong semi-labeled samples and can effectively make use of the unlabeled samples to enrich the knowledge system of classifier and improve the accuracy rate. Moreover, our method also has outstanding generalization performance and the ability to overcome the concept drift in a changing environment.
School of Electronic and Information Engineering, Beihang University, Beijing, 100191, China.
Fei
F
Gao
School of Electronic and Information Engineering, Beihang University, Beijing, 100191, China.
Jingyuan
J
Mei
School of Electronic and Information Engineering, Beihang University, Beijing, 100191, China.
Jinping
J
Sun
School of Electronic and Information Engineering, Beihang University, Beijing, 100191, China.
Jun
J
Wang
Space Mechatronic Systems Technology Laboratory, Department of Design, Manufacture and Engineering Management, University of Strathclyde, Glasgow, G1 1XJ, United Kingdom.
Erfu
E
Yang
Cognitive Signal-Image and Control Processing Research Laboratory, School of Natural Sciences, University of Stirling, Stirling, FK9 4LA, United Kingdom.
Amir
A
Hussain
D000465:Algorithms; D008962:Models, Theoretical; D060388:Support Vector Machine