title: A Self-Organizing Incremental Neural Network based on local distribution learning.
abstract: In this paper, we propose an unsupervised incremental learning neural network based on local distribution learning, which is called Local Distribution Self-Organizing Incremental Neural Network (LD-SOINN). The LD-SOINN combines the advantages of incremental learning and matrix learning. It can automatically discover suitable nodes to fit the learning data in an incremental way without a priori knowledge such as the structure of the network. The nodes of the network store rich local information regarding the learning data. The adaptive vigilance parameter guarantees that LD-SOINN is able to add new nodes for new knowledge automatically and the number of nodes will not grow unlimitedly. While the learning process continues, nodes that are close to each other and have similar principal components are merged to obtain a concise local representation, which we call a relaxation data representation. A denoising process based on density is designed to reduce the influence of noise. Experiments show that the LD-SOINN performs well on both artificial and real-word data.
authors.affiliation: The National Key Laboratory for Novel Software Technology, Nanjing University, China; School of Computer Science and Technology, Anhui University, Hefei, 230601, China. Electronic address: youluxing@sina.com.
authors.forename: Youlu
authors.initials: Y
authors.lastname: Xing
authors.affiliation: The National Key Laboratory for Novel Software Technology, Nanjing University, China. Electronic address: cell000feng@gmail.com.
authors.forename: Xiaofeng
authors.initials: X
authors.lastname: Shi
authors.affiliation: The National Key Laboratory for Novel Software Technology, Nanjing University, China. Electronic address: frshen@nju.edu.cn.
authors.forename: Furao
authors.initials: F
authors.lastname: Shen
authors.affiliation: School of Statistics at University of International Business and Economics, Beijing, China. Electronic address: 02417@uibe.edu.cn.
authors.forename: Ke
authors.initials: K
authors.lastname: Zhou
authors.affiliation: The National Key Laboratory for Novel Software Technology, Nanjing University, China. Electronic address: jxzhao@nju.edu.cn.
authors.forename: Jinxi
authors.initials: J
authors.lastname: Zhao
mesh_terms: D000465:Algorithms; D006801:Humans; D019359:Knowledge; D007858:Learning; D000069550:Machine Learning; D016571:Neural Networks, Computer
keywords: Incremental learning; Matrix learning; Relaxation data representation; Self-Organizing Incremental Neural Network (SOINN)