title: Incremental learning methods with retrieving of interfered patterns.
abstract: There are many cases that a neural-network-based system must memorize some new patterns incrementally. However, if the network learns the new patterns only by referring to them, it probably forgets old memorized patterns, since parameters in the network usually correlate not only to the old memories but also to the new patterns. A certain way to avoid the loss of memories is to learn the new patterns with all memorized patterns. It needs, however, a large computational power. To solve this problem, we propose incremental learning methods with retrieving interfered patterns (ILRI). In these methods, the system employs a modified version of a resource allocating network (RAN) which is one variation of a generalized radial basis function (GRBF). In ILRI, the RAN learns new patterns with a relearning of a few number of retrieved past patterns that are interfered with the incremental learning. In this paper, we construct ILRI in two steps. In the first step, we construct a system which searches the interfered patterns from past input patterns stored in a database. In the second step, we improve the first system in such a way that the system does not need the database. In this case, the system regenerates the input patterns approximately in a random manner. The simulation results show that these two systems have almost the same ability, and the generalization ability is higher than other similar systems using neural networks and k-nearest neighbors.
authors.affiliation: Department of Intelligence and Computer Science Nagoya Institute of Technology, Nagoya, 466, Japan.
authors.forename: K
authors.initials: K
authors.lastname: Yamauchi
authors.forename: N
authors.initials: N
authors.lastname: Yamaguchi
authors.forename: N
authors.initials: N
authors.lastname: Ishii