Incremental linear discriminant analysis for classification of data streams.
This paper presents a constructive method for deriving an updated discriminant eigenspace for classification when bursts of data that contains new classes is being added to an initial discriminant eigenspace in the form of random chunks. Basically, we propose an incremental linear discriminant analysis (ILDA) in its two forms: a sequential ILDA and a Chunk ILDA. In experiments, we have tested ILDA using datasets with a small number of classes and small-dimensional features, as well as datasets with a large number of classes and large-dimensional features. We have compared the proposed ILDA against the traditional batch LDA in terms of discriminability, execution time and memory usage with the increasing volume of data addition. The results show that the proposed ILDA can effectively evolve a discriminant eigenspace over a fast and large data stream, and extract features with superior discriminability in classification, when compared with other methods.
Pang
Shaoning
S
Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, New Zealand. spang@aut.ac.nz
Ozawa
Seiichi
S
Kasabov
Nikola
N
D000465:Algorithms; D001185:Artificial Intelligence; D016000:Cluster Analysis; D003198:Computer Simulation; D016002:Discriminant Analysis; D007089:Image Enhancement / Q000379:methods; D016247:Information Storage and Retrieval / Q000379:methods*; D016014:Linear Models; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D012815:Signal Processing, Computer-Assisted