Tailored aggregation for classification.
Compression and variable selection are two classical strategies to deal with large-dimension data sets in classification. We propose an alternative strategy, called aggregation, which consists of a clustering step of redundant variables and a compression step within each group. We develop a statistical framework to define tailored aggregation methods that can be combined with selection methods to build reliable classifiers that benefit from the information contained in redundant variables. Two algorithms are proposed for ordered and nonordered variables, respectively. Applications to the kNN and CART algorithms are presented.
Mary-Huard
Tristan
T
UMR AgroParisTech/INRIA, Paris Cedex 05, France. maryhuar@agroparistech.fr
Robin
Stéphane
S
D000465:Algorithms; D001185:Artificial Intelligence; D016000:Cluster Analysis; D003198:Computer Simulation; D003661:Decision Support Techniques; D008962:Models, Theoretical; D010363:Pattern Recognition, Automated / Q000379:methods*