Dataset complexity in gene expression based cancer classification using ensembles of k-nearest neighbors.
OBJECTIVE
We explore the link between dataset complexity, determining how difficult a dataset is for classification, and classification performance defined by low-variance and low-biased bolstered resubstitution error made by k-nearest neighbor classifiers.


METHODS
Gene expression based cancer classification is used as the task in this study. Six gene expression datasets containing different types of cancer constitute test data.


RESULTS
Through extensive simulation coupled with the copula method for analysis of association in bivariate data, we show that dataset complexity and bolstered resubstitution error are associated in terms of dependence. As a result, we propose a new scheme for generating ensembles of classifiers that selects subsets of features of low complexity for ensemble members, which constitutes the accurate members according to the found dependence relation.


CONCLUSIONS
Experiments with six gene expression datasets demonstrate that our ensemble generating scheme based on the dependence of dataset complexity and classification error is superior to a single best classifier in the ensemble and to the traditional ensemble construction scheme that is ignorant of dataset complexity.
Okun
Oleg
O
University of Oulu, Department of Electrical and Information Engineering, P.O. Box 4500, Oulu 90014, Finland. oleg@ee.oulu.fi
Priisalu
Helen
H
D015870:Gene Expression; D006801:Humans; D009369:Neoplasms / Q000145:classification* / Q000235:genetics