How large a training set is needed to develop a classifier for microarray data?
OBJECTIVE
A common goal of gene expression microarray studies is the development of a classifier that can be used to divide patients into groups with different prognoses, or with different expected responses to a therapy. These types of classifiers are developed on a training set, which is the set of samples used to train a classifier. The question of how many samples are needed in the training set to produce a good classifier from high-dimensional microarray data is challenging.


METHODS
We present a model-based approach to determining the sample size required to adequately train a classifier.


RESULTS
It is shown that sample size can be determined from three quantities: standardized fold change, class prevalence, and number of genes or features on the arrays. Numerous examples and important experimental design issues are discussed. The method is adapted to address ex post facto determination of whether the size of a training set used to develop a classifier was adequate. An interactive web site for performing the sample size calculations is provided.


CONCLUSIONS
We showed that sample size calculations for classifier development from high-dimensional microarray data are feasible, discussed numerous important considerations, and presented examples.
Dobbin
Kevin K
KK
Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, NIH, Rockville, Maryland 20852, USA. dobbinke@mail.nih.gov
Zhao
Yingdong
Y
Simon
Richard M
RM
D020869:Gene Expression Profiling; D006801:Humans; D008962:Models, Theoretical; D020411:Oligonucleotide Array Sequence Analysis; D012107:Research Design; D018401:Sample Size