Estimating misclassification error with small samples via bootstrap cross-validation.
BACKGROUND
Estimation of misclassification error has received increasing attention in clinical diagnosis and bioinformatics studies, especially in small sample studies with microarray data. Current error estimation methods are not satisfactory because they either have large variability (such as leave-one-out cross-validation) or large bias (such as resubstitution and leave-one-out bootstrap). While small sample size remains one of the key features of costly clinical investigations or of microarray studies that have limited resources in funding, time and tissue materials, accurate and easy-to-implement error estimation methods for small samples are desirable and will be beneficial.


RESULTS
A bootstrap cross-validation method is studied. It achieves accurate error estimation through a simple procedure with bootstrap resampling and only costs computer CPU time. Simulation studies and applications to microarray data demonstrate that it performs consistently better than its competitors. This method possesses several attractive properties: (1) it is implemented through a simple procedure; (2) it performs well for small samples with sample size, as small as 16; (3) it is not restricted to any particular classification rules and thus applies to many parametric or non-parametric methods.
Fu
Wenjiang J
WJ
Department of Statistics, Texas A & M University, College Station, 77843, USA. wfu@stat.tamu.edu
Carroll
Raymond J
RJ
Wang
Suojin
S
D000465:Algorithms; D014408:Biomarkers, Tumor / Q000235:genetics / Q000378:metabolism*; D001943:Breast Neoplasms / Q000175:diagnosis* / Q000235:genetics / Q000378:metabolism*; D003627:Data Interpretation, Statistical; D020869:Gene Expression Profiling / Q000379:methods*; D020022:Genetic Predisposition to Disease / Q000235:genetics; D005820:Genetic Testing / Q000379:methods*; D006801:Humans; D009363:Neoplasm Proteins / Q000235:genetics / Q000378:metabolism*; D020411:Oligonucleotide Array Sequence Analysis / Q000379:methods*; D011379:Prognosis; D015203:Reproducibility of Results; D018401:Sample Size; D012680:Sensitivity and Specificity
D014408:Biomarkers, Tumor; D009363:Neoplasm Proteins