title: Estimating classification probabilities in high-dimensional diagnostic studies.
abstract: BACKGROUND
  Classification algorithms for high-dimensional biological data like gene expression profiles or metabolomic fingerprints are typically evaluated by the number of misclassifications across a test dataset. However, to judge the classification of a single case in the context of clinical diagnosis, we need to assess the uncertainties associated with that individual case rather than the average accuracy across many cases. Reliability of individual classifications can be expressed in terms of class probabilities. While classification algorithms are a well-developed area of research, the estimation of class probabilities is considerably less progressed in biology, with only a few classification algorithms that provide estimated class probabilities.
  
  
  RESULTS
  We compared several probability estimators in the context of classification of metabolomics profiles. Evaluation criteria included sparseness biases, calibration of the estimator, the variance of the estimator and its performance in identifying highly reliable classifications. We observed that several of them display artifacts that compromise their use in practice. Classification probabilities based on a combination of local cross-validation error rates and monotone regression prove superior in metabolomic profiling.
  
  
  BACKGROUND
  The source code written in R is freely available at http://compdiag.uni-regensburg.de/software/probEstimation.shtml.
  
  
  BACKGROUND
  inka.appel@klinik.uni-regensburg.de.
authors.affiliation: Institute of Functional Genomics, University of Regensburg, 93053 Regensburg, Germany. inka.appel@klinik.uni-regensburg.de
authors.forename: Inka J
authors.initials: IJ
authors.lastname: Appel
authors.forename: Wolfram
authors.initials: W
authors.lastname: Gronwald
authors.forename: Rainer
authors.initials: R
authors.lastname: Spang
mesh_terms: D000465:Algorithms; D001499:Bayes Theorem; D006801:Humans; D007674:Kidney Diseases / Q000378:metabolism* / Q000652:urine*; D055442:Metabolome / Q000235:genetics*; D015203:Reproducibility of Results; D014556:Urine / Q000737:chemistry