title: Variable selection for binary classification using error rate p-values applied to metabolomics data.
abstract: BACKGROUND
  Metabolomics datasets are often high-dimensional though only a limited number of variables are expected to be informative given a specific research question. The important task of selecting informative variables can therefore become complex. In this paper we look at discriminating between two groups. Two tasks need to be performed: (i) finding variables which differ between the two groups; and (ii) determining how the selected variables can be used to classify new subjects. We introduce an approach using minimum classification error rates as test statistics to find discriminatory and therefore informative variables. The thresholds resulting in the minimum error rates can be used to classify new subjects. This approach transforms error rates into p-values and is referred to as ERp.
  
  
  RESULTS
  We show that non-parametric hypothesis testing, based on minimum classification error rates as test statistics, can find statistically significantly shifted variables. The discriminatory ability of variables becomes more apparent when error rates are evaluated based on their corresponding p-values, as relatively high error rates can still be statistically significant. ERp can handle unequal and small group sizes, as well as account for the cost of misclassification. ERp retains (if known) or reveals (if unknown) the shift direction, aiding in biological interpretation. The threshold resulting in the minimum error rate can immediately be used to classify new subjects. We use NMR generated metabolomics data to illustrate how ERp is able to discriminate subjects diagnosed with Mycobacterium tuberculosis infected meningitis from a control group. The list of discriminatory variables produced by ERp contains all biologically relevant variables with appropriate shift directions discussed in the original paper from which this data is taken.
  
  
  CONCLUSIONS
  ERp performs variable selection and classification, is non-parametric and aids biological interpretation while handling unequal group sizes and misclassification costs. All this is achieved by a single approach which is easy to perform and interpret. ERp has the potential to address many other characteristics of metabolomics data. Future research aims to extend ERp to account for a large proportion of observations below the detection limit, as well as expand on interactions between variables.
authors.affiliation: Centre for Human Metabolomics, Faculty of Natural Sciences, North-West University (Potchefstroom Campus), Private Bag X6001, Potchefstroom, South Africa. 12791733@nwu.ac.za.|Department of Statistics, Faculty of Natural Sciences, North-West University (Potchefstroom Campus), Private Bag X6001, Potchefstroom, South Africa. 12791733@nwu.ac.za.
authors.forename: Mari
authors.initials: M
authors.lastname: van Reenen
authors.affiliation: Centre for Human Metabolomics, Faculty of Natural Sciences, North-West University (Potchefstroom Campus), Private Bag X6001, Potchefstroom, South Africa. carools.reinecke@nwu.ac.za.
authors.forename: Carolus J
authors.initials: CJ
authors.lastname: Reinecke
authors.affiliation: Biosystems Data Analysis, Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH, Amsterdam, The Netherlands. J.A.Westerhuis@uva.nl.|Centre for Human Metabolomics, Faculty of Natural Sciences, North-West University (Potchefstroom Campus), Private Bag X6001, Potchefstroom, South Africa. J.A.Westerhuis@uva.nl.
authors.forename: Johan A
authors.initials: JA
authors.lastname: Westerhuis
authors.affiliation: Centre for Business Mathematics and Informatics, Faculty of Natural Sciences, North-West University (Potchefstroom Campus), Private Bag X6001, Potchefstroom, South Africa. hennie.venter@nwu.ac.za.
authors.forename: J Hendrik
authors.initials: JH
authors.lastname: Venter
mesh_terms: D019295:Computational Biology / Q000379:methods*; D006801:Humans; D055432:Metabolomics / Q000145:classification / Q000379:methods* / Q000706:statistics & numerical data; D009169:Mycobacterium tuberculosis; D014376:Tuberculosis / Q000378:metabolism