title: Enriching for correct prediction of biological processes using a combination of diverse classifiers.
abstract: BACKGROUND
  Machine learning models (classifiers) for classifying genes to biological processes each have their own unique characteristics in what genes can be classified and to what biological processes. No single learning model is qualitatively superior to any other model and overall precision for each model tends to be low. The classification results for each classifier can be complementary and synergistic suggesting the benefit of a combination of algorithms, but often the prediction probability outputs of various learning models are neither comparable nor compatible for combining. A means to compare outputs regardless of the model and data used and combine the results into an improved comprehensive model is needed.
  
  
  RESULTS
  Gene expression patterns from NCI's panel of 60 cell lines were used to train a Random Forest, a Support Vector Machine and a Neural Network model, plus two over-sampled models for classifying genes to biological processes. Each model produced unique characteristics in the classification results. We introduce the Precision Index measure (PIN) from the maximum posterior probability that allows assessing, comparing and combining multiple classifiers. The class specific precision measure (PIC) is introduced and used to select a subset of predictions across all classes and all classifiers with high precision. We developed a single classifier that combines the PINs from these five models in prediction and found that the PIN Combined Classifier (PINCom) significantly increased the number of correctly predicted genes over any single classifier. The PINCom applied to test genes that were not used in training also showed substantial improvement over any single model.
  
  
  CONCLUSIONS
  This paper introduces novel and effective ways of assessing predictions by their precision and recall plus a method that combines several machine learning models and capitalizes on synergy and complementation in class selection, resulting in higher precision and recall. Different machine learning models yielded incongruent results each of which were successfully combined into one superior model using the PIN measure we developed. Validation of the boosted predictions for gene functions showed the genes to be accurately predicted.
authors: Department of Medicinal Chemistry, School of Pharmacy, Virginia Commonwealth University, Richmond, VA, USA.
authors: Daijin
authors: D
authors: Ko
authors: Brad
authors: B
authors: Windle
references: Nat Genet. 2000 Mar;24(3):227-35
references: 10700174
references: Comput Biol Chem. 2005 Dec;29(6):412-9
references: 16290039
references: Neural Comput. 2001 Sep;13(9):2119-47
references: 11516360
references: Genome Res. 2002 Nov;12(11):1703-15
references: 12421757
references: Nucleic Acids Res. 2007 Jul;35(Web Server issue):W169-75
references: 17576678
references: J Biol. 2004;3(5):21
references: 15588312
references: IEEE Trans Neural Netw. 2002;13(2):415-25
references: 18244442
references: Science. 1999 Jan 1;283(5398):83-7
references: 9872747
references: Proc Natl Acad Sci U S A. 1998 Dec 8;95(25):14863-8
references: 9843981
references: Proc Natl Acad Sci U S A. 2000 Jan 4;97(1):262-7
references: 10618406
references: Genome Biol. 2008;9 Suppl 1:S3
references: 18613947
references: IEEE Trans Neural Netw. 1999;10(5):988-99
references: 18252602
references: Cell Mol Life Sci. 2002 Apr;59(4):627-47
references: 12022471
references: BMC Bioinformatics. 2007 Sep 21;8:358
references: 17888165
references: Genome Res. 2003 May;13(5):965-79
references: 12695321