title: Random forests for feature selection in QSPR Models - an application for predicting standard enthalpy of formation of hydrocarbons.
abstract: BACKGROUND
  One of the main topics in the development of quantitative structure-property relationship (QSPR) predictive models is the identification of the subset of variables that represent the structure of a molecule and which are predictors for a given property. There are several automated feature selection methods, ranging from backward, forward or stepwise procedures, to further elaborated methodologies such as evolutionary programming. The problem lies in selecting the minimum subset of descriptors that can predict a certain property with a good performance, computationally efficient and in a more robust way, since the presence of irrelevant or redundant features can cause poor generalization capacity. In this paper an alternative selection method, based on Random Forests to determine the variable importance is proposed in the context of QSPR regression problems, with an application to a manually curated dataset for predicting standard enthalpy of formation. The subsequent predictive models are trained with support vector machines introducing the variables sequentially from a ranked list based on the variable importance.
  
  
  RESULTS
  The model generalizes well even with a high dimensional dataset and in the presence of highly correlated variables. The feature selection step was shown to yield lower prediction errors with RMSE values 23% lower than without feature selection, albeit using only 6% of the total number of variables (89 from the original 1485). The proposed approach further compared favourably with other feature selection methods and dimension reduction of the feature space. The predictive model was selected using a 10-fold cross validation procedure and, after selection, it was validated with an independent set to assess its performance when applied to new data and the results were similar to the ones obtained for the training set, supporting the robustness of the proposed approach.
  
  
  CONCLUSIONS
  The proposed methodology seemingly improves the prediction performance of standard enthalpy of formation of hydrocarbons using a limited set of molecular descriptors, providing faster and more cost-effective calculation of descriptors by reducing their numbers, and providing a better understanding of the underlying relationship between the molecular structure represented by descriptors and the property of interest.
authors: LaSIGE, Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, 1749-016, Lisboa, Portugal. ateixeira@lasige.di.fc.ul.pt.
authors: Ana L
authors: AL
authors: Teixeira
authors: João P
authors: JP
authors: Leal
authors: Andre O
authors: AO
authors: Falcao
references: J Comput Aided Mol Des. 2005 Jun;19(6):453-63
references: 16231203
references: J Chem Inf Model. 2007 May-Jun;47(3):989-97
references: 17407280
references: J Chem Inf Comput Sci. 2004 Sep-Oct;44(5):1823-8
references: 15446842
references: Curr Top Med Chem. 2002 Dec;2(12):1333-56
references: 12470284
references: SAR QSAR Environ Res. 2009;20(3-4):241-66
references: 19544191
references: NeuroRx. 2005 Jan;2(1):3-14
references: 15717053
references: J Chem Inf Comput Sci. 2001 Sep-Oct;41(5):1218-27
references: 11604021
references: Curr Top Med Chem. 2008;8(18):1606-27
references: 19075770
references: J Chem Inf Model. 2006 Nov-Dec;46(6):2230-55
references: 17125167
references: IEEE Trans Neural Syst Rehabil Eng. 2003 Jun;11(2):141-4
references: 12899257
references: J Comput Aided Mol Des. 2004 Jul-Sep;18(7-9):483-93
references: 15729848
references: Comb Chem High Throughput Screen. 2006 Mar;9(3):213-28
references: 16533155
references: BMC Bioinformatics. 2008 Jul 11;9:307
references: 18620558
references: BMC Bioinformatics. 2008 Jul 22;9:319
references: 18647401
references: BMC Pharmacol. 2010 Jun 07;10:6
references: 20529254
references: Int J Mol Sci. 2009 Apr 29;10(5):1978-98
references: 19564933
references: Mol Inform. 2010 Jul 12;29(6-7):476-88
references: 27463326
references: J Chem Inf Comput Sci. 2002 Nov-Dec;42(6):1460-70
references: 12444744
references: J Chem Inf Comput Sci. 2000 Jan;40(1):1-18
references: 10661545
references: BMC Bioinformatics. 2006 Jan 06;7:3
references: 16398926
references: J Cheminform. 2011 Oct 07;3:33
references: 21982300
references: Curr Pharm Des. 2007;13(34):3494-504
references: 18220786
references: J Chem Inf Comput Sci. 2002 Jul-Aug;42(4):927-36
references: 12132894
references: Comput Chem. 2001 Sep;25(5):475-82
references: 11513237