Decision forest: combining the predictions of multiple independent decision tree models.
The techniques of combining the results of multiple classification models to produce a single prediction have been investigated for many years. In earlier applications, the multiple models to be combined were developed by altering the training set. The use of these so-called resampling techniques, however, poses the risk of reducing predictivity of the individual models to be combined and/or over fitting the noise in the data, which might result in poorer prediction of the composite model than the individual models. In this paper, we suggest a novel approach, named Decision Forest, that combines multiple Decision Tree models. Each Decision Tree model is developed using a unique set of descriptors. When models of similar predictive quality are combined using the Decision Forest method, quality compared to the individual models is consistently and significantly improved in both training and testing steps. An example will be presented for prediction of binding affinity of 232 chemicals to the estrogen receptor.
Tong
Weida
W
Center for Toxicoinformatics, Division of Biometry and Risk Assessment, National Center for Toxicological Research, Jefferson, Arkansas 72079, USA. wtong@nctr.fda.gov
Hong
Huixiao
H
Fang
Hong
H
Xie
Qian
Q
Perkins
Roger
R
D000465:Algorithms; D000818:Animals; D016208:Databases, Factual; D003663:Decision Trees; D005544:Forecasting; D006801:Humans; D008956:Models, Chemical; D011485:Protein Binding; D011960:Receptors, Estrogen / Q000378:metabolism; D013329:Structure-Activity Relationship
D011960:Receptors, Estrogen