title: Extreme Gradient Boosting as a Method for Quantitative Structure-Activity Relationships.
abstract: In the pharmaceutical industry it is common to generate many QSAR models from training sets containing a large number of molecules and a large number of descriptors. The best QSAR methods are those that can generate the most accurate predictions but that are not overly expensive computationally. In this paper we compare eXtreme Gradient Boosting (XGBoost) to random forest and single-task deep neural nets on 30 in-house data sets. While XGBoost has many adjustable parameters, we can define a set of standard parameters at which XGBoost makes predictions, on the average, better than those of random forest and almost as good as those of deep neural nets. The biggest strength of XGBoost is its speed. Whereas efficient use of random forest requires generating each tree in parallel on a cluster, and deep neural nets are usually run on GPUs, XGBoost can be run on a single CPU in less than a third of the wall-clock time of either of the other methods.
authors.affiliation: Modeling and Informatics Department, Merck & Co. Inc. , 126 E. Lincoln Ave., Rahway, New Jersey 07065, United States.
authors.forename: Robert P
authors.identifier: 0000-0002-6549-1635
authors.initials: RP
authors.lastname: Sheridan
authors.affiliation: Data Science Department, MSD International GmbH (Singapore Branch) , 1 Fusionopolis Place, #06-10/07-18, Galaxis, Singapore 138522.
authors.forename: Wei Min
authors.initials: WM
authors.lastname: Wang
authors.affiliation: Biometrics Research Department, Merck & Co. Inc. , 126 E. Lincoln Ave., Rahway, New Jersey 07065, United States.
authors.forename: Andy
authors.initials: A
authors.lastname: Liaw
authors.affiliation: Biometrics Research Department, Merck & Co. Inc. , 126 E. Lincoln Ave., Rahway, New Jersey 07065, United States.
authors.forename: Junshui
authors.initials: J
authors.lastname: Ma
authors.affiliation: Bioinformatics Department, MSD International GmbH (Singapore Branch) , 1 Fusionopolis Place, #06-10/07-18, Galaxis, Singapore 138522.
authors.forename: Eric M
authors.initials: EM
authors.lastname: Gifford
mesh_terms: D000465:Algorithms; D062313:Databases, Pharmaceutical; D055808:Drug Discovery; D006801:Humans; D008954:Models, Biological; D021281:Quantitative Structure-Activity Relationship; D012984:Software