How to do an evaluation: pitfalls and traps.
The recent literature is replete with papers evaluating computational tools (often those operating on 3D structures) for their performance in a certain set of tasks. Most commonly these papers compare a number of docking tools for their performance in cognate re-docking (pose prediction) and/or virtual screening. Related papers have been published on ligand-based tools: pose prediction by conformer generators and virtual screening using a variety of ligand-based approaches. The reliability of these comparisons is critically affected by a number of factors usually ignored by the authors, including bias in the datasets used in virtual screening, the metrics used to assess performance in virtual screening and pose prediction and errors in crystal structures used.
Hawkins
Paul C D
PC
OpenEye Scientific Software, 9, Bisbee Court, Suite D, Santa Fe, NM 87508, USA. phawkins@eyesopen.com
Warren
Gregory L
GL
Skillman
A Geoffrey
AG
Nicholls
Anthony
A
D003198:Computer Simulation; D017076:Computer-Aided Design; D005069:Evaluation Studies as Topic; D008958:Models, Molecular; D012984:Software