Systematic error detection in experimental high-throughput screening.
BACKGROUND
High-throughput screening (HTS) is a key part of the drug discovery process during which thousands of chemical compounds are screened and their activity levels measured in order to identify potential drug candidates (i.e., hits). Many technical, procedural or environmental factors can cause systematic measurement error or inequalities in the conditions in which the measurements are taken. Such systematic error has the potential to critically affect the hit selection process. Several error correction methods and software have been developed to address this issue in the context of experimental HTS 1234567. Despite their power to reduce the impact of systematic error when applied to error perturbed datasets, those methods also have one disadvantage - they introduce a bias when applied to data not containing any systematic error 6. Hence, we need first to assess the presence of systematic error in a given HTS assay and then carry out systematic error correction method if and only if the presence of systematic error has been confirmed by statistical tests.


RESULTS
We tested three statistical procedures to assess the presence of systematic error in experimental HTS data, including the χ2 goodness-of-fit test, Student's t-test and Kolmogorov-Smirnov test 8 preceded by the Discrete Fourier Transform (DFT) method 9. We applied these procedures to raw HTS measurements, first, and to estimated hit distribution surfaces, second. The three competing tests were applied to analyse simulated datasets containing different types of systematic error, and to a real HTS dataset. Their accuracy was compared under various error conditions.


CONCLUSIONS
A successful assessment of the presence of systematic error in experimental HTS assays is possible when the appropriate statistical methodology is used. Namely, the t-test should be carried out by researchers to determine whether systematic error is present in their HTS data prior to applying any error correction method. This important step can significantly improve the quality of selected hits.
Département d'informatique, Université du Québec à Montréal, Montreal (QC) H3C 3P8, Canada.
Plamen
P
Dragiev
Robert
R
Nadon
Vladimir
V
Makarenkov
D003627:Data Interpretation, Statistical; D055808:Drug Discovery; D057166:High-Throughput Screening Assays / Q000379:methods*; D012984:Software
J Biomol Screen. 2010 Sep;15(8):990-1000
20817887
J Biomol Screen. 2003 Dec;8(6):634-47
14711389
Bioinformatics. 2006 Jun 1;22(11):1408-9
16595559
J Biomol Screen. 2003 Dec;8(6):624-33
14711388
J Biomol Screen. 2005 Oct;10(7):653-7
16170050
J Biomol Screen. 2006 Dec;11(8):903-14
17092911
Nat Biotechnol. 2006 Feb;24(2):167-75
16465162
J Am Chem Soc. 2003 Sep 17;125(37):11168-9
16220917
J Biomol Screen. 1999;4(2):67-73
10838414
J Biomol Screen. 2003 Aug;8(4):393-8
14567791
J Comb Chem. 2000 May-Jun;2(3):258-65
10827934
J Biomol Screen. 2005 Sep;10(6):557-67
16103415
Nat Biotechnol. 2003 Aug;21(8):859-64
12894197
Bioinformatics. 2007 Jul 1;23(13):1648-57
17463024