An investigation of new toxicity test method performance in validation studies: 3. Sensitivity and specificity are not independent of prevalence or distribution of toxicity.
Often, the only measures of toxicity test performance provided in validation studies are the contingent probability statistics (CPS) sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Sensitivity and specificity are generally used in preference to NPV and PPV since NPV and PPV are assumed to vary with changes in prevalence while sensitivity and specificity are assumed to be independent of changes in prevalence. The purpose of the studies reported here was to test whether or not sensitivity and specificity are actually independent of changes in prevalence. Results derived from these studies indicate that sensitivity and specificity vary significantly depending on the prevalence of toxic substances in the set of chemicals being tested. This means sensitivity and specificity should not always be considered constant indicators of toxicity test performance.
Bruner
L H
LH
Gillette Environment, Health & Safety, Needham, Massachusetts, USA. leon_bruner@gillette.com
Carr
G J
GJ
Harbell
J W
JW
Curren
R D
RD
D008962:Models, Theoretical; D011237:Predictive Value of Tests; D015995:Prevalence; D012680:Sensitivity and Specificity; D018675:Toxicity Tests / Q000592:standards* / Q000706:statistics & numerical data*