The test validation summary.
Common rates employed in classificatory testing are the true positive rate (TPR), false positive rate (FPR), positive predictive power (PPP), and negative predictive power (NPP). FPR and TPR are estimated from research samples representing populations to be distinguished by classificatory testing. PPP and NPP are used by clinicians to classify test takers into populations. PPP and NPP depend on the base rate (BR) of population members in the clinician's sample. The authors introduce the test validation summary (TVS) as a means to report within a single graph the FPR and TPR and the ranges of PPP and NPP across all potential sample BRs for any chosen cut score. The authors investigate how the TVS has other applications, including the estimation of local BR for the condition of interest and the estimation of standard errors for FPR and TPR when estimated across multiple independent validation studies of the classificatory test.
Frederick
Richard I
RI
Department of Psychology, U.S. Medical Center for Federal Prisoners, Springfield, MO 65807, USA. rickfrederick@gmail.com
Bowden
Stephen C
SC
D000328:Adult; D002648:Child; D005104:Expert Testimony / Q000331:legislation & jurisprudence; D006801:Humans; D008306:Malingering / Q000175:diagnosis; D001523:Mental Disorders / Q000145:classification / Q000175:diagnosis* / Q000523:psychology; D009483:Neuropsychological Tests / Q000706:statistics & numerical data; D011336:Probability; D011581:Psychological Tests / Q000706:statistics & numerical data*; D011594:Psychometrics / Q000706:statistics & numerical data; D015203:Reproducibility of Results; D054928:Validation Studies as Topic