Weighted 2 x 2 kappa coefficients: recommended indices of diagnostic accuracy for evidence-based practice.
OBJECTIVE
The diagnostic accuracy of a clinical test is typically evaluated by comparing the classification of individuals by the test with their classification by some diagnostic gold standard. The most popular indices of diagnostic accuracy are sensitivity, specificity, and positive and negative predictive values. However, these measures are affected by the fact that some diagnostic decisions will be correct by chance, resulting in values that differ widely between indices, and clinicians may be confused as to whether results indicate that a test is good or poor. In keeping with the principle in evidence-based practice that decisions should be based on evidence not guesswork, we might expect that measures of diagnostic accuracy should therefore be chance corrected. The objective of this article was to advocate this and draw attention to indices that achieve this requirement.


METHODS
The principles underlying calculations of diagnostic accuracy are presented as a framework for understanding the problem and its solution.


RESULTS
Disparities between different indices of diagnostic accuracy may be resolved by adjusting them to correct for chance effects. This produces a pair of weighted 2 x 2 "diagnostic" kappa coefficients offering a number of theoretical and practical advantages.


CONCLUSIONS
Routine use of weighted 2 x 2 kappa coefficients as indices of diagnostic accuracy is recommended.
Gilchrist
James M
JM
Bradford School of Optometry & Vision Science, University of Bradford, Richmond Road, Bradford, West Yorkshire BD7 1DP, UK. j.m.gilchrist@bradford.ac.uk
D003627:Data Interpretation, Statistical; D003951:Diagnostic Errors; D003955:Diagnostic Tests, Routine / Q000592:standards*; D019317:Evidence-Based Medicine / Q000379:methods* / Q000592:standards; D006801:Humans; D011237:Predictive Value of Tests; D015995:Prevalence