Exact and resampling probability values for weighted kappa.
Permutation procedures to compute exact and resampling probability values for weighted kappa are described. Comparisons with asymptotic probability values demonstrate that exact permutation procedures are advantageous for sparse data sets, whereas resampling permutation procedures are appropriate for both sparse and nonsparse data sets.
Berry
Kenneth J
KJ
Department of Sociology, Colorado State University, Fort Collins, CO 80523-1784, USA. berry@lamar.colostate.edu
Johnston
Janis E
JE
Mielke
Paul W
PW
D006801:Humans; D008960:Models, Psychological; D015233:Models, Statistical; D015588:Observer Variation; D011584:Psychology / Q000379:methods* / Q000706:statistics & numerical data; D012494:Sampling Studies