title: Exact and resampling probability values for weighted kappa.
abstract: Permutation procedures to compute exact and resampling probability values for weighted kappa are described. Comparisons with asymptotic probability values demonstrate that exact permutation procedures are advantageous for sparse data sets, whereas resampling permutation procedures are appropriate for both sparse and nonsparse data sets.
authors.affiliation: Department of Sociology, Colorado State University, Fort Collins, CO 80523-1784, USA. berry@lamar.colostate.edu
authors.forename: Kenneth J
authors.initials: KJ
authors.lastname: Berry
authors.forename: Janis E
authors.initials: JE
authors.lastname: Johnston
authors.forename: Paul W
authors.initials: PW
authors.lastname: Mielke
mesh_terms: D006801:Humans; D008960:Models, Psychological; D015233:Models, Statistical; D015588:Observer Variation; D011584:Psychology / Q000379:methods* / Q000706:statistics & numerical data; D012494:Sampling Studies