Resampling probability values for weighted kappa with multiple raters.
A new procedure to compute weighted kappa with multiple raters is described. A resampling procedure to compute approximate probability values for weighted kappa with multiple raters is presented. Applications of weighted kappa are illustrated with an example analysis of classifications by three independent raters.
Mielke
Paul W
PW
Department of Statistics, Colorado State University, Fort Collins, CO 80523-1877, USA. mielke@lamar.colostate.edu
Berry
Kenneth J
KJ
Johnston
Janis E
JE
D003205:Computing Methodologies; D016001:Confidence Intervals; D006801:Humans; D015233:Models, Statistical; D010380:Peer Review / Q000379:methods; D010506:Periodicals as Topic / Q000706:statistics & numerical data; D011336:Probability; D018401:Sample Size; D012494:Sampling Studies; D013223:Statistics as Topic