title: The statistical analysis of kappa statistics in multiple samples.
abstract: Methods are presented for assessing and comparing the results of k > or = 2 independent samples of measured agreement or concordance, where in each sample a given member of a pair of observations is classified according to the presence or absence of a binary trait. Examples include the assessment of interobserver agreement across different groups of patients in a clinical study, investigations of sibling concordance across different genetic groups, and meta-analyses of observer agreement across different studies. The methodology described is based on application of goodness-of-fit theory to testing hypotheses concerning kappa statistics. Partitioning methods allow a variety of hypotheses to be tested, including an assessment of the degree of agreement within each sample, a testing procedure based on the pooled data, and a test of heterogeneity that may be used to assess the validity of pooling across samples. Three examples are given.
authors.affiliation: Department of Epidemiology and Biostatistics, University of Western Ontario, London, Canada.
authors.forename: A
authors.initials: A
authors.lastname: Donner
authors.forename: N
authors.initials: N
authors.lastname: Klar
mesh_terms: D006801:Humans; D015201:Meta-Analysis as Topic; D015233:Models, Statistical; D015588:Observer Variation; D013223:Statistics as Topic