title: Bayesian random effects for interrater and test-retest reliability with nested clinical observations.
abstract: OBJECTIVE
  The assessment of inter- and intrarater reliability usually involves more than one level of nesting structures in the collected data, where repeated observations are made by multiple raters. Most approaches, however, are not designed to accommodate both inter- and intrarater reliability jointly, not to mention further difficulties arising when modeling with dichotomous responses. The multiple sources of dependence because of nesting structures and the existence of covariates can result in complexity in inference.
  
  
  METHODS
  We first establish the equivalence between correlation and kappa under common positive correlation models for multiple raters and then apply a Bayesian generalized linear mixed-effects model to interpret simultaneously both types of reproducibility through different annotations of similarity. In addition to marginal correlations, the correlated random effects among raters are adopted to infer similarity between raters, whereas the correlation for random time effects may contribute to test-retest reliability.
  
  
  RESULTS
  This model accounts for individual covariates and random effects because of subjects, raters, and time, and it covers a wide variety of data structures and types. An application of endodontic radiographic examinations is illustrated.
  
  
  CONCLUSIONS
  This Bayesian hierarchical correlation model offers a wide applicability, flexibility, and feasibility in modeling inter- and intrarater reliability together.
authors.affiliation: Department of Public Health and Institute of Epidemiology and Preventive Medicine, College of Public Health, National Taiwan University, Taipei, Taiwan. ckhsiao@ntu.edu.tw
authors.forename: Chuhsing K
authors.initials: CK
authors.lastname: Hsiao
authors.forename: Pei-Chun
authors.initials: PC
authors.lastname: Chen
authors.forename: Wen-Hsin
authors.initials: WH
authors.lastname: Kao
mesh_terms: D001499:Bayes Theorem; D015987:Effect Modifier, Epidemiologic; D004708:Endodontics / Q000592:standards*; D005240:Feasibility Studies; D006801:Humans; D016014:Linear Models; D015588:Observer Variation; D015203:Reproducibility of Results; D012390:Root Canal Therapy / Q000706:statistics & numerical data*