title: Rate of adjudication of radiological progression in rheumatoid arthritis randomized controlled trials depending on preset limits of agreement: a pooled analysis from 15 randomized trials.
abstract: OBJECTIVE
  The aim of this study is to provide data on the adjudication rate for a predetermined threshold of difference in change score between two readers in randomized controlled trials (RCTs).
  
  
  METHODS
  Fifteen datasets from RCTs in RA were scored by 13 experienced readers as pairs according to the modified Sharp-van der Heijde method. The theoretical adjudication rates for thresholds of between 3 and 20 units were calculated. We investigated the influence of the number of time points within the same session, the length of the interval and disease duration on the adjudication rates.
  
  
  RESULTS
  A total of 21,295 time points from 7643 patients from 15 databases were included in the analysis. The adjudication rate was inversely related to the threshold. Higher adjudication rates were observed with a higher number of time points, longer time intervals and in early versus established RA. The adjudication rates ranged from 0% to 22% depending on the scenario.
  
  
  CONCLUSIONS
  With trained and experienced readers, the adjudication rate in RA RCTs is low even with very conservative adjudication thresholds.
authors: Department of Rheumatology, Leiden University Medical Center, PO Box 9600, Leiden, The Netherlands.
authors: Victoria
authors: V
authors: Navarro-Compán
authors: Robert
authors: R
authors: Landewé
authors: Harris A
authors: HA
authors: Ahmad
authors: Colin G
authors: CG
authors: Miller
authors: Dong
authors: D
authors: Xu
authors: Ron
authors: R
authors: Wolterbeek
authors: Désirée
authors: D
authors: van der Heijde
mesh_terms: D000328:Adult; D001172:Arthritis, Rheumatoid / Q000000981:diagnostic imaging*; D001175:Arthrography / Q000379:methods; D016208:Databases, Factual; D018450:Disease Progression; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D009426:Netherlands; D015588:Observer Variation; D016032:Randomized Controlled Trials as Topic / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D012219:Rheumatology / Q000331:legislation & jurisprudence; D012720:Severity of Illness Index
keywords: adjudication; radiographic outcome; rheumatoid arthritis; trials