title: How to evaluate and improve the reliability of power Doppler ultrasonography for assessing enthesitis in spondylarthritis.
abstract: OBJECTIVE
  To evaluate and improve the reliability of power Doppler ultrasonography (PDUS) for detecting and scoring enthesitis in patients with spondylarthitis, using a 3-step procedure.
  
  
  METHODS
  In the first step, we evaluated the reliability of 5 sonographers by bilaterally scanning 5 entheses twice in 5 patients. In the second step, starting from disagreements observed during the first step, we established consensus guidelines. The sonographers' implementation was further evaluated in 2 reliability exercises: one on 60 PDUS enthesitis images and the other by scanning 5 new patients. In the third step, we performed a final reliability evaluation of 5 additional patients after 1 year. Kappa coefficients (kappa) as well as variance component analysis (VCA) and generalizability theory (GT) were used to assess reliability.
  
  
  RESULTS
  The initial intra- and interobserver reliability were poor, especially for detecting and scoring Doppler signal. VCA and GT showed that most variability was accounted for by interaction between sonographer and enthesis. Implementation of consensus guidelines was associated with a significant improvement in Doppler reliability between the first and second steps (mean interobserver kappa increased from 0.13 to 0.51 for binary Doppler scoring in patients; P < 0.005), which persisted in the third step (mean interobserver kappa = 0.57). The high GT coefficients reached in the last steps supported such improvement.
  
  
  CONCLUSIONS
  The 3-step procedure used in this study to standardize PDUS technique was associated with a significant improvement in interobserver reliability for detecting enthesitis in spondylarthritis patients. Such an approach can be useful to standardize PDUS assessment of musculoskeletal disorders.
authors.affiliation: Université de Versailles-St.-Quentin-en-Yvelines, Assistance Publique Hôpitaux de Paris, Ambroise Paré Hospital, Boulogne-Billancourt, Paris, France. dagostino@apr.aphp.fr
authors.forename: Maria Antonietta
authors.initials: MA
authors.lastname: D'agostino
authors.forename: Philippe
authors.initials: P
authors.lastname: Aegerter
authors.forename: Sandrine
authors.initials: S
authors.lastname: Jousse-Joulin
authors.forename: Isabelle
authors.initials: I
authors.lastname: Chary-Valckenaere
authors.forename: Bertrand
authors.initials: B
authors.lastname: Lecoq
authors.forename: Philippe
authors.initials: P
authors.lastname: Gaudin
authors.forename: Isabelle
authors.initials: I
authors.lastname: Brault
authors.forename: Jérôme
authors.initials: J
authors.lastname: Schmitz
authors.forename: François-Xavier
authors.initials: FX
authors.lastname: Dehaut
authors.forename: Jean-Marie
authors.initials: JM
authors.lastname: Le Parc
authors.forename: Maxime
authors.initials: M
authors.lastname: Breban
authors.forename: Paul
authors.initials: P
authors.lastname: Landais
mesh_terms: D000328:Adult; D005260:Female; D017408:Guidelines as Topic; D006801:Humans; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D015203:Reproducibility of Results; D012216:Rheumatic Diseases / Q000000981:diagnostic imaging*; D025241:Spondylarthritis / Q000000981:diagnostic imaging*; D018608:Ultrasonography, Doppler / Q000592:standards*