How to evaluate and improve the reliability of power Doppler ultrasonography for assessing enthesitis in spondylarthritis.
OBJECTIVE
To evaluate and improve the reliability of power Doppler ultrasonography (PDUS) for detecting and scoring enthesitis in patients with spondylarthitis, using a 3-step procedure.


METHODS
In the first step, we evaluated the reliability of 5 sonographers by bilaterally scanning 5 entheses twice in 5 patients. In the second step, starting from disagreements observed during the first step, we established consensus guidelines. The sonographers' implementation was further evaluated in 2 reliability exercises: one on 60 PDUS enthesitis images and the other by scanning 5 new patients. In the third step, we performed a final reliability evaluation of 5 additional patients after 1 year. Kappa coefficients (kappa) as well as variance component analysis (VCA) and generalizability theory (GT) were used to assess reliability.


RESULTS
The initial intra- and interobserver reliability were poor, especially for detecting and scoring Doppler signal. VCA and GT showed that most variability was accounted for by interaction between sonographer and enthesis. Implementation of consensus guidelines was associated with a significant improvement in Doppler reliability between the first and second steps (mean interobserver kappa increased from 0.13 to 0.51 for binary Doppler scoring in patients; P < 0.005), which persisted in the third step (mean interobserver kappa = 0.57). The high GT coefficients reached in the last steps supported such improvement.


CONCLUSIONS
The 3-step procedure used in this study to standardize PDUS technique was associated with a significant improvement in interobserver reliability for detecting enthesitis in spondylarthritis patients. Such an approach can be useful to standardize PDUS assessment of musculoskeletal disorders.
D'agostino
Maria Antonietta
MA
Université de Versailles-St.-Quentin-en-Yvelines, Assistance Publique Hôpitaux de Paris, Ambroise Paré Hospital, Boulogne-Billancourt, Paris, France. dagostino@apr.aphp.fr
Aegerter
Philippe
P
Jousse-Joulin
Sandrine
S
Chary-Valckenaere
Isabelle
I
Lecoq
Bertrand
B
Gaudin
Philippe
P
Brault
Isabelle
I
Schmitz
Jérôme
J
Dehaut
François-Xavier
FX
Le Parc
Jean-Marie
JM
Breban
Maxime
M
Landais
Paul
P
D000328:Adult; D005260:Female; D017408:Guidelines as Topic; D006801:Humans; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D015203:Reproducibility of Results; D012216:Rheumatic Diseases / Q000000981:diagnostic imaging*; D025241:Spondylarthritis / Q000000981:diagnostic imaging*; D018608:Ultrasonography, Doppler / Q000592:standards*