Systemic lupus international collaborating clinics renal activity/response exercise: comparison of agreement in rating renal response.
OBJECTIVE
To assess the degree to which physicians agree with each other and with ratings obtained with 3 existing responder indices, in rating the response to treatment of lupus nephritis.


METHODS
Lupus nephritis patient medical records from 125 pairs of visits (6 months apart) were used to create renal response scenarios. Seven nephrologists and 22 rheumatologists rated each scenario as demonstrating complete response, partial response, same, or worsening. The plurality (most frequent) rating of renal response by the physicians was compared with the calculated score from the renal component of the British Isles Lupus Assessment Group (BILAG) index (original and updated [2004] version) and of the Responder Index for Lupus Erythematosus (RIFLE). The degree of agreement among the physicians was assessed by calculating intraclass correlation coefficients (ICCs). The degree of agreement between the plurality physician rating and ratings obtained with the established response indices was assessed using the kappa statistic.


RESULTS
The ICC among all physicians was 0.64 (0.62 for nephrologists and 0.67 for rheumatologists). The chance-adjusted measure of agreement (kappa coefficient) between the plurality physician rating and the calculated score obtained using established indexes was 0.50 (95% confidence interval [95% CI] 0.38-0.61) for the RIFLE, 0.14 (95% CI 0.03-0.25) for the original BILAG, and 0.23 (95% CI 0.21-0.44) for the BILAG 2004.


CONCLUSIONS
These findings indicate that rheumatologists as a group and nephrologists as a group have equal agreement in their rating of renal response. There was moderate agreement between plurality physician ratings and ratings obtained using the renal component of the RIFLE. Ratings of response using an index based on the original BILAG did not have good agreement with the plurality physician rating.
Petri
Michelle
M
Department of Rheumatology, Johns Hopkins University, Baltimore, Maryland 21205, USA. mpetri@jhmi.edu
Kasitanon
Nuntana
N
Singh
Sukminder
S
Link
Kimberly
K
Magder
Laurence
L
Bae
Sang-Cheol
SC
Hanly
John G
JG
Nived
Ola
O
Sturfelt
Gunnar
G
van Vollenhoven
Ronald
R
Wallace
Daniel J
DJ
Alarcón
Graciela S
GS
Adu
Dwomoa
D
Avila-Casado
Carmen
C
Bernatsky
Sasha R
SR
Bruce
Ian N
IN
Clarke
Ann E
AE
Contreras
Gabriel
G
Fine
Derek M
DM
Gladman
Dafna D
DD
Gordon
Caroline
C
Kalunian
Kenneth C
KC
Madaio
Michael P
MP
Rovin
Brad H
BH
Sanchez-Guerrero
Jorge
J
Steinsson
Kristjan
K
Aranow
Cynthia
C
Balow
James E
JE
Buyon
Jill P
JP
Ginzler
Ellen M
EM
Khamashta
Munther A
MA
Urowitz
Murray B
MB
Dooley
Mary Anne
MA
Merrill
Joan T
JT
Ramsey-Goldman
Rosalind
R
Font
Josef
J
Tumlin
James
J
Stoll
Thomas
T
Zoma
Asad
A
D006801:Humans; D007668:Kidney / Q000503:physiopathology*; D008180:Lupus Erythematosus, Systemic / Q000150:complications / Q000503:physiopathology*; D008181:Lupus Nephritis / Q000175:diagnosis*; D009398:Nephrology / Q000592:standards*; D015588:Observer Variation; D012219:Rheumatology / Q000592:standards*; D012720:Severity of Illness Index