The modified Rankin Scale in acute stroke has good inter-rater-reliability but questionable validity.
OBJECTIVE
The modified Rankin Scale (mRS), designed as a measure of disability in the community, has increasingly been administered in the acute stroke setting but has been poorly studied within the hospital environment. We prospectively studied the interrater reliability of the mRS in acutely hospitalised stroke patients and examined the effect of prior experience with the scale and use of a decision tool on the interrater agreement of trained raters.


METHODS
Patients <4 days after stroke were recruited. Individuals from 3 trained rater groups (experienced, inexperienced and inexperienced with decision tool) independently scored each patient within 6 h of each other. Agreement was measured with the intraclass correlation (ICC) and the weighted kappa statistic (kappa(w)), with systematic bias evaluated using the bias index.


RESULTS
Twelve raters scored 56 patients with overall agreement of ICC = 0.675. Agreement of kappa(w) = 0.686 was found between experienced and inexperienced raters but a modest systematic bias was present. Experience in rating patients appeared to play some role in affecting agreement but the decision tool did not improve the performance of inexperienced raters.


CONCLUSIONS
Trained raters were found to have good interrater agreement overall when the mRS was scored in acute stroke patients but obvious problems with the interpretation and relevancy of the scale in this setting raise concerns about validity. The use of the mRS to rate disability in the acute hospital environment should be questioned.
Zhao
Henry
H
School of Medicine, University of Melbourne, Victoria, Australia.
Collier
Janice M
JM
Quah
Dorcas M
DM
Purvis
Tara
T
Bernhardt
Julie
J
D000368:Aged; D000369:Aged, 80 and over; D002983:Clinical Competence; D004185:Disability Evaluation; D005260:Female; D006801:Humans; D007297:Inpatients; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D011237:Predictive Value of Tests; D011446:Prospective Studies; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D020521:Stroke / Q000175:diagnosis*; D013997:Time Factors; D014739:Victoria