Investigation of clinician agreement in evaluating movement quality during unilateral lower extremity functional tasks: a comparison of 2 rating methods.
METHODS
Nonexperimental.


OBJECTIVE
To determine interrater and intrarater agreement for 2 methods of evaluating movement quality during 2 lower extremity functional tasks, and to descriptively compare levels of agreement between the 2 methods.


BACKGROUND
Clinicians typically use observational analysis to evaluate movement quality during functional tasks, but the extent of agreement is unknown.


METHODS
Twenty-five uninjured subjects performed 3 trials of unilateral squat and lateral step-down tasks. Three clinicians evaluated the trunk, pelvis, and hips for coronal plane and transverse plane movement deviations. Two rating methods were used: assessment of the entire movement ("overall method") and rating each segment individually ("specific method"). Movement deviation severity was rated using basic clinical guidelines and ratings were repeated from videotape. Percent agreement and weighted kappa coefficients were calculated between rater pairs and rating sessions. Generalized kappa coefficients were calculated across raters.


RESULTS
Interrater and intrarater percent agreement were higher using the overall method. Interrater weighted kappa coefficients were similar between rating methods (overall method, 0-0.55; specific method, 0.23-0.53). Intrarater weighted kappa coefficients were higher for the specific method (0.38-0.68) compared to the overall method (0.13-0.50). Generalized kappa coefficients were also higher for specific method compared to the overall method (unilateral squat, 0.19 and 0.01, respectively; lateral step-down, 0.22 and 0.18, respectively) and 95% confidence intervals remained above zero.


CONCLUSIONS
Rating movement at body segments appears to result in agreement among raters that is better than chance. Neither rating method produced high agreement, indicating a need to develop more explicit criteria for rating movement deviation severity.
Chmielewski
Terese L
TL
Department of Physical Therapy, University of Florida, Gainesville 32610, USA. tchm@ufl.edu
Hodges
Michael J
MJ
Horodyski
Marybeth
M
Bishop
Mark D
MD
Conrad
Bryan P
BP
Tillman
Susan M
SM
D000293:Adolescent; D000328:Adult; D001696:Biomechanical Phenomena / Q000592:standards*; D005260:Female; D006621:Hip Joint / Q000502:physiology; D006801:Humans; D007718:Knee Injuries / Q000503:physiopathology / Q000517:prevention & control / Q000534:rehabilitation; D007719:Knee Joint / Q000502:physiology*; D008297:Male; D009068:Movement / Q000502:physiology*; D015588:Observer Variation; D004856:Postural Balance / Q000502:physiology; D016059:Range of Motion, Articular / Q000502:physiology*