title: Investigation of clinician agreement in evaluating movement quality during unilateral lower extremity functional tasks: a comparison of 2 rating methods.
abstract: METHODS
  Nonexperimental.
  
  
  OBJECTIVE
  To determine interrater and intrarater agreement for 2 methods of evaluating movement quality during 2 lower extremity functional tasks, and to descriptively compare levels of agreement between the 2 methods.
  
  
  BACKGROUND
  Clinicians typically use observational analysis to evaluate movement quality during functional tasks, but the extent of agreement is unknown.
  
  
  METHODS
  Twenty-five uninjured subjects performed 3 trials of unilateral squat and lateral step-down tasks. Three clinicians evaluated the trunk, pelvis, and hips for coronal plane and transverse plane movement deviations. Two rating methods were used: assessment of the entire movement ("overall method") and rating each segment individually ("specific method"). Movement deviation severity was rated using basic clinical guidelines and ratings were repeated from videotape. Percent agreement and weighted kappa coefficients were calculated between rater pairs and rating sessions. Generalized kappa coefficients were calculated across raters.
  
  
  RESULTS
  Interrater and intrarater percent agreement were higher using the overall method. Interrater weighted kappa coefficients were similar between rating methods (overall method, 0-0.55; specific method, 0.23-0.53). Intrarater weighted kappa coefficients were higher for the specific method (0.38-0.68) compared to the overall method (0.13-0.50). Generalized kappa coefficients were also higher for specific method compared to the overall method (unilateral squat, 0.19 and 0.01, respectively; lateral step-down, 0.22 and 0.18, respectively) and 95% confidence intervals remained above zero.
  
  
  CONCLUSIONS
  Rating movement at body segments appears to result in agreement among raters that is better than chance. Neither rating method produced high agreement, indicating a need to develop more explicit criteria for rating movement deviation severity.
authors.affiliation: Department of Physical Therapy, University of Florida, Gainesville 32610, USA. tchm@ufl.edu
authors.forename: Terese L
authors.initials: TL
authors.lastname: Chmielewski
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Hodges
authors.forename: Marybeth
authors.initials: M
authors.lastname: Horodyski
authors.forename: Mark D
authors.initials: MD
authors.lastname: Bishop
authors.forename: Bryan P
authors.initials: BP
authors.lastname: Conrad
authors.forename: Susan M
authors.initials: SM
authors.lastname: Tillman
mesh_terms: D000293:Adolescent; D000328:Adult; D001696:Biomechanical Phenomena / Q000592:standards*; D005260:Female; D006621:Hip Joint / Q000502:physiology; D006801:Humans; D007718:Knee Injuries / Q000503:physiopathology / Q000517:prevention & control / Q000534:rehabilitation; D007719:Knee Joint / Q000502:physiology*; D008297:Male; D009068:Movement / Q000502:physiology*; D015588:Observer Variation; D004856:Postural Balance / Q000502:physiology; D016059:Range of Motion, Articular / Q000502:physiology*