title: Analysis of an observational rating scale for repetition, posture, and force in selected manufacturing settings.
abstract: OBJECTIVE
  The aim of this work was to quantify the interrater reliability of a set of scales that assess repetition, posture, and force as used on site when examining industrial work.
  
  
  BACKGROUND
  Interrater reliability of observational assessment methods can vary depending on the definition of the methods and situations in which they are used.
  
  
  METHODS
  In several industries, 846 jobs were assessed using pairs of analysts to rate the repetition, force, and posture of the upper limbs. Twelve analysts with varying experience levels participated.
  
  
  RESULTS
  Using an interclass correlation coefficient (ICC), force and repetition had reliability values of .60 and .71 before and .82 and .87 after discussion, respectively. After discussion, peak posture ratings had ICCs of .60 to .83. ICCs for average posture ratings ranged from .31 to .51 initially to .55 to .67 in final ratings. Less experienced analysts changed their initial ratings more than did the senior investigators.
  
  
  CONCLUSIONS
  The high interrater reliability of the repetition and force metrics indicates that a single analyst is appropriate for basic job assessment. Posture ratings benefit greatly from a two-analyst system. Average postures should be assessed across a full range of the scale for interrater reliability assessment. Analyst pairs should be rotated to avoid forming biases.
  
  
  CONCLUSIONS
  For basic assessments of forceful exertions and repetitive motions, a single analyst can be used, reducing the resource requirements for both industry and large epidemiological studies.
authors.affiliation: University of Michigan, Ann Arbor, Michigan, USA. marissal@umich.edu
authors.forename: Marissa L
authors.initials: ML
authors.lastname: Ebersole
authors.forename: Thomas J
authors.initials: TJ
authors.lastname: Armstrong
mesh_terms: D006801:Humans; D008824:Michigan; D015588:Observer Variation; D016273:Occupational Exposure / Q000032:analysis; D005082:Physical Exertion; D011187:Posture; D013647:Task Performance and Analysis; D034941:Upper Extremity