title: Reliability of the Welling scale (WS1) for rating temporal bone dissection performance.
abstract: OBJECTIVE
  To determine the inter- and intrarater reliability of using a new scale (Welling scale) for resident evaluation of temporal bone dissection performance.
  
  
  METHODS
  Prospective, double-blinded, randomized trial.
  
  
  METHODS
  Twelve residents in otolaryngology (postgraduate year [PGY] 2-5) drilled 26 temporal bones (21 cadaveric, 5 plastic) with the objective to perform a complete mastoidectomy with facial recess approach. These bones were then rated using the Welling scale by six independent raters on two separate occasions (4-6 wk apart). Raters were blinded to PGY year. The Kappa statistic was calculated for inter- and intrarater reliability.
  
  
  RESULTS
  Intrarater agreement was high for all raters, ranging from kappa = 0.65 to 0.72 (all P < .001), whereas the interrater agreement scores were more moderate (range, kappa = 0.49-0.64; all P < .01).
  
  
  CONCLUSIONS
  The Welling scale can be used reliably to assess temporal bone dissection performance where performance is measured by assessment of end product (mastoidectomy with facial recess approach).
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, The Ohio State University College of Medicine, Columbus, Ohio, USA.
authors.forename: Nancy N
authors.initials: NN
authors.lastname: Butler
authors.forename: Gregory J
authors.initials: GJ
authors.lastname: Wiet
mesh_terms: D002102:Cadaver; D002983:Clinical Competence; D004311:Double-Blind Method; D004521:Educational Measurement; D006801:Humans; D007396:Internship and Residency; D008416:Mastoid / Q000601:surgery*; D010036:Otolaryngology / Q000193:education*; D013517:Otorhinolaryngologic Surgical Procedures / Q000379:methods*; D011446:Prospective Studies; D011795:Surveys and Questionnaires; D013701:Temporal Bone / Q000601:surgery*