title: Residency evaluations. Are they worth the effort?
abstract: OBJECTIVE
  The accuracy of rotation evaluation forms was assessed to determine the usefulness of clinical performance ratings in predicting competence in a general surgery residency.
  
  
  METHODS
  Longitudinal, 15-year, multifactorial, repeated-measures design.
  
  
  METHODS
  University medical center residency training program.
  
  
  METHODS
  General surgery and subspecialty residents (n = 310) entering postgraduate training from 1976 to 1990 received 6459 rotation evaluations. Predictive efficiency of 4423 evaluations of a subsample of 199 residents admitted to the general surgery program during the study period was assessed using several outcome measures.
  
  
  METHODS
  Attending surgeons categorized and ranked residents' competence at the completion of training.
  
  
  RESULTS
  Rotation evaluations identified 77.8% of residents who involuntarily withdrew. Prediction of outcome category (problem, average, or superior residents), as well as final ranking (R2 = .54), were demonstrated (P < .001). Evaluations of residents from the first year of training onward predicted outcome at the end of training (P < .01).
  
  
  CONCLUSIONS
  Rotation evaluations demonstrate predictive validity in documenting resident performance, particularly when the accuracy of individual raters is known.
authors.affiliation: Department of Surgery, Loyola University Medical Center, Maywood, IL.
authors.forename: A L
authors.initials: AL
authors.lastname: Scheuneman
authors.forename: J P
authors.initials: JP
authors.lastname: Carley
authors.forename: W H
authors.initials: WH
authors.lastname: Baker
mesh_terms: D000328:Adult; D002983:Clinical Competence / Q000592:standards*; D005260:Female; D013502:General Surgery / Q000193:education*; D006801:Humans; D007087:Illinois; D007396:Internship and Residency / Q000592:standards*; D008297:Male; D008485:Medical Audit / Q000379:methods*