Residency evaluations. Are they worth the effort?
OBJECTIVE
The accuracy of rotation evaluation forms was assessed to determine the usefulness of clinical performance ratings in predicting competence in a general surgery residency.


METHODS
Longitudinal, 15-year, multifactorial, repeated-measures design.


METHODS
University medical center residency training program.


METHODS
General surgery and subspecialty residents (n = 310) entering postgraduate training from 1976 to 1990 received 6459 rotation evaluations. Predictive efficiency of 4423 evaluations of a subsample of 199 residents admitted to the general surgery program during the study period was assessed using several outcome measures.


METHODS
Attending surgeons categorized and ranked residents' competence at the completion of training.


RESULTS
Rotation evaluations identified 77.8% of residents who involuntarily withdrew. Prediction of outcome category (problem, average, or superior residents), as well as final ranking (R2 = .54), were demonstrated (P < .001). Evaluations of residents from the first year of training onward predicted outcome at the end of training (P < .01).


CONCLUSIONS
Rotation evaluations demonstrate predictive validity in documenting resident performance, particularly when the accuracy of individual raters is known.
Scheuneman
A L
AL
Department of Surgery, Loyola University Medical Center, Maywood, IL.
Carley
J P
JP
Baker
W H
WH
D000328:Adult; D002983:Clinical Competence / Q000592:standards*; D005260:Female; D013502:General Surgery / Q000193:education*; D006801:Humans; D007087:Illinois; D007396:Internship and Residency / Q000592:standards*; D008297:Male; D008485:Medical Audit / Q000379:methods*