Residency program director evaluations do not correlate with performance on a required 4th-year objective structured clinical examination.
BACKGROUND
Assessment of resident performance is a complex task.


OBJECTIVE
To correlate performance on a 4th-year objective structured clinical examination (OSCE) with residency program director assessment, class rank, and U.S. Medical Licensing Examination (USMLE) scores.


METHODS
We surveyed program directors about the performance of 50 graduates from our medical school chosen to represent the highest (OSCEHI) and lowest (OSCELO) 25 performers on our required 4th-year OSCE. Program directors were unaware of the OSCE scores of the graduates.


RESULTS
OSCE scores did not correlate with Likert scores for any survey parameter studied (r < .23, p > .13 for all comparisons). Similarly, program director evaluations did not correlate with class rank or USMLE scores (r < .26, p > .09 for all comparisons).


CONCLUSIONS
We concluded that program director evaluations of resident performance do not appear to correlate with objective tests of either clinical skills or knowledge taken during medical school. These findings suggest that more structured and objective evaluative tools might improve postgraduate training program assessment of trainees.
Kahn
M J
MJ
Department of Medicine, Tulane University School of Medicine, SL12, 1430 Tulane Avenue, New Orleans, LA 70112.
Merrill
W W
WW
Anderson
D S
DS
Szerlip
H M
HM
D002983:Clinical Competence; D015331:Cohort Studies; D004503:Education, Medical, Graduate / Q000592:standards*; D004504:Education, Medical, Undergraduate / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007396:Internship and Residency; D016544:Patient Simulation; D018709:Statistics, Nonparametric; D014481:United States