First-year residents' performances compared with their medical school class ranks as determined by three ranking systems.
Difficulties encountered with deans' letters have prompted residency directors to rely on performance indicators, including class rank, that indicate the comparative positions of applicants. However, the validity of class rank as a predictor of performance in residency is not well established. The present investigation studied the relationship of class ranks to residents' performances, the systems of class ranking that correlated with residents' performances, and procedures that strengthened the relationship between ranking information and residents' performances. Three systems of class ranking are described. With each system, the authors used the same study group of 124 graduates (classes of 1986 and 1987) from a midwestern medical school with a baccalaureate-M.D. degree program; by 1991, each graduate had completed his or her first year of residency. All three systems were reliable for assignment of class rank. All three systems showed modest correlations with residents' performances. Multiple regression analysis revealed that a weighted combination of clinical performance measures bore the strongest relationship to performances in residency. Thus, the authors conclude that the formal computational ranking of students is not essential for the generation of reliable and valid deans' letters that can predict residents' performances. An in-depth evaluation that includes comparative information based on statistically generated formulas, as well as information based on personal qualities, may be a superior alternative.
Loftus
L S
LS
Council on Evaluation, University of Missouri-Kansas City School of Medicine 64108.
Arnold
L
L
Willoughby
T L
TL
Connolly
A
A
D002983:Clinical Competence; D004504:Education, Medical, Undergraduate / Q000592:standards*; D004521:Educational Measurement / Q000592:standards*; D004522:Educational Status; D005069:Evaluation Studies as Topic; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D015146:Midwestern United States; D012044:Regression Analysis; D015203:Reproducibility of Results; D012189:Retrospective Studies