title: Ranking Practice Variability in the Medical Student Performance Evaluation: So Bad, It's "Good".
abstract: To examine the variability among medical schools in ranking systems used in medical student performance evaluations (MSPEs).
  
  
  
  The authors reviewed MSPEs from U.S. MD-granting medical schools received by the University of California, Irvine emergency medicine and internal medicine residency programs during 2012-2013 and 2014-2015. They recorded whether the school used a ranking system, the type of ranking system used, the size and description of student categories, the location of the ranking statement and category legend, and whether nonranking schools used language suggestive of rank.
  
  
  
  Of the 134 medical schools in the study sample, the majority (n = 101; 75%) provided ranks for students in the MSPE. Most of the ranking schools (n = 63; 62%) placed students into named category groups, but the number and size of groups varied. The most common descriptors used for these 63 schools' top, second, third, and lowest groups were "outstanding," "excellent," "very good," and "good," respectively, but each of these terms was used across a broad range of percentile ranks. Student ranks and school category legends were found in various locations. Many of the 33 schools that did not rank students included language suggestive of rank.
  
  
  
  There is extensive variation in ranking systems used in MSPEs. Program directors may find it difficult to use MSPEs to compare applicants, which may diminish the MSPE's value in the residency application process and negatively affect high-achieving students. A consistent approach to ranking students would benefit program directors, students, and student affairs officers.
authors.affiliation: M. Boysen Osborn is assistant professor and residency program director, Department of Emergency Medicine, University of California, Irvine, Orange, California. J. Mattson is a fourth-year medical student, University of California, Irvine, School of Medicine, Irvine, California. J. Yanuck is a fourth-year medical student, University of California, Irvine, School of Medicine, Irvine, California. C. Anderson is research specialist, Department of Emergency Medicine, University of California, Irvine, Orange, California. A. Tekian is professor, Department of Medical Education, University of Illinois, Chicago, Chicago, Illinois. J.C. Fox is professor and assistant dean of student affairs, Department of Emergency Medicine, University of California, Irvine, Orange, California. I.B. Harris is professor and head and director of graduate studies, Department of Medical Education, University of Illinois, Chicago, Chicago, Illinois.
authors.forename: Megan
authors.initials: M
authors.lastname: Boysen Osborn
authors.forename: James
authors.initials: J
authors.lastname: Mattson
authors.forename: Justin
authors.initials: J
authors.lastname: Yanuck
authors.forename: Craig
authors.initials: C
authors.lastname: Anderson
authors.forename: Ara
authors.initials: A
authors.lastname: Tekian
authors.forename: John Christian
authors.initials: JC
authors.lastname: Fox
authors.forename: Ilene B
authors.initials: IB
authors.lastname: Harris
mesh_terms: D000124:Achievement; D004504:Education, Medical, Undergraduate; D004521:Educational Measurement / Q000379:methods* / Q000706:statistics & numerical data; D006801:Humans; D007396:Internship and Residency; D012570:School Admission Criteria; D012577:Schools, Medical / Q000706:statistics & numerical data*; D013337:Students, Medical; D014481:United States