title: Predicting success: What medical student measures predict resident performance in neurology?
abstract: OBJECTIVE
  Many medical school metrics are used by residency programs to differentiate residency applicants. The importance of each metric in the field of neurology is unclear.
  
  
  METHODS
  This is a single-site retrospective evaluation of characteristics that predict resident quality. Several measures from all 57 adult neurology residents over 8 years were obtained including Step I scores, college and medical school rankings, in-service training examination scores, advanced degrees, and number of publications during residency. Two program directors, blinded to these data and each other's ratings, rated the quality of all residents at the end of the residency. The data were then anonymized for all analyses.
  
  
  RESULTS
  There was no significant relationship between Step I scores and resident quality, though Step I scores correlated significantly with in-service training examination scores. Medical students with PhDs did not perform differently in terms of resident quality, number of publications in residency, or in-service training examination scores. Resident quality was correlated with the ranking of each applicant's undergraduate college, but not the ranking of their medical school.
  
  
  CONCLUSIONS
  While Step I is used by many residency programs in ranking potential residents, it does not correlate with overall resident quality, although Step I scores may predict success on future standardized medical examinations. Students with PhDs do not differ from other residents across several metrics. Applicants from highly selective colleges, though not highly selective medical schools, had significantly higher quality ratings. Further research is needed to determine characteristics of medical students that predict performance during neurology residency.
authors.affiliation: Department of Neurology, University of California, San Francisco, 505 Parnassus Ave, Room M-798, Box 0114, San Francisco 94143-0114, USA(2). Electronic address: mark.burish@gmail.com.
authors.forename: Mark J
authors.initials: MJ
authors.lastname: Burish
authors.affiliation: Department of Neurology, University of California, San Francisco, 505 Parnassus Ave, Room M-798, Box 0114, San Francisco 94143-0114, USA(2).
authors.forename: Carolyn A
authors.initials: CA
authors.lastname: Fredericks
authors.affiliation: Department of Neurology, University of California, San Francisco, 505 Parnassus Ave, Room M-798, Box 0114, San Francisco 94143-0114, USA(2).
authors.forename: John W
authors.initials: JW
authors.lastname: Engstrom
authors.affiliation: Department of Neurology, University of California, San Francisco, 505 Parnassus Ave, Room M-798, Box 0114, San Francisco 94143-0114, USA(2).
authors.forename: Vicky L
authors.initials: VL
authors.lastname: Tateo
authors.affiliation: Department of Neurology, University of California, San Francisco, 505 Parnassus Ave, Room M-798, Box 0114, San Francisco 94143-0114, USA(2).
authors.forename: S Andrew
authors.initials: SA
authors.lastname: Josephson
mesh_terms: D001076:Aptitude; D002983:Clinical Competence; D004521:Educational Measurement; D006801:Humans; D007396:Internship and Residency; D009462:Neurology / Q000193:education*; D012189:Retrospective Studies; D013337:Students, Medical
keywords: Medical student application; Neurology; Residency In-service Training Examination; Residency education; USMLE Step I