title: Investigating the reliability of the medical school admissions interview.
abstract: OBJECTIVE
  Determining the valid and fair use of the interview for medical school admissions is contingent upon a demonstration of the reproducibility of interview scores. This study seeks to establish the generalizability of interview scores, first assessing the existing research evidence, and then analyzing data from a non-experimental independent replications research design.
  
  
  METHODS
  Multivariate and univariate generalizability analyses are conducted using data from a structured interview obtained from a population of medical school applicants over two years.
  
  
  RESULTS
  The existing literature does not provide sufficient evidence regarding interview reliability. In this study, interview scores derived from a standardized interview were found to display low to moderate levels of reliability. Interview scores do not appear to possess the level of precision found with other measures commonly used to facilitate admissions decisions.
  
  
  CONCLUSIONS
  Given the results obtained, the fairness of using the interview as a highly influential component of the admission process is called into question. Methods for using interview data in a psychometrically defensible fashion are discussed. Specifically, attention to decision reliability provides guidance on how interview scores can best be integrated into the admissions process.
authors.affiliation: University of Iowa, College of Medicine, Iowa City, IA 52242, USA. clarence-kreiter@uiowa.edu
authors.forename: Clarence D
authors.initials: CD
authors.lastname: Kreiter
authors.forename: Ping
authors.initials: P
authors.lastname: Yin
authors.forename: Catherine
authors.initials: C
authors.lastname: Solow
authors.forename: Robert L
authors.initials: RL
authors.lastname: Brennan
mesh_terms: D004504:Education, Medical, Undergraduate; D004521:Educational Measurement; D006801:Humans; D007407:Interviews as Topic / Q000592:standards*; D015999:Multivariate Analysis; D015203:Reproducibility of Results; D012570:School Admission Criteria