Investigating the reliability of the medical school admissions interview.
OBJECTIVE
Determining the valid and fair use of the interview for medical school admissions is contingent upon a demonstration of the reproducibility of interview scores. This study seeks to establish the generalizability of interview scores, first assessing the existing research evidence, and then analyzing data from a non-experimental independent replications research design.


METHODS
Multivariate and univariate generalizability analyses are conducted using data from a structured interview obtained from a population of medical school applicants over two years.


RESULTS
The existing literature does not provide sufficient evidence regarding interview reliability. In this study, interview scores derived from a standardized interview were found to display low to moderate levels of reliability. Interview scores do not appear to possess the level of precision found with other measures commonly used to facilitate admissions decisions.


CONCLUSIONS
Given the results obtained, the fairness of using the interview as a highly influential component of the admission process is called into question. Methods for using interview data in a psychometrically defensible fashion are discussed. Specifically, attention to decision reliability provides guidance on how interview scores can best be integrated into the admissions process.
Kreiter
Clarence D
CD
University of Iowa, College of Medicine, Iowa City, IA 52242, USA. clarence-kreiter@uiowa.edu
Yin
Ping
P
Solow
Catherine
C
Brennan
Robert L
RL
D004504:Education, Medical, Undergraduate; D004521:Educational Measurement; D006801:Humans; D007407:Interviews as Topic / Q000592:standards*; D015999:Multivariate Analysis; D015203:Reproducibility of Results; D012570:School Admission Criteria