Examining the influence of using same versus different questions on the reliability of the medical school preadmission interview.
BACKGROUND
Researchers generally recommend a structured format for the medical school preadmission interview (MSPI). However, the relative benefits of various elements of structure remain unexamined.


OBJECTIVE
In this study, we compared the performance of a highly structured interview format with a semistructured format. Specifically, we examined how the reliability of interview ratings is likely to change when using the same versus different questions for each applicant being interviewed.


METHODS
Variance components from a generalizability (G) study of a structured interview are used in decision studies to compare the relative efficiency of using the same versus different questions for each applicant.


RESULTS
Using different questions for each interviewee is practically as reliable as using the same questions for all applicants (G = .55 vs. .57, respectively).


CONCLUSIONS
Because there are a number of drawbacks to using the same questions for all applicants (i.e., security and validity) and little advantage in terms of increased reliability, the semistructured question format should be considered when conducting the MSPI. A suggested method of implementing a semistructured interview is by presenting each applicant a set of questions randomly drawn from a pool of interview questions.
Kreiter
Clarence D
CD
University of Iowa Carver College of Medicine, Iowa City, Iowa 52242-1000, USA. clarence-kreiter@uiowa.edu
Solow
Catherine
C
Brennan
Robert L
RL
Yin
Ping
P
Ferguson
Kristi
K
Huebner
Kathi
K
D004521:Educational Measurement; D006801:Humans; D007407:Interviews as Topic; D015203:Reproducibility of Results; D012570:School Admission Criteria; D012577:Schools, Medical; D013337:Students, Medical; D011795:Surveys and Questionnaires