title: Examining the influence of using same versus different questions on the reliability of the medical school preadmission interview.
abstract: BACKGROUND
  Researchers generally recommend a structured format for the medical school preadmission interview (MSPI). However, the relative benefits of various elements of structure remain unexamined.
  
  
  OBJECTIVE
  In this study, we compared the performance of a highly structured interview format with a semistructured format. Specifically, we examined how the reliability of interview ratings is likely to change when using the same versus different questions for each applicant being interviewed.
  
  
  METHODS
  Variance components from a generalizability (G) study of a structured interview are used in decision studies to compare the relative efficiency of using the same versus different questions for each applicant.
  
  
  RESULTS
  Using different questions for each interviewee is practically as reliable as using the same questions for all applicants (G = .55 vs. .57, respectively).
  
  
  CONCLUSIONS
  Because there are a number of drawbacks to using the same questions for all applicants (i.e., security and validity) and little advantage in terms of increased reliability, the semistructured question format should be considered when conducting the MSPI. A suggested method of implementing a semistructured interview is by presenting each applicant a set of questions randomly drawn from a pool of interview questions.
authors.affiliation: University of Iowa Carver College of Medicine, Iowa City, Iowa 52242-1000, USA. clarence-kreiter@uiowa.edu
authors.forename: Clarence D
authors.initials: CD
authors.lastname: Kreiter
authors.forename: Catherine
authors.initials: C
authors.lastname: Solow
authors.forename: Robert L
authors.initials: RL
authors.lastname: Brennan
authors.forename: Ping
authors.initials: P
authors.lastname: Yin
authors.forename: Kristi
authors.initials: K
authors.lastname: Ferguson
authors.forename: Kathi
authors.initials: K
authors.lastname: Huebner
mesh_terms: D004521:Educational Measurement; D006801:Humans; D007407:Interviews as Topic; D015203:Reproducibility of Results; D012570:School Admission Criteria; D012577:Schools, Medical; D013337:Students, Medical; D011795:Surveys and Questionnaires