title: Candidate Evaluation Using Targeted Construct Assessment in the Multiple Mini-Interview: A Multifaceted Rasch Model Analysis.
abstract: Construct: A 7-station multiple mini-interview (MMI) circuit was implemented and assessed for 214 candidates rated by 37 interviewers (N = 1,498 ratings). The MMI stations were designed to assess 6 specific constructs (adaptability, empathy, integrity, critical thinking, teamwork [receiving instruction], teamwork [giving instruction]) and one open station about the candidate's interest in the school.
  
  
  BACKGROUND
  Despite the apparent benefits of the MMI, construct-irrelevant variance continues to be a topic of study. Refining the MMI to more effectively measure candidate ability is critical to improving our ability to identify and select candidates that are equipped for success within health professions education and the workforce.
  
  
  METHODS
  Each station assessed a single construct and was rated by a single interviewer who was provided only the name of the candidate and no additional information about the candidate's background, application, or prior academic performance. All interviewers received online and in-person training in the fall prior to the MMI and the morning of the MMI. A 3-facet multifaceted Rasch measurement analysis was completed to determine interviewer severity, candidate ability, and MMI station difficulty and examine how the model performed overall (e.g., rating scale).
  
  
  RESULTS
  Altogether, the Rasch measures explained 62.84% of the variance in the ratings. Differences in candidate ability explained 45.28% of the variance in the data, whereas differences in interviewer severity explained 16.09% of the variance in the data. None of the interviewers had Infit or Outfit mean-square scores greater than 1.7, and only 2 (5.4%) had mean-square scores less than 0.5.
  
  
  CONCLUSIONS
  The data demonstrated acceptable fit to the multifaceted Rasch measurement model. This work is the first of its kind in pharmacy and provides insight into the development of an MMI that provides useful and meaningful candidate assessment ratings for institutional decision making.
authors.affiliation: a Office of Strategic Planning and Assessment, UNC Eshelman School of Pharmacy, UNC Chapel Hill , North Carolina , USA.
authors.forename: Jacqueline E
authors.initials: JE
authors.lastname: McLaughlin
authors.affiliation: b UNC Eshelman School of Pharmacy, UNC Chapel Hill , North Carolina , USA.
authors.forename: David
authors.initials: D
authors.lastname: Singer
authors.affiliation: c Office of Professional Education, UNC Eshelman School of Pharmacy, UNC Chapel Hill , North Carolina , USA.
authors.forename: Wendy C
authors.initials: WC
authors.lastname: Cox
mesh_terms: D005260:Female; D006801:Humans; D007406:Interview, Psychological; D008297:Male; D036301:Qualitative Research; D012570:School Admission Criteria; D013337:Students, Medical
keywords: MFRM; Multiple mini-interview; Rasch modeling; admissions; student selection