title: Internet-based multiple mini-interviews for candidate selection for graduate entry programmes.
abstract: BACKGROUND
  Multiple mini-interviews (MMIs) have been used by The University of Sydney graduate medical and dental programmes since 2006. In 2011, interviews with international candidates were conducted using Skype (iMMI), whereas interviews with local candidates were conducted in person. We determined whether the MMI scores derived from both methods were comparable. We describe the feasibility, acceptability and cost-effectiveness of the iMMI.
  
  
  METHODS
  We compared 2011 international student internet-based iMMI results with data from 2009 international student MMIs and 2011 local student MMIs. Analyses of variance (anovas) were used to investigate equivalence of the two formats by exploring whether the medium of interviewing resulted in significantly different mean scores and variance for the in-person MMI and the iMMI. Acceptability of the process was informed by feedback surveys from interviewers and candidates, and cost savings were estimated.
  
  
  RESULTS
  No significant difference was found between the 2011 iMMI scores for international candidates and MMI scores in 2009 (p > 0.05). There was no significant difference between the MMI scores for local and international candidates in 2011 (p > 0.05); the MMI scores for international candidates had greater variation (p < 0.01). Using generalisability theory, the reliability of the nine-question iMMI was 0.76 and for the MMI was 0.70. Delivery of the iMMI occurred smoothly and candidates and interviewers gave positive feedback on its format and delivery. Cost savings have been estimated to be over AU$50 000, representing an 84% saving.
  
  
  CONCLUSIONS
  We believe this is the first study reporting an internet-based MMI for a high stakes interview. We have shown that interviewers were able to make valid and reliable decisions about candidates through the iMMI in a process that was acceptable to participants, producing comparable results to the in-person MMI with a saving of resources. The slightly wider variance in iMMI scores warrants further investigation.
authors.affiliation: The University of Sydney, Sydney, Australia. dtiller@sydney.edu.au
authors.forename: David
authors.initials: D
authors.lastname: Tiller
authors.forename: Deborah
authors.initials: D
authors.lastname: O'Mara
authors.forename: Imogene
authors.initials: I
authors.lastname: Rothnie
authors.forename: Stewart
authors.initials: S
authors.lastname: Dunn
authors.forename: Lily
authors.initials: L
authors.lastname: Lee
authors.forename: Chris
authors.initials: C
authors.lastname: Roberts
mesh_terms: D000704:Analysis of Variance; D003099:College Admission Test; D004503:Education, Medical, Graduate / Q000592:standards*; D006801:Humans; D020407:Internet / Q000706:statistics & numerical data*; D012570:School Admission Criteria