title: New machine-marked tests for selection into core medical training: evidence from two validation studies.
abstract: This study examined whether two machine-marked tests (MMTs; a clinical problem-solving test and situational judgement test), previously validated for selection into U.K. general practice (GP) training, could provide a valid methodology for shortlisting into core medical training (CMT). A longitudinal design was used to examine the MMTs' psychometric properties in CMT samples, and correlations between MMT scores and CMT interview outcomes. Independent samples from two years were used: in 2008, a retrospective analysis was conducted (n=1711), while in 2009, CMT applicants completed the MMTs for evaluation purposes (n=2265). Both MMTs showed good reliability in CMT samples, similar to GP samples. Both MMTs were good predictors of CMT interview performance (r = 0.56, p < 0.001 in 2008; r = 0.61, p < 0.001 in 2009) and offered incremental validity over the current shortlisting process. The GP MMTs offer an appropriate measurement methodology for selection into CMT, representing a significant innovation for selection methodology.
authors.affiliation: City University, London. f.patterson@city.ac.uk
authors.forename: Fiona
authors.initials: F
authors.lastname: Patterson
authors.forename: Victoria
authors.initials: V
authors.lastname: Carr
authors.forename: Lara
authors.initials: L
authors.lastname: Zibarras
authors.forename: Bill
authors.initials: B
authors.lastname: Burr
authors.forename: Liz
authors.initials: L
authors.lastname: Berkin
authors.forename: Simon
authors.initials: S
authors.lastname: Plint
authors.forename: Bill
authors.initials: B
authors.lastname: Irish
authors.forename: Simon
authors.initials: S
authors.lastname: Gregory
mesh_terms: D000328:Adult; D002983:Clinical Competence; D003099:College Admission Test; D005194:Family Practice / Q000193:education*; D005260:Female; D006801:Humans; D007600:Judgment; D008137:Longitudinal Studies; D008297:Male; D011237:Predictive Value of Tests; D011340:Problem Solving; D011594:Psychometrics; D015203:Reproducibility of Results; D012570:School Admission Criteria; D006113:United Kingdom