New machine-marked tests for selection into core medical training: evidence from two validation studies.
This study examined whether two machine-marked tests (MMTs; a clinical problem-solving test and situational judgement test), previously validated for selection into U.K. general practice (GP) training, could provide a valid methodology for shortlisting into core medical training (CMT). A longitudinal design was used to examine the MMTs' psychometric properties in CMT samples, and correlations between MMT scores and CMT interview outcomes. Independent samples from two years were used: in 2008, a retrospective analysis was conducted (n=1711), while in 2009, CMT applicants completed the MMTs for evaluation purposes (n=2265). Both MMTs showed good reliability in CMT samples, similar to GP samples. Both MMTs were good predictors of CMT interview performance (r = 0.56, p < 0.001 in 2008; r = 0.61, p < 0.001 in 2009) and offered incremental validity over the current shortlisting process. The GP MMTs offer an appropriate measurement methodology for selection into CMT, representing a significant innovation for selection methodology.
Patterson
Fiona
F
City University, London. f.patterson@city.ac.uk
Carr
Victoria
V
Zibarras
Lara
L
Burr
Bill
B
Berkin
Liz
L
Plint
Simon
S
Irish
Bill
B
Gregory
Simon
S
D000328:Adult; D002983:Clinical Competence; D003099:College Admission Test; D005194:Family Practice / Q000193:education*; D005260:Female; D006801:Humans; D007600:Judgment; D008137:Longitudinal Studies; D008297:Male; D011237:Predictive Value of Tests; D011340:Problem Solving; D011594:Psychometrics; D015203:Reproducibility of Results; D012570:School Admission Criteria; D006113:United Kingdom