title: Evaluation of two selection tests for recruitment into radiology specialty training.
abstract: BACKGROUND
  This study evaluated whether two selection tests previously validated for primary care General Practice (GP) trainee selection could provide a valid shortlisting selection method for entry into specialty training for the secondary care specialty of radiology.
  
  
  METHODS
  We conducted a retrospective analysis of data from radiology applicants who also applied to UK GP specialty training or Core Medical Training. The psychometric properties of the two selection tests, a clinical problem solving (CPS) test and situational judgement test (SJT), were analysed to evaluate their reliability. Predictive validity of the tests was analysed by comparing them with the current radiology selection assessments, and the licensure examination results taken after the first stage of training (Fellowship of the Royal College of Radiologists (FRCR) Part 1).
  
  
  RESULTS
  The internal reliability of the two selection tests in the radiology applicant sample was good (α ≥ 0.80). The average correlation with radiology shortlisting selection scores was r = 0.26 for the CPS (with p < 0.05 in 5 of 11 shortlisting centres), r = 0.15 for the SJT (with p < 0.05 in 2 of 11 shortlisting centres) and r = 0.25 (with p < 0.05 in 5 of 11 shortlisting centres) for the two tests combined. The CPS test scores significantly correlated with performance in both components of the FRCR Part 1 examinations (r = 0.5 anatomy; r = 0.4 physics; p < 0.05 for both). The SJT did not correlate with either component of the examination.
  
  
  CONCLUSIONS
  The current CPS test may be an appropriate selection method for shortlisting in radiology but would benefit from further refinement for use in radiology to ensure that the test specification is relevant. The evidence on whether the SJT may be appropriate for shortlisting in radiology is limited. However, these results may be expected to some extent since the SJT is designed to measure non-academic attributes. Further validation work (e.g. with non-academic outcome variables) is required to evaluate whether an SJT will add value in recruitment for radiology specialty training and will further inform construct validity of SJTs as a selection methodology.
authors.affiliation: Department of Psychology, Downing Street, Cambridge, CB2 3 EB, UK.|Work Psychology Group, 27 Brunel Parkway, Pride Park, Derbyshire, DE24 8HR, UK.
authors.forename: Fiona
authors.initials: F
authors.lastname: Patterson
authors.affiliation: Work Psychology Group, 27 Brunel Parkway, Pride Park, Derbyshire, DE24 8HR, UK.
authors.forename: Alec
authors.initials: A
authors.lastname: Knight
authors.affiliation: Department of Radiology, Morriston Hospital, Swansea, West Glamorgan, SA6 6NL, UK.
authors.forename: Liam
authors.initials: L
authors.lastname: McKnight
authors.affiliation: Department of Neuroradiology, King's College Hospital NHS Foundation Trust, London, SE5 9RS, UK. tombooth@doctors.org.uk.
authors.forename: Thomas C
authors.initials: TC
authors.lastname: Booth
mesh_terms: D000328:Adult; D002983:Clinical Competence / Q000592:standards*; D004503:Education, Medical, Graduate; D004521:Educational Measurement; D005260:Female; D058006:General Practice / Q000193:education; D006801:Humans; D008297:Male; D010560:Personnel Selection / Q000592:standards*; D011871:Radiology / Q000193:education* / Q000592:standards; D015203:Reproducibility of Results; D012189:Retrospective Studies; D013038:Specialization; D006113:United Kingdom
keywords: Radiology; Recruitment; Secondary care; Selecting; Selection; Shortlist; Shortlisting; Specialty training