title: Correlation of selection scores with subsequent assessment scores during surgical training.
abstract: BACKGROUND
  Determining admission criteria to select candidates most likely to succeed in surgical training in Australia and New Zealand has been an imprecise art with little empirical evidence informing decisions. Selection to the Royal Australasian College of Surgeons' Surgical Education and Training programme is based entirely on applicants' performance in structured curriculum vitae (CV), referees' reports and interviews. This retrospective review compared General Surgery (GS) trainees' performance in selection with subsequent performance in assessments during training.
  
  
  METHODS
  Data from three cohorts of GS trainees were sourced. Scores for four selection items were compared with scores from six training assessments. Interrelationships within each of the sets of selection and assessment variables were determined.
  
  
  RESULTS
  A single significant relationship was found between scores on the three selection tools. High scores in the CV did not correlate with higher scores in any subsequent assessments. The structured referee report score, multi-station interview score and total selection score all correlated with performance in subsequent work-based assessments and examinations. Direct observation of procedural skills (DOPS) scores appear to reflect increasing acquisition of operative skills. Performance in mini clinical examinations (Mini-CEX) was variable, perhaps reflecting limitations of this assessment. Candidates who perform well in one examination tend to perform well in all three examinations.
  
  
  CONCLUSIONS
  No selection tool demonstrated strong relationships with scores in all subsequent assessments; however referee reports, multi-station interviews and total selection scores are indicators for performance in particular assessments. This may engender confidence that candidates admitted into the GS training programme are likely to progress successfully through the programme.
authors: Education Development and Research Department, Royal Australasian College of Surgeons, Melbourne, Victoria, Australia. zaita.oldfield@surgeons.org
authors: Zaita
authors: Z
authors: Oldfield
authors: Spencer W
authors: SW
authors: Beasley
authors: Julian
authors: J
authors: Smith
authors: Adrian
authors: A
authors: Anthony
authors: Anthony
authors: A
authors: Watt
mesh_terms: D044362:Australasia; D002983:Clinical Competence; D004502:Education, Medical, Continuing / Q000379:methods*; D004521:Educational Measurement; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency / Q000379:methods*; D012189:Retrospective Studies; D013043:Specialties, Surgical / Q000193:education*