title: Traditional finals and OSCEs in predicting consultant and self-reported clinical skills of PRHOs: a pilot study.
abstract: BACKGROUND
  As we move from standard 'long case' final examinations to new objective structured formats, we need to ensure the new is at least as good as the old. Furthermore, knowledge of which examination format best predicts medical student progression and clinical skills development would be of value.
  
  
  METHODS
  A group of medical students sat both the standard long case examination and the new objective structured clinical examination (OSCE) to introduce this latter examination to our Medical School for final MB. At the end of their pre-registration year, the group and their supervising consultants submitted performance evaluation questionnaires.
  
  
  RESULTS
  Thirty medical students sat both examinations and 20 returned evaluation questionnaires. Of the 72 consultants approached, 60 (83%) returned completed questionnaires. No correlation existed between self- and consultant reported performance. The traditional finals examination was inversely associated with consultant assessment. Better performing students were not rated as better doctors. The OSCE (and its components) was more consistent and showed positive associations with consultant ratings across the board.
  
  
  CONCLUSIONS
  Major discrepancies exist between the 2 examination formats, in data interpretation and practical skills, which are explicitly tested in OSCEs but less so in traditional finals. Standardised marking schemes may reduce examiner variability and discretion and weaken correlations across the 2 examinations. This pilot provides empirical evidence that OSCEs assess different clinical domains than do traditional finals. Additionally, OSCEs improve prediction of clinical performance as assessed by independent consultants.
  
  
  CONCLUSIONS
  Traditional finals and OSCEs correlate poorly with one another. Objective structured clinical examinations appear to correlate well with consultant assessment at the end of the pre-registration house officer year.
authors.affiliation: Division of Medicine, University of Bristol, Bristol Royal Infirmary, Bristol, UK.
authors.forename: Christopher S
authors.initials: CS
authors.lastname: Probert
authors.forename: David J
authors.initials: DJ
authors.lastname: Cahill
authors.forename: Gemma L
authors.initials: GL
authors.lastname: McCann
authors.forename: Yoav
authors.initials: Y
authors.lastname: Ben-Shlomo
mesh_terms: D002983:Clinical Competence / Q000592:standards*; D003479:Curriculum; D004504:Education, Medical, Undergraduate / Q000592:standards*; D004521:Educational Measurement / Q000592:standards; D004739:England; D006801:Humans; D010865:Pilot Projects; D011795:Surveys and Questionnaires