title: Supervised learning events: direct observation of procedural skills pilot.
abstract: BACKGROUND
  Workplace-based assessment (WBA) is the assessment of specialist competence based on what a trainee doctor actually does in the workplace. Between January 2014 and January 2015, all UK occupational medicine (OM) trainees were invited to test a suite of direct observation of procedural skills (DOPS) tools designed in a supervised learning event (SLE) format. The Faculty of Occupational Medicine (FOM) Workplace-Based Assessment Advisory Group (WBAAG) studied feedback on the new format.
  
  
  OBJECTIVE
  To assess the utility of the redesigned tools, including their acceptability, feasibility, usability and key aspects of their reliability and validity.
  
  
  METHODS
  The face and content validity of the new forms were assessed by a comprehension trial (CT), inter-rater reliability by a video scoring exercise and usability and acceptability by an electronic survey of trainees and trainers.
  
  
  RESULTS
  The CT of trainees and trainers indicated that the face and content validity of the revised tools were acceptable. Inter-rater reliability video assessments indicated there was consistency of grading among trainers. Sixty-eight per cent of trainees and 95% of trainers agreed that the redesigned tools were an improvement on the current WBA DOPS tools and 83% of trainees indicated the new tools encouraged them to reflect on their performance.
  
  
  CONCLUSIONS
  The results from this pilot study provided evidence to support a request to the General Medical Council (GMC) for the new SLE-DOPS forms to be used for WBA in OM. These changes were accepted by the GMC in January 2016 for implementation in April 2016.
authors: Department of Occupational Health and Wellbeing, King's College Hospital, London SE5 9RS, UK.
authors: L
authors: L
authors: Batty
authors: Occupational Medicine Department, Headquarters Army Recruitment and Training Division, Upavon, Pewsey, Wiltshire SN9 6BE, UK.
authors: K
authors: K
authors: McKinnon
authors: Occupational Health Department, Southampton General Hospital, Ground Level, Block 4, Mailpoint 100, Southampton SO16 6YD, UK.
authors: A
authors: A
authors: Skidmore
authors: Faculty of Occupational Medicine, 69-73 Theobalds Road, London WC1X 8TA, UK.
authors: M
authors: M
authors: McKinnon
keywords: Direct observation of procedural skills (DOPS); supervised learning event (SLE); workplace-based assessment (WBA).