title: Development and implementation of the Structured Training Trainer Assessment Report (STTAR) in the English National Training Programme for laparoscopic colorectal surgery.
abstract: BACKGROUND
  There is a lack of educational tools available for surgical teaching critique, particularly for advanced laparoscopic surgery. The aim was to develop and implement a tool that assesses training quality and structures feedback for trainers in the English National Training Programme for laparoscopic colorectal surgery.
  
  
  METHODS
  Semi-structured interviews were performed and analysed, and items were extracted. Through the Delphi process, essential items pertaining to desirable trainer characteristics, training structure and feedback were determined. An assessment tool (Structured Training Trainer Assessment Report-STTAR) was developed and tested for feasibility, acceptability and educational impact.
  
  
  RESULTS
  Interview transcripts (29 surgical trainers, 10 trainees, four educationalists) were analysed, and item lists created and distributed for consensus opinion (11 trainers and seven trainees). The STTAR consisted of 64 factors, and its web-based version, the mini-STTAR, included 21 factors that were categorised into four groups (training structure, training behaviour, trainer attributes and role modelling) and structured around a training session timeline (beginning, middle and end). The STTAR (six trainers, 48 different assessments) demonstrated good internal consistency (α = 0.88) and inter-rater reliability (ICC = 0.75). The mini-STTAR demonstrated good inter-item reliability (α = 0.79) and intra-observer reliability on comparison of 85 different trainer/trainee combinations (r = 0.701, p = <0.001). Both were found to be feasible and acceptable. The educational report for trainers was found to be useful (4.4 out of 5).
  
  
  CONCLUSIONS
  An assessment tool that evaluates training quality was developed and shown to be reliable, acceptable and of educational value. It has been successfully implemented into the English National Training Programme for laparoscopic colorectal surgery.
authors.affiliation: Department of Surgery and Cancer, St Mary's Hospital, Imperial College London, London, UK. susannah.wyles@imperial.ac.uk.
authors.forename: Susannah M
authors.initials: SM
authors.lastname: Wyles
authors.affiliation: St James University Hospital, Leeds, UK.
authors.forename: Danilo
authors.initials: D
authors.lastname: Miskovic
authors.affiliation: National Training Programme, Department of Surgery and Cancer, St Mary's Hospital, Imperial College London, London, UK.
authors.forename: Zhifang
authors.initials: Z
authors.lastname: Ni
authors.affiliation: Department of Surgery and Cancer, St Mary's Hospital, Imperial College London, London, UK.
authors.forename: Ara W
authors.initials: AW
authors.lastname: Darzi
authors.affiliation: Department of Gastroenterology, Gloucestershire Hospitals NHS Foundation Trust, Gloucester, UK.
authors.forename: Roland M
authors.initials: RM
authors.lastname: Valori
authors.affiliation: National Training Programme, Derriford Hospital, Plymouth, UK.
authors.forename: Mark G
authors.initials: MG
authors.lastname: Coleman
authors.affiliation: National Training Programme, Department of Surgery and Cancer, St Mary's Hospital, Imperial College London, Praed St, London, W2 1NY, UK. g.hanna@imperial.ac.uk.
authors.forename: George B
authors.initials: GB
authors.lastname: Hanna
mesh_terms: D003107:Colorectal Surgery / Q000193:education*; D003697:Delphi Technique; D004521:Educational Measurement / Q000379:methods*; D005246:Feedback; D006801:Humans; D010535:Laparoscopy / Q000193:education*; D015203:Reproducibility of Results; D006113:United Kingdom
keywords: Assessment; Education; Feedback; Surgery; Teaching; Training