title: The Generic Error Rating Tool: A Novel Approach to Assessment of Performance and Surgical Education in Gynecologic Laparoscopy.
abstract: OBJECTIVE
  Global rating scales are commonly used to rate surgeons' skill level. However, these tools lack granularity required for specific skill feedback. Recently, an alternative framework has been developed that is designed to measure technical errors during laparoscopy. The purpose of the present study was to gather validity evidence for the Generic Error Rating Tool (GERT) in gynecologic laparoscopy.
  
  
  METHODS
  Video recordings of total laparoscopic hysterectomies were analyzed by 2 blinded reviewers using the GERT and the Objective Structured Assessment of Technical Skills (OSATS) scale. Several sources of validity were examined according to the unitary framework of validity. Main outcomes were interrater and intrarater reliability regarding total number of errors and events. Further, surgeons were grouped according to OSATS scores (OSATS ≥ 28 = high performers and OSATS < 28 = low performers), and the number of errors and events was compared between groups. Correlation analysis between GERT and OSATS scores was performed. Lastly, error distribution within procedure steps was explored and compared between high- and low-performing surgeons.
  
  
  METHODS
  University teaching hospital.
  
  
  METHODS
  A total of 20 anonymized video recordings of total laparoscopic hysterectomies.
  
  
  RESULTS
  Interrater and intrarater reliability was high (intraclass correlation coefficient >0.95) for total number of errors and events. Low performers made significantly more errors than high performers did (median = 49.5 [interquartile range: 34.5-66] vs median = 31 [interquartile range: 16.75-35.25], p = 0.002). There was a significant negative correlation between individual OSATS scores and total number of errors (Spearman ρ = -0.76, p < 0.001, and ρ = -0.88, p < 0.001, for raters 1 and 2, respectively). Error distribution varied between operative steps, and low performers made more errors in some steps, but not in others.
  
  
  CONCLUSIONS
  GERT allows for objective and reproducible assessment of technical errors during gynecologic laparoscopy and could be used for performance analysis and personalized surgical education and training.
authors.affiliation: Division of Obstetrics and Gynaecology, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada; Department of Obstetrics and Gynecology, Medical University Vienna, Vienna, Austria. Electronic address: heinrich.husslein@meduniwien.ac.at.
authors.forename: Heinrich
authors.initials: H
authors.lastname: Husslein
authors.affiliation: Division of Obstetrics and Gynaecology, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada.
authors.forename: Lindsay
authors.initials: L
authors.lastname: Shirreff
authors.affiliation: Division of Obstetrics and Gynaecology, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada.
authors.forename: Eliane M
authors.initials: EM
authors.lastname: Shore
authors.affiliation: Division of Obstetrics and Gynaecology, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada.
authors.forename: Guylaine G
authors.initials: GG
authors.lastname: Lefebvre
authors.affiliation: Division of General Surgery, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada.
authors.forename: Teodor P
authors.initials: TP
authors.lastname: Grantcharov
mesh_terms: D002983:Clinical Competence; D007044:Hysterectomy / Q000193:education*; D010535:Laparoscopy / Q000193:education*; D019300:Medical Errors
keywords: Practice-Based Learning and Improvement; Professionalism; Systems-Based Practice; error analysis; gynecology; laparoscopy; surgical education; technical error