title: Developing criteria for proficiency-based training of surgical technical skills using simulation: changes in performances as a function of training year.
abstract: BACKGROUND
  Proficiency-based residency training programs can be more efficient than the current duration-based formats. For their successful implementation, appropriate proficiency criteria must be developed. The objective of this study was to investigate the relationship between technical skill performances assessed using computer- and expert-based methods and training year. An assumption was that asymptotes in performance as a function of training year can be used to set the proficiency level for a technical skill, so the value at which the asymptote occurs can be labeled as the proficiency criteria.
  
  
  METHODS
  Thirty-eight general surgery residents performed one-handed knot tying on bench-top simulators at two levels of difficulty: superficial and deep. Motion-efficiency measures and expert-based measures were used to evaluate performance. Total number of operations (ie, surgical volume) that each trainee participated in during residency was also acquired.
  
  
  RESULTS
  On the superficial model, asymptotes were observed at year 1 for motion-efficiency and year 3 for expert-based measures. On the deep model, asymptotes were observed at year 2 for motion-efficiency and year 4 for expert-based measures.
  
  
  CONCLUSIONS
  The data demonstrate the challenges associated with defining technical skills proficiency criteria. Different asymptotes were observed for the two assessment methods and neither covaried substantially with surgical volume. These data suggest that this asymptote approach in defining proficiency criteria can be suitable for development of proficiency-based residency training programs. The sensitivity of this approach to the type of assessment method and to the functional difficulty of the simulators used for assessment must be considered.
authors.affiliation: Wilson Centre, University of Toronto, Toronto, Ontario, Canada.
authors.forename: Ryan
authors.initials: R
authors.lastname: Brydges
authors.forename: Allison
authors.initials: A
authors.lastname: Kurahashi
authors.forename: Vera
authors.initials: V
authors.lastname: Brümmer
authors.forename: Lisa
authors.initials: L
authors.lastname: Satterthwaite
authors.forename: Roger
authors.initials: R
authors.lastname: Classen
authors.forename: Adam
authors.initials: A
authors.lastname: Dubrowski
mesh_terms: D002983:Clinical Competence; D003162:Competency-Based Education; D003198:Computer Simulation; D003430:Cross-Sectional Studies; D004521:Educational Measurement / Q000379:methods*; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D009048:Motor Skills / Q000502:physiology*; D013536:Suture Techniques / Q000193:education*; D013997:Time Factors