title: Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery.
abstract: BACKGROUND
  There is no objective scale for assessment of operative skill in laparoscopic gastric bypass (LGBP). The objective of this study was to develop and demonstrate feasibility of use, validity, and reliability of a Bariatric Objective Structured Assessment of Technical Skill (BOSATS) scale.
  
  
  METHODS
  The BOSATS scale was developed using a hierarchical task analysis (HTA), a Delphi questionnaire, and a panel of international experts in bariatric surgery. The feasibility of use, reliability, and validity of the developed scale were demonstrated by reviewing 52 prospectively collected video recordings of LGBP performed by novice and experienced surgeons.
  
  
  RESULTS
  A total of 214 discrete steps were identified in HTA. A total of 12 and 17 panel members completed the first and second round of the Delphi questionnaire, respectively. Consensus among the panel was achieved after the second round (Cronbach's alpha = 0.85). The BOSATS scale demonstrated high inter-rater (intraclass correlation coefficient [ICC] = 0.954; p < 0.001) and test-retest reliability (ICC = 0.99; p < 0.001). Significant differences between BOSATS scores of experienced and novice surgeon groups were noted for the creation of jejunojejunostomy (JJ), gastric pouch, linear stapled gastrojejunostomy (GJ), circular stapled GJ, and hand-sewn GJ. Moderate to high correlations between BOSATS scale and Objective Structured Assessment of Technical Skills Global Rating Scale (OSATS GRS) were seen for JJ (rho = 0.59; p = 0.001), gastric pouch (rho = 0.48; p = 0.0004), linear stapled GJ (rho = 0.70; p = 0.0001), and hand-sewn GJ (rho = 0.96; p < 0.0001).
  
  
  CONCLUSIONS
  The BOSATS scale is a feasible to use, reliable, and valid instrument for objective assessment of operative performance in LGBP. Implementation of this scale is expected to facilitate deliberate practice and provide a means for future certification in bariatric surgery.
authors.affiliation: University of Toronto, Toronto, Canada. boris.zevin@utoronto.ca
authors.forename: Boris
authors.initials: B
authors.lastname: Zevin
authors.forename: Esther M
authors.initials: EM
authors.lastname: Bonrath
authors.forename: Rajesh
authors.initials: R
authors.lastname: Aggarwal
authors.forename: Nicolas J
authors.initials: NJ
authors.lastname: Dedy
authors.forename: Najma
authors.initials: N
authors.lastname: Ahmed
authors.forename: Teodor P
authors.initials: TP
authors.lastname: Grantcharov
mesh_terms: D000328:Adult; D002983:Clinical Competence / Q000592:standards*; D003697:Delphi Technique; D005240:Feasibility Studies; D005260:Female; D015390:Gastric Bypass / Q000379:methods* / Q000592:standards*; D006801:Humans; D020407:Internet; D010535:Laparoscopy / Q000379:methods / Q000592:standards; D059032:Learning Curve; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires; D013647:Task Performance and Analysis