title: In-training assessment and predictors of competency in endoscopic sinus surgery.
abstract: OBJECTIVE
  To evaluate the reliability and validity of the assessment tool for endoscopic sinus surgery when used in the operating room for in-training assessment of operative competency; to identify the tasks that may serve as the best indicators for overall surgical performance.
  
  
  METHODS
  Cross-sectional validation study.
  
  
  METHODS
  We implemented the global and checklist parts of the endoscopic sinus surgery (ESS) assessment tool to evaluate the surgical skills of 13 Otolaryngology-Head & Neck Surgery residents (PGY 1-5) in the operating room over a period of 15 months. Rhinology faculty scored residents' performance of every step of ESS at the end of each procedure using a previously validated tool. Construct validity was calculated by comparing scores across training levels (using analysis of variance [ANOVA]). Regression analysis was performed to identify tasks on the ESS checklist that most strongly correlated to the overall surgical performance.
  
  
  RESULTS
  Construct validity was demonstrated with senior residents performing better than junior residents. Average checklist and global scores improved with the number of days on rhinology rotation. "Identification of uncinate and boundaries" was found to be the strongest predictor of overall surgical performance.
  
  
  CONCLUSIONS
  The results indicate that this evaluation tool is a reliable and valid instrument for the assessment of surgical competency in the operating room. It can be used to identify weak areas of performance for which additional training may be required early in the rotation/training.
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University, Baltimore, Maryland, USA.
authors.forename: Kulsoom
authors.initials: K
authors.lastname: Laeeq
authors.forename: Raafeh
authors.initials: R
authors.lastname: Waseem
authors.forename: Robert A
authors.initials: RA
authors.lastname: Weatherly
authors.forename: Douglas D
authors.initials: DD
authors.lastname: Reh
authors.forename: Sandra Y
authors.initials: SY
authors.lastname: Lin
authors.forename: Andrew P
authors.initials: AP
authors.lastname: Lane
authors.forename: Masaru
authors.initials: M
authors.lastname: Ishii
authors.forename: Charles W
authors.initials: CW
authors.lastname: Cummings
authors.forename: Nasir I
authors.initials: NI
authors.lastname: Bhatti
mesh_terms: D002983:Clinical Competence; D004521:Educational Measurement; D004724:Endoscopy; D006801:Humans; D007396:Internship and Residency; D010036:Otolaryngology / Q000193:education*; D013517:Otorhinolaryngologic Surgical Procedures / Q000193:education* / Q000592:standards; D010256:Paranasal Sinuses / Q000601:surgery*; D015203:Reproducibility of Results