title: Impact of educational intervention on the interrater agreement of nasal endoscopy interpretation.
abstract: OBJECTIVE
  Nasal endoscopy is integral to the evaluation of sinonasal disorders. However, prior studies have shown significant variability in the interrater agreement of nasal endoscopy interpretation among practicing rhinologists. The objective of the current study is to evaluate the interrater agreement of nasal endoscopy among otolaryngology residents from a single training program at baseline and following an educational intervention.
  
  
  METHODS
  Eleven otolaryngology residents completed nasal endoscopy grading forms for eight digitally recorded nasal endoscopic examinations. An instructional lecture reviewing nasal endoscopy interpretation was subsequently provided. The residents then completed grading forms for eight different nasal endoscopic examinations. Interrater agreement among residents for the pre- and postlecture videos was calculated using the unweighted Fleiss' kappa (Kf) statistic and intraclass correlation agreement (ICC).
  
  
  RESULTS
  Interrater agreement improved from a baseline level of fair (Kf range 0.268-0.383) to a posteducational level of moderate (Kf range 0.401-0.547) for nasal endoscopy findings of middle meatus mucosa, middle turbinate mucosa, middle meatus discharge, sphenoethmoid recess mucosa, sphenoethmoid recess discharge, and atypical lesions (ICC, P < 0.001). The baseline level of agreement for evaluation of nasal septum deviation was poor/fair and did not improve following educational intervention.
  
  
  CONCLUSIONS
  This study demonstrates a limited baseline level of interrater agreement of nasal endoscopy interpretation among otolaryngology residents. The interrater agreement for the majority of the characteristics that were evaluated improved after educational intervention. Further study is needed to improve nasal endoscopy interpretation.
  
  
  METHODS
  N/A.
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, Mount Sinai Health Systems, New York, New York.
authors.forename: Patrick
authors.initials: P
authors.lastname: Colley
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon, U.S.A.
authors.forename: Jess C
authors.initials: JC
authors.lastname: Mace
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, Mount Sinai Health Systems, New York, New York.
authors.forename: Madeleine R
authors.initials: MR
authors.lastname: Schaberg
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon, U.S.A.
authors.forename: Timothy L
authors.initials: TL
authors.lastname: Smith
authors.affiliation: Department of Otolaryngology-Head and Neck Surgery, Mount Sinai Health Systems, New York, New York.
authors.forename: Abtin
authors.initials: A
authors.lastname: Tabaee
mesh_terms: D000328:Adult; D002983:Clinical Competence; D004724:Endoscopy / Q000193:education* / Q000379:methods / Q000706:statistics & numerical data; D005260:Female; D006801:Humans; D008297:Male; D009666:Nose; D015588:Observer Variation; D010036:Otolaryngology / Q000193:education*; D011996:Records
keywords: Nasal endoscopy; interrater agreement; otolaryngology; residency; sinusitis