Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery.
BACKGROUND
Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, the objectivity and interrater agreement of the procedure related findings have not been well studied, especially in patients who have previously had sinus surgery.


METHODS
Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computed tomography (CT) and completed the Sinonasal Outcome Test (SNOT-22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss' kappa statistic (K(f) ) and the prevalence- and bias-adjusted kappa (PABAK).


RESULTS
There were no significant correlations between age, Lund-Mackay score, or SNOT-22 score. Interrater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (K(f) = 0.886); moderate for the assessments of middle turbinate (MT) integrity (K(f) = 0.543), MT position (K(f) = 0.443), maxillary sinus patency (K(f) = 0.593), and ethmoid sinus patency (K(f) = 0.429); fair for discharge (K(f) = 0.314), synechiae (K(f) = 0.257), and middle meatus patency (K(f) = 0.229); and poor for MT mucosal changes (K(f) = 0.148) and uncinate process (K(f) = 0.126).


CONCLUSIONS
This study was notable for variability in the interrater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice.
Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medical College, New York, NY 10003, USA.
Edward D
ED
McCoul
Timothy L
TL
Smith
Jess C
JC
Mace
Vijay K
VK
Anand
Brent A
BA
Senior
Peter H
PH
Hwang
James A
JA
Stankiewicz
Abtin
A
Tabaee
D000328:Adult; D000368:Aged; D002908:Chronic Disease; D002983:Clinical Competence / Q000592:standards; D004724:Endoscopy / Q000379:methods* / Q000523:psychology / Q000592:standards; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D009298:Nasal Polyps / Q000175:diagnosis / Q000523:psychology / Q000601:surgery; D015588:Observer Variation; D010036:Otolaryngology / Q000592:standards; D011446:Prospective Studies; D011788:Quality of Life; D012086:Reoperation / Q000379:methods / Q000523:psychology; D012220:Rhinitis / Q000175:diagnosis / Q000523:psychology / Q000601:surgery*; D012307:Risk Factors; D012852:Sinusitis / Q000175:diagnosis / Q000523:psychology / Q000601:surgery*; D014057:Tomography, X-Ray Computed; D014741:Video Recording; D055815:Young Adult