Interrater and intrarater reliability in the evaluation of velopharyngeal insufficiency within a single institution.
OBJECTIVE
To explore the interrater and intrarater reliability in nasoendoscopic assessment of velopharyngeal (VP) function using the standardized reporting method described by Golding-Kushner within a single institution.


METHODS
Prospective blinded study.


METHODS
Academic, tertiary care, pediatric hospital.


METHODS
Six health care providers (2 pediatric otolaryngology faculty members, 2 pediatric otolaryngology fellows, and 2 speech pathologists) independently rated 50 videotaped nasoendoscopy segments twice. The segments on the videotape were obtained in a clinical setting.


METHODS
The Golding-Kushner rating system was used to rate VP function. Raters described VP closure quantitatively by rating palatal and lateral pharyngeal wall movement for each segment. They also qualitatively described characteristics of the VP gap, rated gap size as none, small, medium, or large, and estimated the percentage gap size relative to the resting position. Reliability coefficients were calculated for the data sets.


RESULTS
Fairly good interrater and intrarater reliability was seen in the quantitative measures. Faculty otolaryngologists rated segments more similarly to each other than did pediatric otolaryngology fellows, but intrarater reliability was similar for both the experienced and less experienced otolaryngologists. Less consistency was seen in the ratings of the speech pathologists. Raters tended to rate with less consistency when describing qualitative characteristics of the VP gap than when making quantitative measurements.


CONCLUSIONS
The Golding-Kushner scale is a reasonably reliable tool for reporting nasoendoscopic findings at our institution. However, these data also indicate that there exists room for improvement and that rater training may increase reliability.
Yoon
Patricia J
PJ
Department of Otolaryngology-Head and Neck Surgery, University of Colorado School of Medicine, The Children's Hospital, Denver, USA.
Starr
Jacqueline R
JR
Perkins
Jonathan A
JA
Bloom
David
D
Sie
Kathleen C Y
KC
D000293:Adolescent; D002648:Child; D002675:Child, Preschool; D004724:Endoscopy; D005260:Female; D006801:Humans; D008297:Male; D009296:Nasal Cavity; D015588:Observer Variation; D010160:Palate, Soft / Q000503:physiopathology; D010614:Pharynx / Q000503:physiopathology; D015203:Reproducibility of Results; D014681:Velopharyngeal Insufficiency / Q000175:diagnosis* / Q000503:physiopathology