Speech tasks and interrater reliability in perceptual voice evaluation.
OBJECTIVE
The optimal selection of speech task is essential for more reliable perceptual ratings and a better understanding of the perceptual qualities of pathologic voices. Nevertheless, researchers have rarely explored this issue using the GRBAS scale. This study investigates the effect of speech task selection on interrater reliability during perceptual voice assessment.


METHODS
Experimental study.


METHODS
Sixty subjects, 39 dysphonic subjects and 21 normal controls, performed 13 speech tasks including three 5-second sustained vowel sounds (/ɑ/, /i/, and /u/) each at three pitch levels (high, habitual, and low), maximum phonation of the vowel /ɑ/, pitch glide, counting from 1 to 10, and oral reading of the Rainbow Passage. A group of 18 graduate students in speech-language pathology served as perceptual judges and rated the dysphonic severity for the speech samples based on three parameters in the GRBAS scale-Grade, Roughness, and Breathiness. The formalism of the AC1 statistic proposed by Gwet was applied to determine relative reliability between the speech tasks and the raters.


RESULTS
The counting task and sustained vowel /ɑ/ in high, habitual, and low registers exhibited the most reproducibility and consequently the highest reliability statistic.


CONCLUSIONS
The counting task and sustained /ɑ/ phonation are the optimal tasks for perceptual voice judgment in regard to interrater reliability. Future perceptional studies may benefit from this finding to determine the relationship between speech task selection and the validity of any given perceptual rating system in terms of sensitivity and specificity.
Department of Speech and Hearing Sciences, University of North Texas, Denton, Texas. Electronic address: flu@unt.edu.
Fang-Ling
FL
Lu
Department of Physics, University of North Texas, Denton, Texas.
Samuel
S
Matteson
D000293:Adolescent; D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D016022:Case-Control Studies; D055154:Dysphonia / Q000175:diagnosis* / Q000503:physiopathology / Q000523:psychology; D005260:Female; D006801:Humans; D007600:Judgment; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D010699:Phonation; D011237:Predictive Value of Tests; D011379:Prognosis; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D013061:Speech Acoustics; D013067:Speech Perception; D013068:Speech Production Measurement; D014833:Voice Quality; D055815:Young Adult
Contextual speech; GRBAS scale; Interrater reliability; Sustained vowel phonation