The effect of visible speech in the perceptual rating of pathological voices.
OBJECTIVE
To test a simple method for improving consistency among raters for the perceptual evaluation of pathological voice quality by providing visible speech (spectrogram) as additional information because, to date, the interrater variability still limits the widespread clinical use of the best available rating system.


METHODS
Experimental comparison between 2 different ways (with and without the addition of visible speech) of perceptual rating by trained professionals of recorded pathological voices. Furthermore, the correlation between acoustical (jitter, shimmer, and noise-harmonic ratio) and perceptual parameters was investigated in both rating conditions.


METHODS
Six experts evaluated 70 recorded pathological voices using the GIRBAS (grade, instability, roughness, breathiness, asthenicity, and strain) scale in 2 separate sessions: first, conventionally, without visible speech as additional information, and several months later, with visible speech as additional information.


METHODS
The kappa interrater agreement and the correlation coefficient between GIRBAS scores and acoustic measures.


RESULTS
We found a significant effect of visible speech on the agreement between the raters. The interrater agreement according to kappa statistics was significantly stronger with the addition of visible speech than without for rating grade, roughness, and breathiness. The correlation between acoustical and perceptual parameters showed no significant effect of visible speech.


CONCLUSIONS
The addition of visible speech to the perceptual evaluation of pathological voices is an interesting clinical asset to enhance its reliability. The addition of visible speech to the clinical setting is feasible, since affordable computer programs are currently available that can provide the spectrogram in quasi-real time while conversing with the patient. The acoustical analysis might be applied in addition to perceptual rating in a multidimensional approach to assess voice quality.
Martens
Jan W M A F
JW
The Institute of Phoniatrics, Department of Otorhinolaryngology, University Medical Centre Utrecht, Utrecht, the Netherlands.
Versnel
Huib
H
Dejonckere
Philippe H
PH
D006801:Humans; D015588:Observer Variation; D013018:Sound Spectrography; D013061:Speech Acoustics; D013067:Speech Perception; D014832:Voice Disorders / Q000175:diagnosis* / Q000503:physiopathology; D014833:Voice Quality