Audio-perceptual evaluation of Portuguese voice disorders-an inter- and intrajudge reliability study.
OBJECTIVE
The aim of this article was to describe the results of an audio-perceptual evaluation carried out by 10 judges, on a database comprising 90 voice recordings plus 10 samples repetition, with the purpose of characterizing the intra- and interrater reliability.


METHODS
Exploratory, transversal.


METHODS
The classification of the GRBAS parameters was obtained for each one of the 10 experts, concerning the 90 voice samples. The intraclass correlation coefficient determined the interrater reliability. For the 10 repeated voices, the intrarater reliability was assessed by means of a dispersion analysis.


RESULTS
The average judges' classification for each of the GRBAS parameters differs (P < 0.05). The values of the correlations, with confidence intervals of 95%, between the average scores for all components of the GRBAS scale lie, in general, between 0.838 and 0.966. The first three parameters of the scale (G, R, and B) have the higher interrater reliability. Differences were statistically significant (P < 0.05) for experts 1, 6, 9, and 10, which means a poor intrarater reliability for 40% of the judges.


CONCLUSIONS
All the experts had similar evaluation criteria for the assessment of the five parameters of the GRBAS scale (the values of the confidence intervals at 95% of the experts average ratings of the GRB were above 0.8). However, its quantification is not statistically similar. Asthenia and Strain have lower reliability. Most experts do not reveal statistically significant differences between the values assigned to the GRB parameters (P > 0.05).
Neuroscience Department, Speech Pathology Unit of Otolaryngology Service, Centro Hospitalar do Porto, Porto, Portugal; Speech Therapy Department, Faculty of Health Sciences, Universidade Fernando Pessoa, Porto, Portugal; Biomedical Engineering Department, Faculty of Engineering, Universidade do Porto, Porto, Portugal. Electronic address: svazfreitas@gmail.com.
Susana
S
Vaz Freitas
Speech Therapy Department, Faculty of Health Sciences, Universidade Fernando Pessoa, Porto, Portugal.
Pedro Melo
PM
Pestana
Electrical and Computer Engineering Department, Faculty of Engineering, Universidade do Porto, Porto, Portugal.
Vítor
V
Almeida
Electrical and Computer Engineering Department, Faculty of Engineering, Universidade do Porto, Porto, Portugal.
Aníbal
A
Ferreira
D006801:Humans; D007802:Language; D015588:Observer Variation; D011174:Portugal; D011237:Predictive Value of Tests; D015203:Reproducibility of Results; D013061:Speech Acoustics; D013067:Speech Perception; D013068:Speech Production Measurement; D014832:Voice Disorders / Q000175:diagnosis* / Q000523:psychology; D014833:Voice Quality
Assessment; Audio-perceptual; Reliability; Voice