title: [Study on the stability of perceptual evaluation of voice quality].
abstract: OBJECTIVE
  To explore the factors that influence the stability of evaluation results judged by a jury through a standard research on perceptual evaluation measurements of voice quality.
  
  
  METHODS
  Voice samples from 300 patients with dysphonia and 100 control subjects with normal voice were recorded and assessed by a jury composed of 6 experienced listeners from different hospitals. The voice samples were discourse voices and ordered randomly 3 times, and the mean of 3 evaluations using visual analogue scale were the final results. The jury was instructed to classify voice samples according to the G (grade), R (rough) and B (breathy) components of the GRBAS scale on a 4-point scale ranging from 0 for normal to 3 for severe dysphonia. Κ value was used to analyze the concordance of evaluation results and regression analysis was used to research the effects of the extent of voice disorder to the stability of perceptual evaluation.
  
  
  RESULTS
  The discordance of evaluation existed both between the jury and in listeners themselves. The concordance of listeners themselves of each evaluation parameter was not bad, good, or even very good, and the concordance of evaluation of G was the best (κ value: 0.46 - 0.85), then R (κ value: 0.41 - 0.84) and B (κ value: 0.41 - 0.81). The concordance between the jury was worse than that in themselves. And except a listener whose concordance of evaluation was under the requirement, the concordance of evaluation of G was the best (κ value: 0.43 - 0.96), then R (κ value: 0.33 - 0.78) and B (κ value: 0.002 - 0.45). The stability of evaluation of normal voice and severe voice disorder was better than mild and moderate voice disorder.
  
  
  CONCLUSIONS
  The discordance between the jury was the main factor that influence the stability of perceptual evaluation. The evaluation parameters and extent of voice disorder will influence the stability of perceptual evaluation of the jury.
authors.affiliation: Department of Otorhinolaryngology Head and Neck Surgery, Chinese People's Liberation Army General Hospital, Beijing 100853, China.
authors.forename: Gang
authors.initials: G
authors.lastname: Wang
authors.forename: Ping
authors.initials: P
authors.lastname: Yu
authors.forename: Wen
authors.initials: W
authors.lastname: Xu
authors.forename: Wu
authors.initials: W
authors.lastname: Wen
authors.forename: Chun-sheng
authors.initials: CS
authors.lastname: Wei
authors.forename: Dong-yan
authors.initials: DY
authors.lastname: Huang
authors.forename: Li-zhen
authors.initials: LZ
authors.lastname: Hou
mesh_terms: D000293:Adolescent; D000328:Adult; D001307:Auditory Perception; D016022:Case-Control Studies; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D013067:Speech Perception; D013068:Speech Production Measurement; D014832:Voice Disorders / Q000175:diagnosis*; D014833:Voice Quality; D055815:Young Adult