title: Comparison of Rater's reliability on perceptual evaluation of different types of voice sample.
abstract: OBJECTIVE
  The objective of this study was to determine whether different types of voice samples affect rater reliability and which type of sample can be rated most reliably, with particular reference to two types of connected speech-passage reading and conversational speech.
  
  
  METHODS
  Prospective reliability study.
  
  
  METHODS
  One hundred fifty voice samples from 40 speakers were presented to 14 speech pathologists experienced in managing voice disorders. Each speaker contributed three types of voice samples: sustained vowels, passage reading, and conversational speech. Ratings were made on four vocal parameters--overall severity, roughness, breathiness, and strain--on a 10-point equal-appearing interval scale.
  
  
  RESULTS
  Differences in intrarater reliability across the three types of voice samples were noted. Higher intrarater reliability was achieved with connected speech than with sustained vowel samples. Interrater reliability showed no statistically significant difference across the three types but increased with the severity of dysphonia.
  
  
  CONCLUSIONS
  This study reveals that raters give internally more reliable ratings for connected speech samples. Results also indicate that voices with severe disorders appear to be rated more reliably.
authors.affiliation: Department of Otorhinolaryngology, Head & Neck Surgery, The Chinese University of Hong Kong, and Department of Ear, Nose and Throat, United Christian Hospital, Hospital Authority, Sha Tin, New Territories, Hong Kong, China. thomaslaw@ent.cuhk.edu.hk
authors.forename: Thomas
authors.initials: T
authors.lastname: Law
authors.forename: Jean H
authors.initials: JH
authors.lastname: Kim
authors.forename: Kathy Y
authors.initials: KY
authors.lastname: Lee
authors.forename: Eric C
authors.initials: EC
authors.lastname: Tang
authors.forename: Joffee H
authors.initials: JH
authors.lastname: Lam
authors.forename: Andrew C
authors.initials: AC
authors.lastname: van Hasselt
authors.forename: Michael C
authors.initials: MC
authors.lastname: Tong
mesh_terms: D000162:Acoustics; D000328:Adult; D000704:Analysis of Variance; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D011237:Predictive Value of Tests; D011446:Prospective Studies; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D013061:Speech Acoustics; D013067:Speech Perception; D013068:Speech Production Measurement; D014832:Voice Disorders / Q000175:diagnosis* / Q000503:physiopathology / Q000523:psychology; D014833:Voice Quality; D055815:Young Adult