title: The evaluation of singing voice accuracy: a comparison between subjective and objective methods.
abstract: OBJECTIVE
  Vocal accuracy of a sung performance can be evaluated by two methods: acoustic analyses and subjective judgments. Acoustic analyses have been presented as a more reliable solution but both methods are still used for the evaluation of singing voice accuracy. This article presents a first time direct comparison of these methods.
  
  
  METHODS
  One hundred sixty-six untrained singers were asked to sing the popular song "Happy birthday." These recordings constituted the database analyzed. Acoustic analyses were performed to quantify the pitch interval deviation, number of contour errors, and number of tonality modulations for each recording. Additionally, 18 experts in singing voice or music rated the global pitch accuracy of these performances.
  
  
  RESULTS
  A high correlation occurred between acoustic measurements and subjective rating. The total model of acoustic analyses explained 81% of the variance of the judges' scores. Their rating was influenced by both tonality modulations and pitch interval deviation.
  
  
  CONCLUSIONS
  This study highlights the congruence between objective and subjective measurements of vocal accuracy within this first time comparison. Our results confirm the relevance of the pitch interval deviation criterion in vocal accuracy assessment. Furthermore, the number of tonality modulations is also a salient criterion in perceptive rating and should be taken into account in studies using acoustic analyses.
authors.affiliation: Logopédie de la Voix, Department of Psychology: Cognition and Behaviour, University of Liège, Liège, Belgium. pauline.larrouy@ulg.ac.be
authors.forename: Pauline
authors.initials: P
authors.lastname: Larrouy-Maestri
authors.forename: Yohana
authors.initials: Y
authors.lastname: Lévêque
authors.forename: Daniele
authors.initials: D
authors.lastname: Schön
authors.forename: Antoine
authors.initials: A
authors.lastname: Giovanni
authors.forename: Dominique
authors.initials: D
authors.lastname: Morsomme
mesh_terms: D000161:Acoustic Stimulation; D000162:Acoustics; D000293:Adolescent; D000328:Adult; D000368:Aged; D005260:Female; D006801:Humans; D007600:Judgment; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D010898:Pitch Perception; D012044:Regression Analysis; D015203:Reproducibility of Results; D012647:Self-Assessment; D012815:Signal Processing, Computer-Assisted; D063346:Singing; D013018:Sound Spectrography; D014833:Voice Quality; D055815:Young Adult