title: Audiovisual perception of congruent and incongruent Dutch front vowels.
abstract: OBJECTIVE
  Auditory perception of vowels in background noise is enhanced when combined with visually perceived speech features. The objective of this study was to investigate whether the influence of visual cues on vowel perception extends to incongruent vowels, in a manner similar to the McGurk effect observed with consonants.
  
  
  METHODS
  Identification of Dutch front vowels /i, y, e, Y/ that share all features other than height and lip-rounding was measured for congruent and incongruent audiovisual conditions. The audio channel was systematically degraded by adding noise, increasing the reliance on visual cues.
  
  
  RESULTS
  The height feature was more robustly carried over through the auditory channel and the lip-rounding feature through the visual channel. Hence, congruent audiovisual presentation enhanced identification, while incongruent presentation led to perceptual fusions and thus decreased identification.
  
  
  CONCLUSIONS
  Visual cues influence the identification of congruent as well as incongruent audiovisual vowels. Incongruent visual information results in perceptual fusions, demonstrating that the McGurk effect can be instigated by long phonemes such as vowels. This result extends to the incongruent presentation of the visually less reliably perceived height. The findings stress the importance of audiovisual congruency in communication devices, such as cochlear implants and videoconferencing tools, where the auditory signal could be degraded.
authors.affiliation: University of Groningen, the Netherlands. B.Valkenier@ai.rug.nl
authors.forename: Bea
authors.initials: B
authors.lastname: Valkenier
authors.forename: Jurriaan Y
authors.initials: JY
authors.lastname: Duyne
authors.forename: Tjeerd C
authors.initials: TC
authors.lastname: Andringa
authors.forename: Deniz
authors.initials: D
authors.lastname: Baskent
mesh_terms: D000161:Acoustic Stimulation / Q000379:methods; D000328:Adult; D003463:Cues; D005260:Female; D006801:Humans; D007088:Illusions / Q000502:physiology*; D008085:Lipreading; D008297:Male; D008954:Models, Biological; D009622:Noise; D010470:Perceptual Masking / Q000502:physiology*; D010700:Phonetics; D010775:Photic Stimulation / Q000379:methods; D011571:Psychoacoustics; D013060:Speech / Q000502:physiology; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult