title: How visual timing and form information affect speech and non-speech processing.
abstract: Auditory speech processing is facilitated when the talker's face/head movements are seen. This effect is typically explained in terms of visual speech providing form and/or timing information. We determined the effect of both types of information on a speech/non-speech task (non-speech stimuli were spectrally rotated speech). All stimuli were presented paired with the talker's static or moving face. Two types of moving face stimuli were used: full-face versions (both spoken form and timing information available) and modified face versions (only timing information provided by peri-oral motion available). The results showed that the peri-oral timing information facilitated response time for speech and non-speech stimuli compared to a static face. An additional facilitatory effect was found for full-face versions compared to the timing condition; this effect only occurred for speech stimuli. We propose the timing effect was due to cross-modal phase resetting; the form effect to cross-modal priming.
authors.affiliation: The MARCS Institute, University of Western Sydney, Australia. Electronic address: j.kim@uws.edu.au.
authors.forename: Jeesun
authors.initials: J
authors.lastname: Kim
authors.affiliation: The MARCS Institute, University of Western Sydney, Australia. Electronic address: chris.davis@uws.edu.au.
authors.forename: Chris
authors.initials: C
authors.lastname: Davis
mesh_terms: D000704:Analysis of Variance; D001307:Auditory Perception / Q000502:physiology*; D005149:Facial Expression; D006801:Humans; D009633:Nonverbal Communication / Q000502:physiology*; D011930:Reaction Time; D012016:Reference Values; D060865:Repetition Priming / Q000502:physiology; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*
keywords: Auditory and visual speech processing; Visual form and timing information; Visual speech