title: Haptic and visual information speed up the neural processing of auditory speech in live dyadic interactions.
abstract: Speech can be perceived not only by the ear and by the eye but also by the hand, with speech gestures felt from manual tactile contact with the speaker׳s face. In the present electro-encephalographic study, early cross-modal interactions were investigated by comparing auditory evoked potentials during auditory, audio-visual and audio-haptic speech perception in dyadic interactions between a listener and a speaker. In line with previous studies, early auditory evoked responses were attenuated and speeded up during audio-visual compared to auditory speech perception. Crucially, shortened latencies of early auditory evoked potentials were also observed during audio-haptic speech perception. Altogether, these results suggest early bimodal interactions during live face-to-face and hand-to-face speech perception in dyadic interactions.
authors: GIPSA-LAB, Département Parole and Cognition, CNRS and Grenoble Université, Grenoble, France. Electronic address: avril.treille@gipsa-lab.inpg.fr.
authors: Avril
authors: A
authors: Treille
authors: GIPSA-LAB, Département Parole and Cognition, CNRS and Grenoble Université, Grenoble, France.
authors: Camille
authors: C
authors: Cordeboeuf
authors: GIPSA-LAB, Département Parole and Cognition, CNRS and Grenoble Université, Grenoble, France.
authors: Coriandre
authors: C
authors: Vilain
authors: GIPSA-LAB, Département Parole and Cognition, CNRS and Grenoble Université, Grenoble, France.
authors: Marc
authors: M
authors: Sato
mesh_terms: D000161:Acoustic Stimulation; D000162:Acoustics; D000328:Adult; D000704:Analysis of Variance; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D004569:Electroencephalography; D005071:Evoked Potentials / Q000502:physiology; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D010775:Photic Stimulation; D011930:Reaction Time; D013067:Speech Perception / Q000502:physiology*; D014110:Touch; D055698:Touch Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: Audio–haptic speech perception; Audio–visual speech perception; EEG; Multisensory interactions