title: Audiovisual alignment of co-speech gestures to speech supports word learning in 2-year-olds.
abstract: Analyses of caregiver-child communication suggest that an adult tends to highlight objects in a child's visual scene by moving them in a manner that is temporally aligned with the adult's speech productions. Here, we used the looking-while-listening paradigm to examine whether 25-month-olds use audiovisual temporal alignment to disambiguate and learn novel word-referent mappings in a difficult word-learning task. Videos of two equally interesting and animated novel objects were simultaneously presented to children, but the movement of only one of the objects was aligned with an accompanying object-labeling audio track. No social cues (e.g., pointing, eye gaze, touch) were available to the children because the speaker was edited out of the videos. Immediately afterward, toddlers were presented with still images of the two objects and asked to look at one or the other. Toddlers looked reliably longer to the labeled object, demonstrating their acquisition of the novel word-referent mapping. A control condition showed that children's performance was not solely due to the single unambiguous labeling that had occurred at experiment onset. We conclude that the temporal link between a speaker's utterances and the motion they imposed on the referent object helps toddlers to deduce a speaker's intended reference in a difficult word-learning scenario. In combination with our previous work, these findings suggest that intersensory redundancy is a source of information used by language users of all ages. That is, intersensory redundancy is not just a word-learning tool used by young infants.
authors.affiliation: Department of Psychological and Brain Sciences, University of Massachusetts, Amherst, MA 01003, USA. Electronic address: ajesse@psych.umass.edu.
authors.forename: Alexandra
authors.initials: A
authors.lastname: Jesse
authors.affiliation: Department of Psychology, University of Toronto Mississauga, Mississauga, Ontario L5L 1C6, Canada.
authors.forename: Elizabeth K
authors.initials: EK
authors.lastname: Johnson
mesh_terms: D002657:Child Development / Q000502:physiology*; D002675:Child, Preschool; D005260:Female; D005868:Gestures; D006801:Humans; D007804:Language Development; D008297:Male; D013067:Speech Perception / Q000502:physiology*; D014706:Verbal Learning / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*
keywords: Audiovisual perception; Developmental speech perception; Language acquisition; Multisensory perception; Referent resolution; Word learning