title: Visual speech segmentation: using facial cues to locate word boundaries in continuous speech.
abstract: Speech is typically a multimodal phenomenon, yet few studies have focused on the exclusive contributions of visual cues to language acquisition. To address this gap, we investigated whether visual prosodic information can facilitate speech segmentation. Previous research has demonstrated that language learners can use lexical stress and pitch cues to segment speech and that learners can extract this information from talking faces. Thus, we created an artificial speech stream that contained minimal segmentation cues and paired it with two synchronous facial displays in which visual prosody was either informative or uninformative for identifying word boundaries. Across three familiarisation conditions (audio stream alone, facial streams alone, and paired audiovisual), learning occurred only when the facial displays were informative to word boundaries, suggesting that facial cues can help learners solve the early challenges of language acquisition.
authors.affiliation: Department of Psychology, Bucknell University, Lewisburg, PA 17837, USA.
authors.forename: Aaron D
authors.initials: AD
authors.lastname: Mitchel
authors.affiliation: Department of Psychology and Program in Linguistics, The Pennsylvania State University, 643 Moore Building, University Park, PA 16802, USA.
authors.forename: Daniel J
authors.initials: DJ
authors.lastname: Weiss
keywords: audiovisual speech; language acquisition; multisensory integration; speech segmentation; visual prosody