title: Optical phonetics and visual perception of lexical and phrasal stress in English.
abstract: In a study of optical cues to the visual perception of stress, three American English talkers spoke words that differed in lexical stress and sentences that differed in phrasal stress, while video and movements of the face were recorded. The production of stressed and unstressed syllables from these utterances was analyzed along many measures of facial movement, which were generally larger and faster in the stressed condition. In a visual perception experiment, 16 perceivers identified the location of stress in forced-choice judgments of video clips of these utterances (without audio). Phrasal stress was better perceived than lexical stress. The relation of the visual intelligibility of the prosody of these utterances to the optical characteristics of their production was analyzed to determine which cues are associated with successful visual perception. While most optical measures were correlated with perception performance, chin measures, especially Chin Opening Displacement, contributed the most to correct perception independently of the other measures. Thus, our results indicate that the information for visual stress perception is mainly associated with mouth opening movements.
authors.affiliation: Linguistics Department, University of Colorado, Boulder, CO 80309, USA. rebecca.scarborough@colorado.edu
authors.forename: Rebecca
authors.initials: R
authors.lastname: Scarborough
authors.forename: Patricia
authors.initials: P
authors.lastname: Keating
authors.forename: Sven L
authors.initials: SL
authors.lastname: Mattys
authors.forename: Taehong
authors.initials: T
authors.lastname: Cho
authors.forename: Abeer
authors.initials: A
authors.lastname: Alwan
mesh_terms: D000293:Adolescent; D000328:Adult; D001696:Biomechanical Phenomena; D003463:Cues; D005145:Face / Q000502:physiology; D005260:Female; D019416:Head Movements / Q000502:physiology; D006801:Humans; D007802:Language; D008297:Male; D009043:Motor Activity / Q000502:physiology; D010700:Phonetics; D011578:Psycholinguistics; D013060:Speech / Q000502:physiology; D013061:Speech Acoustics; D013067:Speech Perception; D014741:Video Recording; D014796:Visual Perception; D055815:Young Adult