title: The Auditory Kuleshov Effect: Multisensory Integration in Movie Editing.
abstract: Almost a hundred years ago, the Russian filmmaker Lev Kuleshov conducted his now famous editing experiment in which different objects were added to a given film scene featuring a neutral face. It is said that the audience interpreted the unchanged facial expression as a function of the added object (e.g., an added soup made the face express hunger). This interaction effect has been dubbed "Kuleshov effect." In the current study, we explored the role of sound in the evaluation of facial expressions in films. Thirty participants watched different clips of faces that were intercut with neutral scenes, featuring either happy music, sad music, or no music at all. This was crossed with the facial expressions of happy, sad, or neutral. We found that the music significantly influenced participants' emotional judgments of facial expression. Thus, the intersensory effects of music are more specific than previously thought. They alter the evaluation of film scenes and can give meaning to ambiguous situations.
authors.affiliation: Department of Psychology, Johannes Gutenberg-University Mainz, Germany.
authors.forename: Andreas M
authors.initials: AM
authors.lastname: Baranowski
authors.affiliation: Department of Psychology, Johannes Gutenberg-University Mainz, Germany.
authors.forename: H
authors.initials: H
authors.lastname: Hecht
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001307:Auditory Perception; D004644:Emotions; D005149:Facial Expression; D005260:Female; D006801:Humans; D008297:Male; D009040:Motion Pictures; D009146:Music / Q000523:psychology*; D010775:Photic Stimulation; D014796:Visual Perception; D055815:Young Adult
keywords: Kuleshov effect; emotional context; facial expressions; film editing; multisensory integration