title: The pieces fit: Constituent structure and global coherence of visual narrative in RSVP.
abstract: Recent research has shown that comprehension of visual narrative relies on the ordering and timing of sequential images. Here we tested if rapidly presented 6-image long visual sequences could be understood as coherent narratives. Half of the sequences were correctly ordered and half had two of the four internal panels switched. Participants reported whether the sequence was correctly ordered and rated its coherence. Accuracy in detecting a switch increased when panels were presented for 1 s rather than 0.5 s. Doubling the duration of the first panel did not affect results. When two switched panels were further apart, order was discriminated more accurately and coherence ratings were low, revealing that a strong local adjacency effect influenced order and coherence judgments. Switched panels at constituent boundaries or within constituents were most disruptive to order discrimination, indicating that the preservation of constituent structure is critical to visual narrative grammar.
authors.affiliation: Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States. Electronic address: cehagman@syr.edu.
authors.forename: Carl Erick
authors.initials: CE
authors.lastname: Hagmann
authors.affiliation: Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States.
authors.forename: Neil
authors.initials: N
authors.lastname: Cohn
mesh_terms: D000328:Adult; D032882:Comprehension / Q000502:physiology*; D005260:Female; D006801:Humans; D007600:Judgment / Q000502:physiology*; D008297:Male; D008875:Middle Aged; D033262:Narration; D010775:Photic Stimulation / Q000379:methods*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: Comics; Constituent structure; Narrative; RSVP; Visual cognition; Visual language