title: [Influence of the type of visualization on the construction of mental models during picture and text comprehension].
abstract: The following article describes an integrative model of text and picture comprehension. Text and picture comprehension is considered as a task oriented process of constructing descriptive and depictive mental representations by selection and organisation of information, parsing of symbols, mapping of analog structures as well as mental model construction and model inspection. Based on this theoretical model an experiment was conducted in which subjects had to acquire knowledge about a complex learning content (time and date differences on the earth) through self directed learning with a hypertext and different, but informationally equivalent pictures. The study aimed to investigate under which conditions learners prefer which kind of information and whether the kind of visualisation has an effect on the mental model structure created during the comprehension of texts and pictures. The results indicate that simple pictures induce more superficial processing, in which picture comprehension replaces text comprehension to some extent and vice versa. Demanding pictures, on the contrary, induce more intensive processing in which text comprehension and picture comprehension stimulate each other. Furthermore, the results suggest that the surface structure of pictures affects the structure of mental models. Accordingly, the presentation of a visualisation which is not task adequate may interfere with the required mental model construction. In designing texts combined with pictures the form of visualisation deserves therefore special attention.
authors.affiliation: Universität Koblenz-Landau. schnotz@uni-landau.de
authors.forename: W
authors.initials: W
authors.lastname: Schnotz
authors.forename: M
authors.initials: M
authors.lastname: Bannert
mesh_terms: D003071:Cognition; D006801:Humans; D007092:Imagination; D008960:Models, Psychological; D011932:Reading; D014796:Visual Perception