title: CogSketch: sketch understanding for cognitive science research and for education.
abstract: Sketching is a powerful means of working out and communicating ideas. Sketch understanding involves a combination of visual, spatial, and conceptual knowledge and reasoning, which makes it both challenging to model and potentially illuminating for cognitive science. This paper describes CogSketch, an ongoing effort of the NSF-funded Spatial Intelligence and Learning Center, which is being developed both as a research instrument for cognitive science and as a platform for sketch-based educational software. We describe the idea of open-domain sketch understanding, the scientific hypotheses underlying CogSketch, and provide an overview of the models it employs, illustrated by simulation studies and ongoing experiments in creating sketch-based educational software.
authors.affiliation: Qualitative Reasoning Group, Northwestern University.
authors.forename: Kenneth
authors.initials: K
authors.lastname: Forbus
authors.forename: Jeffrey
authors.initials: J
authors.lastname: Usher
authors.forename: Andrew
authors.initials: A
authors.lastname: Lovett
authors.forename: Kate
authors.initials: K
authors.lastname: Lockwood
authors.forename: Jon
authors.initials: J
authors.lastname: Wetzel
mesh_terms: D001296:Audiovisual Aids / Q000592:standards*; D019336:Cognitive Science / Q000295:instrumentation*; D032882:Comprehension / Q000502:physiology*; D003198:Computer Simulation; D003210:Concept Formation / Q000502:physiology*; D006801:Humans; D008960:Models, Psychological; D010364:Pattern Recognition, Visual / Q000502:physiology*; D013028:Space Perception / Q000502:physiology*
keywords: Analogy; Cognitive simulation; Qualitative reasoning; Sketch understanding; Spatial cognition; Spatial reasoning; Visual reasoning