title: Evidence for Optimal Integration of Visual Feature Representations across Saccades.
abstract: We explore the visual world through saccadic eye movements, but saccades also present a challenge to visual processing by shifting externally stable objects from one retinal location to another. The brain could solve this problem in two ways: by overwriting preceding input and starting afresh with each fixation or by maintaining a representation of presaccadic visual features in working memory and updating it with new information from the remapped location. Crucially, when multiple objects are present in a scene the planning of eye movements profoundly affects the precision of their working memory representations, transferring limited memory resources from fixation toward the saccade target. Here we show that when humans make saccades, it results in an update of not just the precision of representations but also their contents. When multiple item colors are shifted imperceptibly during a saccade the perceived colors are found to fall between presaccadic and postsaccadic values, with the weight given to each input varying continuously with item location, and fixed relative to saccade parameters. Increasing sensory uncertainty, by adding color noise, biases updating toward the more reliable input, which is consistent with an optimal integration of presaccadic working memory with a postsaccadic updating signal. We recover this update signal and show it to be tightly focused on the vicinity of the saccade target. These results reveal how the nervous system accumulates detailed visual information from multiple views of the same object or scene.
  
  
  CONCLUSIONS
  This study examines the consequences of saccadic eye movements for the internal representation of visual objects. A saccade shifts the image of a stable visual object from one part of the retina to another. We show that visual representations are built up over these different views of the same object, by combining information obtained before and after each saccade. The weights given to presaccadic and postsaccadic information are determined by the relative reliability of each input. This provides evidence that the visual system combines inputs over time in a statistically optimal way.
authors.affiliation: Institute of Neurology, University College London, London WC1N 3BG, United Kingdom and l.wijdenes@ucl.ac.uk.
authors.forename: Leonie
authors.identifier: http://orcid.org/0000-0002-7264-7853
authors.initials: L
authors.lastname: Oostwoud Wijdenes
authors.affiliation: Institute of Neurology, University College London, London WC1N 3BG, United Kingdom and.
authors.forename: Louise
authors.identifier: http://orcid.org/0000-0002-7885-591X
authors.initials: L
authors.lastname: Marshall
authors.affiliation: Institute of Neurology, University College London, London WC1N 3BG, United Kingdom and Institute of Cognitive and Brain Sciences, University of California Berkeley, Berkeley, California 94720.
authors.forename: Paul M
authors.identifier: http://orcid.org/0000-0003-4684-4893
authors.initials: PM
authors.lastname: Bays
mesh_terms: D000293:Adolescent; D000328:Adult; D003118:Color Perception / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D008570:Memory, Short-Term / Q000502:physiology*; D008875:Middle Aged; D010775:Photic Stimulation; D015203:Reproducibility of Results; D012438:Saccades / Q000502:physiology*; D014785:Vision, Ocular / Q000502:physiology*; D055815:Young Adult
keywords: optimal integration; saccades; visual updating; working memory