title: Intrinsic and extrinsic effects on image memorability.
abstract: Previous studies have identified that images carry the attribute of memorability, a predictive value of whether a novel image will be later remembered or forgotten. Here we investigate the interplay between intrinsic and extrinsic factors that affect image memorability. First, we find that intrinsic differences in memorability exist at a finer-grained scale than previously documented. Second, we test two extrinsic factors: image context and observer behavior. Building on prior findings that images that are distinct with respect to their context are better remembered, we propose an information-theoretic model of image distinctiveness. Our model can automatically predict how changes in context change the memorability of natural images. In addition to context, we study a second extrinsic factor: where an observer looks while memorizing an image. It turns out that eye movements provide additional information that can predict whether or not an image will be remembered, on a trial-by-trial basis. Together, by considering both intrinsic and extrinsic effects on memorability, we arrive at a more complete and fine-grained model of image memorability than previously available.
authors: Department of Electrical Engineering and Computer Science, MIT, Cambridge 02141, USA; Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge 02141, USA. Electronic address: zoya@mit.edu.
authors: Zoya
authors: Z
authors: Bylinskii
authors: Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge 02141, USA; Department of Brain and Cognitive Sciences, MIT, Cambridge 02141, USA.
authors: Phillip
authors: P
authors: Isola
authors: Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge 02141, USA.
authors: Constance
authors: C
authors: Bainbridge
authors: Department of Electrical Engineering and Computer Science, MIT, Cambridge 02141, USA; Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge 02141, USA.
authors: Antonio
authors: A
authors: Torralba
authors: Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge 02141, USA.
authors: Aude
authors: A
authors: Oliva
mesh_terms: D001288:Attention; D005133:Eye Movements / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D057567:Memory, Long-Term / Q000502:physiology*; D010364:Pattern Recognition, Visual / Q000502:physiology*; D013647:Task Performance and Analysis; D055815:Young Adult
keywords: Context; Eye movements; Fine-grained categories; Image memorability; Scene dataset; Visual distinctiveness