title: The contributions of image content and behavioral relevancy to overt attention.
abstract: During free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot of attention. Here, a battery of 15 visual stimulus features was used to quantify the contribution of stimulus properties during free-viewing of 4 different categories of images (Natural, Urban, Fractal and Pink Noise). Behaviorally relevant information was estimated in the form of topographical interestingness maps by asking an independent set of subjects to click at image regions that they subjectively found most interesting. Using a Bayesian scheme, we computed saliency functions that described the probability of a given feature to be fixated. In the case of stimulus features, the precise shape of the saliency functions was strongly dependent upon image category and overall the saliency associated with these features was generally weak. When testing multiple features jointly, a linear additive integration model of individual saliencies performed satisfactorily. We found that the saliency associated with interesting locations was much higher than any low-level image feature and any pair-wise combination thereof. Furthermore, the low-level image features were found to be maximally salient at those locations that had already high interestingness ratings. Temporal analysis showed that regions with high interestingness ratings were fixated as early as the third fixation following stimulus onset. Paralleling these findings, fixation durations were found to be dependent mainly on interestingness ratings and to a lesser extent on the low-level image features. Our results suggest that both low- and high-level sources of information play a significant role during exploration of complex scenes with behaviorally relevant information being more effective compared to stimulus features.
authors.affiliation: Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.
authors.forename: Selim
authors.initials: S
authors.lastname: Onat
authors.affiliation: Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.
authors.forename: Alper
authors.initials: A
authors.lastname: Açık
authors.affiliation: Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.
authors.forename: Frank
authors.initials: F
authors.lastname: Schumann
authors.affiliation: Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.
authors.forename: Peter
authors.initials: P
authors.lastname: König
mesh_terms: D000328:Adult; D001288:Attention; D001499:Bayes Theorem; D005133:Eye Movements; D005260:Female; D006801:Humans; D008297:Male; D008962:Models, Theoretical; D010775:Photic Stimulation; D014796:Visual Perception; D055815:Young Adult
references.citation: J Vis. 2008 Oct 23;8(14):12.1-17
references.pmid: 19146313
references.citation: Nat Rev Neurosci. 2001 Mar;2(3):194-203
references.pmid: 11256080
references.citation: Adv Neural Inf Process Syst. 2005;17:1121-8
references.pmid: 16175670
references.citation: J Exp Psychol Hum Percept Perform. 1978 Nov;4(4):565-72
references.pmid: 722248
references.citation: J Vis. 2008 Feb 15;8(2):2.1-19
references.pmid: 18318628
references.citation: J Vis. 2012 Jun 15;12(6):22
references.pmid: 22707429
references.citation: Neuropsychologia. 2012 Dec;50(14):3478-87
references.pmid: 23044277
references.citation: J Vis. 2010 Aug 26;10(10):28
references.pmid: 20884493
references.citation: Vision Res. 2002 Jan;42(1):107-23
references.pmid: 11804636
references.citation: Proc Natl Acad Sci U S A. 2002 Jul 9;99(14):9596-601
references.pmid: 12077298
references.citation: J Vis. 2008 Nov 20;8(14):18.1-26
references.pmid: 19146319
references.citation: J Vis. 2011 Nov 30;11(13):26
references.pmid: 22131447
references.citation: J Vis. 2009 Nov 18;9(12):10.1-15
references.pmid: 20053101
references.citation: PLoS Comput Biol. 2010 May 20;6(5):e1000791
references.pmid: 20502672
references.citation: Vision Res. 2005 Mar;45(5):643-59
references.pmid: 15621181
references.citation: J Vis. 2011 Apr 14;11(4):8
references.pmid: 21493707
references.citation: Front Psychol. 2010 Nov 25;1:207
references.pmid: 21833263
references.citation: J Vis. 2009 Jan 22;9(1):29.1-19
references.pmid: 19271899
references.citation: Eur J Neurosci. 2001 Sep;14(5):869-76
references.pmid: 11576191
references.citation: J Vis. 2008 Oct 23;8(14):6.1-17
references.pmid: 19146307
references.citation: Cognit Comput. 2011 Mar;3(1):223-240
references.pmid: 21475690
references.citation: J Vis. 2012 Jun 19;12(6):
references.pmid: 22715197
references.citation: Neuropsychologia. 2012 Jul;50(9):2142-53
references.pmid: 22627025
references.citation: Vision Res. 2000;40(10-12):1183-201
references.pmid: 10788635
references.citation: J Physiol. 1984 Dec;357:241-65
references.pmid: 6512691
references.citation: Vis cogn. 2012 Jan 1;20(4-5):495-514
references.pmid: 22844203
references.citation: J Vis. 2010 Mar 29;10(3):15.1-14
references.pmid: 20377292
references.citation: Curr Opin Neurobiol. 1998 Apr;8(2):245-53
references.pmid: 9635209
references.citation: J Exp Psychol. 1974 Sep;103(3):597-600
references.pmid: 4448962
references.citation: Trends Cogn Sci. 2002 Jan 1;6(1):9-16
references.pmid: 11849610
references.citation: Child Dev. 2012 Jul-Aug;83(4):1122-8
references.pmid: 22533474
references.citation: Percept Psychophys. 2007 Feb;69(2):153-61
references.pmid: 17557586
references.citation: J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1407-18
references.pmid: 12868645
references.citation: J Neural Eng. 2010 Feb;7(1):16006
references.pmid: 20075505
references.citation: Hum Neurobiol. 1985;4(4):219-27
references.pmid: 3836989
references.citation: Curr Biol. 2012 Aug 7;22(15):1429-34
references.pmid: 22748317
references.citation: J Vis. 2009 May 19;9(5):19.1-15
references.pmid: 19757897
references.citation: J Exp Psychol. 1974 Jul;103(1):62-70
references.pmid: 4424680
references.citation: Psychol Rev. 2006 Oct;113(4):766-86
references.pmid: 17014302
references.citation: J Vis. 2008 May 07;8(5):1.1-18
references.pmid: 18842072
references.citation: PLoS Comput Biol. 2013;9(1):e1002871
references.pmid: 23341766
references.citation: J Vis. 2008 Mar 07;8(3):3.1-15
references.pmid: 18484809
references.citation: Nature. 1996 Jun 6;381(6582):520-2
references.pmid: 8632824
references.citation: Spat Vis. 2003;16(2):125-54
references.pmid: 12696858
references.citation: J Vis. 2007 Jul 25;7(10):11.1-16
references.pmid: 17997680
references.citation: Q J Exp Psychol (Hove). 2006 Nov;59(11):1931-49
references.pmid: 16987782
references.citation: J Vis. 2009 Oct 27;9(11):25.1-22
references.pmid: 20053088
references.citation: Vision Res. 2009 Jun;49(12):1541-53
references.pmid: 19306892
references.citation: J Vis. 2007 Nov 21;7(14):4.1-17
references.pmid: 18217799
references.citation: Eur J Neurosci. 2003 Mar;17(5):1089-97
references.pmid: 12653985
references.citation: Network. 1999 Nov;10(4):341-50
references.pmid: 10695763
references.citation: Vision Res. 2012 Dec 1;74:80-5
references.pmid: 22902641
references.citation: J Vis. 2009 May 13;9(5):7.1-15
references.pmid: 19757885
references.citation: J Vis. 2011 Mar 10;11(3):
references.pmid: 21393388
references.citation: PLoS One. 2011;6(7):e21719
references.pmid: 21750726
references.citation: Cogn Psychol. 1980 Jan;12(1):97-136
references.pmid: 7351125
references.citation: Atten Percept Psychophys. 2009 Aug;71(6):1337-52
references.pmid: 19633349
references.citation: J Vis. 2007 Jul 11;7(10):3.1-10
references.pmid: 17997672
references.citation: IEEE Trans Pattern Anal Mach Intell. 2006 May;28(5):802-17
references.pmid: 16640265
references.citation: J Vis. 2012 Apr 01;12(4):9
references.pmid: 22510977
references.citation: J Vis. 2011 Sep 14;11(5):
references.pmid: 21917784
references.citation: Trends Cogn Sci. 2003 Nov;7(11):498-504
references.pmid: 14585447
references.citation: Vision Res. 2000;40(10-12):1489-506
references.pmid: 10788654
references.citation: PLoS One. 2011;6(9):e24038
references.pmid: 21931638
references.citation: Trends Cogn Sci. 2007 Dec;11(12):520-7
references.pmid: 18024143
references.citation: Eur J Neurosci. 2004 Feb;19(3):783-9
references.pmid: 14984430
references.citation: Vision Res. 2006 Sep;46(18):2824-33
references.pmid: 16647742