title: Predicting the eye fixation locations in the gray scale images in the visual scenes with different semantic contents.
abstract: In recent years, there has been considerable interest in visual attention models (saliency map of visual attention). These models can be used to predict eye fixation locations, and thus will have many applications in various fields which leads to obtain better performance in machine vision systems. Most of these models need to be improved because they are based on bottom-up computation that does not consider top-down image semantic contents and often does not match actual eye fixation locations. In this study, we recorded the eye movements (i.e., fixations) of fourteen individuals who viewed images which consist natural (e.g., landscape, animal) and man-made (e.g., building, vehicles) scenes. We extracted the fixation locations of eye movements in two image categories. After extraction of the fixation areas (a patch around each fixation location), characteristics of these areas were evaluated as compared to non-fixation areas. The extracted features in each patch included the orientation and spatial frequency. After feature extraction phase, different statistical classifiers were trained for prediction of eye fixation locations by these features. This study connects eye-tracking results to automatic prediction of saliency regions of the images. The results showed that it is possible to predict the eye fixation locations by using of the image patches around subjects' fixation points.
authors.affiliation: Neuroscience and Neuroengineering Research Lab., Biomedical Engineering Department, Faculty of Electrical Engineering, Iran University of Science and Technology (IUST), Narmak, 16846-13114 Tehran, Iran ; School of Cognitive Sciences (SCS), Institute for Research in Fundamental Research (IPM), Niavaran, P.O. Box 19395-5746, Tehran, Iran.
authors.forename: Hassan
authors.initials: H
authors.lastname: Zanganeh Momtaz
authors.affiliation: Neuroscience and Neuroengineering Research Lab., Biomedical Engineering Department, Faculty of Electrical Engineering, Iran University of Science and Technology (IUST), Narmak, 16846-13114 Tehran, Iran ; School of Cognitive Sciences (SCS), Institute for Research in Fundamental Research (IPM), Niavaran, P.O. Box 19395-5746, Tehran, Iran.
authors.forename: Mohammad Reza
authors.initials: MR
authors.lastname: Daliri
keywords: Bottom-up and top-down attention; Eye fixation; Eye tracking; Saliency map; Semantic content; Visual attention model
references.citation: J Neurophysiol. 1976 Nov;39(6):1320-33
references.pmid: 825622
references.citation: Hum Neurobiol. 1985;4(4):219-27
references.pmid: 3836989
references.citation: Trends Cogn Sci. 2002 Jan 1;6(1):9-16
references.pmid: 11849610
references.citation: Trends Cogn Sci. 2012 Aug;16(8):437-43
references.pmid: 22795563
references.citation: Nat Neurosci. 2000 Nov;3 Suppl:1199-204
references.pmid: 11127838
references.citation: IEEE Trans Image Process. 2003;12(2):243-54
references.pmid: 18237905
references.citation: J Neurophysiol. 1976 Nov;39(6):1288-319
references.pmid: 825621
references.citation: Cogn Neurodyn. 2013 Apr;7(2):143-54
references.pmid: 24427198
references.citation: Q J Exp Psychol. 1980 Feb;32(1):3-25
references.pmid: 7367577
references.citation: Nat Rev Neurosci. 2001 Mar;2(3):194-203
references.pmid: 11256080
references.citation: Psychol Rev. 2006 Oct;113(4):766-86
references.pmid: 17014302
references.citation: J Neurophysiol. 1976 Nov;39(6):1334-51
references.pmid: 825623
references.citation: J Vis. 2008 Dec 16;8(7):32.1-20
references.pmid: 19146264
references.citation: J Vis. 2009 Mar 13;9(3):5.1-24
references.pmid: 19757944
references.citation: Vision Res. 1982;22(5):531-44
references.pmid: 7112953
references.citation: Cogn Neurodyn. 2009 Sep;3(3):223-42
references.pmid: 19125356
references.citation: Cogn Neurodyn. 2013 Oct;7(5):361-79
references.pmid: 24427212
references.citation: Nat Neurosci. 1999 Nov;2(11):1019-25
references.pmid: 10526343
references.citation: Cogn Neurodyn. 2007 Dec;1(4):275-85
references.pmid: 19003498
references.citation: Cogn Neurodyn. 2011 Nov;5(4):321-32
references.pmid: 23115590
references.citation: J Neurosci. 2000 Nov 15;20(22):8504-14
references.pmid: 11069958
references.citation: IEEE Trans Pattern Anal Mach Intell. 2013 Jan;35(1):185-207
references.pmid: 22487985
references.citation: Cogn Neurodyn. 2010 Sep;4(3):189-98
references.pmid: 21886671
references.citation: Vision Res. 1982;22(5):545-59
references.pmid: 7112954
references.citation: IEEE Trans Pattern Anal Mach Intell. 2006 May;28(5):802-17
references.pmid: 16640265
references.citation: Neuroscientist. 2003 Oct;9(5):317-31
references.pmid: 14580117