title: An inverse Yarbus process: predicting observers' task from eye movement patterns.
abstract: In this paper we develop a probabilistic method to infer the visual-task of a viewer given measured eye movement trajectories. This method is based on the theory of hidden Markov models (HMM) that employs a first order Markov process to predict the coordinates of fixations given the task. The prediction confidence level of each task-dependent model is used in a Bayesian inference formulation, whereby the task with the maximum a posteriori (MAP) probability is selected. We applied this technique to a challenging dataset consisting of eye movement trajectories obtained from subjects viewing monochrome images of real scenes tasked with answering questions regarding the scenes. The results show that the HMM approach, combined with a clustering technique, can be a reliable way to infer visual-task from eye movements data.
authors.affiliation: Centre for Intelligent Machines, Department of Electrical and Computer Engineering, McGill University, Montreal, Quebec H3A 0E9, Canada. Electronic address: amin@cim.mcgill.ca.
authors.forename: Amin
authors.initials: A
authors.lastname: Haji-Abolhassani
authors.affiliation: Centre for Intelligent Machines, Department of Electrical and Computer Engineering, McGill University, Montreal, Quebec H3A 0E9, Canada. Electronic address: clark@cim.mcgill.ca.
authors.forename: James J
authors.initials: JJ
authors.lastname: Clark
mesh_terms: D000293:Adolescent; D000328:Adult; D001288:Attention / Q000502:physiology*; D003071:Cognition / Q000502:physiology; D003198:Computer Simulation; D005133:Eye Movements / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D008390:Markov Chains; D008962:Models, Theoretical; D010775:Photic Stimulation / Q000379:methods; D013647:Task Performance and Analysis; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: Attention cognitive model; Eye movement; Hidden Markov model; K-means clustering; Visual search; Visual-task inference