It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience.
The field of social neuroscience has made remarkable progress in elucidating the neural mechanisms of social cognition. More recently, the need for new experimental approaches has been highlighted that allow studying social encounters in a truly interactive manner by establishing 'online' reciprocity in social interaction. In this article, we present a newly developed adaptation of a method which uses eyetracking data obtained from participants in real time to control visual stimulation during functional magnetic resonance imaging, thus, providing an innovative tool to generate gaze-contingent stimuli in spite of the constraints of this experimental setting. We review results of two paradigms employing this technique and demonstrate how gaze data can be used to animate a virtual character whose behavior becomes 'responsive' to being looked at allowing the participant to engage in 'online' interaction with this virtual other in real-time. Possible applications of this setup are discussed highlighting the potential of this development as a new 'tool of the trade' in social cognitive and affective neuroscience.
Institute of Neurosciences and Medicine, Research Centre Juelich, Juelich, Germany.
Marcus
M
Wilms
Leonhard
L
Schilbach
Ulrich
U
Pfeiffer
Gary
G
Bente
Gereon R
GR
Fink
Kai
K
Vogeley
D001288:Attention / Q000502:physiology; D001931:Brain Mapping / Q000379:methods*; D053483:Eye Movement Measurements; D005133:Eye Movements; D006801:Humans; D008279:Magnetic Resonance Imaging / Q000379:methods*; D010775:Photic Stimulation; D014796:Visual Perception / Q000502:physiology