title: Storing upright turns: how visual and vestibular cues interact during the encoding and recalling process.
abstract: Many previous studies have focused on how humans combine inputs provided by different modalities for the same physical property. However, it is not yet very clear how different senses providing information about our own movements combine in order to provide a motion percept. We designed an experiment to investigate how upright turns are stored, and particularly how vestibular and visual cues interact at the different stages of the memorization process (encoding/recalling). Subjects experienced passive yaw turns stimulated in the vestibular modality (whole-body rotations) and/or in the visual modality (limited lifetime star-field rotations), with the visual scene turning 1.5 times faster when combined (unnoticed conflict). Then they were asked to actively reproduce the rotation displacement in the opposite direction, with body cues only, visual cues only, or both cues with either the same or a different gain factor. First, we found that in none of the conditions did the reproduced motion dynamics follow that of the presentation phase (Gaussian angular velocity profiles). Second, the unimodal recalling of turns was largely uninfluenced by the other sensory cue that it could be combined with during the encoding. Therefore, turns in each modality, visual, and vestibular are stored independently. Third, when the intersensory gain was preserved, the bimodal reproduction was more precise (reduced variance) and lay between the two unimodal reproductions. This suggests that with both visual and vestibular cues available, these combine in order to improve the reproduction. Fourth, when the intersensory gain was modified, the bimodal reproduction resulted in a substantially larger change for the body than for the visual scene rotations, which indicates that vision prevails for this rotation displacement task when a matching problem is introduced.
authors.affiliation: Max Planck Institute for Biological Cybernetics, Tübingen, Germany. manuel.vidal@college-de-france.fr
authors.forename: Manuel
authors.initials: M
authors.lastname: Vidal
authors.forename: Heinrich H
authors.initials: HH
authors.lastname: Bülthoff
mesh_terms: D000293:Adolescent; D000328:Adult; D000704:Analysis of Variance; D003463:Cues; D005260:Female; D006801:Humans; D008297:Male; D011939:Mental Recall / Q000502:physiology*; D009039:Motion Perception / Q000502:physiology*; D017711:Nonlinear Dynamics; D009949:Orientation / Q000502:physiology*; D010775:Photic Stimulation / Q000379:methods; D004856:Postural Balance; D011434:Proprioception; D011597:Psychomotor Performance; D015203:Reproducibility of Results; D012153:Retention, Psychology / Q000502:physiology*; D012399:Rotation; D014722:Vestibule, Labyrinth / Q000502:physiology*; D055815:Young Adult
references.citation: J Neurophysiol. 1997 Jun;77(6):3180-92
references.pmid: 9212267
references.citation: J Neurosci. 2007 Sep 5;27(36):9742-56
references.pmid: 17804635
references.citation: Vision Res. 2000;40(21):2951-71
references.pmid: 11000394
references.citation: Exp Brain Res. 2000 Sep;134(1):66-73
references.pmid: 11026727
references.citation: Exp Brain Res. 2004 Jan;154(1):11-21
references.pmid: 14600796
references.citation: Vision Res. 2005 Jun;45(13):1679-92
references.pmid: 15792843
references.citation: Exp Brain Res. 2005 Jun;163(4):540-6
references.pmid: 15937701
references.citation: Aviat Space Environ Med. 1989 Mar;60(3):205-13
references.pmid: 2712798
references.citation: Nat Neurosci. 2007 Aug;10(8):1038-47
references.pmid: 17618278
references.citation: J Exp Psychol Hum Percept Perform. 1991 Feb;17(1):28-43
references.pmid: 1826318
references.citation: Trends Cogn Sci. 2003 Oct;7(10):460-7
references.pmid: 14550494
references.citation: Psychol Bull. 1980 Nov;88(3):638-67
references.pmid: 7003641
references.citation: Science. 1995 Jul 7;269(5220):95-8
references.pmid: 7604286
references.citation: Exp Brain Res. 2009 Jul;197(1):59-68
references.pmid: 19544058
references.citation: Exp Brain Res. 2008 Apr;186(4):677-81
references.pmid: 18350283
references.citation: Science. 2002 Nov 22;298(5598):1627-30
references.pmid: 12446912
references.citation: Exp Brain Res. 2007 May;179(2):263-90
references.pmid: 17136526
references.citation: Acta Otolaryngol. 1995 Jan;115(1):3-8
references.pmid: 7762380
references.citation: Brain Res Cogn Brain Res. 2002 Jun;14(1):177-86
references.pmid: 12063141
references.citation: Vision Res. 2003 Sep;43(20):2173-83
references.pmid: 12855252
references.citation: Trends Cogn Sci. 2000 Aug;4(8):319-324
references.pmid: 10904256
references.citation: J Neurophysiol. 2000 Oct;84(4):2001-15
references.pmid: 11024093
references.citation: J Neurophysiol. 2001 Apr;85(4):1648-60
references.pmid: 11287488
references.citation: Trends Cogn Sci. 2004 Apr;8(4):162-9
references.pmid: 15050512
references.citation: Brain Res Cogn Brain Res. 2004 May;19(3):244-58
references.pmid: 15062862
references.citation: Exp Brain Res. 1997 Dec;117(3):419-27
references.pmid: 9438709
references.citation: Biol Cybern. 1991;65(5):311-20
references.pmid: 1742369
references.citation: Vision Res. 2008 Jan;48(2):289-303
references.pmid: 18177912
references.citation: Exp Brain Res. 1999 Jul;127(1):33-42
references.pmid: 10424412
references.citation: Perception. 2001;30(6):733-41
references.pmid: 11464561
references.citation: J Vestib Res. 2003;13(4-6):273-86
references.pmid: 15096671
references.citation: Nature. 2002 Jan 24;415(6870):429-33
references.pmid: 11807554
references.citation: Nat Neurosci. 2008 Oct;11(10):1201-10
references.pmid: 18776893