title: Effect of pitch-space correspondence on sound-induced visual motion perception.
abstract: The brain tends to associate specific features of stimuli across sensory modalities. The pitch of a sound is for example associated with spatial elevation such that higher-pitched sounds are felt as being "up" in space and lower-pitched sounds as being "down." Here we investigated whether changes in the pitch of sounds could be effective for visual motion perception similar to those in the location of sounds. We demonstrated that only sounds that alternate in up/down location induced illusory vertical motion of a static visual stimulus, while sounds that alternate in higher/lower pitch did not induce this illusion. The pitch of a sound did not even modulate the visual motion perception induced by sounds alternating in up/down location. Interestingly, though, sounds alternating in higher/lower pitch could become a driver for visual motion if they were paired in a previous exposure phase with vertical visual apparent motion. Thus, only after prolonged exposure, the pitch of a sound became an inducer for upper/lower visual motion. This occurred even if during exposure the pitch and location of the sounds were paired in an incongruent fashion. These findings indicate that pitch-space correspondence is not so strong to drive or modulate visual motion perception. However, associative exposure could increase the saliency of pitch-space relationships and then the pitch could induce visual motion perception by itself.
authors.affiliation: Department of Psychology, Rikkyo University, 1-2-26, Kitano, Niiza-shi, Saitama, 352-8558, Japan, hidaka@rikkyo.ac.jp.
authors.forename: Souta
authors.initials: S
authors.lastname: Hidaka
authors.forename: Wataru
authors.initials: W
authors.lastname: Teramoto
authors.forename: Mirjam
authors.initials: M
authors.lastname: Keetels
authors.forename: Jean
authors.initials: J
authors.lastname: Vroomen
mesh_terms: D000161:Acoustic Stimulation; D000704:Analysis of Variance; D006801:Humans; D007088:Illusions / Q000523:psychology; D009039:Motion Perception / Q000502:physiology*; D010775:Photic Stimulation; D010898:Pitch Perception / Q000502:physiology*; D013028:Space Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*
references.citation: Nat Neurosci. 2004 Oct;7(10):1057-8
references.pmid: 15361877
references.citation: Exp Brain Res. 2012 Aug;220(3-4):319-33
references.pmid: 22706551
references.citation: Cognition. 2006 Mar;99(2):113-29
references.pmid: 15925355
references.citation: J Vis. 2010 Jan 12;10(1):6.1-12
references.pmid: 20143899
references.citation: PLoS One. 2011 Mar 09;6(3):e17499
references.pmid: 21408078
references.citation: Atten Percept Psychophys. 2012 Aug;74(6):1154-67
references.pmid: 22648604
references.citation: Curr Biol. 2004 Dec 14;14(23):R990-1
references.pmid: 15589145
references.citation: Sci Rep. 2012;2:365
references.pmid: 22511997
references.citation: Neurosci Lett. 2008 Sep 19;442(3):257-61
references.pmid: 18638522
references.citation: J Vis. 2007 Jun 25;7(5):7.1-14
references.pmid: 18217847
references.citation: BMC Neurosci. 2011 May 15;12:44
references.pmid: 21569617
references.citation: PLoS One. 2012;7(5):e36803
references.pmid: 22649500
references.citation: Percept Psychophys. 1987 Nov;42(5):491-502
references.pmid: 2447557
references.citation: Cognition. 2011 Oct;121(1):133-9
references.pmid: 21741633
references.citation: Vision Res. 1985;25(11):1595-601
references.pmid: 3832582
references.citation: Atten Percept Psychophys. 2011 May;73(4):971-95
references.pmid: 21264748
references.citation: Iperception. 2012;3(5):316-8
references.pmid: 23145286
references.citation: J Acoust Soc Am. 1968 Jun;43(6):1255-9
references.pmid: 5659493
references.citation: J Exp Psychol. 1963 Oct;66:347-52
references.pmid: 14051851
references.citation: PLoS One. 2009 Dec 07;4(12):e8188
references.pmid: 19997648
references.citation: Vision Res. 2006 Sep;46(18):2968-76
references.pmid: 16698060
references.citation: Perception. 2012;41(3):339-53
references.pmid: 22808586
references.citation: Proc Natl Acad Sci U S A. 1993 Jun 15;90(12):5718-22
references.pmid: 8516322
references.citation: Perception. 1985;14(6):721-7
references.pmid: 3837873
references.citation: Curr Biol. 2012 Mar 6;22(5):383-8
references.pmid: 22326023
references.citation: Proc Natl Acad Sci U S A. 2011 Dec 20;108(51):20661-5
references.pmid: 22143791
references.citation: Trends Cogn Sci. 2004 Apr;8(4):162-9
references.pmid: 15050512
references.citation: J Neurosci. 2009 May 20;29(20):6490-9
references.pmid: 19458220
references.citation: Spat Vis. 1997;10(4):437-42
references.pmid: 9176953
references.citation: Psychol Sci. 2010 Jan;21(1):21-5
references.pmid: 20424017
references.citation: PLoS One. 2010 Aug 19;5(8):e12255
references.pmid: 20808861
references.citation: Neurosci Lett. 2010 Aug 2;479(3):221-5
references.pmid: 20639000
references.citation: Spat Vis. 1997;10(4):433-6
references.pmid: 9176952
references.citation: J Exp Psychol. 1971 Feb;87(2):241-7
references.pmid: 5542226
references.citation: Neuropsychologia. 2010 Jan;48(2):591-600
references.pmid: 19883668
references.citation: PLoS One. 2009 May 27;4(5):e5664
references.pmid: 19471644
references.citation: Cognition. 2012 Aug;124(2):194-200
references.pmid: 22633004