Auditory temporal modulation of the visual Ternus effect: the influence of time interval.
Research on multisensory interactions has shown that the perceived timing of a visual event can be captured by a temporally proximal sound. This effect has been termed 'temporal ventriloquism effect.' Using the Ternus display, we systematically investigated how auditory configurations modulate the visual apparent-motion percepts. The Ternus display involves a multielement stimulus that can induce either of two different percepts of apparent motion: 'element motion' or 'group motion'. We found that two sounds presented in temporal proximity to, or synchronously with, the two visual frames, respectively, can shift the transitional threshold for visual apparent motion (Experiments 1 and 3). However, such effects were not evident with single-sound configurations (Experiment 2). A further experiment (Experiment 4) provided evidence that time interval information is an important factor for crossmodal interaction of audiovisual Ternus effect. The auditory interval was perceived as longer than the same physical visual interval in the sub-second range. Furthermore, the perceived audiovisual interval could be predicted by optimal integration of the visual and auditory intervals.
Shi
Zhuanghua
Z
Department Psychologie, Ludwig-Maximilians-Universität München, Leopoldstrasse 13, 80802, Munich, Germany. shi@psy.lmu.de
Chen
Lihan
L
Müller
Hermann J
HJ
D000161:Acoustic Stimulation / Q000379:methods; D000328:Adult; D000704:Analysis of Variance; D001307:Auditory Perception / Q000502:physiology*; D005260:Female; D006801:Humans; D007088:Illusions / Q000502:physiology*; D007600:Judgment / Q000502:physiology; D008297:Male; D009039:Motion Perception / Q000502:physiology*; D010775:Photic Stimulation / Q000379:methods; D011594:Psychometrics; D011930:Reaction Time / Q000502:physiology; D012684:Sensory Thresholds / Q000502:physiology; D013016:Sound; D013997:Time Factors; D055815:Young Adult
Q J Exp Psychol (Hove). 2006 Oct;59(10):1709-24
16945856
J Exp Psychol Hum Percept Perform. 2006 Aug;32(4):1063-71
16846297
Percept Psychophys. 1980 Apr;27(4):307-12
7383815
Q J Exp Psychol B. 1998 May;51(2):97-120
9621837
Percept Mot Skills. 1974 Aug;39(1):63-82
4415924
Acta Psychol (Amst). 2008 Oct;129(2):273-83
18790468
Spat Vis. 1997;10(4):433-6
9176952
Perception. 2006;35(6):807-21
16836046
J Exp Psychol Hum Percept Perform. 2004 Jun;30(3):513-8
15161383
Nature. 2002 Jan 24;415(6870):429-33
11807554
Perception. 1980;9(6):719-21
7220244
Perception. 2007;36(7):1089-103
17844974
Percept Mot Skills. 1976 Oct;42(43):487-93
980644
Psychol Bull. 1980 Nov;88(3):638-67
7003641
J Exp Psychol Hum Percept Perform. 2009 Aug;35(4):1005-19
19653745
Percept Psychophys. 1997 Jan;59(1):87-99
9038411
Proc Biol Sci. 2001 Jan 7;268(1462):31-8
12123295
J Exp Psychol Hum Percept Perform. 1981 Dec;7(6):1327-39
6458656
Cogn Affect Behav Neurosci. 2004 Jun;4(2):218-29
15460928
Percept Psychophys. 2001 May;63(4):719-25
11436740
Brain Res Cogn Brain Res. 2003 Jun;17(1):154-63
12763201
Exp Brain Res. 2009 Sep;198(1):49-57
19597804
Curr Biol. 2008 Aug 26;18(16):1262-6
18718760
Annu Rev Psychol. 1984;35:1-36
6367623
Perception. 2004;33(1):103-11
15035332
Percept Psychophys. 1981 Jun;29(6):578-84
7279586
J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1391-7
12868643
Neuron. 2005 Nov 3;48(3):489-96
16269365
Trends Cogn Sci. 2004 Apr;8(4):162-9
15050512
Spat Vis. 1997;10(4):437-42
9176953
Perception. 2007;36(10):1455-64
18265828
J Gen Psychol. 1964 Apr;70:369-87
14140126
Curr Biol. 2004 Feb 3;14(3):257-62
14761661
Neurosci Lett. 2007 May 7;417(3):219-24
17428607
Psychol Rev. 1976 Mar;83(2):157-71
769017
J Exp Psychol Hum Percept Perform. 1981 Dec;7(6):1318-28
6458655
Percept Psychophys. 1999 Jan;61(1):87-106
10070202
Science. 1976 Aug 6;193(4252):500-2
941023
Exp Brain Res. 2007 Jul;180(3):449-56
17279379
Psychol Res. 1987;49(1):17-22
3615744
J Exp Psychol. 1964 May;67:483-5
14171241