title: Multisensory integration is independent of perceived simultaneity.
abstract: The importance of multisensory integration for perception and action has long been recognised. Integrating information from individual senses increases the chance of survival by reducing the variability in the incoming signals, thus allowing us to respond more rapidly. Reaction times (RTs) are fastest when the components of the multisensory signals are simultaneous. This response facilitation is traditionally attributed to multisensory integration. However, it is unclear if facilitation of RTs occurs when stimuli are perceived as synchronous or are actually physically synchronous. Repeated exposure to audiovisual asynchrony can change the delay at which multisensory stimuli are perceived as simultaneous, thus changing the delay at which the stimuli are integrated-perceptually. Here we set out to determine how such changes in multisensory integration for perception affect our ability to respond to multisensory events. If stimuli perceived as simultaneous were reacted to most rapidly, it would suggest a common system for multisensory integration for perception and action. If not, it would suggest separate systems. We measured RTs to auditory, visual, and audiovisual stimuli following exposure to audiovisual asynchrony. Exposure affected the variability of the unisensory RT distributions; in particular, the slowest RTs were either speed up or slowed down (in the direction predicted from shifts in perceived simultaneity). Additionally, the multisensory facilitation of RTs (beyond statistical summation) only occurred when audiovisual onsets were physically synchronous, rather than when they appeared simultaneous. We conclude that the perception of synchrony is therefore independent of multisensory integration and suggest a division between multisensory processes that are fast (automatic and unaffected by temporal adaptation) and those that are slow (perceptually driven and adaptable).
authors.affiliation: School of Optometry, University of Montreal, 3744 Jean-Brillant, Montreal, QC, H3T 1P1, Canada. vanessa.harrar@umontreal.ca.|Department of Experimental Psychology, University of Oxford, Oxford, OX1 3UD, UK. vanessa.harrar@umontreal.ca.
authors.forename: Vanessa
authors.identifier: 0000-0001-5481-7954
authors.initials: V
authors.lastname: Harrar
authors.affiliation: Centre for Vision Research, York University, Toronto, ON, M3J 1P3, Canada.
authors.forename: Laurence R
authors.initials: LR
authors.lastname: Harris
authors.affiliation: Department of Experimental Psychology, University of Oxford, Oxford, OX1 3UD, UK.
authors.forename: Charles
authors.initials: C
authors.lastname: Spence
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D008960:Models, Psychological; D010775:Photic Stimulation; D011930:Reaction Time / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: Adaptation; Crossmodal; Ex-Gaussian; Miller’s inequality; Multisensory integration; Race model; Reaction time; Stimulus onset asynchrony; Time