title: Cross-modal sensory integration of visual-tactile motion information: instrument design and human psychophysics.
abstract: Information obtained from multiple sensory modalities, such as vision and touch, is integrated to yield a holistic percept. As a haptic approach usually involves cross-modal sensory experiences, it is necessary to develop an apparatus that can characterize how a biological system integrates visual-tactile sensory information as well as how a robotic device infers object information emanating from both vision and touch. In the present study, we develop a novel visual-tactile cross-modal integration stimulator that consists of an LED panel to present visual stimuli and a tactile stimulator with three degrees of freedom that can present tactile motion stimuli with arbitrary motion direction, speed, and indentation depth in the skin. The apparatus can present cross-modal stimuli in which the spatial locations of visual and tactile stimulations are perfectly aligned. We presented visual-tactile stimuli in which the visual and tactile directions were either congruent or incongruent, and human observers reported the perceived visual direction of motion. Results showed that perceived direction of visual motion can be biased by the direction of tactile motion when visual signals are weakened. The results also showed that the visual-tactile motion integration follows the rule of temporal congruency of multi-modal inputs, a fundamental property known for cross-modal integration.
authors.affiliation: Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, Taoyuan 333, Taiwan. yspeii@adm.cgmh.org.tw
authors.forename: Yu-Cheng
authors.initials: YC
authors.lastname: Pei
authors.forename: Ting-Yu
authors.initials: TY
authors.lastname: Chang
authors.forename: Tsung-Chi
authors.initials: TC
authors.lastname: Lee
authors.forename: Sudipta
authors.initials: S
authors.lastname: Saha
authors.forename: Hsin-Yi
authors.initials: HY
authors.lastname: Lai
authors.forename: Manuel
authors.initials: M
authors.lastname: Gomez-Ramirez
authors.forename: Shih-Wei
authors.initials: SW
authors.lastname: Chou
authors.forename: Alice M K
authors.initials: AM
authors.lastname: Wong
mesh_terms: D006801:Humans; D009038:Motion; D011601:Psychophysics; D055698:Touch Perception; D014796:Visual Perception