title: Other ways of seeing: From behavior to neural mechanisms in the online "visual" control of action with sensory substitution.
abstract: Vision is the dominant sense for perception-for-action in humans and other higher primates. Advances in sight restoration now utilize the other intact senses to provide information that is normally sensed visually through sensory substitution to replace missing visual information. Sensory substitution devices translate visual information from a sensor, such as a camera or ultrasound device, into a format that the auditory or tactile systems can detect and process, so the visually impaired can see through hearing or touch. Online control of action is essential for many daily tasks such as pointing, grasping and navigating, and adapting to a sensory substitution device successfully requires extensive learning. Here we review the research on sensory substitution for vision restoration in the context of providing the means of online control for action in the blind or blindfolded. It appears that the use of sensory substitution devices utilizes the neural visual system; this suggests the hypothesis that sensory substitution draws on the same underlying mechanisms as unimpaired visual control of action. Here we review the current state of the art for sensory substitution approaches to object recognition, localization, and navigation, and the potential these approaches have for revealing a metamodal behavioral and neural basis for the online control of action.
authors.affiliation: Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath, UK.
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Proulx
authors.affiliation: Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath, UK.
authors.forename: James
authors.initials: J
authors.lastname: Gwinnutt
authors.affiliation: Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath, UK.
authors.forename: Sara
authors.initials: S
authors.lastname: Dell'Erba
authors.affiliation: Cognition, Aging and Rehabilitation Lab, Recanati School for Community Health Professions, Department of Physical Therapy & Zlotowski Center for Neuroscience, Ben Gurion University of the Negev, Beer-Sheva, Israel.
authors.forename: Shelly
authors.initials: S
authors.lastname: Levy-Tzedek
authors.affiliation: Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath, UK.|Department of Science, Bath Spa University, Bath, UK.
authors.forename: Alexandra A
authors.initials: AA
authors.lastname: de Sousa
authors.affiliation: Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath, UK.
authors.forename: David J
authors.initials: DJ
authors.lastname: Brown
mesh_terms: D001766:Blindness / Q000503:physiopathology; D001921:Brain / Q000502:physiology* / Q000503:physiopathology; D006801:Humans; D009043:Motor Activity / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*
keywords: Sensory substitution; active sensing; blindness; object recognition; perception for action; prosthetics