Simplification of Visual Rendering in Simulated Prosthetic Vision Facilitates Navigation.
Visual neuroprostheses are still limited and simulated prosthetic vision (SPV) is used to evaluate potential and forthcoming functionality of these implants. SPV has been used to evaluate the minimum requirement on visual neuroprosthetic characteristics to restore various functions such as reading, objects and face recognition, object grasping, etc. Some of these studies focused on obstacle avoidance but only a few investigated orientation or navigation abilities with prosthetic vision. The resolution of current arrays of electrodes is not sufficient to allow navigation tasks without additional processing of the visual input. In this study, we simulated a low resolution array (15 × 18 electrodes, similar to a forthcoming generation of arrays) and evaluated the navigation abilities restored when visual information was processed with various computer vision algorithms to enhance the visual rendering. Three main visual rendering strategies were compared to a control rendering in a wayfinding task within an unknown environment. The control rendering corresponded to a resizing of the original image onto the electrode array size, according to the average brightness of the pixels. In the first rendering strategy, vision distance was limited to 3, 6, or 9 m, respectively. In the second strategy, the rendering was not based on the brightness of the image pixels, but on the distance between the user and the elements in the field of view. In the last rendering strategy, only the edges of the environments were displayed, similar to a wireframe rendering. All the tested renderings, except the 3 m limitation of the viewing distance, improved navigation performance and decreased cognitive load. Interestingly, the distance-based and wireframe renderings also improved the cognitive mapping of the unknown environment. These results show that low resolution implants are usable for wayfinding if specific computer vision algorithms are used to select and display appropriate information regarding the environment.
Université de Toulouse and CNRS, IRIT, UMR5505, Toulouse, France.
Victor
V
Vergnieux
Université de Toulouse and CNRS, IRIT, UMR5505, Toulouse, France.
Marc J-M
http://orcid.org/0000-0003-4124-8697
MJ
Macé
Université de Toulouse and CNRS, IRIT, UMR5505, Toulouse, France.
Christophe
C
Jouffrais
D000328:Adult; D000465:Algorithms; D032882:Comprehension; D004566:Electrodes; D005260:Female; D064368:Healthy Volunteers; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008297:Male; D010719:Phosphenes; D011474:Prosthesis Design; D065854:Spatial Navigation; D014786:Vision Disorders / Q000601:surgery; D014785:Vision, Ocular / Q000502:physiology*; D057488:Visual Prosthesis; D055815:Young Adult
Blind; Computer vision; Navigation; Retinal implant; Spatial cognition; Visual neuroprostheses; Wayfinding