Visualization tools for blind people using multiple modalities.
OBJECTIVE
There are many problems when blind people need to access visualizations such as graphs and tables. Current speech or raised-paper technology does not provide a good solution. Our approach is to use non-speech sounds and haptics to allow a richer and more flexible form of access to graphs and tables.


METHODS
Two experiments are reported that test out designs for both sound and haptic graph solutions. In the audio case a standard speech interface is compared to one with non-speech sounds added. The haptic experiment compares two different graph designs to see which was the most effective.


RESULTS
Our results for the sound graphs showed a significant decrease in subjective workload, reduced time taken to complete tasks and reduced errors as compared to a standard speech interface. For the haptic graphs reductions in workload and some of the problems that can occur when using such graphs are shown.


CONCLUSIONS
Using non-speech sound and haptics can significantly improve interaction with visualizations such as graphs. This multimodal approach makes the most of the senses our users have to provide access to information in more flexible ways.
Brewster
S
S
Department of Computing Science, University of Glasgow, UK. stephen@dcs.gla.ac.uk
D001766:Blindness / Q000534:rehabilitation*; D004867:Equipment Design; D006804:Ergonomics / Q000379:methods; D005260:Female; D006801:Humans; D008297:Male; D010865:Pilot Projects; D012107:Research Design; D012656:Self-Help Devices; D012680:Sensitivity and Specificity; D012985:Software Design; D012986:Software Validation; D013016:Sound; D013017:Sound Localization; D014110:Touch; D014584:User-Computer Interface; D014796:Visual Perception