title: EyeMusic: Introducing a "visual" colorful experience for the blind using auditory sensory substitution.
abstract: OBJECTIVE
  Sensory-substitution devices (SSDs) provide auditory or tactile representations of visual information. These devices often generate unpleasant sensations and mostly lack color information. We present here a novel SSD aimed at addressing these issues.
  
  
  METHODS
  We developed the EyeMusic, a novel visual-to-auditory SSD for the blind, providing both shape and color information. Our design uses musical notes on a pentatonic scale generated by natural instruments to convey the visual information in a pleasant manner. A short behavioral protocol was utilized to train the blind to extract shape and color information, and test their acquired abilities. Finally, we conducted a survey and a comparison task to assess the pleasantness of the generated auditory stimuli.
  
  
  RESULTS
  We show that basic shape and color information can be decoded from the generated auditory stimuli. High performance levels were achieved by all participants following as little as 2-3 hours of training. Furthermore, we show that users indeed found the stimuli pleasant and potentially tolerable for prolonged use.
  
  
  CONCLUSIONS
  The novel EyeMusic algorithm provides an intuitive and relatively pleasant way for the blind to extract shape and color information. We suggest that this might help facilitating visual rehabilitation because of the added functionality and enhanced pleasantness.
authors.affiliation: Department of Medical Neurobiology, The Institute for Medical Research Israel-Canada, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel.
authors.forename: Sami
authors.initials: S
authors.lastname: Abboud
authors.affiliation: Department of Medical Neurobiology, The Institute for Medical Research Israel-Canada, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel.
authors.forename: Shlomi
authors.initials: S
authors.lastname: Hanassy
authors.affiliation: Department of Medical Neurobiology, The Institute for Medical Research Israel-Canada, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel The Edmond and Lily Safra Center for Brain Sciences (ELSC), The Hebrew University of Jerusalem, Jerusalem, Israel.
authors.forename: Shelly
authors.initials: S
authors.lastname: Levy-Tzedek
authors.affiliation: Department of Medical Neurobiology, The Institute for Medical Research Israel-Canada, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel.
authors.forename: Shachar
authors.initials: S
authors.lastname: Maidenbaum
authors.affiliation: Department of Medical Neurobiology, The Institute for Medical Research Israel-Canada, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel The Edmond and Lily Safra Center for Brain Sciences (ELSC), The Hebrew University of Jerusalem, Jerusalem, Israel The Cognitive Science Program, The Hebrew University of Jerusalem, Jerusalem, Israel.
authors.forename: Amir
authors.initials: A
authors.lastname: Amedi
mesh_terms: D000161:Acoustic Stimulation / Q000379:methods*; D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D001766:Blindness / Q000628:therapy*; D060329:Education of Persons with Visual Disabilities; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D009473:Neuronal Plasticity / Q000502:physiology; D012677:Sensation / Q000502:physiology; D019987:Persons with Visual Disabilities
keywords: SSD; Sensory substitution devices; blindness; color; pleasant sounds; rehabilitation