title: When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition.
abstract: In the most recent report published by the World Health Organization concerning people with visual disabilities it is highlighted that by the year 2020, worldwide, the number of completely blind people will reach 75 million, while the number of visually impaired (VI) people will rise to 250 million. Within this context, the development of dedicated electronic travel aid (ETA) systems, able to increase the safe displacement of VI people in indoor/outdoor spaces, while providing additional cognition of the environment becomes of outmost importance. This paper introduces a novel wearable assistive device designed to facilitate the autonomous navigation of blind and VI people in highly dynamic urban scenes. The system exploits two independent sources of information: ultrasonic sensors and the video camera embedded in a regular smartphone. The underlying methodology exploits computer vision and machine learning techniques and makes it possible to identify accurately both static and highly dynamic objects existent in a scene, regardless on their location, size or shape. In addition, the proposed system is able to acquire information about the environment, semantically interpret it and alert users about possible dangerous situations through acoustic feedback. To determine the performance of the proposed methodology we have performed an extensive objective and subjective experimental evaluation with the help of 21 VI subjects from two blind associations. The users pointed out that our prototype is highly helpful in increasing the mobility, while being friendly and easy to learn.
authors: ARTEMIS Department, Institut Mines-Télécom/Télécom SudParis, UMR CNRS MAP5 8145, 9 rue Charles Fourier, Évry 91000, France. bogdan.mocanu@telecom-sudparis.eu.|Telecommunication Department, Faculty of ETTI, University Politehnica of Bucharest, Splaiul Independentei 313, Bucharest 060042, Romania. bogdan.mocanu@telecom-sudparis.eu.
authors: Bogdan
authors: B
authors: Mocanu
authors: ARTEMIS Department, Institut Mines-Télécom/Télécom SudParis, UMR CNRS MAP5 8145, 9 rue Charles Fourier, Évry 91000, France. ruxandra.tapu@telecom-sudparis.eu.|Telecommunication Department, Faculty of ETTI, University Politehnica of Bucharest, Splaiul Independentei 313, Bucharest 060042, Romania. ruxandra.tapu@telecom-sudparis.eu.
authors: Ruxandra
authors: R
authors: Tapu
authors: ARTEMIS Department, Institut Mines-Télécom/Télécom SudParis, UMR CNRS MAP5 8145, 9 rue Charles Fourier, Évry 91000, France. titus.zaharia@telecom-sudparis.eu.
authors: Titus
authors: T
authors: Zaharia
mesh_terms: D000162:Acoustics; D000328:Adult; D000368:Aged; D040421:Cell Phone / Q000295:instrumentation; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000295:instrumentation / Q000379:methods*; D000069550:Machine Learning; D008875:Middle Aged; D012656:Self-Help Devices; D019987:Persons with Visual Disabilities
keywords: acoustic feedback; computer vision techniques, machine learning algorithms; object recognition; obstacle detection; ultrasonic network; wearable assistive device