title: Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments.
abstract: Independent travel is a well known challenge for blind and visually impaired persons. In this paper, we propose a proof-of-concept computer vision-based wayfinding aid for blind people to independently access unfamiliar indoor environments. In order to find different rooms (e.g. an office, a lab, or a bathroom) and other building amenities (e.g. an exit or an elevator), we incorporate object detection with text recognition. First we develop a robust and efficient algorithm to detect doors, elevators, and cabinets based on their general geometric shape, by combining edges and corners. The algorithm is general enough to handle large intra-class variations of objects with different appearances among different indoor environments, as well as small inter-class differences between different objects such as doors and door-like cabinets. Next, in order to distinguish intra-class objects (e.g. an office door from a bathroom door), we extract and recognize text information associated with the detected objects. For text recognition, we first extract text regions from signs with multiple colors and possibly complex backgrounds, and then apply character localization and topological analysis to filter out background interference. The extracted text is recognized using off-the-shelf optical character recognition (OCR) software products. The object type, orientation, location, and text information are presented to the blind traveler as speech.
authors: Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York, NY 10031.
authors: Yingli
authors: Y
authors: Tian
authors: Xiaodong
authors: X
authors: Yang
authors: Chucai
authors: C
authors: Yi
authors: Aries
authors: A
authors: Arditi
keywords: Indoor wayfinding; blind/visually impaired persons; computer vision; object detection; optical character recognition (OCR); text extraction
references: Comput Help People Spec Needs. 2008 Jul;5105:1135-1140
references: 26949755
references: IEEE Trans Pattern Anal Mach Intell. 1986 Jun;8(6):679-98
references: 21869365
references: Psychol Rev. 1987 Apr;94(2):115-147
references: 3575582
references: Comput Help People Spec Needs. 2008 Jul;5105:1122-1128
references: 26949754
references: Trends Cogn Sci. 2007 Dec;11(12):520-7
references: 18024143