title: Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind.
abstract: In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.
authors.affiliation: School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA. zava@purdue.edu.
authors.forename: Donghun
authors.initials: D
authors.lastname: Kim
authors.affiliation: Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-ITTechnology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea. kwangtaekkim@yonsei.ac.kr.
authors.forename: Kwangtaek
authors.initials: K
authors.lastname: Kim
authors.affiliation: Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-ITTechnology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea. syleee@yonsei.ac.kr.
authors.forename: Sangyoun
authors.initials: S
authors.lastname: Lee
mesh_terms: D001766:Blindness / Q000534:rehabilitation*; D002183:Canes; D004867:Equipment Design; D019544:Equipment Failure Analysis; D025461:Feedback, Physiological; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000295:instrumentation*; D009949:Orientation; D010363:Pattern Recognition, Automated / Q000379:methods; D010812:Physical Stimulation / Q000295:instrumentation*; D012656:Self-Help Devices; D012815:Signal Processing, Computer-Assisted / Q000295:instrumentation; D014110:Touch; D014159:Transducers; D014584:User-Computer Interface