title: Fusion of Haptic and Gesture Sensors for Rehabilitation of Bimanual Coordination and Dexterous Manipulation.
abstract: Disabilities after neural injury, such as stroke, bring tremendous burden to patients, families and society. Besides the conventional constrained-induced training with a paretic arm, bilateral rehabilitation training involves both the ipsilateral and contralateral sides of the neural injury, fitting well with the fact that both arms are needed in common activities of daily living (ADLs), and can promote good functional recovery. In this work, the fusion of a gesture sensor and a haptic sensor with force feedback capabilities has enabled a bilateral rehabilitation training therapy. The Leap Motion gesture sensor detects the motion of the healthy hand, and the omega.7 device can detect and assist the paretic hand, according to the designed cooperative task paradigm, as much as needed, with active force feedback to accomplish the manipulation task. A virtual scenario has been built up, and the motion and force data facilitate instantaneous visual and audio feedback, as well as further analysis of the functional capabilities of the patient. This task-oriented bimanual training paradigm recruits the sensory, motor and cognitive aspects of the patient into one loop, encourages the active involvement of the patients into rehabilitation training, strengthens the cooperation of both the healthy and impaired hands, challenges the dexterous manipulation capability of the paretic hand, suits easy of use at home or centralized institutions and, thus, promises effective potentials for rehabilitation training.
authors.affiliation: Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China. nyu@nankai.edu.cn.|Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China. nyu@nankai.edu.cn.
authors.forename: Ningbo
authors.initials: N
authors.lastname: Yu
authors.affiliation: Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China. xuch@mail.nankai.edu.cn.|Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China. xuch@mail.nankai.edu.cn.
authors.forename: Chang
authors.initials: C
authors.lastname: Xu
authors.affiliation: Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China. lihuanshuai@mail.nankai.edu.cn.|Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China. lihuanshuai@mail.nankai.edu.cn.
authors.forename: Huanshuai
authors.initials: H
authors.lastname: Li
authors.affiliation: Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China. wangkui337@mail.nankai.edu.cn.|Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China. wangkui337@mail.nankai.edu.cn.
authors.forename: Kui
authors.initials: K
authors.lastname: Wang
authors.affiliation: Rehabilitation Center, Tianjin Hospital, Tianjin 300211, China. cmoweb@126.com.
authors.forename: Liancheng
authors.initials: L
authors.lastname: Wang
authors.affiliation: Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China. liujt@nankai.edu.cn.|Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China. liujt@nankai.edu.cn.
authors.forename: Jingtai
authors.initials: J
authors.lastname: Liu
mesh_terms: D000203:Activities of Daily Living; D005868:Gestures; D006225:Hand / Q000503:physiopathology*; D006801:Humans; D009068:Movement / Q000502:physiology; D020127:Recovery of Function / Q000502:physiology; D066191:Sensorimotor Cortex / Q000503:physiopathology*; D020521:Stroke / Q000503:physiopathology*; D000071939:Stroke Rehabilitation / Q000295:instrumentation* / Q000379:methods
keywords: bimanual coordination; dexterous manipulation; haptics; rehabilitation; sensory-motor cognitive skills