Using Object Detection to Select Grasp Type & Control Functional Electrical Stimulation for Hand Rehabilitation

Bhagat, NA and Ruppa, M (2023) Using Object Detection to Select Grasp Type & Control Functional Electrical Stimulation for Hand Rehabilitation. In: 10th International Conference on Signal Processing and Integrated Networks, SPIN 2023, 23-24 March 2023, Noida, India, pp. 538-542.

PDF SPI_538-542_2023 .pdf - Published Version Restricted to Registered users only Download (480kB) | Request a copy

Abstract

Unilateral muscle weakness and hand paralysis is the most common outcome after a stroke. Functional electrical stimulation (FES) is effective in assisting hand prehension, but conventional stimulators require users to manually select the grasp type (e.g. by pressing a button), which is challenging for patients with severe paralysis. Also, patients need to frequently divert attention from their task to operate the stimulator, which is cumbersome and reduces their engagement in the therapy. In this study, we develop a novel deep learning-based object detection approach to select multiple grasp types and control an electrical stimulator, in order to assist grasping. Object detection was performed using a state-of-the-art YOLOv5 algorithm, which achieved above 93% mean average precision. The algorithm tracked the positions of the hand and objects and selected a grasp type based on the object nearest to the hand. Once the grasp type was selected, a custom-built FES stimulator was activated to execute pre-defined stimulation sequences and allow a person to grasp the nearest object. This contactless, vision-based solution is beneficial for patients opting for homebased rehabilitation since it doesn't require additional setup time or help from caregivers. The future scope of this work includes testing the object detection-based FES on stroke patients and determining its efficacy in restoring hand movements.

Item Type:	Conference Paper
Publication:	Proceedings of the 10th International Conference on Signal Processing and Integrated Networks, SPIN 2023
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright for this article belongs to the Institute of Electrical and Electronics Engineers Inc.
Keywords:	functional electrical stimulation; grasp assistance; hand rehabilitation; human-machine interface; object detection
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	03 Jul 2023 07:12
Last Modified:	03 Jul 2023 07:12
URI:	https://eprints.iisc.ac.in/id/eprint/82134

Actions (login required)

View Item