ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Design and implementation of deep learning based contactless authentication system using hand gestures

Dayal, A and Paluru, N and Cenkeramaddi, LR and Soumya, J and Yalavarthy, PK (2021) Design and implementation of deep learning based contactless authentication system using hand gestures. In: Electronics (Switzerland), 10 (2). pp. 1-15.

ele_10-02_1-15_2021.pdf - Published Version

Download (5MB) | Preview
Official URL: https://dx.doi.org/10.3390/electronics10020182


Hand gestures based sign language digits have several contactless applications. Applications include communication for impaired people, such as elderly and disabled people, health-care applications, automotive user interfaces, and security and surveillance. This work presents the design and implementation of a complete end-to-end deep learning based edge computing system that can verify a user contactlessly using �authentication code�. The �authentication code� is an �n� digit numeric code and the digits are hand gestures of sign language digits. We propose a memory-efficient deep learning model to classify the hand gestures of the sign language digits. The proposed deep learning model is based on the bottleneck module which is inspired by the deep residual networks. The model achieves classification accuracy of 99.1 on the publicly available sign language digits dataset. The model is deployed on a Raspberry pi 4 Model B edge computing system to serve as an edge device for user verification. The edge computing system consists of two steps, it first takes input from the camera attached to it in real-time and stores it in the buffer. In the second step, the model classifies the digit with the inference rate of 280 ms, by taking the first image in the buffer as input. © 2021 by the authors. Li-censee MDPI, Basel, Switzerland.

Item Type: Journal Article
Publication: Electronics (Switzerland)
Publisher: MDPI AG
Additional Information: The copyright of this article belongs to MDPI AG
Department/Centre: Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited: 26 Feb 2021 09:53
Last Modified: 26 Feb 2021 09:53
URI: http://eprints.iisc.ac.in/id/eprint/68017

Actions (login required)

View Item View Item