Tripathi, A and Mondal, AK and Kumar, L and AP, Prathosh (2022) SCLAiR: Supervised Contrastive Learning for User and Device Independent Airwriting Recognition. In: IEEE Sensors Letters, 6 (2).
|
PDF
IEEE_sen_let_6-2_2022.pdf - Published Version Download (785kB) | Preview |
Abstract
Airwriting recognition is the problem of identifying letters written in free space with finger movement. It is essentially a specialized case of gesture recognition, wherein the vocabulary of gestures corresponds to letters as in a particular language. With the wide adoption of smart wearables in the general population, airwriting recognition using motion sensors from a smart band can be used as a medium of user input for applications in human-computer interaction. There has been limited work in the recognition of in-air trajectories using motion sensors, and the performance of the techniques in the case when the device used to record signals is changed has not been explored hitherto. Motivated by these, a new paradigm for device and user-independent airwriting recognition based on supervised contrastive learning is proposed. A two-stage classification strategy is employed, the first of which involves training an encoder network with supervised contrastive loss. In the subsequent stage, a classification head is trained with the encoder weights kept frozen. The efficacy of the proposed method is demonstrated through experiments on a publicly available dataset and also with a dataset recorded in our lab using a different device. Experiments have been performed in both supervised and unsupervised settings and compared against several state-of-the-art domain adaptation techniques. Data and the code for our implementation will be made available at https://github.com/ayushayt/SCLAiR.
| Item Type: | Journal Article |
|---|---|
| Publication: | IEEE Sensors Letters |
| Publisher: | Institute of Electrical and Electronics Engineers Inc. |
| Additional Information: | The copyright for this article belongs to Institute of Electrical and Electronics Engineers Inc. |
| Keywords: | Human computer interaction; Signal encoding; Wearable sensors, Airwriting; Domain adaptation; Free spaces; Motion detection; Motion sensors; Performances evaluation; Smart-band; Supervised contrastive learning; Target recognition; Writing, Motion analysis |
| Department/Centre: | Division of Electrical Sciences > Electrical Communication Engineering |
| Date Deposited: | 27 Jun 2022 06:58 |
| Last Modified: | 27 Jun 2022 06:58 |
| URI: | https://eprints.iisc.ac.in/id/eprint/73906 |
Actions (login required)
 |
View Item |
