A comparative study of different emg features for acoustics-to-emg mapping

Sharma, M and Gaddam, N and Umesh, T and Murthy, A and Ghosh, PK (2021) A comparative study of different emg features for acoustics-to-emg mapping. In: 22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021, 30 Aug - 03 Sep 2021, Brno, pp. 461-465.

PDF INTERSPEECH_2021.pdf - Published Version Restricted to Registered users only Download (916kB) | Request a copy

Abstract

Electromyography (EMG) signals have been extensively used to capture facial muscle movements while speaking since they are one of the most closely related bio-signals generated during speech production. In this work, we focus on speech acoustics to EMG prediction. We present a comparative study of ten different EMG signal-based features including Time Domain (TD) features existing in the literature to examine their effectiveness in speech acoustics to EMG inverse (AEI) mapping. We propose a novel feature based on the Hilbert envelope of the filtered EMG signal. The raw EMG signal is reconstructed from these features as well. For the AEI mapping, we use a bi-directional long short-term memory (BLSTM) network in a session-dependent manner. To estimate the raw EMG signal from the EMG features, we use a CNN-BLSTM model comprising of a convolution neural network (CNN) followed by BLSTM layers. AEI mapping performance using the BLSTM network reveals that the Hilbert envelope based feature is predicted from speech with the highest accuracy, among all the features. Therefore, it could be the most representative feature of the underlying muscle activation during speech production. The proposed Hilbert envelope feature, when used together with the existing TD features, improves the raw EMG signal reconstruction performance compared to using the TD features alone. Copyright © 2021 ISCA.

Item Type:	Conference Paper
Publication:	Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Publisher:	International Speech Communication Association
Additional Information:	The copyright for this article belongs to International Speech Communication Association
Department/Centre:	Division of Biological Sciences > Centre for Neuroscience Division of Electrical Sciences > Electrical Engineering
Date Deposited:	03 Dec 2021 08:49
Last Modified:	03 Dec 2021 08:49
URI:	http://eprints.iisc.ac.in/id/eprint/70633

Actions (login required)

View Item