ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Attention and encoder-decoder based models for transforming articulatory movements at different speaking rates

Singh, A and Illa, A and Ghosh, PK (2020) Attention and encoder-decoder based models for transforming articulatory movements at different speaking rates. In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 25-29 October 2020, Shanghai; China, pp. 2907-2911.

[img]
Preview
PDF
INTERSPEECH-Vol-2020-2907-2911.pdf - Published Version

Download (1MB) | Preview
Official URL: https://dx.doi.org/10.21437/Interspeech.2020-2708

Abstract

While speaking at different rates, articulators (like tongue, lips) tend to move differently and the enunciations are also of different durations. In the past, affine transformation and DNN have been used to transform articulatory movements from neutral to fast(N2F) and neutral to slow(N2S) speaking rates 1. In this work, we improve over the existing transformation techniques by modeling rate specific durations and their transformation using AstNet, an encoder-decoder framework with attention. In the current work, we propose an encoder-decoder architecture using LSTMs which generates smoother predicted articulatory trajectories. For modeling duration variations across speaking rates, we deploy attention network, which eliminates the need to align trajectories in different rates using DTW. We perform a phoneme specific duration analysis to examine how well duration is transformed using the proposed AstNet. As the range of articulatory motions is correlated with speaking rate, we also analyze amplitude of the transformed articulatory movements at different rates compared to their original counterparts, to examine how well the proposed AstNet predicts the extent of articulatory movements in N2F and N2S. We observe that AstNet could model both duration and extent of articulatory movements better than the existing transformation techniques resulting in more accurate transformed articulatory trajectories. © 2020 ISCA

Item Type: Conference Paper
Additional Information: cited By 0; Conference of 21st Annual Conference of the International Speech Communication Association, INTERSPEECH 2020 ; Conference Date: 25 October 2020 Through 29 October 2020; Conference Code:165507
Keywords: Affine transforms; Decoding; Speech; Speech communication; Trajectories, Affine transformations; Encoder-decoder; Encoder-decoder architecture; Speaking rate; Transformation techniques, Signal encoding
Department/Centre: Division of Electrical Sciences > Electrical Engineering
Depositing User: Mr Parikshita Behera
Date Deposited: 12 Jan 2021 10:54
Last Modified: 12 Jan 2021 10:54
URI: http://eprints.iisc.ac.in/id/eprint/67636

Actions (login required)

View Item View Item