Singh, A and Illa, A and Ghosh, PK (2020) Attention and encoder-decoder based models for transforming articulatory movements at different speaking rates. In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 25-29 October 2020, Shanghai; China, pp. 2907-2911.
|
PDF
INTERSPEECH-Vol-2020-2907-2911.pdf - Published Version Download (1MB) | Preview |
Abstract
While speaking at different rates, articulators (like tongue, lips) tend to move differently and the enunciations are also of different durations. In the past, affine transformation and DNN have been used to transform articulatory movements from neutral to fast(N2F) and neutral to slow(N2S) speaking rates 1. In this work, we improve over the existing transformation techniques by modeling rate specific durations and their transformation using AstNet, an encoder-decoder framework with attention. In the current work, we propose an encoder-decoder architecture using LSTMs which generates smoother predicted articulatory trajectories. For modeling duration variations across speaking rates, we deploy attention network, which eliminates the need to align trajectories in different rates using DTW. We perform a phoneme specific duration analysis to examine how well duration is transformed using the proposed AstNet. As the range of articulatory motions is correlated with speaking rate, we also analyze amplitude of the transformed articulatory movements at different rates compared to their original counterparts, to examine how well the proposed AstNet predicts the extent of articulatory movements in N2F and N2S. We observe that AstNet could model both duration and extent of articulatory movements better than the existing transformation techniques resulting in more accurate transformed articulatory trajectories. © 2020 ISCA
| Item Type: | Conference Paper |
|---|---|
| Publication: | Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH |
| Publisher: | International Speech Communication Association |
| Additional Information: | cited By 0; Conference of 21st Annual Conference of the International Speech Communication Association, INTERSPEECH 2020 ; Conference Date: 25 October 2020 Through 29 October 2020; Conference Code:165507 |
| Keywords: | Affine transforms; Decoding; Speech; Speech communication; Trajectories, Affine transformations; Encoder-decoder; Encoder-decoder architecture; Speaking rate; Transformation techniques, Signal encoding |
| Department/Centre: | Division of Electrical Sciences > Electrical Engineering |
| Date Deposited: | 12 Jan 2021 10:54 |
| Last Modified: | 12 Jan 2021 10:54 |
| URI: | http://eprints.iisc.ac.in/id/eprint/67636 |
Actions (login required)
 |
View Item |
