Afshan, Amber and Ghosh, Prasanta Kumar (2015) Improved subject-independent acoustic-to-articulatory inversion. In: SPEECH COMMUNICATION, 66 . pp. 1-16.
PDF
spe_com_66_1_2015.pdf.pdf - Published Version Restricted to Registered users only Download (766kB) | Request a copy |
Abstract
In subject-independent acoustic-to-articulatory inversion, the articulatory kinematics of a test subject are estimated assuming that the training corpus does not include data from the test subject. The training corpus in subject-independent inversion (SII) is formed with acoustic and articulatory kinematics data and the acoustic mismatch between training and test subjects is then estimated by an acoustic normalization using acoustic data drawn from a large pool of speakers called generic acoustic space (GAS). In this work, we focus on improving the SII performance through better acoustic normalization and adaptation. We propose unsupervised and several supervised ways of clustering GAS for acoustic normalization. We perform an adaptation of acoustic models of GAS using the acoustic data of the training and test subjects in SII. It is found that SII performance significantly improves (similar to 25% relative on average) over the subject-dependent inversion when the acoustic clusters in GAS correspond to phonetic units (or states of 3-state phonetic HMMs) and when the acoustic model built on GAS is adapted to training and test subjects while optimizing the inversion criterion. (C) 2014 Elsevier B.V. All rights reserved.
Item Type: | Journal Article |
---|---|
Publication: | SPEECH COMMUNICATION |
Publisher: | ELSEVIER SCIENCE BV |
Additional Information: | Copy right for this article belongs to theELSEVIER SCIENCE BV, PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS |
Keywords: | Acoustic-to-articulatory inversion; Subject-independence; Generic acoustic space; Adaptation |
Department/Centre: | Division of Electrical Sciences > Electrical Engineering |
Date Deposited: | 04 Mar 2015 12:41 |
Last Modified: | 04 Mar 2015 12:41 |
URI: | http://eprints.iisc.ac.in/id/eprint/50984 |
Actions (login required)
View Item |