Improved subject-independent acoustic-to-articulatory inversion

Afshan, Amber and Ghosh, Prasanta Kumar (2015) Improved subject-independent acoustic-to-articulatory inversion. In: SPEECH COMMUNICATION, 66 . pp. 1-16.

PDF spe_com_66_1_2015.pdf.pdf - Published Version Restricted to Registered users only Download (766kB) | Request a copy

Abstract

In subject-independent acoustic-to-articulatory inversion, the articulatory kinematics of a test subject are estimated assuming that the training corpus does not include data from the test subject. The training corpus in subject-independent inversion (SII) is formed with acoustic and articulatory kinematics data and the acoustic mismatch between training and test subjects is then estimated by an acoustic normalization using acoustic data drawn from a large pool of speakers called generic acoustic space (GAS). In this work, we focus on improving the SII performance through better acoustic normalization and adaptation. We propose unsupervised and several supervised ways of clustering GAS for acoustic normalization. We perform an adaptation of acoustic models of GAS using the acoustic data of the training and test subjects in SII. It is found that SII performance significantly improves (similar to 25% relative on average) over the subject-dependent inversion when the acoustic clusters in GAS correspond to phonetic units (or states of 3-state phonetic HMMs) and when the acoustic model built on GAS is adapted to training and test subjects while optimizing the inversion criterion. (C) 2014 Elsevier B.V. All rights reserved.

Item Type:	Journal Article
Publication:	SPEECH COMMUNICATION
Publisher:	ELSEVIER SCIENCE BV
Additional Information:	Copy right for this article belongs to theELSEVIER SCIENCE BV, PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS
Keywords:	Acoustic-to-articulatory inversion; Subject-independence; Generic acoustic space; Adaptation
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	04 Mar 2015 12:41
Last Modified:	04 Mar 2015 12:41
URI:	http://eprints.iisc.ac.in/id/eprint/50984

Actions (login required)

View Item