A COMPARATIVE STUDY OF ACOUSTIC-TO-ARTICULATORY INVERSION FOR NEUTRAL AND WHISPERED SPEECH

Illa, Aravind and Meenakshi, Nisha G and Ghosh, Prasanta Kumar (2017) A COMPARATIVE STUDY OF ACOUSTIC-TO-ARTICULATORY INVERSION FOR NEUTRAL AND WHISPERED SPEECH. In: International Conference on Acoustics Speech and Signal Processing ICASSP, MAR 05-09, 2017, New Orleans, LA, pp. 5075-5079.

PDF Iee_Int_Con_5075_2017.pdf - Published Version Restricted to Registered users only Download (258kB) | Request a copy

Abstract

Whispered speech is known to have different characteristics in acoustics and articulation compared to neutral speech. In this study, we compare the accuracy with which the articulation can be recovered from the acoustics of both types of speech, individually. Acoustic-to-articulatory inversion (AAI) is performed with twelve articulatory features using the deep neural network (DNN) with data obtained from four subjects. We consider AAI in matched and mis-matched train-test conditions, where the speech types in training and test are identical and different respectively. Experiments in matched condition reveal that the AAI performance for whispered speech drops significantly compared to that for neutral speech, only for jaw, tongue tip and tongue body, consistently, for all four subjects. This indicates that the whispered speech encodes information about the rest of the articulators to a degree similar to that of the neutral speech. Experiments in the mis-matched condition show a consistent drop in the AAI performance compared to the matched condition. This drop in performance from matched to mis-matched condition is found be the highest for upper lip which indicates that the upper lip movement could be encoded differently in whispered speech compared to that in neutral speech.

Item Type:	Conference Paper
Series.:	International Conference on Acoustics Speech and Signal Processing ICASSP
Publisher:	10.1109/ICASSP.2017.7953123
Additional Information:	IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, MAR 05-09, 2017 Copy right for this article belongs to the IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	20 Jan 2018 05:48
Last Modified:	20 Jan 2018 05:48
URI:	http://eprints.iisc.ac.in/id/eprint/58841

Actions (login required)

View Item