Automatic speaker profiling from short duration speech data

Kalluri, SB and Vijayasenan, D and Ganapathy, S (2020) Automatic speaker profiling from short duration speech data. In: Speech Communication, 121 . pp. 16-28.

PDF spe_com_121_16-28_2020 .pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

Many paralinguistic applications of speech demand the extraction of information about the speaker characteristics from as little speech data as possible. In this work, we explore the estimation of multiple physical parameters of the speaker from the short duration of speech in a multilingual setting. We explore different feature streams for age and body build estimation derived from the speech spectrum at different resolutions, namely � short-term log-mel spectrogram, formant features and harmonic features of the speech. The statistics of these features over the speech recording are used to learn a support vector regression model for speaker age and body build estimation. The experiments performed on the TIMIT dataset show that each of the individual features is able to achieve results that outperform previously published results in height and age estimation. Furthermore, the estimation errors from these different feature streams are complementary, which allows the combination of estimates from these feature streams to further improve the results. The combined system from short audio snippets achieves a performance of 5.2 cm, and 4.8 cm in Mean Absolute Error (MAE) for male and female respectively for height estimation. Similarly in age estimation the MAE is of 5.2 years, and 5.6 years for male, and female speakers respectively. We also extend the same physical parameter estimation to other body build parameters like shoulder width, waist size and weight along with height on a dataset we collected for speaker profiling. The duration analysis of the proposed scheme shows that the state of the art results can be achieved using only around 1�2 s of speech data. To the best of our knowledge, this is the first attempt to use a common set of features for estimating the different physical traits of a speaker.

Item Type:	Journal Article
Publication:	Speech Communication
Publisher:	ELSEVIER
Additional Information:	The copyright of this article belongs to ELSEVIER
Keywords:	Speech; Support vector regression, Different resolutions; Extraction of information; Height estimation; Individual features; Mean absolute error; Physical parameters; Speaker characteristics; Support vector regression models, Parameter estimation
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	12 Aug 2020 11:35
Last Modified:	12 Aug 2020 11:35
URI:	http://eprints.iisc.ac.in/id/eprint/65475

Actions (login required)

View Item