Automatic Identification of Speakers from Head Gestures in a Narration

Vadiraj, SK and Achuth Rao, MV and Ghosh, PK (2020) Automatic Identification of Speakers from Head Gestures in a Narration. In: 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2020, 4-8, May 2020, Barcelona; Spain, pp. 6314-6318.

PDF ica_iee_int_con_aco_spe_sig_pro_6314-6318_2020.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

In this work, we focus on quantifying speaker identity information encoded in the head gestures of speakers, while they narrate a story. We hypothesize that the head gestures over a long duration have speaker-specific patterns. To establish this, we consider a classification problem to identify speakers from head gestures. We represent every head orientation as a triplet of Euler angles and a sequence of head orientations as head gestures. We use a database having recordings from 24 speakers where the head movements are recorded using a motion capture device, with each subject narrating ten stories. We get the best speaker identification accuracy of 0.836 using head gestures over a duration of 40 seconds. Further, the accuracy increases by combining decisions from multiple 40 second windows when a recording is available with duration more than the window length. We achieve an average accuracy of 0.9875 on our database when the entire recording is used. Analysis of the speaker identification performance over 40 second windows across a recording reveals that the speaker-identity information is more prevalent in some parts of a story than others.

Item Type:	Conference Poster
Publication:	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright of this article belongs to Institute of Electrical and Electronics Engineers Inc.
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	24 Aug 2020 06:55
Last Modified:	24 Aug 2020 06:55
URI:	http://eprints.iisc.ac.in/id/eprint/66384

Actions (login required)

View Item