Automatic recognition of social roles using long term role transitions in small group interactions

Fotedar, Gaurav and Gaonkar, Aditya P and Chatterjee, Saikat and Ghosh, Prasanta Kumar (2017) Automatic recognition of social roles using long term role transitions in small group interactions. In: 17th Annual Conference of the International-Speech-Communication-Association (INTERSPEECH 2016), SEP 08-12, 2016, San Francisco, CA, pp. 2065-2069.

PDF UND_SPE_PRO_HUM_MAC_2065_2017.PDF - Published Version Restricted to Registered users only Download (174kB) | Request a copy

Abstract

Recognition of social roles in small group interactions is challenging because of the presence of disfluency in speech, frequent overlaps between speakers, short speaker turns and the need for reliable data annotation. In this work, we consider the problem of recognizing four roles, namely Gatekeeper, Protagonist, Neutral, and Supporter in small group interactions in AMI corpus. In general, Gatekeeper and Protagonist roles occur less frequently compared to Neutral, and Supporter. In this work, we exploit role transitions across segments in a meeting by incorporating role transition probabilities and formulating the role recognition as a decoding problem over the sequence of segments in an interaction. Experiments are performed in a five fold cross validation setup using acoustic, lexical and structural features with precision, recall and F-score as the performance metrics. The results reveal that precision averaged across all folds and different feature combinations improves in the case of Gatekeeper and Protagonist by 13.64% and 12.75% when the role transition information is used which in turn improves the F-score for Gatekeeper by 6.58% while the F-scores for the rest of the roles do not change significantly.

Item Type:	Conference Paper
Series.:	Interspeech
Additional Information:	Copy right for this article belongs to the ISCA-INT SPEECH COMMUNICATION ASSOC, C/O EMMANUELLE FOXONET, 4 RUE DES FAUVETTES, LIEU DIT LOUS TOURILS, BAIXAS, F-66390, FRANCE
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	30 Oct 2017 03:39
Last Modified:	30 Oct 2017 03:39
URI:	http://eprints.iisc.ac.in/id/eprint/58123

Actions (login required)

View Item