ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

LEVERAGING LSTM MODELS FOR OVERLAP DETECTION IN MULTI-PARTY MEETINGS

Sajjan, Neeraj and Ganesh, Shobhana and Sharma, Neeraj and Ganapathy, Sriram and Ryant, Neville (2018) LEVERAGING LSTM MODELS FOR OVERLAP DETECTION IN MULTI-PARTY MEETINGS. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), APR 15-20, 2018, Calgary, CANADA, pp. 5249-5253.

[img] PDF
Ieee_Int_Con_Aco_Spe_Sig_Pro_5249_2018.pdf - Published Version
Restricted to Registered users only

Download (506kB) | Request a copy
Official URL: https://doi.org/10.1109/ICASSP.2018.8462548

Abstract

The detection of overlapping speech segments is of key importance in speech applications involving analysis of multi-party conversations. The detection problem is challenging because overlapping speech segments are typically captured as short speech utterances far-field microphone recordings. In this paper, we propose detection of overlap segments using a neural network architecture consisting of long-short term memory (LSTM) models. The neural network architecture learns the presence of overlap in speech by identifying the spectrotemporal structure of overlapping speech segments. In order to evaluate the model performance, we perform experiments on simulated overlapped speech generated from the TIMIT database, and natural multi-talker conversational speech in the augmented Multiparty Interaction (AMI) meeting corpus. The proposed approach yields improvements over a Gaussian mixture model based overlap detection system. Furthermore, as an application of overlap detection, integration of overlap detection into speaker diarization task is shown to give improvement in diarization error rate.

Item Type: Conference Proceedings
Additional Information: Copy right for this article belong to IEEE
Keywords: Overlap Detection; LSTM modeling; Speaker Diarization; Conversational Speech Analysis
Department/Centre: Division of Electrical Sciences > Electrical Engineering
Depositing User: Id for Latest eprints
Date Deposited: 26 Oct 2018 14:44
Last Modified: 26 Oct 2018 14:44
URI: http://eprints.iisc.ac.in/id/eprint/60964

Actions (login required)

View Item View Item