ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Supervised Hierarchical Clustering Using Graph Neural Networks for Speaker Diarization

Singh, P and Kaul, A and Ganapathy, S (2023) Supervised Hierarchical Clustering Using Graph Neural Networks for Speaker Diarization. In: UNSPECIFIED.

Ica_iee_int_con_aco_spe_sig_pro_pro_2023.pdf - Published Version

Download (1MB) | Preview
Official URL: https://doi.org/10.1109/ICASSP49357.2023.10095372


Conventional methods for speaker diarization involve windowing an audio file into short segments to extract speaker embeddings, followed by an unsupervised clustering of the embeddings. This multistep approach generates speaker assignments for each segment. In this paper, we propose a novel Supervised HierArchical gRaph Clustering algorithm (SHARC) for speaker diarization where we introduce a hierarchical structure using Graph Neural Network (GNN) to perform supervised clustering. The supervision allows the model to update the representations and directly improve the clustering performance, thus enabling a single-step approach for diarization. In the proposed work, the input segment embeddings are treated as nodes of a graph with the edge weights corresponding to the similarity scores between the nodes. We also propose an approach to jointly update the embedding extractor and the GNN model to perform end-to-end speaker diarization (E2E-SHARC). During inference, the hierarchical clustering is performed using node densities and edge existence probabilities to merge the segments until convergence. In the diarization experiments, we illustrate that the proposed E2E-SHARC approach achieves 53 and 44 relative improvements over the baseline systems on benchmark datasets like AMI and Voxconverse, respectively. © 2023 IEEE.

Item Type: Conference Paper
Publication: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Publisher: Institute of Electrical and Electronics Engineers Inc.
Additional Information: The copyright for this article belongs to author.
Department/Centre: Division of Electrical Sciences > Electrical Engineering
Date Deposited: 04 Mar 2024 09:10
Last Modified: 04 Mar 2024 09:10
URI: https://eprints.iisc.ac.in/id/eprint/84289

Actions (login required)

View Item View Item