ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Dereverberation of autoregressive envelopes for far-field speech recognition

Purushothaman, A and Sreeram, A and Kumar, R and Ganapathy, S (2022) Dereverberation of autoregressive envelopes for far-field speech recognition. In: Computer Speech and Language, 72 .

com_spe_lan_72_2022.pdf - Published Version

Download (959kB) | Preview
Official URL: https://doi.org/10.1016/j.csl.2021.101277


The task of speech recognition in far-field environments is adversely affected by the reverberant artifacts that elicit as the temporal smearing of the sub-band envelopes. In this paper, we develop a neural model for speech dereverberation using the long-term sub-band envelopes of speech. The sub-band envelopes are derived using frequency domain linear prediction (FDLP) which performs an autoregressive estimation of the Hilbert envelopes. The neural dereverberation model estimates the envelope gain which when applied to reverberant signals suppresses the late reflection components in the far-field signal. The dereverberated envelopes are used for feature extraction in speech recognition. Further, the sequence of steps involved in envelope dereverberation, feature extraction and acoustic modeling for ASR can be implemented as a single neural processing pipeline which allows the joint learning of the dereverberation network and the acoustic model. Several experiments are performed on the REVERB challenge dataset, CHiME-3 dataset and VOiCES dataset. In these experiments, the joint learning of envelope dereverberation and acoustic model yields significant performance improvements over the baseline ASR system based on log-mel spectrogram as well as other past approaches for dereverberation (average relative improvements of 10�24 over the baseline system). A detailed analysis on the choice of hyper-parameters and the cost function involved in envelope dereverberation is also provided. © 2021

Item Type: Journal Article
Publication: Computer Speech and Language
Publisher: Academic Press
Additional Information: The copyright for this article belongs to Authors
Keywords: Acoustic logging; Cost functions; Extraction; Feature extraction; Frequency domain analysis; Frequency estimation; Learning systems; Reverberation; Speech, Autoregressive estimations; Far-field environments; Far-field signals; Frequency domains; Hilbert envelope; Linear prediction; Reflection components; Speech dereverberation, Speech recognition
Department/Centre: Division of Electrical Sciences > Electrical Engineering
Date Deposited: 03 Dec 2021 08:22
Last Modified: 03 Dec 2021 08:22
URI: http://eprints.iisc.ac.in/id/eprint/70185

Actions (login required)

View Item View Item