SPEECH ENHANCEMENT USING MULTIPLE DEEP NEURAL NETWORKS

Karjol, Pavan and Kumar, Ajay M and Ghosh, Prasanta Kumar (2018) SPEECH ENHANCEMENT USING MULTIPLE DEEP NEURAL NETWORKS. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), APR 15-20, 2018, Calgary, CANADA, pp. 5049-5053.

PDF Ieee_Int_Con_Aco_Spe_Sig_Pro_5049_2018.pdf - Published Version Restricted to Registered users only Download (235kB) | Request a copy

Abstract

In this work, we present a variant of multiple deep neural network (DNN) based speech enhancement method. We directly estimate clean speech spectrum as a weighted average of outputs from multiple DNNs. The weights are provided by a gating network. The multiple DNNs and the gating network are trained jointly. The objective function is set as the mean square logarithmic error between the target clean spectrum and the estimated spectrum. We conduct experiments using two and four DNNs using the TIMIT corpus with nine noise types (four seen noises and five unseen noises) taken from the AURORA database at four different signal-to-noise ratios (SNRs). We also compare the proposed method with a single DNN based speech enhancement scheme and existing multiple DNN schemes using segmental SNR, perceptual evaluation of speech quality (PESQ) and short-term objective intelligibility (STOI) as the evaluation metrics. These comparisons show the superiority of proposed method over baseline schemes in both seen and unseen noises. Specifically, we observe an absolute improvement of 0.07 and 0.04 in PESQ measure compared to single DNN when averaged over all noises and SNRs for seen and unseen noise cases respectively.

Item Type:	Conference Proceedings
Publisher:	IEEE
Additional Information:	Copy right for this article belong to IEEE
Keywords:	Deep neural networks; speech enhancement; gating network
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	26 Oct 2018 14:44
Last Modified:	26 Oct 2018 14:44
URI:	http://eprints.iisc.ac.in/id/eprint/60962

Actions (login required)

View Item