Deep Canonical Correlation Analysis for Decoding the Auditory Brain

Katthi, JR and Ganapathy, S and Kothinti, S and Slaney, M (2020) Deep Canonical Correlation Analysis for Decoding the Auditory Brain. In: 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC-2020, 20-24 July 2020, Montreal; Canada, pp. 3505-3508.

PDF pro_ann_int_con_iee_eng_med_bio_soc_emb_2020_3505-3508_2020.pdf - Published Version Restricted to Registered users only Download (925kB) | Request a copy

Abstract

The process of decoding the auditory brain for an acoustic stimulus involves finding the relationship between the audio input and the brain activity measured in terms of Electroencephalography (EEG) recordings. Prior methods focus on linear analysis methods like Canonical Correlation Analysis (CCA) to establish a relationship. In this paper, we present a deep learning framework that is learned to maximize correlation. For dealing with high levels of noise in EEG data, we employ regularization techniques and experiment with various model architectures. With a paired dataset of audio envelope and EEG, we perform several experiments with deep correlation analysis using forward and backward correlation models. In these experiments, we show that regularized deep CCA is consistently able to outperform the linear models in terms of providing improved correlation (up to 9 absolute improvement in Pearson correlation which is statistically significant). We present an analysis that highlights the benefits of using dropouts for neural network regularization in the deep CCA model.Clinical relevance - The proposed method helps to decode human auditory attention. In the case of overlapping speech from two speakers, decoding the auditory attention provides information about how well the sources are separated in the brain and which of the sources is attended. This can impact cochlear implants that use EEG for decoding attention as well as in development of BCI applications. The correlation method proposed in this work can also be extended to other modalities like visual stimuli. © 2020 IEEE.

Item Type:	Conference Paper
Publication:	Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright of this article belongs to Institute of Electrical and Electronics Engineers Inc.
Keywords:	Audio acoustics; Brain; Brain computer interface; Cochlear implants; Correlation methods; Decoding; Electroencephalography; Electrophysiology, Auditory attention; Canonical correlation analysis; Correlation analysis; Forward-and-backward; Learning frameworks; Model architecture; Pearson correlation; Regularization technique, Deep learning
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	13 Nov 2020 07:43
Last Modified:	13 Nov 2020 07:43
URI:	http://eprints.iisc.ac.in/id/eprint/66688

Actions (login required)

View Item