ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Deep multiway canonical correlation analysis for multi-subject eeg normalization

Katthi, JR and Ganapathy, S (2021) Deep multiway canonical correlation analysis for multi-subject eeg normalization. In: 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021, 6 June - 11 June 2021, Virtual, Toronto, pp. 1245-1249.

[img]
Preview
PDF
ICASSP_2021.pdf - Published Version

Download (3MB) | Preview
Official URL: https://doi.org/10.1109/ICASSP39728.2021.9414274

Abstract

The normalization of brain recordings from multiple subjects responding to the natural stimuli is one of the key challenges in auditory neuroscience. The objective of this normalization is to transform the brain data in such a way as to remove the inter-subject redundancies and to boost the component related to the stimuli. In this paper, we propose a deep learning framework to improve the correlation of electroencephalography (EEG) data recorded from multiple subjects engaged in an audio listening task. The proposed model extends the linear multi-way canonical correlation analysis (CCA) for audio-EEG analysis using an auto-encoder network with a shared encoder layer. The model is trained to optimize a combined loss involving correlation and reconstruction. The experiments are performed on EEG data collected from subjects listening to natural speech and music. In these experiments, we show that the proposed deep multiway CCA (DMCCA) based model significantly improves the correlations over the linear multi-way CCA approach with absolute improvements of 0:08 and 0:29 in terms of the Pearson correlation values for speech and music tasks respectively.

Item Type: Conference Paper
Publication: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Publisher: Institute of Electrical and Electronics Engineers Inc.
Additional Information: The copyright for this article belongs to the Authors.
Keywords: Correlation methods; Deep learning; Electrophysiology; Signal encoding, Auto encoders; Brain data; Canonical correlation analysis; EEG analysis; Eeg datum; Learning frameworks; Natural speech; Pearson correlation, Electroencephalography
Department/Centre: Division of Electrical Sciences > Electronic Systems Engineering (Formerly Centre for Electronic Design & Technology)
Division of Electrical Sciences > Electrical Engineering
Date Deposited: 06 Jun 2023 10:19
Last Modified: 06 Jun 2023 10:19
URI: https://eprints.iisc.ac.in/id/eprint/81825

Actions (login required)

View Item View Item