ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Multi-Modal Point-of-Care Diagnostics for COVID-19 Based on Acoustics and Symptoms

Chetupalli, SR and Krishnan, P and Sharma, N and Muguli, A and Kumar, A and Nanda, V and Pinto, LM and Ghosh, PK and Ganapathy, S (2023) Multi-Modal Point-of-Care Diagnostics for COVID-19 Based on Acoustics and Symptoms. In: IEEE Journal of Translational Engineering in Health and Medicine, 11 . pp. 199-210.

iee_jou_tra_11_199-210_2023.pdf - Published Version

Download (1MB) | Preview
Official URL: https://doi.org/10.1109/JTEHM.2023.3250700


Background: The COVID-19 pandemic has highlighted the need to invent alternative respiratory health diagnosis methodologies which provide improvement with respect to time, cost, physical distancing and detection performance. In this context, identifying acoustic bio-markers of respiratory diseases has received renewed interest. Objective: In this paper, we aim to design COVID-19 diagnostics based on analyzing the acoustics and symptoms data. Towards this, the data is composed of cough, breathing, and speech signals, and health symptoms record, collected using a web-application over a period of twenty months. Methods: We investigate the use of time-frequency features for acoustic signals and binary features for encoding different health symptoms. We experiment with use of classifiers like logistic regression, support vector machines and long-short term memory (LSTM) network models on the acoustic data, while decision tree models are proposed for the symptoms data. Results: We show that a multi-modal integration of inference from different acoustic signal categories and symptoms achieves an area-under-curve (AUC) of 96.3, a statistically significant improvement when compared against any individual modality ( p < 0.05 ). Experimentation with different feature representations suggests that the mel-spectrogram acoustic features performs relatively better across the three kinds of acoustic signals. Further, a score analysis with data recorded from newer SARS-CoV-2 variants highlights the generalization ability of the proposed diagnostic approach for COVID-19 detection. Conclusion: The proposed method shows a promising direction for COVID-19 detection using a multi-modal dataset, while generalizing to new COVID variants. © 2013 IEEE.

Item Type: Journal Article
Publication: IEEE Journal of Translational Engineering in Health and Medicine
Publisher: Institute of Electrical and Electronics Engineers Inc.
Additional Information: The copyright for this article belongs to the Authors.
Keywords: Acoustic waves; Decision trees; Diagnosis; Long short-term memory; Support vector machines, Acoustic bio-marker; Acoustic signals; Bio markers; COVID-19 diagnostic; Health diagnosis; Multi-modal; Multi-modal classification; Point of care diagnostic; Point-of-care testing; Time cost, COVID-19, acoustics; human; pandemic, Acoustics; COVID-19; COVID-19 Testing; Humans; Pandemics; SARS-CoV-2
Department/Centre: Division of Electrical Sciences > Electrical Engineering
Date Deposited: 29 Mar 2023 10:41
Last Modified: 29 Mar 2023 10:41
URI: https://eprints.iisc.ac.in/id/eprint/81172

Actions (login required)

View Item View Item