ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Virtual-reality-based digital twin of office spaces with social distance measurement feature

Mukhopadhyay, A and Reddy, GSR and Saluja, KS and Ghosh, S and Pena Rios, A and Gopal, G and Biswas, P (2022) Virtual-reality-based digital twin of office spaces with social distance measurement feature. In: Virtual Reality and Intelligent Hardware, 4 (1). pp. 55-75.

vir_rea_int_2022.pdf - Published Version

Download (9MB) | Preview
Official URL: https://doi.org/10.1016/j.vrih.2022.01.004


Background: Social distancing is an effective way to reduce the spread of the SARS-CoV-2 virus. Many students and researchers have already attempted to use computer vision technology to automatically detect human beings in the field of view of a camera and help enforce social distancing. However, because of the present lockdown measures in several countries, the validation of computer vision systems using large-scale datasets is a challenge. Methods: In this paper, a new method is proposed for generating customized datasets and validating deep-learning-based computer vision models using virtual reality (VR) technology. Using VR, we modeled a digital twin (DT) of an existing office space and used it to create a dataset of individuals in different postures, dresses, and locations. To test the proposed solution, we implemented a convolutional neural network (CNN) model for detecting people in a limited-sized dataset of real humans and a simulated dataset of humanoid figures. Results: We detected the number of persons in both the real and synthetic datasets with more than 90 accuracy, and the actual and measured distances were significantly correlated (r=0.99). Finally, we used intermittent-layer- and heatmap-based data visualization techniques to explain the failure modes of a CNN. Conclusions: A new application of DTs is proposed to enhance workplace safety by measuring the social distance between individuals. The use of our proposed pipeline along with a DT of the shared space for visualizing both environmental and human behavior aspects preserves the privacy of individuals and improves the latency of such monitoring systems because only the extracted information is streamed. © 2021 Beijing Zhongke Journal Publishing Co. Ltd

Item Type: Journal Article
Publication: Virtual Reality and Intelligent Hardware
Publisher: KeAi Communications Co.
Additional Information: The copyright for this article belongs to Authors
Department/Centre: Division of Mechanical Sciences > Centre for Product Design & Manufacturing
Date Deposited: 16 Mar 2022 06:07
Last Modified: 16 Mar 2022 06:07
URI: http://eprints.iisc.ac.in/id/eprint/71445

Actions (login required)

View Item View Item