Mukhopadhyay, A and Reddy, GSR and Saluja, KS and Ghosh, S and Pena Rios, A and Gopal, G and Biswas, P (2022) Virtual-reality-based digital twin of office spaces with social distance measurement feature. In: Virtual Reality and Intelligent Hardware, 4 (1). pp. 55-75.
|
PDF
vir_rea_int_2022.pdf - Published Version Download (9MB) | Preview |
Abstract
Background: Social distancing is an effective way to reduce the spread of the SARS-CoV-2 virus. Many students and researchers have already attempted to use computer vision technology to automatically detect human beings in the field of view of a camera and help enforce social distancing. However, because of the present lockdown measures in several countries, the validation of computer vision systems using large-scale datasets is a challenge. Methods: In this paper, a new method is proposed for generating customized datasets and validating deep-learning-based computer vision models using virtual reality (VR) technology. Using VR, we modeled a digital twin (DT) of an existing office space and used it to create a dataset of individuals in different postures, dresses, and locations. To test the proposed solution, we implemented a convolutional neural network (CNN) model for detecting people in a limited-sized dataset of real humans and a simulated dataset of humanoid figures. Results: We detected the number of persons in both the real and synthetic datasets with more than 90 accuracy, and the actual and measured distances were significantly correlated (r=0.99). Finally, we used intermittent-layer- and heatmap-based data visualization techniques to explain the failure modes of a CNN. Conclusions: A new application of DTs is proposed to enhance workplace safety by measuring the social distance between individuals. The use of our proposed pipeline along with a DT of the shared space for visualizing both environmental and human behavior aspects preserves the privacy of individuals and improves the latency of such monitoring systems because only the extracted information is streamed. © 2021 Beijing Zhongke Journal Publishing Co. Ltd
| Item Type: | Journal Article |
|---|---|
| Publication: | Virtual Reality and Intelligent Hardware |
| Publisher: | KeAi Communications Co. |
| Additional Information: | The copyright for this article belongs to Authors |
| Department/Centre: | Division of Mechanical Sciences > Centre for Product Design & Manufacturing |
| Date Deposited: | 16 Mar 2022 06:07 |
| Last Modified: | 16 Mar 2022 06:07 |
| URI: | http://eprints.iisc.ac.in/id/eprint/71445 |
Actions (login required)
 |
View Item |
