Multimodal interaction for real and virtual environments

Murthy, LRD (2020) Multimodal interaction for real and virtual environments. In: 25th International Conference on Intelligent User Interfaces, IUI 2020, 17-20 Mar 2020, Cagliari, Italy, pp. 29-30.

PDF int_con_int_use_int_29-30_2020.pdf - Published Version Restricted to Registered users only Download (382kB) | Request a copy

Abstract

Multimodal interfaces can leverage the information from multiple modalities to provide robust and error-free interaction. Early multimodal interfaces demonstrate the feasibility of building such systems but focused on specific applications. The challenge in building adaptive systems is lack of techniques for input data fusion. In this direction, we have developed a multimodal head and eye gaze interface and evaluated it in two scenarios. In aviation scenario, our interface has reduced the task time and perceived cognitive load significantly from the existing interface. We have also studied the effect of various output conditions on user's performance in a Virtual Reality (VR) task. Further, we are making our proposed interface to include additional modalities and building novel haptic and multimodal output systems for VR. © 2020 International Conference on Intelligent User Interfaces, Proceedings IUI. All rights reserved.

Item Type:	Conference Paper
Publication:	International Conference on Intelligent User Interfaces, Proceedings IUI
Publisher:	Association for Computing Machinery
Additional Information:	Copyright of this article belongs to Association for Computing Machinery
Keywords:	Data fusion; Interactive computer systems; Learning systems; Virtual reality, Cognitive loads; Eye-gaze interface; In-buildings; Multi-modal; Multi-Modal Interactions; Multi-modal interfaces; Multimodal output; Multiple modalities, Haptic interfaces
Department/Centre:	Division of Mechanical Sciences > Centre for Product Design & Manufacturing
Date Deposited:	09 Apr 2021 10:46
Last Modified:	09 Apr 2021 10:46
URI:	http://eprints.iisc.ac.in/id/eprint/65057

Actions (login required)

View Item