VXSlate: Exploring Combination of Head Movements and Mobile Touch for Large Virtual Display Interaction
Paper in proceeding, 2021

Virtual Reality (VR) headsets can open opportunities for users to accomplish complex tasks on large virtual displays using compact and portable devices. However, interacting with such large virtual displays using existing interaction techniques might cause fatigue, especially for precise manipulation tasks, due to the lack of physical surfaces. To deal with this issue, we explored the design of VXSlate, an interaction technique that uses a large virtual display as an expansion of a tablet. We combined a user's head movements as tracked by the VR headset, and touch interaction on the tablet. Using VXSlate, a user head movements positions a virtual representation of the tablet together with the user's hand, on the large virtual display. This allows the user to perform fine-tuned multi-touch content manipulations. In a user study with seventeen participants, we investigated the effects of VXSlate on users in problem-solving tasks involving content manipulations at different levels of difficulty, such as translation, rotation, scaling, and sketching. As a baseline for comparison, off-the-shelf touch-controller interactions were used. Overall, VXSlate allowed participants to complete the task with completion times and accuracy that are comparable to touch-controller interactions. After an interval of use, VXSlate significantly reduced users' time to perform scaling tasks in content manipulations, as well as reducing perceived effort. We reflected on the advantages and disadvantages of VXSlate in content manipulation on large virtual displays and explored further applications within the VXSlate design space.

head movements

mobile device

VR

virtual large displays

touch interaction

Author

Khanh Duy Le

ABB

University of Economics, Ho Chi Minh City

Tanh Quang Tran

University of Otago

Karol Chlasta

Polsko-Japońska Akademia Technik Komputerowych

Krzysztof Krejtz

SWPS University of Social Sciences and Humanities

Morten Fjeld

Chalmers, Computer Science and Engineering (Chalmers), Interaction design

University of Bergen

Andreas Kunz

Swiss Federal Institute of Technology in Zürich (ETH)

DIS 2021 - Proceedings of the 2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere

283-297
9781450384766 (ISBN)

2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere, DIS 2021
Virtual, Online, USA,

Subject Categories

Media and Communication Technology

Interaction Technologies

Human Computer Interaction

DOI

10.1145/3461778.3462076

More information

Latest update

10/28/2022