Exploring Mobile Devices as Haptic Interfaces for Mixed Reality
Paper i proceeding, 2024

Dedicated handheld controllers facilitate haptic experiences of virtual objects in mixed reality (MR). However, as mobile MR becomes more prevalent, we observe the emergence of controller-free MR interactions. To retain immersive haptic experiences, we explore the use of mobile devices as a substitute for specialised MR controller. In an exploratory gesture elicitation study (n = 18), we examined users' (1) intuitive hand gestures performed with prospective mobile devices and (2) preferences for real-time haptic feedback when exploring haptic object properties. Our results reveal three haptic exploration modes for the mobile device, as an object, hand substitute, or as an additional tool, and emphasise the benefits of incorporating the device's unique physical features into the object interaction. This work expands the design possibilities using mobile devices for tangible object interaction, guiding the future design of mobile devices for haptic MR experiences.

gesture elicitation

haptic exploration

mobile phones

haptic interfaces

mixed reality

haptic feedback

mobile gestures


Carolin Stellmacher

Universität Bremen

Florian Mathis

Universität St. Gallen

Yannick Weiss

Ludwig-Maximilians-Universität München (LMU)

Meagan Loerakker

Chalmers, Data- och informationsteknik, Interaktionsdesign och Software Engineering

Nadine Wagener

Universität Bremen

Johannes Schöning

Universität St. Gallen

Conference on Human Factors in Computing Systems - Proceedings

9798400703300 (ISBN)

2024 CHI Conference on Human Factors in Computing Sytems, CHI 2024
Hybrid, Honolulu, USA,

PAPACUI: Färdighetsbaserad anpassning i interaktiva system för fysisk aktivitet

Vetenskapsrådet (VR) (2022-03196), 2023-01-01 -- 2026-12-31.



Människa-datorinteraktion (interaktionsdesign)



Mer information

Senast uppdaterat