SEMarbeta: Mobile sketch-gesture-video remote support for car drivers
Paper in proceeding, 2013

Uneven knowledge distribution is often an issue in remote support systems, creating the occasional need for additional information layers that extend beyond plain videoconference and shared workspaces. This paper introduces SEMarbeta, a remote support system designed for car drivers in need of help from an officebound professional expert. We introduce a design concept and its technical implementation using low-cost hardware and techniques inspired by augmented reality research. In this setup, the driver uses a portable Android tablet PC while the expert mechanic uses a stationary computer equipped with a video camera capturing his gestures and sketches. Hence, verbal instructions can be combined with supportive gestures and sketches added by the expert mechanic to the car's video display. To validate this concept, we carried out a user study involving two typical automotive repair tasks: checking engine oil and examining fuses. Based on these tasks and following a between-group (drivers and expert mechanics) design, we compared voice-only with additional sketch- and gesture-overlay on video screenshots measuring objective and perceived quality of help. Results indicate that sketch- and gesture-overlay can benefit remote car support in typical breakdown situations.

Remote support

Mobile

Handheld computer

Automotive

Author

S. Chen

Semcon

Chalmers, Applied Information Technology (Chalmers), Interaction design

M. Chen

Chalmers, Applied Information Technology (Chalmers), Interaction design

Semcon

Andreas Kunz

Swiss Federal Institute of Technology in Zürich (ETH)

A.E. Yantaç

Semcon

Chalmers, Applied Information Technology (Chalmers), Interaction design

M. Bergmark

Semcon

A. Sundin

Semcon

Morten Fjeld

Chalmers, Applied Information Technology (Chalmers), Interaction design

ACM International Conference Proceeding Series

69-76
978-1-4503-1904-1 (ISBN)

Areas of Advance

Information and Communication Technology

Driving Forces

Innovation and entrepreneurship

Subject Categories

Interaction Technologies

DOI

10.1145/2459236.2459249

ISBN

978-1-4503-1904-1

More information

Latest update

8/13/2020