Designing Multi-Modal Interaction – A Basic Operations Approach
Paper in proceedings, 2019

A basic operations approach to designing multimodal user interfaces has been explored in two experimental studies. By basic operations is here meant the most fundamental operations that make up a(ny) interaction task. Study A investigated if certain basic operations have a preferred modal counterpart and execution and Study B what happens when several basic operations are combined into tasks. The results suggest interdependencies between basic operations and specific modalities but also indicate that users may prefer unimodal interaction or to choose modality as desired. Hence, further studies are needed to assess the feasibility of a basic operations approach to multimodal interaction design.

multi-modal interaction

interaction design

interface design

system input

Author

MariAnne Karlsson

Chalmers, Industrial and Materials Science, Design and Human Factors

Fredrick Ekman

Chalmers, Industrial and Materials Science, Design and Human Factors

Mikael Johansson

Chalmers, Industrial and Materials Science, Design and Human Factors

Advances in Intelligent Systems and Computing

21945357 (ISSN)

Vol. 827 43-53

20th Congress of the International Ergonomics Association (IEA 2018)
Florens, Italy,

AIMMIT - Automotive Integration of MultiModal Interaction Technologies

VINNOVA, 2014-01-01 -- 2016-12-31.

Areas of Advance

Information and Communication Technology

Transport

Subject Categories

Human Computer Interaction

DOI

10.1007/978-3-319-96059-3_5

More information

Latest update

8/21/2019