Designing Multi-Modal Interaction – A Basic Operations Approach

Paper in proceeding, 2019

A basic operations approach to designing multimodal user interfaces has been explored in two experimental studies. By basic operations is here meant the most fundamental operations that make up a(ny) interaction task. Study A investigated if certain basic operations have a preferred modal counterpart and execution and Study B what happens when several basic operations are combined into tasks. The results suggest interdependencies between basic operations and specific modalities but also indicate that users may prefer unimodal interaction or to choose modality as desired. Hence, further studies are needed to assess the feasibility of a basic operations approach to multimodal interaction design.