Sounding Robots: Design and Evaluation of Auditory Displays for Unintentional Human-robot Interaction
Journal article, 2023

Non-verbal communication is important in HRI, particularly when humans and robots do not need to actively engage in a task together, but rather they co-exist in a shared space. Robots might still need to communicate states such as urgency or availability, and where they intend to go, to avoid collisions and disruptions. Sounds could be used to communicate such states and intentions in an intuitive and non-disruptive way. Here, we propose a multi-layer classification system for displaying various robot information simultaneously via sound. We first conceptualise which robot features could be displayed (robot size, speed, availability for interaction, urgency, and directionality); we then map them to a set of audio parameters. The designed sounds were then evaluated in five online studies, where people listened to the sounds and were asked to identify the associated robot features. The sounds were generally understood as intended by participants, especially when they were evaluated one feature at a time, and partially when they were evaluated two features simultaneously. The results of these evaluations suggest that sounds can be successfully used to communicate robot states and intended actions implicitly and intuitively.

Additional Key Words and PhrasesSonification

Non-verbal communication

unintentional Human-Robot Interaction

Auditory Display

Design Evaluation

Author

Bastian Orthmann

Royal Institute of Technology (KTH)

Iolanda Leite

Royal Institute of Technology (KTH)

Roberto Bresin

Royal Institute of Technology (KTH)

Ilaria Torre

Royal Institute of Technology (KTH)

Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering

ACM Transactions on Human-Robot Interaction

25739522 (eISSN)

Vol. 12 4 49

Subject Categories

Media and Communication Technology

Production Engineering, Human Work Science and Ergonomics

Human Computer Interaction

Robotics

Computer Vision and Robotics (Autonomous Systems)

DOI

10.1145/3611655

More information

Latest update

1/12/2024