What Impact Do My Preferences Have?

Paper in proceeding, 2024

[Context and motivation]
Successful human-robot collaboration requires that humans can express their requirements and that they comprehend the decisions that robots make. Requirements in this context are often related to potentially conflicting quality objectives, such as performance, security, or safety. Humans tend to have preferences regarding how important different objectives are at different points in time.
[Question/problem]
Currently, preferences are often expressed based on assumptions of what importance level should be assigned to a quality objective at runtime. To assign meaningful preferences to quality objectives, it is important that humans understand the impact of these preferences on the behavior of a robot. To the best of our knowledge, there is yet no framework that supports the explanation-based elicitation of quality preferences.
[Principal ideas/results]
To address these needs, we have developed OBJUST, a framework that helps with the interactive elicitation of preferences for robot mission planning. [Contribution]
The framework relies on the specification of human preferences and contrastive explanations. We evaluated our framework in a study with 7 participants. Our results indicate that the visual and textual explanations of the generated robotic mission plans help humans better understand the impact of their preferences, which can facilitate the elicitation process.