DARS: An Approach for Data Annotation Requirements Specification
Paper in proceeding, 2026
Data annotation is a critical, yet often overlooked process in the engineering lifecycle of AI-enabled software systems. Recent interviews with industry experts revealed that the data annotation process introduces distinct requirementsrelated challenges regarding ambiguity, context specification, and verification. Here, we propose the Data Annotation Requirements Specification (DARS) framework with two artifacts: (1) the Annotation Negotiation Card to align diverse stakeholders on system objectives and constraints; and (2) the Scenario-based Annotation Specification, a template for atomic, verifiable data annotation requirements. We evaluate DARS through an empirical study involving twelve participants with AI expertise from both industry and academia. Our results demonstrate that DARS mitigates ambiguity and identifies blind spots overlooked in annotation workflows by providing a structured link between system goals and data labeling. This suggests a strong practical relevance for industrial practice.
Data Annotation Requirements Specification (DARS)
Data annotation
Annotation Negotiation Card
Author
Yi Peng
Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering
University of Gothenburg
Hina Saeeda
University of Gothenburg
Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering
Hans-Martin Heyn
University of Gothenburg
Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering
Jennifer Horkoff
Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering
University of Gothenburg
Eric Knauss
Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering
University of Gothenburg
Fredrik Warg
RISE Research Institutes of Sweden
Proceedings 2026 IEEE 34th International Requirements Engineering Conference Workshops Rew 2026
64-73
9798319545350 (ISBN)
34th IEEE International Requirements Engineering Conference Workshops, REW 2026
Montreal, Canada,
Montreal, Canada,
FAMER - Facilitating Multi-Party Engineering of Requirements
FFI - Strategic Vehicle Research and Innovation (2023-00771), 2023-09-01 -- 2026-08-31.
Subject Categories (SSIF 2025)
Software Engineering
DOI
10.1109/REW72749.2026.00020
Related datasets
Data [dataset]
URI: http://doi.org/10.6084/m9.figshare. 31385977