Non-functional requirements for machine learning: understanding current use and challenges among practitioners
Journal article, 2023

Systems that rely on Machine Learning (ML systems) have differing demands on quality—known as non-functional requirements (NFRs)—from traditional systems. NFRs for ML systems may differ in their definition, measurement, scope, and comparative importance. Despite the importance of NFRs in ensuring the quality ML systems, our understanding of all of these aspects is lacking compared to our understanding of NFRs in traditional domains. We have conducted interviews and a survey to understand how NFRs for ML systems are perceived among practitioners from both industry and academia. We have identified the degree of importance that practitioners place on different NFRs, including cases where practitioners are in agreement or have differences of opinion. We explore how NFRs are defined and measured over different aspects of a ML system (i.e., model, data, or whole system). We also identify challenges associated with NFR definition and measurement. Finally, we explore differences in perspective between practitioners in industry, academia, or a blended context. This knowledge illustrates how NFRs for ML systems are treated in current practice, and helps to guide future RE for ML efforts.

NFR Challenges

Requirements engineering

Non-functional requirements

NFRs

Qualities

Machine learning

Author

Khan Mohammad Habibullah

University of Gothenburg

Gregory Gay

University of Gothenburg

Jennifer Horkoff

University of Gothenburg

Requirements Engineering

0947-3602 (ISSN) 1432-010X (eISSN)

Vol. 28 2 283-316

Subject Categories

Computer and Information Science

DOI

10.1007/s00766-022-00395-3

More information

Latest update

7/27/2024