Boundary Value Exploration for Software Analysis
Paper i proceeding, 2020

For software to be reliable and resilient, it is widely accepted that tests must be created and maintained alongside the software itself. One safeguard from vulnerabilities and failures in code is to ensure correct behavior on the boundaries between subdomains of the input space. So-called boundary value analysis (BVA) and boundary value testing (BVT) techniques aim to exercise those boundaries and increase test effectiveness. However, the concepts of BVA and BVT themselves are not generally well defined, and it is not clear how to identify relevant sub-domains, and thus the boundaries delineating them, given a specification. This has limited adoption and hindered automation. We clarify BVA and BVT and introduce Boundary Value Exploration (BVE) to describe techniques that support them by helping to detect and identify boundary inputs. Additionally, we propose two concrete BVE techniques based on information-theoretic distance functions: (i) an algorithm for boundary detection and (ii) the usage of software visualization to explore the behavior of the software under test and identify its boundary behavior. As an initial evaluation, we apply these techniques on a much used and well-tested date handling library. Our results reveal questionable behavior at boundaries highlighted by our techniques. In conclusion, we argue that the boundary value exploration that our techniques enable is a step towards automated boundary value analysis and testing, which can foster their wider use and improve test effectiveness and efficiency.

Test Augmentation

Boundary Value Testing

Boundary Value Analysis

Test Automation

Författare

Felix Dobslaw

Chalmers, Data- och informationsteknik, Software Engineering, Software Engineering for Testing, Requirements, Innovation and Psychology

Francisco Gomes

Chalmers, Data- och informationsteknik, Software Engineering

Robert Feldt

Chalmers, Data- och informationsteknik, Software Engineering, Software Engineering for Testing, Requirements, Innovation and Psychology

Proceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020

2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
Porto, Portugal,

Informationsteori för programvarutestning

Vetenskapsrådet (VR), 2016-01-01 -- 2019-12-31.

Ämneskategorier

Annan data- och informationsvetenskap

Programvaruteknik

Datavetenskap (datalogi)

DOI

10.1109/ICSTW50294.2020.00062

Mer information

Skapat

2020-10-28