Multi-Requirement Testing Using Focused Falsification
Paper in proceeding, 2022

Testing of Cyber-Physical Systems (CPS) deals with the problem of finding input traces to the systems such that given requirements do not hold. Requirements can be formalized in many different ways; in this work requirements are modeled using Signal Temporal Logic (STL) for which a quantitative measure, or \emph{robustness value}, can be computed given a requirement together with input and output traces. This value is a measure of how far away the requirement is from not holding and is used to guide falsification procedures for deciding on new input traces to simulate one after the other. When the system under test has multiple requirements, standard approaches are to falsify them one-by-one, or as a conjunction of all requirements, but these approaches do not scale well for industrial-sized problems. In this work we consider testing of systems with multiple requirements by proposing focused multi-requirement falsification. This is a multi-stage approach where the solver tries to sequentially falsify the requirements one-by-one, but for every simulation also evaluate the robustness value for all requirements. After one requirement has been focused long enough, the next requirement to focus is selected by considering the robustness values and trajectory history calculated thus far. Each falsification attempt makes use of a prior sensitivity analysis, which for each requirement estimates the parameters that are unlikely to affect the robustness value, in order to reduce the number of parameters that are used by the optimization solver. The proposed approach is evaluated on a public benchmark example containing a large number of requirements, and includes a comparison of the proposed algorithm against a new suggested baseline method.

CPS

Formal Requirements

Testing

Falsification

Author

Johan Lidén Eddeland

Chalmers, Electrical Engineering, Systems and control

Alexandre Donzé

Decyphir SAS

Knut Åkesson

Chalmers, Electrical Engineering, Systems and control

HSCC 2022 - Proceedings of the 25th ACM International Conference on Hybrid Systems: Computation and Control, Part of CPS-IoT Week 2022


9781450391962 (ISBN)

HSCC 2022 : ACM International Conference on Hybrid Systems: Computation and Control
Online, ,

Systematic testing of cyber-physical systems (SyTeC)

Swedish Research Council (VR) (2016-06204), 2017-01-01 -- 2022-12-31.

Model Based Testing of Mechatronic Systems (TESTRON)

VINNOVA (2015-04893), 2016-01-01 -- 2019-12-31.

Subject Categories

Control Engineering

Signal Processing

Computer Science

DOI

10.1145/3501710.3519521

More information

Latest update

4/21/2023