Evaluating Optimization Solvers and Robust Semantics for Simulation-Based Falsification
Paper in proceedings, 2020

Temporal-logic based falsification of Cyber-Physical Systems is a testing technique used to verify certain behaviours in simulation models, however the problem statement typically requires some model-specific tuning of parameters to achieve optimal results. In this experience report, we investigate how different optimization solvers and objective functions affect the falsification outcome for a benchmark set of models and specifications. With data from the four different solvers and three different objective functions for the falsification problem, we see that choice of solver and objective function depends both on the model and the specification that are to be falsified. We also note that using a robust semantics of Signal Temporal Logic typically increases falsification performance compared to using Boolean semantics.

Falsification

Temporal Logic

Cyber-Physical Systems

Author

Johan Lidén Eddeland

Chalmers, Electrical Engineering, Systems and control, Automation

Sajed Miremadi

Volvo Cars

Knut Åkesson

Chalmers, Electrical Engineering, Systems and control, Automation

7th International Workshop on Applied Verification of Continuous and Hybrid Systems

7th International Workshop on Applied Verification for Continuous and Hybrid Systems
, ,

Modellbaserad Testning av Mekatroniska System (TESTRON)

VINNOVA, 2016-01-01 -- 2019-12-31.

Systematic testing of cyber-physical systems (SyTeC)

Swedish Research Council (VR), 2017-01-01 -- 2022-12-31.

Subject Categories

Computational Mathematics

Control Engineering

Computer Science

More information

Latest update

9/11/2020