Evaluating Two Semantics for Falsification using an Autonomous Driving Example
Paper i proceeding, 2019

We consider the falsification of temporal logic properties as a method to test complex systems, such as autonomous systems. Since these systems are often safety-critical, it is important to assess whether they fulfill given specifications or not. An adaptive cruise controller for an autonomous car is considered where the closed-loop model has unknown parameters and an important problem is to find parameter combinations for which given specification are broken. We assume that the closed-loop system can be simulated with the known given parameters, no other information is available to the testing framework. The specification, such as, the ability to avoid collisions, is expressed using Signal Temporal Logic (STL). In general, systems consist of a large number of parameters, and it is not possible or feasible to explicitly enumerate all combinations of the parameters. Thus, an optimization-based approach is used to guide the search for parameters that might falsify the specification. However, a key challenge is how to select the objective function such that the falsification of the specification, if it can be falsified, can be falsified using as few simulations as possible. For falsification using optimization it is required to have a measure representing the distance to the falsification of the specification. The way the measure is defined results in different objective functions used during optimization. Different measures have been proposed in the literature and in this paper the properties of the Max Semantics (MAX) and the Mean Alternative Robustness Value (MARV) semantics are discussed. After evaluating these two semantics on an adaptive cruise control example, we discuss their strengths and weaknesses to better understand the properties of the two semantics.

Max Semantics

Falsification

Mean Alternative Robustness Value

Testing

Autonomous Driving.

Författare

Zahra Ramezani

Chalmers, Elektroteknik, System- och reglerteknik

Nicholas Smallbone

Chalmers, Data- och informationsteknik, Funktionell programmering

Martin Fabian

Chalmers, Elektroteknik, System- och reglerteknik

Knut Åkesson

Chalmers, Elektroteknik, System- och reglerteknik

IEEE International Conference on Industrial Informatics (INDIN)

19354576 (ISSN)

Vol. 2019-July 386-391
978-1-7281-2928-0 (ISBN)

2019 IEEE 17th International Conference on Industrial Informatics (INDIN)
Helsinki, Finland,

Systematisk testning av cyberfysiska system (SyTeC)

Vetenskapsrådet (VR) (2016-06204), 2017-01-01 -- 2022-12-31.

Fundament

Grundläggande vetenskaper

Ämneskategorier

Reglerteknik

Datavetenskap (datalogi)

Datorsystem

DOI

10.1109/INDIN41052.2019.8972229

ISBN

9781728129273

Mer information

Senast uppdaterat

2024-07-17