Reinforcement Learning with Temporal Logic Constraints
Paper i proceeding, 2020

Reinforcement learning (RL) is an agent based AI learning method, where learning and optimization are combined. Dynamic programming is then performed iteratively, based on reward and next state observations from the system to be controlled. A brief survey of RL is given, followed by an evaluation of a recently proposed method to include temporal logic safety and liveness guarantees in RL, here combined with classical performance optimization. RL is based on Markov decision processes (MDPs), and to reduce the number of observations from the system, a modular MDP framework is proposed. In the learning process, it is then assumed that some parts of the system are represented by known MDP models, while other parts can be estimated by observations from the real system. Local information from the modular system may then be used to reduce the computational complexity, especially in the handling of safety properties.

modular systems

reinforcement learning

adaption

temporal logic specifications

Författare

Bengt Lennartson

Chalmers, Elektroteknik, System- och reglerteknik

Qing Shan Jia

Tsinghua University

IFAC-PapersOnLine

24058963 (eISSN)

Vol. 53 4 485-492

15th IFAC Workshop on Discrete Event Systems, WODES 2020
Rio de Janeiro, Brazil,

Ämneskategorier

Reglerteknik

Datavetenskap (datalogi)

Datorsystem

DOI

10.1016/j.ifacol.2021.04.044

Mer information

Senast uppdaterat

2021-06-09