Solving the Hamilton-Jacobi-Bellman equation for a stochastic system with state constraints
Paper in proceedings, 2014

We present a method for finding a stationary solution to the Hamilton-Jacobi-Bellman (HJB) equation for a stochastic system with state constraints. A variable transformation is introduced which turns the HJB equation into a combination of an eigenvalue problem, a set of partial differential equations (PDEs), and a point-wise equation. As a result the difficult infinite boundary conditions of the original HJB becomes homogeneous. To illustrate, we numerically solve for the optimal control of a Linear Quadratic Gaussian (LQG) system with state constraints. A reasonably accurate solution is obtained even with a very small number of collocation points (three in each dimension), which suggests that the method could be used on high order systems, mitigating the curse of dimensionality. Source code for the example is available online.

Author

Torsten Wik

Chalmers, Signals and Systems, Systems and control, Automatic Control

Claes Breitholtz

Chalmers, Signals and Systems, Systems and control, Automatic Control

Proceedings of the 53rd IEEE Annual Conference on Decision and Control, CDC 2014, Los Angeles, United States, 15-17 December 2014

0743-1546 (ISSN)

1840-1845

Subject Categories

Computational Mathematics

Control Engineering

Roots

Basic sciences

DOI

10.1109/CDC.2014.7039666

More information

Created

10/7/2017