Risk-Averse Decision-Making under Parametric Uncertainty
Licentiate thesis, 2022

For sequential decision-making problems with potentially catastrophic consequences appropriate risk assessment may be required. In contrast to traditional techniques for decision-making under uncertainty that aim to maximise performance in expectation, we chose to focus on other properties of the probability distribution. For instance, in an application such as autonomous driving, the chance of causing an accident might be small but yet fatal. A decision-maker focusing on performance in the worst outcomes may be able to obtain a safer decision-making process by keeping this in mind. We propose frameworks for quantifying uncertainty under the reinforcement learning framework and develop algorithms that allow for risk-sensitive decision-making under uncertainty.

Risk-Sensitive Learning

Uncertainty Estimation

Autonomous Driving

Machine Learning

Reinforcement Learning

EDIT 3128, Chalmers, Maskingränd 2
Opponent: Marc G. Bellemare

Author

Hannes Eriksson

Chalmers, Computer Science and Engineering (Chalmers), Data Science and AI

Epistemic risk-sensitive reinforcement learning

ESANN 2020 - Proceedings, 28th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning,;(2020)p. 339-344

Paper in proceeding

Inferential Induction: A Novel Framework for Bayesian Reinforcement Learning

Proceedings of Machine Learning Research,;Vol. 137(2020)p. 43-52

Paper in proceeding

SENTINEL: Taming Uncertainty with Ensemble-based Distributional Reinforcement Learning

Proceedings of the 38th Conference on Uncertainty in Artificial Intelligence, UAI 2022,;Vol. 180(2022)p. 631-640

Paper in proceeding

Infrastructure

C3SE (-2020, Chalmers Centre for Computational Science and Engineering)

Subject Categories (SSIF 2011)

Computer Science

Computer Vision and Robotics (Autonomous Systems)

Technical report L - Department of Computer Science and Engineering, Chalmers University of Technology and Göteborg University

Publisher

Chalmers

EDIT 3128, Chalmers, Maskingränd 2

Opponent: Marc G. Bellemare

More information

Latest update

10/4/2026