Learning to Estimate: Bayesian Filtering with Deep Density Methods
Doktorsavhandling, 2026

Bayesian filtering concerns the sequential estimation of the hidden state of a dynamical system from partial and noisy observations. Its central object is the conditional distribution of the hidden state given the available data, which provides both point estimates and a quantitative description of uncertainty. In nonlinear and non-Gaussian settings, this distribution is typically not available in closed form, and the construction of accurate and computationally feasible approximation methods becomes a central challenge, especially for high-dimensional systems.

This thesis studies Bayesian filtering with particular emphasis on density-based formulations when the underlying state is governed by a stochastic differential equation. We formulate the filtering problem through the evolution of conditional probability densities, described by stochastic and deterministic partial differential equations. Across the four appended papers, we develop methodologies for approximating these equations in high-dimensional settings. The proposed approaches draw on stochastic analysis, numerical analysis, and deep learning. They combine operator splitting, probabilistic backward representations, logarithmic transformations, and neural networks to approximate the conditional probability density. Theoretical convergence orders are established and verified numerically. The approaches are successfully demonstrated on nonlinear, high-dimensional, and partially observed stochastic differential equations.

Taken together, the papers in this thesis develop a framework for Bayesian filtering that combines probabilistic density representations with modern learning-based computational methods. The results indicate that these approaches can provide accurate and scalable alternatives to classical filtering methods for nonlinear and high-dimensional systems.

Bayesian filtering

backward stochastic differential equations

partial differential equations

error estimates

stochastic differential equations

numerical methods

density estimation

operator splitting

learning-based approximations

Euler, Skeppsgränd 3, Göteborg
Opponent: Professor Donald Estep, Department of Statistics and Actuarial Science, Simon Fraser University, Canada

Författare

Kasper Bågmark

Chalmers, Matematiska vetenskaper, Tillämpad matematik och statistik

Runtom i världen finns det processer som förändras över tid, men som vi bara kan mäta indirekt. Mätningarna är ofta ofullständiga och kan störas av brus, vilket gör det svårt att veta exakt vad som händer. Men vi behöver hantera sådana mätningar för att kunna uppskatta tillståndet hos processen både nu och i framtiden så att vi kan göra välgrundade beslut. Ett exempel är för väderprognoser, där ofullständiga mätningar kombineras med kunskap om hur atmosfären utvecklas för att skatta och förutsäga dess tillstånd. Liknande utmaningar uppstår också inom områden som robotik, navigation samt kemiska och biologiska system. I sådana situationer är det viktigt att inte bara ta fram en uppskattning, utan också att beräkna osäkerheten i uppskattningen.

I denna avhandling utvecklar vi nya metoder för att göra sådana skattningar och kvantifiera osäkerheter för tillstånd hos komplexa system där vi endast kan göra ofullständiga mätningar. Fokus ligger på ickelinjära och högdimensionella problem, där traditionella matematiska metoder ofta blir antingen felaktiga eller för beräkningsmässigt dyra. Genom att kombinera sannolikhetsteori, beräkningsmatematik och maskininlärning, introducerar avhandlingen metoder som vilar på stark matematisk grund och som fungerar väl i praktiken. Resultatet av avhandlingen är nya verktyg för att analysera komplexa system utifrån ofullständig data.

The world around us is full of processes that change over time, yet can only be observed indirectly. Measurements are often incomplete and affected by noise, making it difficult to know exactly what is happening. Even so, we need to make sense of such information in order to understand ongoing developments, predict what may happen next, and make informed decisions. One example is weather forecasting, where imperfect observations are combined with knowledge of how the atmosphere evolves in order to estimate and predict its state. Similar challenges also arise in areas such as robotics, navigation, and chemical or biological systems. In such settings, it is important not only to produce an estimate, but also to describe how uncertain it is.

This thesis develops new methods for estimating hidden states and quantifying uncertainty from observations in complex dynamical systems. The focus is nonlinear and high-dimensional problems, where traditional approaches often become inaccurate or computationally too expensive. By combining probability theory, computational mathematics, and machine learning, the thesis introduces methods that are both mathematically grounded and effective in practice. The results provide new tools for analyzing complex systems from imperfect data.

Ämneskategorier (SSIF 2025)

Sannolikhetsteori och statistik

Beräkningsmatematik

Signalbehandling

Artificiell intelligens

Fundament

Grundläggande vetenskaper

Infrastruktur

Chalmers e-Commons (inkl. C3SE, 2020-)

DOI

10.63959/chalmers.dt/5867

ISBN

978-91-8103-410-3

Doktorsavhandlingar vid Chalmers tekniska högskola. Ny serie: 5867

Utgivare

Chalmers

Euler, Skeppsgränd 3, Göteborg

Opponent: Professor Donald Estep, Department of Statistics and Actuarial Science, Simon Fraser University, Canada

Mer information

Senast uppdaterat

2026-04-27