Towards data-conditional simulation for ABC inference in stochastic differential equations
Preprint, 2023

We develop a Bayesian inference method for discretely-observed stochastic differential equations (SDEs). Inference is challenging for most SDEs, due to the analytical intractability of the likelihood function. Nevertheless, forward simulation via numerical methods is straightforward, motivating the use of approximate Bayesian computation (ABC). We propose a conditional simulation scheme for SDEs that is based on lookahead strategies for sequential Monte Carlo (SMC) and particle smoothing using backward simulation. This leads to the simulation of trajectories that are consistent with the observed trajectory, thereby increasing the ABC acceptance rate. We additionally employ an invariant neural network, previously developed for Markov processes, to learn the summary statistics function required in ABC. The neural network is incrementally retrained by exploiting an ABC-SMC sampler, which provides new training data at each round. Since the SDE simulation scheme differs from standard forward simulation, we propose a suitable importance sampling correction, which has the added advantage of guiding the parameters towards regions of high posterior density, especially in the first ABC-SMC round. Our approach achieves accurate inference and is about three times faster than standard (forward-only) ABC-SMC. We illustrate our method in four simulation studies, including three examples from the Chan-Karaolyi-Longstaff-Sanders SDE family.

sequential Monte Carlo

approximate Bayesian computation

smoothing.

synthetic likelihood

invariant neural networks

stochastic differential equations

Author

Petar Jovanovski

Chalmers, Mathematical Sciences, Applied Mathematics and Statistics

Andrew Golightly

Durham University

Umberto Picchini

Chalmers, Mathematical Sciences, Applied Mathematics and Statistics

Deep learning and likelihood-free Bayesian inference for stochastic modelling

Chalmers AI Research Centre (CHAIR), 2020-01-01 -- 2024-12-31.

Swedish Research Council (VR) (2019-03924), 2020-01-01 -- 2023-12-31.

Statistical Inference and Stochastic Modelling of Protein Folding

Swedish Research Council (VR) (2013-5167), 2014-01-01 -- 2019-12-31.

Subject Categories

Computational Mathematics

Probability Theory and Statistics

More information

Latest update

4/19/2024