Repository: Freie Universität Berlin, Math Department

Affine Invariant Interacting Langevin Dynamics for Bayesian Inference

Garbuno-Inigo, Alfredo and Nüsken, Nikolas and Reich, Sebastian (2020) Affine Invariant Interacting Langevin Dynamics for Bayesian Inference. SIAM J. APPLIED DYNAMICAL SYSTEMS, 19 (3). pp. 1633-1658.

[img] PDF
704kB

Official URL: http://doi.org/10.1137/19M1304891

Abstract

We propose a computational method (with acronym ALDI) for sampling from a given target distribution based on first-order (overdamped) Langevin dynamics which satisfies the property of affine invariance. The central idea of ALDI is to run an ensemble of particles with their empirical covariance serving as a preconditioner for their underlying Langevin dynamics. ALDI does not require taking the inverse or square root of the empirical covariance matrix, which enables application to high-dimensional sampling problems. The theoretical properties of ALDI are studied in terms of nondegeneracy and ergodicity. Furthermore, we study its connections to diffusion on Riemannian manifolds and Wasserstein gradient flows. Bayesian inference serves as a main application area for ALDI. In case of a forward problem with additive Gaussian measurement errors, ALDI allows for a gradient-free approximation in the spirit of the ensemble Kalman filter. A computational comparison between gradient-free and gradient-based ALDI is provided for a PDE constrained Bayesian inverse problem.

Item Type:Article
Subjects:Mathematical and Computer Sciences > Mathematics > Applied Mathematics
Divisions:Department of Mathematics and Computer Science > Institute of Mathematics
ID Code:2690
Deposited By: Monika Drueck
Deposited On:25 Jan 2022 15:43
Last Modified:15 Jan 2024 11:04

Repository Staff Only: item control page