UNBIASED ESTIMATION USING UNDERDAMPED LANGEVIN DYNAMICS
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | A3047-A3070 |
Journal / Publication | SIAM Journal on Scientific Computing |
Volume | 45 |
Issue number | 6 |
Online published | 5 Dec 2023 |
Publication status | Published - Dec 2023 |
Externally published | Yes |
Link(s)
Abstract
In this work we consider the unbiased estimation of expectations w.r.t. probability measures that have nonnegative Lebesgue density and which are known pointwise up to a normalizing constant. We focus upon developing an unbiased method via the underdamped Langevin dynamics, which has proven to be popular of late due to applications in statistics and machine learning. Specifically in continuous time, the dynamics can be constructed to admit the probability of interest as a stationary measure. We develop a novel scheme based upon doubly randomized estimation as in [J. Heng, J. Houssineau, and A. Jasra, On Unbiased Score Estimation for Partially Observed Diffusions, preprint, 2021] and [J. Heng, A. Jasra, K. J. H. Law, and A. Tarakanov, SIAM/ASA J. Uncertain. Quantif., 11 (2023), pp. 616-645], which requires access only to time-discretized versions of the dynamics, i.e., the ones used in practical algorithms. We prove, under standard assumptions, that our estimator is of finite variance and either has finite expected cost or has finite cost with a high probability. To illustrate our theoretical findings we provide numerical experiments that verify our theory, which include challenging examples from Bayesian statistics and statistical physics. © 2023 Society for Industrial and Applied Mathematics.
Research Area(s)
- Markov chain simulation, maximal couplings, unbiased estimation, underdamped Langevin dynamics
Citation Format(s)
UNBIASED ESTIMATION USING UNDERDAMPED LANGEVIN DYNAMICS. / RUZAYQAT, Hamza; CHADA, Neil K.; JASRA, Ajay.
In: SIAM Journal on Scientific Computing, Vol. 45, No. 6, 12.2023, p. A3047-A3070.
In: SIAM Journal on Scientific Computing, Vol. 45, No. 6, 12.2023, p. A3047-A3070.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review