---
title: Langevin MCMC Methods
url: https://www.emergentmind.com/topics/langevin-markov-chain-monte-carlo-mcmc
type: topic
---

# Langevin MCMC Methods

Langevin Markov chain Monte Carlo (MCMC) is a family of sampling methods that build Markov chains by discretizing a continuous-time stochastic differential equation whose invariant distribution is the target posterior or Gibbs measure [1609.06144][1612.07471]. In its classical form, the target density is written either as \(\pi(x)\propto e^{-U(x)}\) or \(\mu(\theta)\propto \exp(-U(\theta))\), and the resulting algorithms include the overdamped and underdamped Langevin schemes, the Unadjusted Langevin Algorithm (ULA), and Metropolis-adjusted variants such as MALA. Subsequent work extends the same core construction to stochastic gradients, adaptive scaling, non-smooth convex targets, manifold geometry, distributed inference, deep latent-variable models, privacy guarantees, and several notions of acceleration [1201.1433][2503.19066].

## 1. Diffusion formulation and classical discretizations

The canonical overdamped Langevin diffusion for \(\pi(x)\propto e^{-U(x)}\) is
\[
dX_t = -\nabla U(X_t)\,dt + \sqrt{2}\,dB_t,
\]
and under mild conditions it has a unique invariant distribution with density proportional to \(e^{-U(x)}\) [1612.07471]. In Bayesian notation, a corresponding posterior-targeting diffusion can be written as
\[
d\theta_t = \Big( \nabla \log \pi(\theta_t) + \sum_{i=1}^N \nabla \log \pi(x_i \mid \theta_t) \Big)\,dt + \sqrt{2}\,dW_t,
\]
whose invariant law is the posterior \(\pi(\theta\mid X)\) under suitable conditions [1609.06144].

Euler–Maruyama discretization yields the Unadjusted Langevin Algorithm. In one common form,
\[
X_{k+1} = X_k - \gamma \nabla U(X_k) + \sqrt{2\gamma}\,Z_{k+1},
\qquad Z_{k+1}\sim\mathcal N(0,I_d),
\]
while in posterior form one writes
\[
\theta_{k+1} = \theta_k + h\Big( \nabla \log \pi(\theta_k) + \sum_{i=1}^N \nabla \log \pi(x_i \mid \theta_k) \Big) + \sqrt{2h}\,\xi_k.
\]
ULA is biased: its invariant distribution approximates, but does not equal, the target [1612.07471][1609.06144].

Metropolis-adjusted Langevin algorithms correct that discretization bias by using one Langevin step as a proposal inside Metropolis–Hastings. The resulting chain has the target posterior exactly as invariant distribution and is the standard correction from ULA to MALA [1609.06144]. In state-space filtering, the same principle appears as preconditioned MALA and manifold MALA, with proposal covariance either fixed as \(\epsilon^2\Sigma\) or state dependent through a metric \(G(x)\) [1504.05715].

Underdamped or kinetic Langevin dynamics enlarge the state by a momentum variable. A representative form is
\[
\begin{cases}
dr_t = -\gamma r_t\,dt - \nabla U(\theta_t)\,dt + \sqrt{2\gamma}\,dW_t,\\
d\theta_t = r_t\,dt,
\end{cases}
\]
which preserves an augmented Gibbs law in \((\theta,r)\) and often improves exploration relative to overdamped dynamics [2503.19066]. This kinetic formulation is the basis of several later accelerations, including high-order, high-resolution, and regime-switching constructions.

## 2. Stochastic gradients and large-data Langevin sampling

When the target posterior factorizes over a large dataset, exact gradient evaluation is often the dominant cost. Stochastic Gradient Langevin Dynamics (SGLD) replaces the full gradient by a minibatch estimator:
\[
\theta_{k+1}
=
\theta_k
+
h\Big(
\nabla \log \pi(\theta_k)
+
\frac{N}{n}\sum_{i=1}^n \nabla \log \pi(x_{\tau_i}\mid \theta_k)
\Big)
+
\sqrt{2h}\,\xi_k,
\]
where \(\tau\) is a random minibatch of size \(n\ll N\) [1609.06144]. With decreasing step sizes, SGLD can asymptotically sample from the true posterior, but its root mean square error scales as \(\mathcal{O}(c^{-1/3})\) in computational cost \(c\), in contrast to the \(\mathcal{O}(c^{-1/2})\) rate of standard MCMC methods such as MALA [1609.06144].

Several Langevin variants target the extra variance introduced by stochastic gradients. “Laplacian Smoothing Stochastic Gradient Markov Chain Monte Carlo” [1911.00782] introduces the preconditioned SDE
\[
d\bX_t = -\Ab_\sigma^{-1}\nabla f(\bX_t)\,dt
         + \sqrt{2\beta^{-1}}\,\Ab_\sigma^{-1/2}\,d\bB_t,
\]
and its discretization
\[
\mathbf x_{k+1} = \mathbf x_k - \eta\,\Ab_\sigma^{-1}\mathbf g_k + \sqrt{2\beta^{-1}\eta}\,\Ab_\sigma^{-1/2}\boldsymbol\varepsilon_k.
\]
The continuous-time process preserves the same Gibbs measure, and the paper proves that LS-SGLD achieves strictly smaller discretization error in \(2\)-Wasserstein distance, although its mixing rate can be slightly slower [1911.00782].

“Langevin Markov Chain Monte Carlo with stochastic gradients” [1805.08863] instead develops an underdamped integrator, NOGIN, for noisy gradients. Its central theoretical claim is second-order weak consistency with respect to an underdamped Langevin SDE in which the friction is modified to
\[
\mu(\theta)=\gamma I + \frac{h}{2}\Sigma(\theta),
\]
where \(\Sigma(\theta)\) is the covariance of the stochastic gradient estimator. The same paper also proves an exactness result in the Gaussian case: when the target is Gaussian and the stochastic gradient noise is Gaussian, the marginal invariant law in \(\theta\) is exact [1805.08863].

A different route is to incorporate local curvature. “Stochastic Quasi-Newton Langevin Monte Carlo” [1602.03442] proposes HAMCMC, which uses L-BFGS approximations of inverse Hessians inside SG-MCMC. The algorithm maintains linear time and memory complexity in the dimension, uses dense approximations of the inverse Hessian, and is shown to be asymptotically unbiased and consistent with posterior expectations [1602.03442]. This places quasi-Newton preconditioning inside the Langevin framework without resorting to full Riemannian metrics.

## 3. Geometry, non-smoothness, and manifold adaptations

A recurrent limitation of classical ULA and MALA is their reliance on differentiability and globally Lipschitz gradients. For high-dimensional log-concave but non-smooth targets, especially in imaging, proximal Langevin methods replace the raw potential \(U=f+g\) by a Moreau–Yoshida regularization \(U^\lambda=f+g_\lambda\), where
\[
g_\lambda(x)=\min_y\left\{g(y)+\frac{1}{2\lambda}\|x-y\|^2\right\},
\qquad
\nabla g_\lambda(x)=\frac{1}{\lambda}\bigl(x-\operatorname{prox}_{\lambda g}(x)\bigr).
\]
This yields MYULA,
\[
X_{k+1}
=
\Big(1-\frac{\gamma}{\lambda}\Big)X_k
-\gamma \nabla f(X_k)
+\frac{\gamma}{\lambda}\operatorname{prox}_{\lambda g}(X_k)
+\sqrt{2\gamma}\,Z_{k+1},
\]
which targets a regularized density \(\pi^\lambda\) and comes with asymptotic and non-asymptotic total-variation bounds [1612.07471]. A common misunderstanding is that Langevin MCMC is intrinsically limited to smooth potentials; proximal constructions show that the framework extends to non-smooth log-concave posteriors once the drift is regularized through proximal operators [1612.07471].

State-dependent geometry enters through manifold Langevin proposals. In sequential filtering, manifold MALA uses a position-specific metric \(G(x)\) and proposal
\[
q(x\mid X^i)=N\!\Big(
x \,\Big|\,
X^i+\frac{\epsilon^2}{2}G^{-1}(X^i)\nabla\log\pi(X^i)+\frac{\epsilon^2}{2}\Lambda(X^i),
\,
\epsilon^2 G^{-1}(X^i)
\Big),
\]
with simplified variants omitting the \(\Lambda(X^i)\) correction when its computation is too costly [1504.05715]. In practice, the metric is often chosen from a negative Hessian or Fisher information construction tailored to the likelihood and prior [1504.05715].

A more explicitly differential-geometric development appears in “Geometrically adapted Langevin dynamics for Markov chain Monte Carlo simulations” [2201.08072]. That work uses stochastic development on Riemannian manifolds, the metric tensor \(g\), and Christoffel symbols \(\Gamma^k_{ij}\) to construct a geometrically adapted Langevin dynamics and the corresponding GALA algorithm. The proposal uses covariance \(\Delta t\,g^{-1}(\theta)\) together with a nontrivial geometric drift term, and the paper reports strong empirical performance on anisotropic and high-dimensional targets, including logistic regression [2201.08072].

## 4. Adaptive limits, multilevel constructions, and acceleration

One line of work derives Langevin dynamics as a limit of adaptive Metropolis procedures. “Langevin type limiting processes for Adaptive MCMC” [1201.1433] studies an adaptive random-walk Metropolis scheme with proposal scale \(\theta_n\), continuous-time embedding with step size \(h=1/n\), proposal variance scaled like \(h\theta^2\), and a sped-up time parameter. Under that regime, the embedded chain converges weakly to a coupled SDE for \((X_t,\theta_t)\), whose \(X\)-component is
\[
dX_t = \frac{\theta_t^2}{2}\frac{\psi'(X_t)}{\psi(X_t)}\,dt + \theta_t\,dW_t,
\]
while the non-adaptive limit reduces to the standard one-dimensional Langevin diffusion with invariant density \(\psi\) [1201.1433]. The result gives a rigorous bridge between adaptive random-walk Metropolis and Langevin-type MCMC.

A different objective is estimator complexity rather than single-chain mixing. “Multilevel Monte Carlo for Scalable Bayesian Computations” [1609.06144] embeds SGLD in a multilevel Monte Carlo hierarchy with step sizes \(h_l=h_0 2^{-l}\), coupled Brownian paths, and coupled subsampling indices. Its antithetic ML-SGLD construction achieves empirical variance decay of order \(h_l^2\) and recovers the \(\mathcal{O}(c^{-1/2})\) RMSE–cost scaling of standard MCMC without Metropolis–Hastings correction [1609.06144].

Acceleration has also been formalized directly at the level of continuous-time empirical measures. “Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis” [2503.19066] introduces a generalized Langevin SDE framework
\[
d\mathbf z_t = \mathbf f(\mathbf z_t)\,dt + \sqrt{2\mathcal D(\mathbf z_t)}\,d\mathbf W_t,
\]
covering overdamped, underdamped, nonreversible, mirror, high-order, and Hessian-free high-resolution dynamics. The paper establishes large deviation principles for empirical measures, derives explicit rate functions, and uses rate-function domination as an acceleration criterion relative to overdamped Langevin dynamics [2503.19066].

Two further accelerations use randomized or higher-order continuous dynamics. “Regime-Switching Langevin Monte Carlo Algorithms” [2509.00941] studies regime-switching overdamped and kinetic Langevin dynamics, together with discretizations RS-LMC, RS-KLMC, and FRS-KLMC, which can be interpreted as LMC and KLMC with random step sizes or random friction coefficients and admit \(2\)-Wasserstein non-asymptotic guarantees under strong log-concavity [2509.00941]. “High-Order Langevin Diffusion Yields an Accelerated MCMC Algorithm” [1908.10859] introduces a third-order Langevin diffusion and a tailored splitting integrator, proving \(\tilde O(d^{1/4}\varepsilon^{-1/2})\) mixing for a broad class of \(d\)-dimensional ridge-separable targets and \(\tilde O(d^{1/4}\varepsilon^{-1/2}+d^{1/2}\varepsilon^{-1/(\alpha-1)})\) under \(\alpha\)-th order smoothness [1908.10859]. These papers use different performance criteria—Wasserstein mixing, RMSE–cost scaling, and large-deviation rate functions—so their acceleration statements are complementary rather than interchangeable.

## 5. Distributed, sequential, and amortized Langevin formulations

Langevin proposals also serve as modular components inside larger inference architectures. “DG-LMC: A Turn-key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo within Gibbs” [2106.06300] starts from an asymptotically exact data augmentation factorization
\[
\Pi_{\boldsymbol{\rho}}(\theta,z_{1:b})
\propto
\prod_{i=1}^b
\exp\!\Big(-U_i(z_i)-\frac{\|z_i-A_i\theta\|^2}{2\rho_i}\Big),
\]
which makes the conditional \(z_i\mid\theta\) independent across workers. Each worker then runs local LMC updates for its \(z_i\), while the master samples \(\theta\mid z_{1:b}\) from a Gaussian conditional. The resulting synchronous distributed chain has explicit high-dimensional \(W_2\) mixing-time guarantees under strong log-concavity [2106.06300].

In nonlinear state-space models, Langevin updates appear inside Sequential MCMC. “Langevin and Hamiltonian based Sequential MCMC for Efficient Bayesian Filtering in High-dimensional Spaces” [1504.05715] samples the current latent state \(x_n\) conditional on a selected past trajectory using MALA, preconditioned MALA, manifold MALA, or simplified manifold MALA. The target at time \(n\) is the conditional
\[
\breve{\pi}_n(x_n\mid x_{n-1}^{(j)}) \propto g_n(y_n\mid x_n)\,f_n(x_n\mid x_{n-1}^{(j)}),
\]
and the paper reports substantial improvements over particle-filter baselines in high-dimensional filtering examples [1504.05715].

A different extension replaces datapoint-wise latent Langevin chains by a shared encoder. “Langevin Autoencoders for Learning Deep Latent Variable Models” [2209.07036] defines an encoder \(f_{\phi\mid\psi}(x)=\phi\,g(x;\psi)\) and a potential over the last-layer parameters,
\[
V(\phi)=\sum_{i=1}^n U\big(x^{(i)},f_{\phi\mid\psi}(x^{(i)});\theta\big).
\]
Langevin dynamics are then run in \(\phi\)-space rather than separately for each latent \(z^{(i)}\). Under a rank condition on the feature matrix \(G\), the induced stationary law over the encoded latents equals the product of the true posteriors for the datapoints in the batch, so the amortized Langevin dynamics remain a valid MCMC algorithm [2209.07036]. This suggests that Langevin MCMC can operate not only on latent variables or model parameters, but also on shared inference-network parameters when the induced Markov structure is controlled.

## 6. Invariance, stability, and contemporary guarantees

The Langevin framework is anchored by invariant-measure calculations and SDE well-posedness conditions. For fixed diffusion coefficient, the stationary density \(p(x)=\psi(x)\) solves the stationary Fokker–Planck equation associated with the one-dimensional Langevin SDE, and standard linear-growth and local-Lipschitz conditions guarantee existence, uniqueness, and non-explosion of the resulting SDEs [1201.1433]. For MYULA, convexity and Lipschitz continuity of \(\nabla U^\lambda\) yield geometric ergodicity of the Markov kernel and explicit total-variation error bounds that separate mixing error, discretization bias, and Moreau–Yoshida approximation bias [1612.07471].

A contemporary extension concerns privacy. “Differential privacy guarantees of Markov chain Monte Carlo algorithms” [2502.17150] establishes differential privacy and Rényi differential privacy guarantees for MCMC outputs under assumptions on convergence of the underlying Markov chain. For ULA and SGLD specifically, the paper uses Girsanov’s theorem and a perturbation trick to prove uniform in \(n\) privacy guarantees when the state of the chain after \(n\) iterations is released, and also derives bounds for the privacy of the entire chain trajectory [2502.17150]. A central structural conclusion is that if an asymptotically exact MCMC algorithm is uniformly private in time, then the target posterior itself must be differentially private [2502.17150].

Across these strands, Langevin MCMC functions less as a single algorithm than as a design principle: specify a diffusion with the desired invariant law, choose a discretization with acceptable bias and stability, and adapt the geometry, noise model, communication pattern, or auxiliary variables to the structure of the target and the computational environment. The resulting family now spans overdamped and kinetic samplers, stochastic-gradient and multilevel schemes, proximal and manifold methods, adaptive diffusion limits, distributed Gibbs constructions, amortized latent-variable inference, and privacy-aware sampling [1609.06144][1612.07471][2503.19066].

Source: https://www.emergentmind.com/topics/langevin-markov-chain-monte-carlo-mcmc