Papers
Topics
Authors
Recent
Search
2000 character limit reached

Weak Convergence Rate Bounds

Updated 11 December 2025
  • Weak Convergence Rate Bounds are quantitative estimates that measure how fast the expectation of test functionals converges in discretized stochastic and numerical systems.
  • They are crucial in applications such as SDEs, SPDEs, inverse problems, and optimization, offering rigorous error control when strong convergence is unattainable.
  • These bounds leverage analytical tools like Kolmogorov equations, weak Poincaré inequalities, and spectral regularization to yield precise rate estimates in diverse settings.

Weak convergence rate bounds provide explicit quantitative estimates on how fast sequences of measures, stochastic processes, operator semigroups, or iterates of optimization algorithms converge in law or against a prescribed class of test functions, typically as a function of algorithmic parameters, discretization granularity, or small parameters in multiscale dynamics. These bounds control the decay of expectation errors for functionals of the solution—not just pointwise trajectories—making them central in numerical analysis, stochastic process theory, and optimization, particularly when strong (pathwise) convergence is either unobtainable or too stringent. Weak rates are foundational for rigorous error analysis in PDEs, SDEs, SPDEs, inverse problems, adaptive MCMC, and statistical physics.

1. Fundamental Notions and Settings

Weak convergence rate bounds quantify the rate at which the expectation of a test functional φ\varphi under an approximate solution XnX^n converges to its value under the exact solution XX, i.e.,

E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)

for all φ\varphi in a class T\mathcal{T}, with r(n)0r(n)\to0 as nn\to\infty. The choice of T\mathcal{T} (bounded, Lipschitz, CkC^k), and the metric (total variation, Wasserstein, bounded Lipschitz, or Hilbert space dual-pairing) defines the "weakness" of the convergence.

Key settings in which weak convergence rates have been rigorously characterized include:

2. Weak Convergence Rate Bounds for Stochastic Differential Equations

Weak error bounds for SDE discretizations arise from expansions of the local error in expectation via the Kolmogorov backward equation, Malliavin calculus, or duality-based techniques. For example:

  • In the log-Heston model, under smooth payoff XnX^n0 and Feller index XnX^n1, the drift-implicit Milstein–Euler scheme achieves a weak rate

XnX^n2

where XnX^n3 is the maximal step size (Altmayer et al., 2016). The analysis uses Kolmogorov PDE techniques and a Malliavin calculus integration-by-parts to achieve leading term cancellation.

  • For rough volatility models, the discretization error for smooth payoffs XnX^n4 admits the lower bound

XnX^n5

where XnX^n6 is the Hurst index of the volatility process (Bayer et al., 2022). If the volatility functional is linear, sharper bounds XnX^n7 are attainable.

For SPDEs such as the stochastic Allen–Cahn equation with additive noise, explicit full discretization (spectral Galerkin in space, tamed exponential Euler in time) yields weak convergence in both time and space with rate essentially double that of strong error: XnX^n8 for XnX^n9 the noise regularity index and XX0 the XX1-th Laplacian eigenvalue (Cai et al., 2019).

3. Weak Convergence via Functional Inequalities and Operator Semigroups

Degenerate or non-uniformly elliptic diffusions often lack classical Poincaré inequalities, precluding exponential convergence in strong metrics. Instead, weak Poincaré inequalities yield explicit subgeometric rate bounds:

  • For a XX2-semigroup XX3 generated by XX4 (symmetric XX5, anti-symmetric XX6), if weak Poincaré inequalities hold

XX7

(with Dirichlet form XX8), then

XX9

where E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)0 is given by an explicit minimization involving E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)1 and their rate of divergence as E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)2 (Grothaus et al., 2017, Bertram et al., 2021).

  • For polynomially confining potentials E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)3, decay can be stretched-exponential:

E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)4

and with weakly confining (logarithmic) potentials, only polynomial or iterated-logarithmic rates are obtained. The regime is dictated by the tails of the invariant measure (Bertram et al., 2021).

4. Weak Convergence in Inverse Problems and Spectral Regularization

In inverse problems, weak convergence rates quantify the decay of the bias and variance of linear observation functionals under spectral regularization. Key insights include:

  • For compact forward operators E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)5 and noisy samples at E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)6 points, spectral regularization (e.g., Tikhonov, cutoff) admits weak error bounds for test functions E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)7:

E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)8

with E[φ(Xn)]E[φ(X)]Cr(n)|\mathbb{E}[\varphi(X^n)] - \mathbb{E}[\varphi(X)]| \leq C\,r(n)9 the fill distance, φ\varphi0 kernel smoothness, and φ\varphi1 noise level. In trace-class settings, variance scaling improves and optimal weak rates are φ\varphi2 (Guastavino et al., 4 Dec 2025).

Sampling inequalities replace classical source conditions; thus, weak rates can be achieved independently of function smoothness assumptions, controlled solely by fill-distance/geometric considerations.

5. Weak Convergence in Stochastic Systems and Limit Theorems

Weak convergence rates also characterize fluctuation limits in multiscale stochastic systems:

  • In two-scale McKean–Vlasov models, after rescaling the deviation process,

φ\varphi3

it is shown that for smooth test functions φ\varphi4,

φ\varphi5

where φ\varphi6 is the unique limit McKean–Vlasov SDE (Xiang et al., 20 May 2025). This employs Poisson equation techniques and a Kolmogorov–Cauchy duality.

In directed polymer models, the weak-disorder regime (φ\varphi7) leads to polynomial φ\varphi8 rates for the partition function martingale: φ\varphi9 with fluctuation scaling governed by a CLT with stable and mixing laws, in sharp contrast to the exponential rates seen on trees (Comets et al., 2016).

6. Weak Convergence Rates in Optimization and Sampling

In optimization and MCMC theory, "weak" convergence rates often pertain to Bregman divergences, Lyapunov function decay, or distances in Wasserstein/total variation metrics:

  • For mirror descent with T\mathcal{T}0-strongly convex and T\mathcal{T}1-smooth objective T\mathcal{T}2, and T\mathcal{T}3 likewise smooth and strongly convex, the Bregman divergence decays exponentially in continuous time:

T\mathcal{T}4

and linearly in discrete time for optimal step size choices (Li et al., 2023).

  • More generally, Grimmer's meta-theorems show that general (Hölder) growth bounds allow for a systematic derivation of weak convergence rates in first-order methods and enable new lower bounds in rates under additional growth conditions. This unifies and extends the landscape of possible rates in convex optimization (Grimmer, 2021).

For adaptive MCMC, subgeometric weak convergence lower and upper bounds are matched up to log factors when the adaptation schedule T\mathcal{T}5 decays fast: T\mathcal{T}6 where the rate is determined by the drift function T\mathcal{T}7 and invariant measure tail T\mathcal{T}8; upper bounds of the same order obtain under minorization and drift conditions (Brown et al., 2024).

In data-driven generative modeling, weak log-concavity suffices for 2-Wasserstein non-asymptotic error bounds for probability flow ODE samplers: T\mathcal{T}9 with each term controlled in explicit dependence on step size r(n)0r(n)\to00, horizon r(n)0r(n)\to01, and other model parameters (Kremling et al., 20 Oct 2025).

7. Structural Features and Tightness of Weak Rate Bounds

The main determinants of the weak rate are:

  • Regularity of the coefficients, functional class of test observables, and stochastic integrability properties.
  • Geometric or analytic inequalities (Poincaré, weak-Poincaré, Log-Sobolev) controlling variance decay.
  • Tail properties of the invariant measure or potential.
  • The structure of the discretization scheme: explicit/implicit, projection methods, and adaptivity.

In most settings, weak convergence rates are strictly better than strong rates; for example, in many SPDEs, the weak rate is double the strong rate (Cai et al., 2019). However, in the absence of regularity or under roughness or degeneracy (e.g., in rough volatility models, degenerate diffusions, heavy-tailed targets), only sublinear or subgeometric (polynomial, stretched-exponential, logarithmic) weak rates are available.

Lower bound results demonstrate that, in many settings, the proven weak rates are sharp—reflecting both algorithmic and analytic limitations (e.g., Talay–Tubaro expansion for SDEs, information-theoretic lower bounds for optimization, tail-driven rates for MCMC) (Altmayer et al., 2016, Brown et al., 2024, Grimmer, 2021).

Table: Representative Weak Convergence Rate Bounds

Domain Setting / Model Weak Rate Bound Example Reference
Discretized SDE Log-Heston, r(n)0r(n)\to02 r(n)0r(n)\to03 (Altmayer et al., 2016)
Rough Volatility Hurst r(n)0r(n)\to04 r(n)0r(n)\to05, r(n)0r(n)\to06 (Bayer et al., 2022)
SPDE (Allen–Cahn) Additive noise, degree r(n)0r(n)\to07 r(n)0r(n)\to08 (Cai et al., 2019)
Degenerate Diffusion Weak Poincaré, power tails r(n)0r(n)\to09 (Grothaus et al., 2017)
Inverse Problems Tikhonov reg., RKHS nn\to\infty0 (Guastavino et al., 4 Dec 2025)
Adaptive MCMC Student-nn\to\infty1 target nn\to\infty2 (Brown et al., 2024)
Probability Flow ODE Weak log-concave nn\to\infty3 (Kremling et al., 20 Oct 2025)
Multiscale SDE CLT McKean–Vlasov systems nn\to\infty4 for suitable test observables (Xiang et al., 20 May 2025)

These results indicate that under general circumstances, the precise weak convergence rate is dictated by the interplay between noise regularity or system degeneracy, the choice of test functions, and underlying analytic/geometric properties of the process or scheme.

References

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Weak Convergence Rate Bounds.