--- title: Exponential Ergodicity of RLMC url: https://www.emergentmind.com/topics/exponential-ergodicity-of-rlmc type: topic --- # Exponential Ergodicity of RLMC Exponential ergodicity of RLMC refers to the property that the randomized midpoint Langevin Monte Carlo (RLMC) chain, under suitable conditions, converges to its invariant distribution at an exponential rate, uniformly over initial states. This article provides a comprehensive account of definitions, theoretical guarantees, methodologies, explicit convergence rates, and their implications within the wider Markov process literature. ## 1. Definitions and Theoretical Framework Exponential ergodicity denotes the existence of constants $C<\infty$ and $\rho\in(0,1)$ such that, for a Markov chain $(X_k)_{k\ge0}$ with invariant distribution $\pi$, the distance between the $n$-step law $P^n(x,\cdot)$ from any initial $x$ and $\pi$ in a suitable norm decays as $C\rho^n$. For RLMC, the Markov chain is constructed as follows: Given $U:\mathbb{R}^d\to\mathbb{R}$ twice continuously differentiable (with parameters $m, L > 0$ such that $m I_d \preceq \nabla^2 U(x) \preceq L I_d$ for all $x$), the chain iterates by first drawing $u_k \sim \mathrm{Unif}[0,1]$ and independent Gaussians $\xi_{k+1}, \xi_{k+1}' \sim N(0, I_d)$, computing the "midpoint" \[ Y = X_k - u_k h \nabla U(X_k) + \sqrt{2 u_k h} \xi_{k+1}', \] and then setting \[ X_{k+1} = X_k - h\nabla U(Y) + \sqrt{2h} \xi_{k+1}. \] The corresponding kernel $P_h(x, \cdot)$ defines a time-homogeneous Markov chain with generator $\mathcal{L}_h = (P_h - I)/h$, which approximates the overdamped Langevin diffusion's generator up to $O(h^2)$ error [2511.13093]. ## 2. Main Exponential Ergodicity Results The main theorem established for RLMC asserts that, under the strong convexity and smoothness conditions on $U$ and for step-size $0 < h \le m/L^2$, the RLMC chain is exponentially ergodic. There exist explicit constants $C>0$, $\rho\in(0,1)$, and Lyapunov function $V(x) = 1 + |x|^2$ such that \[ d_{\mathrm{TV},V}\left(P_h^n(x,\cdot),\pi_h\right) \le C (1 + V(x)) \rho^n, \] or equivalently for $\rho = e^{-\alpha h}$, \[ d_{\mathrm{TV},V}\left(P_h^n(x,\cdot),\pi_h\right) \le C(1 + |x|^2) \exp\left( - \alpha n h \right), \] where $d_{\mathrm{TV},V}$ denotes the weighted total variation (V-norm) distance, \[ \|f\|_V = \sup_x |f(x)| / (1 + V(x)). \] The explicit contraction rate is $\alpha = -\frac{1}{h}\ln(1-2mh + (2L^2+1)h^2)$, and the prefactor $C$ is given in terms of drift and minorization constants [2511.13093]. ## 3. Proof Methodology: Drift and Minorization The exponential ergodicity proof has three main components: - **Geometric Drift Condition:** For $V(x)=|x|^2$, the RLMC kernel satisfies $P_h V(x) \le \lambda V(x) + b$ with $\lambda = 1 - 2mh + (2L^2+1)h^2 < 1$ (for small $h$) and explicit $b$, ensuring the process contracts towards a compact set in expectation. - **Minorization (Small-Set Condition):** Every ball $E = \{x : |x|\le R\}$ is $(1,\varepsilon)$-small for $P_h$, allowing a uniform lower density on subsets of positive measure. - **Meyn–Tweedie Theorem:** Combining drift and minorization yields the existence and uniqueness of an invariant law, with exponential convergence in weighted total variation [2511.13093]. The midpoint in RLMC reduces the discretization bias in the drift to $O(h^2)$, yielding faster mixing compared to the unadjusted Langevin algorithm (ULA), where the drift bias is only $O(h)$ [2511.13093]. ## 4. Explicit Rates and Step Size Constraints The key contraction parameter \[ \lambda = 1 - 2mh + (2L^2+1)h^2 \] yields the spectral gap of the Markov kernel: \[ \alpha = -\frac{1}{h}\ln(\lambda) \ge 2m - (2L^2+1)h, \] for $h \le m/(2L^2+1)$. The prefactor \[ C = 1 + \frac{(2+L^2)d h + L^2 d h^3}{2mh - (2L^2+1)h^2} \] is determined by the Lyapunov function and small set constants. For the time-randomized skeleton (continuous-time RLMC), analogous spectral gap arguments give exponential ergodicity with the continuous-time rate matching the underlying diffusion, i.e., contraction at rate $m$ under $m$-strong convexity of $U$ [2102.07069]. ## 5. Relationship to General Ergodicity and Markov Process Theory RLMC inherits its ergodicity properties from general Markov semigroup theory: - For reversible chains, the exponential $L^2$ ergodicity rate equals the spectral gap $\lambda_1$ [2102.07069, 2003.13986]. - Uniform ergodicity in total variation is guaranteed provided a geometric drift-minorization pair holds [2511.13093], and the actual convergence rate $\kappa$ can be equated to the exponential rate $\lambda$ under tight hitting-time control for small sets [2102.07069]. - In the setting of functional ergodicity (e.g., $f$-norms), the spectral gap criterion is necessary and sufficient for exponential ergodicity when the process is reversible; the same holds as a sufficient condition in the non-reversible case [2003.13986]. Summary of subordinate results: | Property | Condition | Rate Description | |----------------------------|---------------------------------------------------|-------------------------------| | Geometric ergodicity | $m$-strong convexity, $L$-smoothness, $h$ small | $\alpha \approx 2m$ | | Uniform total variation | Small-set (minorization), drift | $\kappa = \lambda$ | | $L^2$-spectral gap | Reversible, Poincaré inequality | $\lambda_1 = \inf \mathscr{D}$| | Weighted $f$-ergodicity | $f\in L^2(\pi)$, spectral gap positive | $\varepsilon_{\max} = \lambda_{\mathrm{gap}}$ | The RLMC thus achieves the optimal exponential rate allowed by the diffusion process being discretized. ## 6. RLMC in Broader Algorithmic Contexts and Infinite Dimensions RLMC-type models are linked to infinite-dimensional OU processes with cylindrical Lévy noise, where exponential ergodicity has also been established under spectral gap and lower-bound conditions on the noise [1501.06131]. The RLMC methodology integrates into the general framework by verifying the geometric drift and small-set criteria, which translates to exponential mixing in total variation with explicit rates. If the generator admits a uniform spectral gap and the noise is sufficiently rich (in the sense of the lower Bernstein function bound), ergodicity extends to infinite-dimensional or randomized linear Markov chain settings [1501.06131]. ## 7. Metrics, Extensions, and Applications Convergence analysis for RLMC is typically presented in weighted total variation, $W_2$, relative entropy, or $f$-norms. The explicit rates established for the RLMC algorithm give not only theoretical mixing guarantees but inform practical step size selection and algorithmic robustness, especially for strongly convex log-concave targets. The RLMC framework also provides a foundation for understanding ergodicity in perturbed and reflected variants of Langevin dynamics as encountered in stochastic sampling, statistical physics, and high-dimensional Bayesian inference. --- **References**: - [2511.13093] "Convergence rate of randomized midpoint Langevin Monte Carlo" - [2102.07069] "Convergence Rates in Uniform Ergodicity by Hitting Times and $L^2$-exponential Convergence Rates" - [2003.13986] "Estimate the exponential convergence rate of f-ergodicity via spectral gap" - [1501.06131] "Linear Evolution Equations with Cylindrical Lévy Noise: Gradient Estimates and Exponential Ergodicity" Source: https://www.emergentmind.com/topics/exponential-ergodicity-of-rlmc