---
title: Moderate Deviation Principles (MDP)
url: https://www.emergentmind.com/topics/moderate-deviation-principles-mdp
type: topic
---

# Moderate Deviation Principles (MDP)

A moderate deviation principle (MDP) describes the asymptotic probabilities of stochastic fluctuations that are larger than those governed by central limit theorems (CLT) but smaller than those covered by large deviation principles (LDP). Formally, an MDP bridges the gap between the Gaussian scaling—where fluctuations are typically of size $O(n^{-1/2})$—and the exponentially unlikely events on the $O(1)$ scale of a full LDP, quantifying the decay rates for “moderately rare” events that vanish more slowly than those dictated by the CLT but still much more rapidly than in the law of large numbers regime. The mathematical structure of the MDP involves precise scalings, variational formulations, and functional-analytic constraints that depend on the stochastic model class under consideration.

## 1. Fundamental Definition and Scaling Regimes

Let $\{X_n\}$ be a sequence of random variables or empirical processes satisfying a law of large numbers $X_n \to x_0$ in probability, and a CLT at the scale $b_n$ (typically $b_n = \sqrt{n}$), and an LDP at a much larger scale $U_n$ (e.g., $U_n = n$). The MDP typically involves a scaling sequence $a_n$ such that $a_n \to \infty$ and $a_n / b_n \to 0$ as $n \to \infty$ (i.e., $a_n$ grows faster than 1 but much slower than $\sqrt{n}$). The moderate deviations regime is governed by the normalized variable $a_n (X_n - x_0)$, and an MDP states that for Borel sets $A$:
\[
-\inf_{x \in A^\circ} I(x) \leq \liminf_{n\to\infty} \frac{1}{a_n^2} \log \mathbb{P}\left( \frac{X_n - x_0}{b_n/a_n} \in A \right) \leq \limsup_{n\to\infty} \frac{1}{a_n^2} \log \mathbb{P}\left( \frac{X_n - x_0}{b_n/a_n} \in A \right) \leq -\inf_{x \in \bar{A}} I(x)
\]
with $I$ a good, quadratic rate function. The rate function and the path space (e.g., $C([0,T])$, $D([0,T])$, $\ell_2$, or a space of signed measures) are model-specific [1510.02187, 1711.05247, 2010.12843].

## 2. Representative Models and Path-Space Frameworks

MDPs have been rigorously established for a wide range of stochastic models:

- **Weakly Interacting Diffusions and Jump Processes:** For empirical measure processes associated with mean-field SDEs (e.g., McKean–Vlasov systems) and pure jump Markov processes, MDPs are formulated for centered, scaled empirical measure-valued processes. Path spaces include $C([0,T]:\mathcal{S}'_p)$, the space of continuous paths with values in the dual of the Schwartz space, and $D([0,T]:\ell_2)$ for countable jump systems [1510.02187].

- **Particle Systems, Reaction-Diffusion, and Exclusion Processes:** Fluctuation fields in weakly asymmetric exclusion processes (WASEP) and reaction-diffusion models admit MDPs in the topology of distributions or test-function duals, with the rate function determined via variational (Laplace principle) formulations, typically exhibiting quadratic structure constrained by conservation or hydrodynamic equations [2405.16151, 2408.11633].

- **Stochastic Recursive Algorithms:** For the continuous-time interpolation of recursive stochastic algorithms, MDPs hold for the scaled deviation processes, often in $C([0,1];\mathbb{R}^d)$, with the speed and quadratic rate function determined by local linearization and the noise covariance structure [1401.6055].

- **Multiscale and Slow–Fast Systems:** In two-time-scale diffusions, reaction-diffusion SPDEs, or systems with fast Markovian environments, the MDP describes moderate fluctuations around an averaged (or homogenized) limit, integrating weak convergence techniques, stochastic control, and occupation measures in infinite-dimensional path spaces [1611.05903, 2101.00085, 2512.00236].

- **Random Fields (Hierarchical Approach):** For splittable or CMS random fields (i.e., fields admitting suitable “splitting” structure), MDPs are established for integrals over large boxes and for empirical linear statistics against test functions, employing hierarchical induction on dimension and cumulant generating function chaining [1706.00991, 1711.05247, 1810.05673, 1909.03238].

## 3. Variational Rate Functions and Structural Features

MDP rate functions typically involve quadratic cost functionals subject to linear constraints encoding the (possibly infinite-dimensional) linearized dynamics:

- **Interacting Diffusions:** The rate function for empirical measure deviation $n$ is given by
\[
I(n) = \inf_{g} \frac{1}{2} \int_0^T \int_{\mathbb{R}} g^2(x,s) \mu_s(dx) ds
\]
where $g$ represents the control enforcing $n$’s deviation, linked to solutions of a linearized PDE or SDE along the LLN trajectory $\mu$ [1510.02187].

- **Markov Jump Systems:** Similar quadratic forms arise for jump processes, on spaces like $D([0,T]:\ell_2)$.

- **SPDEs and Infinite-Dimensional Systems:** The MDP rate is an action functional over control fields in $L^2$, often arising via the solution to an associated “skeleton” (deterministic controlled) equation. For example, in stochastic primitive equations,
\[
I(\varphi) = \inf\left\{ \tfrac{1}{2} \int_0^t |h(s)|_U^2 ds : \varphi = G^0_R\left(\int_0^\cdot h ds\right) \right\}
\]
where $G^0_R$ maps controls to deterministic paths via the skeleton equation [2010.12843].

- **Martingale and Empirical Process Settings:** In models based on recursive algorithms or BMCs, the MDP rate function is given in terms of the solution to a linear ODE with noise covariance appearing in the quadratic cost [1401.6055, 1111.7303].

- **Random Fields:** For splittable random fields, the MDP rate function is universally quadratic, $I(x)=x^2/2$, under box averaging or test function integration, reflecting CLT-typical Gaussian structure in the moderate regime [1711.05247, 1810.05673].

## 4. Methodological Framework: Variational Representations and Proof Structure

The dominant proof methodologies for MDPs—especially for infinite-dimensional or path-dependent models—employ variational representations of exponential functionals of stochastic processes:

- **Budhiraja–Dupuis Weak Convergence Approach:** The Laplace principle,
\[
- \frac{1}{a_n^2} \log \mathbb{E} \exp\left(-a_n^2 F(X^n)\right) = \inf_{\text{controls}} \mathbb{E}\left[\tfrac{1}{2} \int |u|^2 + F(\text{controlled path})\right]
\]
is established by characterizing limits of controlled versions of the underlying process and connecting candidate large deviations to optimal controls in a deterministic variational problem [1510.02187, 2512.00236, 1611.05903].

- **Martingale and Exponential Martingale Methods:** For particle and interacting system models, exponential martingales and Feynman–Kac formulae are deployed to construct tight upper bounds and to identify rate functions via entropy minimization and duality [2405.16151, 2408.11633].

- **Hierarchical Inductive Control of CGFs:** For spatial random fields, a succession of single-coordinate halvings, leak estimates, and cumulant bounds is iterated to establish quadratic control of the generating function, which yields the MDP via a Gärtner–Ellis-type argument [1711.05247, 1706.00991].

## 5. Canonical Examples and Applications

MDPs have been computed explicitly for a diverse range of systems:

| Model Class                      | Rate Function (examples)                                    | Path Space/Topology                    |
|-----------------------------------|------------------------------------------------------------|----------------------------------------|
| Interacting Diffusions (McKean–Vlasov)       | Quadratic action functional over deviations                | $C([0,T]:\mathcal{S}'_p)$              |
| Weakly Asymmetric Exclusion (WASEP)          | Supremum of linear functional minus Dirichlet form         | $D([0,T], \mathcal{S}')$               |
| Join-the-Shortest-Queue-d Systems            | Quadratic variational functional on $\ell^2$-paths         | $D([0,T]:\ell^2)$                      |
| Bifurcating Markov Chains                    | $I(x) = x^2/(2Q)$ with $Q$ dependent on ergodic variance  | Real line or finite-dimensional vector |
| Splittable Random Fields                     | $I(x)=x^2/2$ for box averages or test function integrals   | $\R$, test-function dual               |
| Recursive Stochastic Algorithms              | $I(\phi) = \frac{1}{2}\int_{0}^{1} \| \cdot \|_{\Sigma(x^0(t))^{-1}}^2$ | $C([0,1];\mathbb{R}^d)$                |

Beyond the abstract theory, MDPs are instrumental in numerical rare-event simulation, statistical estimation theory, and the study of phase transitions in high-dimensional statistical mechanics [1401.6055, 2408.11633, 1111.7303].

## 6. Assumptions, Technical Requirements, and Limitations

The precise form of the MDP and the validity of the quadratic rate function depend on:

- **Regularity of Dynamics:** Smoothness and Lipschitz conditions on drift and diffusion coefficients, global Lipschitzity in both state and measure arguments, and boundedness of derivatives up to suitable order (for interacting diffusions) are typically necessary [1510.02187].

- **Ergodicity and Mixing:** Rapid mixing / exponential ergodicity for the fast variable (in multiscale systems) and for Markov chains ensures the effective collapse of the occupation measures to those governed by the invariant law [2512.00236].

- **Non-degeneracy and Polynomial Growth:** Non-degeneracy of noise is sufficient but not always necessary (e.g., certain degenerate SDEs, provided averaging arguments are available), and growth conditions control the tail behavior for additive functionals [2101.09482].

- **Structural Model Constraints:** For splittable random fields, the entire construction of the MDP hinges on the ability to recursively split the field along coordinate axes, bounding the remainder "leak" terms and ensuring cumulant generating function control [1706.00991, 1711.05247].

- **Scaling Constraints:** The MDP regime strictly requires $a_n \to \infty$, $a_n/\sqrt{n} \to 0$; the scaling must remain within a zone where quadratic approximations of the log-moment-generating function remain valid, but the Gaussian limit no longer dominates tail probabilities.

## 7. Broader Context and Significance

The MDP precisely characterizes the regime where fluctuations are too rare for CLT arguments but too frequent for full LDP analysis, providing refined estimates for Gaussian-type tails and the rough shape of moderately large deviations. The quadratic structure of the rate function and the path-level variational principles (or skeleton equations) that arise in MDPs carry direct algorithmic implications (efficient importance sampling, Riccati-based controls), underpin rare-event estimation in complex stochastic systems [1401.6055].

In conclusion, the moderate deviation principle serves as a rigorous bridge between the central limit and large deviations domains, unifying Gaussian fluctuation theory with the calculus of rare macroscopically significant events, across an array of stochastic models from particle systems to random fields, interacting diffusions, and recursive algorithms [1510.02187, 1711.05247, 1612.08396, 1401.6055, 2405.16151].

Source: https://www.emergentmind.com/topics/moderate-deviation-principles-mdp