Donsker–Varadhan Action Functional
- Donsker–Varadhan action functional is the large-deviation rate functional for occupation measures in Markov processes, capturing long-time behavior.
- It offers generator-based, pressure-based, and entropy-rate variational representations that clarify its role in both reversible and nonequilibrium systems.
- It underpins the analysis of metastability, empirical currents, and convergence properties in finite, infinite-dimensional, and interacting-particle settings.
The Donsker–Varadhan action functional is the large-time rate functional for occupation measures and empirical processes of Markov dynamics. In its classical level-2 form, it governs the asymptotics of empirical measures such as
through a large-deviation principle of the form . It admits generator-based, pressure-based, and entropy-rate representations; in reversible settings it reduces to a Dirichlet form, while away from detailed balance it can encode empirical currents, entropy production, or excess dynamical activity (Maes et al., 2011, Zhao, 17 Jun 2025, Hoppenau et al., 2016).
1. Classical definition and level structure
For a finite-state irreducible continuous-time Markov jump process on a finite set with rates and generator
the empirical occupation measure of a trajectory is
Under the stationary process , one has
with a strictly convex rate functional and unique minimum 0 in the irreducible finite-state setting (Maes et al., 2011).
The same object appears far beyond finite-state chains. For Markov processes on Polish or infinite-dimensional spaces, the empirical measure
1
is the canonical level-2 observable, while level-3 formulations lift the large deviations to empirical processes on path space. For the white-forced 2D Navier–Stokes system in a bounded domain, both the level-2 empirical measure and the level-3 empirical process satisfy Donsker–Varadhan type large deviation principles with good rate functions (Zhao, 17 Jun 2025). For discrete-time chains, the analogous empirical measure is
2
and the action functional is defined by the corresponding discrete-time variational formula (Chen et al., 28 Oct 2025).
A basic structural distinction is between level 2, which concerns one-time occupation statistics, level 2.5, which incorporates empirical currents or flows in addition to empirical densities, and level 3, which is formulated on stationary path-space measures. This hierarchy becomes essential away from detailed balance, because density fluctuations alone no longer capture the full nonequilibrium structure (Hoppenau et al., 2016, Bertini et al., 2022).
2. Variational representations and spectral duality
The classical generator representation for a finite-state continuous-time chain is
3
and, more generally, for a Markov generator 4 on a Polish space,
5
In discrete time, with one-step Markov operator 6, the corresponding formula becomes
7
These are the canonical Donsker–Varadhan formulas for occupation measures (Maes et al., 2011, Chen et al., 28 Oct 2025).
A complementary representation uses the Feynman–Kac pressure. For bounded continuous potentials 8, one defines the pressure by long-time logarithmic growth of the Feynman–Kac semigroup, and the action functional is its Legendre transform: 9 For the white-forced 2D Navier–Stokes system this representation is central, and the analysis uses generalized Markov semigroups, principal eigenvalues and eigenvectors, and a resolvent approximation scheme to justify the generator formula in a non-compact infinite-dimensional phase space (Zhao, 17 Jun 2025). In the discrete-time NLS setting, the analogous pressure is
0
and the action functional is
1
with the equivalent entropy formula
2
At level 3, the Donsker–Varadhan functional is an entropy rate on path space. For shift-invariant path measures 3, the level-3 functional for the 2D Navier–Stokes system is given by the entropy production per unit time of 4 relative to the reference Markov dynamics conditioned on the past, and the level-2 functional is obtained by contraction to one-time marginals (Zhao, 17 Jun 2025). For small-noise diffusions on 5, the level-3 Donsker–Varadhan functional at fixed noise strength is likewise the relative entropy per unit time with respect to the stationary path law (Bertini et al., 2022).
| Setting | Donsker–Varadhan representation | Source |
|---|---|---|
| Continuous-time finite-state chain | 6 | (Maes et al., 2011) |
| General continuous-time Markov process | 7 | (Chen et al., 28 Oct 2025) |
| Pressure representation | 8 | (Zhao, 17 Jun 2025) |
| Discrete-time chain | 9 | (Chen et al., 28 Oct 2025) |
| Reversible case | 0 | (Maes et al., 2011) |
| Level 3 | entropy production per unit time on path space | (Zhao, 17 Jun 2025) |
3. Reversible structure, empirical current, and metastable decomposition
Under detailed balance, the Donsker–Varadhan action functional becomes an explicit Dirichlet form. For a reversible finite-state chain with invariant law 1 and 2,
3
For reversible diffusions
4
with Gibbs invariant measure 5, one has
6
and 7 if 8 (Maes et al., 2011, Landim et al., 16 Sep 2025).
Away from detailed balance, the empirical current must be incorporated. For overdamped Langevin dynamics, the level-2.5 rate functional for the empirical density 9 and empirical current 0 is
1
with the stationary constraint 2. The level-2 functional 3 is recovered by contraction over divergence-free currents. In the reversible case, this contraction reproduces the Dirichlet-form representation. The same formalism gives a decomposition into adiabatic and non-adiabatic entropy production, and the Donsker–Varadhan functional equals one quarter of the non-adiabatic entropy production rate in equilibrium (Hoppenau et al., 2016).
For small-noise reversible diffusions, the level-2 action itself has a metastable hierarchy. The expansion
4
decomposes the functional into a microscopic term 5, an order-one term 6 supported on critical points, and exponentially slow contributions 7 associated with effective finite-state Markov chains between wells on metastable time-scales 8 (Landim et al., 16 Sep 2025). In that setting, the Donsker–Varadhan action functional is not merely a single asymptotic cost: it resolves the full hierarchy of inter-well relaxation scales.
4. Dynamical activity and monotone relaxation
For finite-state nonequilibrium Markov jump processes, the Donsker–Varadhan functional has an exact representation in terms of dynamical activity. If 9 is the potential such that 0 is stationary for the tilted rates
1
then
2
and therefore
3
The functional is thus the excess of expected dynamical activity of the original dynamics over that of the minimally active tilted dynamics making 4 stationary (Maes et al., 2011).
This interpretation is specific to nonequilibrium. Under detailed balance, monotonicity of relative entropy is classical, but away from detailed balance the Donsker–Varadhan functional does not derive from relative entropy and need not be monotone at short times. For the Markov evolution 5, eventual monotonicity is nevertheless rigorously available under a sector condition, or “normal linear-response” condition,
6
Under that assumption there exists 7, of order the relaxation time, such that
8
The proof expands the attained variational representation along the evolution, identifies a leading quadratic form
9
and shows that the exponentially decaying remainder becomes negligible at sufficiently large times (Maes et al., 2011).
The same work links this sector condition to a susceptibility identity. For a perturbation
0
the generalized susceptibility satisfies
1
Hence normal linear response corresponds to initial decay of 2. This relation gives the monotonicity theorem a direct linear-response interpretation (Maes et al., 2011).
The finite-state examples are sharply contrasted. For the totally asymmetric random walk on a homogeneous ring,
3
and 4 for all 5. By contrast, for an inhomogeneous asymmetric ring, explicit perturbative choices of the centered potential can produce a positive initial derivative, so short-time non-monotonicity occurs even though eventual monotonic decay is recovered later (Maes et al., 2011).
5. Infinite-dimensional, interacting-particle, and controlled extensions
The Donsker–Varadhan action functional persists in genuinely infinite-dimensional stochastic systems. For the white-forced 2D Navier–Stokes equation in a bounded domain, under 6 for all modes and 7, the empirical measure satisfies a uniform level-2 large deviation principle with good rate function
8
and the empirical process on path space satisfies a level-3 large deviation principle with rate given by entropy production per unit time relative to the Markov dynamics (Zhao, 17 Jun 2025). For the locally damped, randomly forced NLS sampled at integer times, the discrete-time occupation measures satisfy a uniform large deviation principle with a convex good rate function given by the pressure transform and by the discrete entropy formula
9
and the proof hinges on principal eigenvalues of the Feynman–Kac semigroup and a bootstrap argument yielding Lipschitz estimates (Chen et al., 28 Oct 2025). For path-distribution dependent SDEs and SPDEs, where the original dynamics is non-Markovian, the action functional is identified with the Donsker–Varadhan functional of a reference Markov equation obtained by freezing the law argument at the invariant measure; the transfer from the reference equation to the original one uses exponential equivalence of occupation measures (Ren et al., 2020).
In interacting-particle systems and hydrodynamic limits, the functional survives but changes level and scale. For the weakly asymmetric exclusion process on the 0-dimensional torus, the microscopic level-3 Donsker–Varadhan functional 1 for the empirical process, when projected to empirical density and current and rescaled by 2, converges to the macroscopic quadratic action of macroscopic fluctuation theory (Bertini et al., 2021). For the open one-dimensional symmetric simple exclusion process with reservoirs, the time-averaged two-point correlation field satisfies a large deviation principle with a Donsker–Varadhan type rate functional
3
where 4 combines a Laplacian term, a nonlocal bilinear operator 5, a diagonal Neumann contribution, and a reservoir source term (Bodineau et al., 2022). In that setting, the functional encodes a variety of scales depending on the observable of interest.
Risk-sensitive control produces a controlled version of the Donsker–Varadhan principle. In discrete time, with controlled kernel 6 and reward 7, the optimal long-run risk-sensitive reward is represented by
8
where the relative entropy term is the action functional for deviations of the empirical transition kernel from the nominal controlled dynamics (Arapostathis et al., 2019).
6. Degenerate, nonlocal, and conceptual boundary cases
The classical irreducible picture does not persist universally. For degenerate continuous-time jump Markov processes on a compact metric space with absorbing states 9, the joint level-2.5 rate function for empirical measure 0 and flow 1 is
2
under the equal-marginals constraint 3, and 4 otherwise. By contraction, the level-2 Donsker–Varadhan functional retains the canonical generator form
5
but its zero level set is no longer a singleton: it contains convex combinations of the stationary measure 6 and measures supported on the absorbing set 7 (Basile et al., 2013).
For the zig-zag process, a nonreversible piecewise deterministic Markov process on position–velocity space, the empirical measure satisfies a Donsker–Varadhan large deviation principle on the torus and in one-dimensional Euclidean space. In the compact case the functional can be written explicitly; if 8 and 9, then finiteness already requires the streaming compatibility condition 0. Under that condition, the action involves logarithmic, 1, and square-root terms built from 2 and the switching rates 3, and it is strictly decreasing in the refreshment rate 4 away from stationarity (Bierkens et al., 2019). This explicit formula is a nonreversible, non-diffusive analogue of the Dirichlet representation.
For nonlocal elliptic operators 5, the action functional
6
admits a nonlocal energy representation. In the pure diffusion case 7, if 8 with 9 sufficiently regular,
00
For the general transport case, the functional contains the nonlocal energy 01, the transport term 02, and an explicitly controlled nonnegative remainder. This structure is then used to solve a nonlocal inverse problem: equality of the spectral data 03 for all bounded domains and potentials forces equality of the local coefficients 04, and under an additional decomposition of the matrices one obtains 05 (Dávila et al., 2020).
7. Failures, distinctions, and open directions
The Donsker–Varadhan framework has well-defined boundaries. For renewal processes, the empirical measure of backward and forward recurrence times does satisfy a large deviation principle, but the resulting rate functional differs from the Donsker–Varadhan prediction. In particular, the natural Donsker–Varadhan candidate 06 is not good when the waiting-time law has only a finite exponential moment range, and the correct rate functional allows mixtures with a point mass at 07, yielding non-strict convexity and non-analyticity (Lefevere et al., 2010). This is an explicit case in which the Donsker–Varadhan theory does not apply and the correct occupation-measure rate functional is not of Donsker–Varadhan form.
A related pathology appears for probabilistic cellular automata viewed as discrete-time Markov chains on infinite product spaces. For a wide class of PCA with synchronous product structure, strict positivity, and finite influence range, finite Donsker–Varadhan action implies boundary invariance. Under spatial shift invariance, this sharpens to a dichotomy: 08 so for shift-invariant measures the action functional is effectively 09 on time-invariant measures and 10 otherwise (Eizenberg, 1 Sep 2025). The finite-action class is therefore extremely narrow.
The Donsker–Varadhan action functional is also distinct from the Freidlin–Wentzell action. In the joint limit of large time and vanishing noise for diffusions on 11, the level-3 Donsker–Varadhan functional 12, which is a relative entropy rate per unit time, satisfies
13
where
14
is the Freidlin–Wentzell action per unit time (Bertini et al., 2022). The distinction is therefore structural: Donsker–Varadhan describes long-time occupation fluctuations of Markov processes, whereas Freidlin–Wentzell describes small-noise path deviations; the two coincide only after a nontrivial joint asymptotic procedure.
Several open directions are explicitly identified in the literature. In nonequilibrium monotonicity theory, the normal linear-response sector condition is sufficient but not necessary, and short-time non-monotonicity may coexist with eventual decay (Maes et al., 2011). In infinite-dimensional SPDEs, extensions beyond the treated non-compact settings require additional functional-analytic control (Zhao, 17 Jun 2025). A plausible implication is that the modern theory of the Donsker–Varadhan action functional is best viewed not as a single closed formula, but as a family of equivalent variational objects whose precise form depends on the level of description, the geometry of the state space, reversibility properties, and the presence or absence of degeneracy.