Empirical Occupation Measure
- Empirical occupation measure is a construct that encodes time- or population-averaged state distributions in stochastic processes, labor networks, and economic systems.
- It underpins methodologies for quantifying convergence rates, controlling multi-agent systems, and robust statistical inference through semidefinite relaxations and moment-based techniques.
- Applications range from ergodic theory and large deviations in statistical physics to mean-field games and network economics, providing tractable approximations for complex dynamics.
An empirical occupation measure is a fundamental construct in probability, statistics, stochastic processes, ergodic theory, statistical physics, mean-field games, and labor economics, encoding the empirical distribution of state or event realizations—typically by averaging over time, space, individuals, or both. It provides a data-driven proxy for the time- or population-averaged law associated with a process or ensemble. Modern applications span from quantifying mixing and convergence rates of stochastic dynamics, to constructing semidefinite relaxations for stochastic control, to measuring skill-task matches across entire economies, and directly informing inference in large-scale agent-based or network settings.
1. Mathematical Definition and Variants
The empirical occupation measure is context-dependent but universally takes the form of an empirical distribution associated with process samples or population instances. For a single stochastic process on state space , the time- occupation measure is defined by
where is the Dirac mass at . Analogously, for a discrete-time process , the occupation measure is
For a finite population of agents or particles with states , the empirical occupation measure at time 0 is
1
as in mean-field models or large deviations for interacting particle systems (Béthencourt et al., 2024).
In control and reinforcement learning, if trajectories 2 are sampled under a control policy, the empirical occupation measure estimates the state-action-time visitation frequency: 3 (Holtorf et al., 2022, Yu et al., 17 Mar 2026). In network-economics, empirical occupation measures may encode match frequencies in bipartite graphs of workers and jobs, with matrix-valued analogs (see Section 3 below) (Fogel et al., 2023).
2. Law of Large Numbers and Convergence Rates
The empirical occupation measure 4 or 5 converges (almost surely or in probability) to an invariant measure or occupation law under weak regularity conditions—a quantitative formulation of the law of large numbers for processes or populations.
Key Results:
- For i.i.d. sampling, 6 almost surely, with 7 the 8-Wasserstein metric; rates are governed by metric entropy/covering numbers: 9 in 0 (Boissard et al., 2011, Boissard, 2011, Pagès et al., 7 May 2026).
- For ergodic Markov chains, occupation measure convergence rates depend on mixing/contractivity constants, and can achieve similar 1 or 2 rates under suitable conditions (Boissard et al., 2011, Pagès et al., 7 May 2026).
- For ergodic diffusions on compact spaces, Donsker-type CLTs hold: 3 for classes of smooth test-functions 4, yielding 5 in up to three dimensions (Deo, 2022).
- In non-stationary or non-Markovian setups with conditional mixing, convergence holds at similar rates provided suitable coupling and moment conditions (Pagès et al., 7 May 2026).
- For time-inhomogeneous Markov chains with vanishing "mutation" (annealing/simulated annealing, evolutionary models), the occupation measure converges almost surely to the zero-noise stochastically stable law at an explicit rate: 6 (Benaïm et al., 6 Feb 2026).
Implications: These convergence results justify empirical occupation measures for plug-in inference and as tractable approximations of deterministic or expectation-based occupation measure formulations in high-dimensional or complex models.
3. Occupation Measures in Large-Scale Economic and Network Models
In labor economics and network theory, the "empirical occupation measure" can generalize far beyond time averages to encode empirical interaction structure in large bipartite graphs. Notably, (Fogel et al., 2023) applies a data-driven assignment of workers to "types" and jobs to "markets" by modeling the observed worker-job match network via a degree-corrected bipartite stochastic block model. The empirical occupation measure here is the (estimated) block-wise matrix 7 defining match probabilities between latent worker types (8) and market classes (9).
Pipeline:
- Nodes: workers, jobs (occupation-establishment pairs).
- Edge weights: counts of realized job holdings.
- Block modeling: cluster nodes into types and markets that maximize the likelihood of observed links.
- Economic interpretation: latent block structure corresponds to a Roy-equilibrium matching of heterogeneous skills and tasks.
Significance: Empirically optimized occupation measures yield low-dimensional sufficient statistics for predicting wage changes, job flows, and shock propagation, outperforming classical occupation-sector classification systems in explanatory power for wage and flow data.
4. Empirical Occupation Measures in Control and Mean Field Games
Occupation measures are foundational in stochastic control, mean field games, and convex relaxation of optimal control problems. Empirical occupation measures are constructed from sampled or simulated trajectories and serve as statistically consistent proxies for theoretical (pre-averaged) occupation measures.
Applications:
- Semidefinite programming (SDP) relaxations: Moment-based constraints on empirical occupation measures can be embedded directly into SDP frameworks, yielding data-driven or robust optimization problems (Holtorf et al., 2022).
- Frank–Wolfe optimization over measure spaces: Empirical occupation measures enter both the forward population simulation and the aggregation of control policies in large multi-agent systems (e.g., UAV swarm, satellite constellations), converging as 0 to mean-field limits (Yu et al., 17 Mar 2026).
- Empirical moments: For each trajectory, observed empirical occupation moments are
1
and used to enforce affine constraints and to inform lower bounds for optimal values (Holtorf et al., 2022).
- Propagation of chaos: As 2, empirical occupation measures converge to law-determined occupation measures; sampling error scales like 3 (Yu et al., 17 Mar 2026).
Significance: Empirical occupation measures allow sample-based plug-in control synthesis, verification, and robustification of stochastic optimal control and mean-field equilibrium problems intractable by direct analytic means.
5. Large Deviations and Statistical Physics
Occupation measures in statistical mechanics and interacting particle systems encode spatial and temporal averages of system configurations or trajectories. Large deviations principles (LDPs) for empirical occupation measures provide variational characterizations of rare event probabilities.
Main developments:
- For symmetric exclusion and diffusive interacting systems, large deviations rate functionals 4 quantify the cost to enforce atypical empirical density profiles, often with quadratic Onsager–Machlup structure (Landim et al., 2017).
- In Brownian motion, conditioning on extreme trajectory self-intersections or mutual interactions leads to occupation measures concentrating on optimal profiles determined by Sobolev or Gagliardo–Nirenberg extremals (Park, 9 Apr 2026).
- Compactification and profile decomposition: By taking quotient spaces under spatial shifts and allowing splitting into multiple "islands", full LDPs are established, with minimizers reflecting system symmetries and variational constraints (Park, 9 Apr 2026).
Significance: Empirical occupation measures become canonical random objects for describing the macroscopic empirical profile of stochastic systems, both in typical and in large deviation regimes.
6. Empirical Occupation Measures in Stochastic Control of Particle Ensembles
For 5 controlled Brownian particles, the empirical occupation measure 6 encodes the time-7 spatial distribution of all particles. Modern theory (see (Béthencourt et al., 2024)) analyzes controlled dynamics where the cost depends on 8, and the value function 9 solves an HJB equation in the Wasserstein space of probability measures: 0 where 1 denotes the Lions derivative, and 2 is a Hamiltonian functional encoding feedback coupling through the measure.
A generalized Itô formula for functionals of the occupation measure allows derivation of both the measure-space HJB and its probabilistic representation via Boué–Dupuis variational formulas and nonlinear Feynman–Kac representations. This machinery underpins control of macroscopic observables, e.g., maximizing the Wiener sausage volume in Brownian ensembles, with empirical occupation measures encoding the ensemble configuration (Béthencourt et al., 2024).
7. Statistical Inference, Robustness, and Empirical Use
Empirical occupation measures undergird statistical inference, estimation, and verification for stochastic process models:
- Nonasymptotic deviation inequalities (in Wasserstein metrics, under transport-entropy or contractivity conditions) quantify the sampling error between occupation measures and their limiting laws (Boissard et al., 2011, Boissard, 2011, Pagès et al., 7 May 2026).
- Moment-based constraints following from empirical occupation measures can rigorously quantify confidence intervals or robustify solutions in stochastic optimization (Holtorf et al., 2022, Yu et al., 17 Mar 2026).
- Bootstrapping and finite-sample scaling: The precise scaling of empirical occupation measures allows robust design and verification even in high-dimensional, non-i.i.d., or networked agent settings.
- In ergodic estimation, empirical occupation measures serve as consistent estimators for invariant laws and mixing times, justifying their use in MCMC and SDE simulation output analysis (Pagès et al., 7 May 2026, Deo, 2022).
References:
- Stochastic optimal control and SDP: (Holtorf et al., 2022, Yu et al., 17 Mar 2026, Béthencourt et al., 2024)
- Large deviations/statistical mechanics: (Landim et al., 2017, Park, 9 Apr 2026)
- Quantitative convergence, mixing: (Boissard et al., 2011, Boissard, 2011, Pagès et al., 7 May 2026, Deo, 2022, Benaïm et al., 6 Feb 2026)
- Labor networks and empirical matching: (Fogel et al., 2023)
- Quasar clustering and mean occupation functions: (Chatterjee et al., 2013)