Posterior Contraction Rates
- Posterior contraction rates are defined as the rate at which Bayesian posteriors concentrate around the true parameter using metrics like L2, Hellinger, or Wasserstein.
- They serve as a critical benchmark in Bayesian nonparametric theory, validating inference approaches in high- and infinite-dimensional settings.
- Establishing these rates involves verifying entropy and prior-mass conditions, constructing sieves, and leveraging dynamic methods such as the Benamou–Brenier formulation.
Posterior contraction rates quantify the asymptotic speed at which the Bayesian posterior distribution concentrates around the true data-generating parameter or function as sample size increases. They are central to Bayesian nonparametric theory, providing a frequentist benchmarking of Bayesian learning and establishing certainty quantification for Bayesian inference in both parametric and high- or infinite-dimensional models. The mathematical machinery for posterior contraction rates ("PCRs"—Editor's term) has evolved to include information- and transportation-based distances, particularly the Wasserstein metrics, and adapts to dominated, non-dominated, parametric, nonparametric, linear, nonlinear, and even computationally discrete settings.
1. Formal Definition and Conceptual Framework
Given a statistical model with parameter space (which may be infinite-dimensional), observations , a prior on , and sample size , the posterior quantifies the conditional belief on after observing data. A sequence is a posterior contraction rate at if, for every 0,
1
where 2 is an appropriate metric, such as 3, Hellinger, or Wasserstein (Dolera et al., 2020, Dolera et al., 2022, Camerlenghi et al., 2022). This quantifies that posterior mass contracts around 4 at rate 5.
In nonparametric and high-dimensional models, 6 is often taken as a norm on function spaces or a probability metric (e.g., Wasserstein-7 distance): 8 with 9 the set of couplings of 0 (Dolera et al., 2022).
2. Posterior Contraction in Dominated and Non-dominated Models
- Dominated models: Classical PCRs exploit Bayes' formula; the posterior can be written as
1
where 2 is a density with respect to a dominating measure (Dolera et al., 2020).
- Non-dominated models: In many Bayesian nonparametric constructions (e.g., Dirichlet process mixtures, normalized random measures), no single dominating measure 3 exists. In this case, one works with posterior kernels 4 arising from disintegration (de Finetti decomposition), and PCRs are defined using, for example, the 5 metric on 6 (Camerlenghi et al., 2022). The formal PCR is then:
7
which quantifies the expected 8-Wasserstein distance of the random posterior to the Dirac mass at 9.
3. Methodologies for Establishing Posterior Contraction Rates
The general theoretical strategy for establishing PCRs involves verifying a combination of:
- Entropy (complexity) conditions: Covering numbers or metric entropy of the effective parameter space at scale 0, e.g. 1 (Gao et al., 2015, Finocchio et al., 2021, Oh et al., 12 May 2026).
- Prior-mass (small ball) conditions: Sufficient prior mass near the truth, i.e. 2 for Kullback–Leibler neighborhood (Gao et al., 2015, Camerlenghi et al., 2022).
- Testing and concentration inequalities: Existence of exponentially powerful tests for testing 3 against alternatives at distance 4 (Reiss et al., 2017, Fan et al., 25 Jan 2026, Dolera et al., 2024).
- Sieve construction: In nonparametrics or under weak regularity, contractive "sieves" (compact/entropy-controlled sets) inside which entropy and testing conditions hold, with negligible prior mass outside (Camerlenghi et al., 2022).
Recent developments leverage the Wasserstein metric and the dynamic Benamou–Brenier formulation (Dolera et al., 2020, Dolera et al., 2022), providing two novelties:
- Avoidance of sieves in certain contexts — PCRs can be established in strong metrics via the dynamic formulation (Dolera et al., 2020, Dolera et al., 2022, Dolera et al., 2024).
- Direct connection to empirical process rates and Poincaré inequalities: PCRs are linked to rates of convergence in the empirical measure (Glivenko–Cantelli), Sanov's large deviation principle in Wasserstein distance, and the estimation of weighted Poincaré–Wirtinger constants (Dolera et al., 2022).
4. Quantitative Examples in Parametric, Nonparametric, and Infinite-dimensional Models
Regular parametric models
For regular finite-dimensional models, the posterior contracts at the optimal parametric rate: 5 for any prior with positive, continuous density at 6 (Dolera et al., 2022).
Nonparametric Dirichlet-Laplace mixtures
For the model 7 with Laplace mixing and a Dirichlet process prior, Gao and van der Vaart (Gao et al., 2015) show: 8 for the mixing distribution, and
9
for the density, matching minimax lower bounds up to log factors.
Deep Gaussian process priors and compositional classes
Under deep GP priors for functions expressed as compositions 0 with layerwise Hölder or Besov regularity, the contraction rate in 1 is
2
achieving minimax adaptivity to unknown compositional structure (Finocchio et al., 2021).
Besov-Laplace priors in white noise
For functions 3 (4) and smoothness-matching Besov-Laplace priors, the strong posterior contraction rate in the Sobolev norm is
5
matching minimax lower bounds (Dolera et al., 2024).
High-dimensional and nonparametric sparsity
For regression with spike-and-slab or shrinkage priors, the rate is
6
where 7 is true sparsity, and 8 (Zhang et al., 2019, Naveau et al., 2024).
Non-dominated nonparametric models
For Dirichlet process ({\small DP}) or normalized Gamma process priors in non-dominated settings (i.e., not absolutely continuous in the parameter), the contraction rate in 9 is (Camerlenghi et al., 2022): 0 where 1 is the expected Wasserstein convergence of the empirical measure, and the second term depends on the metric entropy and prior concentration.
5. Analytical Structure: Wasserstein Dynamics, Glivenko–Cantelli, and Poincaré Constants
A central methodological innovation is the combination of:
- Local Lipschitz-continuity of the posterior: If 2 for sufficient statistics or empirical measures 3, then PCRs can be controlled by data fluctuation rates (Dolera et al., 2020, Dolera et al., 2022).
- Dynamic Benamou–Brenier formulation of 4: The infimum over transport plans is reframed as an infimum over absolutely continuous probability curve flows 5 solving the continuity equation with minimal kinetic energy (Dolera et al., 2022).
- Laplace method and weighted Poincaré–Wirtinger constants: Asymptotics in both finite and infinite dimension rely on Laplace expansions and spectral gap estimates for