Berry–Esseen Inequalities Overview
- Berry–Esseen type inequalities are quantitative refinements of the CLT that provide explicit convergence rates based on the third absolute moment and characteristic function analysis.
- They employ smoothing inequalities, truncation, and exponential tilts to extend classical results to dependent structures, bootstrapping, and high-dimensional settings.
- Recent advancements using Zolotarev metrics and nonuniform corrections have sharpened these bounds, impacting applications in martingale theory, nonlinear functionals, and large deviations.
A Berry–Esseen type inequality is a quantitative refinement of the central limit theorem (CLT) that provides explicit rates of convergence in probability metrics—typically the Kolmogorov metric—between the distribution of a normalized sum of independent random variables and the standard normal law. These inequalities are foundational in probability theory and statistical inference, precisely quantifying how quickly the distribution of partial sums converges to normality in terms of moments of the summands. Beyond the i.i.d. scalar case, the theory encompasses dependent structures, nonlinear functionals, bootstrapping, high-dimensional and non-standard (e.g., non-Gaussian) limit regimes.
1. Classical Berry–Esseen Inequality and Constants
The classical Berry–Esseen inequality applies to normalized sums of real i.i.d. random variables with mean zero, unit variance, and finite third absolute moment . The inequality is stated as
where is the cdf of and is the standard normal cdf. The optimal (smallest possible) constant has been the subject of extensive study:
- Shevtsova (Shevtsova, 2011) sharpened the best upper estimate to by proving
For all , both forms yield , and the second is sharper for .
- Earlier landmarks:
- Esseen originally established .
- Korolev–Shevtsova (2010): by optimization over Lyapunov fractions.
- Tyurin and others progressively improved explicit numerical bounds.
- Zolotukhin–Nagaev–Chebotarev (Zolotukhin et al., 2018) provided a finite- computational approach for Bernoulli summands, proving , strictly smaller than the Esseen constant for , with similar asymptotics for non-Bernoulli two-point laws.
The dependence on the third absolute moment is optimal in the classical i.i.d. setting.
2. Methodological Foundations
The proof techniques for Berry–Esseen bounds are based on smoothing inequalities and characteristic function analysis. Key elements include:
- Smoothing–inequality (Prawitz [Zolotarev 1965–67]–type) arguments:
Shevtsova (Shevtsova, 2011) used enhanced remainder bounds, analysis of the Lyapunov fraction, and explicit numerical optimization over parameters.
- Truncation and exponential tilts are used in non-uniform and moderate/large deviation regimes (Pinelis, 2013, Pinelis, 2013).
- For sums of non-identically distributed or dependent summands (e.g., -dependent, Markov, or martingale differences), adaptations include replacement of classical expansions with local limit results and anti-concentration bounds (Bong et al., 2022, Guo et al., 2017, Fan et al., 2016).
- In smooth-function bounds, Zolotarev metrics and the Wasserstein-1/Kantorovich distance are employed, allowing Berry–Esseen type results in , Lipschitz, or Zolotarev norms (Mattner et al., 2017, Mattner, 2022).
3. Scope: Extensions and Generalizations
3.1 Non-i.i.d. Sums and Dependence Structures
- Non-identical summands: Nonuniform and uniform BE bounds have forms similar to the classical, with Lyapunov ratios reflecting the pooled variance and third-moment data (Pinelis, 2013, Mattner, 2022).
- Martingales: Under a conditional Bernstein condition,
producing bounds with optimal exponential tails, unifying normal approximation with Cramér–type large deviations (Fan et al., 2016).
- Regenerative and mixing processes: Provided weak moment and mixing assumptions, Berry–Esseen rates of are obtainable, generalizing Bolthausen’s results to lower-moment or weaker mixing regimes (Guo et al., 2017).
- Conditioned structures: Quantitative BE bounds exist for sums conditional on combinatorial constraints (e.g., occupancy, hashing, random forests), retaining rates under uniform control of moments and characteristic function decay (Klein et al., 2019).
3.2 Functionals, Bootstrapping, and High-Dimensional Settings
- Smooth functionals (): For functions with Lipschitz Hessians,
with constants , via sharp analysis of the Zolotarev metrics (Mattner et al., 2017).
- Multivariate, nonlinear functionals and high-dimensional CLT: For with a sum and a small nonlinear remainder,
with explicit and sharp up to factor (Shao et al., 2021).
- Bootstrap accuracy: Multivariate, higher-order Berry–Esseen bounds (Zhilova, 2016) yield optimal –type rates for bootstrap approximations of smooth functionals and likelihood ratio statistics in high dimensions, provided higher moment-matching is available.
3.3 Non-normal and Conditional Limit Laws
- Chernoff-type (non-normal) limits: For isotonic regression, Berry–Esseen bounds of order reflect the cube-root asymptotics of the underlying estimation problem (Han et al., 2019).
- Conditioned-to-stay-positive random walks: The limiting law is Rayleigh, and an order Berry–Esseen bound in the Kolmogorov norm holds for the properly rescaled sum on the event of staying positive, with an explicit (but potentially non-optimal) exponent-3 dependence on the third-moment (Denisov et al., 2024).
4. Structural Refinements and Norm Improvements
Recent advances have established that classical metrics in Berry–Esseen inequalities can be replaced or refined:
- Zolotarev norms , : Mattner (Mattner, 2022) showed
so if is "Zolotarev-close" to normal, the Berry–Esseen bound can be significantly sharper than in terms of .
- Local limit (density) bounds: For independent vectors in with sufficient smoothness/density,
with smoothness penalty arising from the sup-norm of densities (Bobkov et al., 2024).
5. Nonuniform Inequalities and Large Deviations
Nonuniform Berry–Esseen bounds are essential for tail accuracy and moderate/large deviations:
- Canonical form: For independent summands,
with best proven in the iid case (Pinelis, 2013), though lower bounds show and smoothing approaches may eventually reduce this constant further.
- Martingale analogues: Under conditional Bernstein conditions, nonuniform bounds combine optimal tail decay (exponential in deviation) with polynomial prefactors, unifying Cramér–type expansions and BE theory (Fan et al., 2016).
6. Fast Rates and Moment Matching
Assuming extra structure or smoothness leads to accelerated convergence:
- If the first moments of match those of the standard normal and there is a local lower bound on the density, then
and for this yields an rate for symmetric variables (Johnston, 2023).
- The regime and sharpness of these results have been confirmed via Bernoulli plus small-uniform perturbations.
7. Applications and Statistical Inference
Berry–Esseen type bounds underpin a variety of quantitative statistical analysis:
- Small deviation probabilities (e.g., Feige’s conjecture) via an overview of BE and semidefinite-moment inequalities (Guo et al., 2020).
- Parameter estimation in stochastic processes: Explicit Berry–Esseen rates for parameter estimation in fractional OU models via Malliavin–Stein techniques elucidate the connection between Hurst index, estimation rate, and the fine structure of the likelihood (Chen et al., 2018).
- High-dimensional dependence: -dependent random vector arrays, bootstrapped sums, and even nonlinear functional estimators (such as -estimators, SGD averages) fall within the reach of contemporary multivariate and probabilistic BE inequalities (Bong et al., 2022, Zhang, 2021, Shao et al., 2021, Zhilova, 2016).
References within this article are to arXiv preprints as cited, e.g., (Shevtsova, 2011, Mattner, 2022, Klein et al., 2019), etc.