Berry–Esseen Inequalities: Convergence Bounds
- Berry–Esseen type inequalities are explicit bounds that measure the difference between a normalized sum’s distribution and the Gaussian distribution in terms of moment conditions.
- They have been refined for various settings including i.i.d. variables, dependency graphs, and multivariate frameworks to optimize convergence in central limit theorems.
- These inequalities support practical applications in statistical estimation, probability theory, and computational techniques by providing sharp bounds for normal approximations.
A Berry-Esseen type inequality precisely quantifies the rate of convergence in the central limit theorem (CLT), bounding the difference between the cumulative distribution function (cdf) of a normalized sum of independent random variables and the Gaussian cdf. These inequalities provide explicit rates under moment and dependence conditions, and have been refined for a variety of settings: classic i.i.d., dependent graphs, weak dependence, random walks conditionally constrained, multivariate statistics, local limit theorems, functional laws, and even free probability.
1. Classical Berry-Esseen Inequality and Refinements
The canonical Berry-Esseen theorem provides an explicit upper bound on the Kolmogorov distance between the distribution function of a normalized sum of i.i.d., mean-zero, unit-variance random variables and the standard normal cdf , in terms of the normalized third absolute moment: Recent work has focused on reducing the absolute constant , with the currently best-known values for i.i.d. (Shevtsova, 2011) and for non-identical summands. Additionally, Zolotukhin et al. demonstrate that for i.i.d. Bernoulli variables, the optimal is at most above Esseen's lower bound for (Zolotukhin et al., 2018).
For smooth test functions, Mattner–Shevtsova established refined inequalities in Zolotarev -distance: where are symmetric two-point laws, , and is explicitly smaller than for , strictly improving Tyurin's optimal bounds (Mattner et al., 2017).
2. Optimality, Nonuniform Inequalities, and Smoothing Techniques
The uniform Berry–Esseen bound does not reflect tail improvements. Nonuniform Berry–Esseen inequalities, due to Nagaev and refined by Pinelis, provide bounds of the form: for normalized sums with third moment (Pinelis, 2013, Pinelis, 2013). Innovations in Fourier-based smoothing inequalities and truncation/exponential tilt permit sharper tail behavior and constants. Pinelis shows in the i.i.d. regime, considerably narrowing the gap from earlier 25x factors.
3. Berry–Esseen Bounds under Dependence Structures
Several extensions generalize Berry–Esseen type bounds to various dependence frameworks:
- Dependency graphs: For sums of random variables linked by a sparse dependency graph of degree , Fourier-analytic techniques yield Kolmogorov bounds matching the independence rate (up to replacement), improving over earlier Stein-method-based constants (Janisch et al., 2022).
- Weak dependence (Bernoulli-shift): With stationary sequences admitting sufficiently summable coupling coefficients, the Berry–Esseen rate is for , optimal for time series models, dynamical systems, and nonlinear recursions (Jirak, 2016).
- Self-normalization/local dependence: Stein’s method and concentration inequalities allow optimal () uniform rates for self-normalized statistics under mild local dependence and only third-moment conditions (Zhang, 2021).
4. Multidimensional, Nonlinear, and Conditional Extensions
- Multivariate CLTs: The quantification of convergence rate in the multidimensional central limit theorem involves intricate combinatorial smoothing (partition–Möbius operator), yielding Berry–Esseen bounds of order modulo combinatorial constants depending on dimension (Heuberger et al., 2016).
- General nonlinear statistics: Using randomized multivariate concentration, Berry–Esseen-type rates of are established for wide classes of estimators, including M-estimators and stochastic gradient descent averages, with explicit dependence on third moment and nonlinearity envelope (Shao et al., 2021).
- Conditional sums: For sums of independent random variables conditioned on another sum (e.g., occupancy, hashing, branching), a Berry–Esseen inequality with rate holds under moment and smoothing assumptions (Klein et al., 2019).
5. Berry–Esseen for Random Processes and Functional Laws
- Local limit theorems in : Explicit Berry–Esseen bounds in terms of Lyapunov coefficients , density maxima , and dimension are achieved for the uniform difference between convolution densities and the Gaussian, allowing control even for log-concave measures and symmetric cases (Bobkov et al., 30 Jul 2024).
- Breuer–Major functional CLT: For sums of functionals of stationary Gaussian sequences, Malliavin–Stein plus Gebelein's maximal correlation yield explicit bounds in total variation, optimal in rate under covariances and Hermite rank assumptions (Nourdin et al., 2018).
- Fast convergence under density assumptions: If i.i.d. summands match moments to order and have a small density piece, the Kolmogorov distance achieves rates plus exponentially small residual, sharply improving upon the classical (Johnston, 2023).
- Berry–Esseen for conditioned random walks: For random walks conditioned to stay positive, the convergence to Rayleigh limit law admits Berry–Esseen bounds, with all constants explicit and third-moment dependence cubic in the denominator (Denisov et al., 11 Dec 2024).
- Fractional Ornstein-Uhlenbeck and Gaussian-driven models: For ergodic (moment) estimators of drift under discrete observation, Berry–Esseen bounds hold for Hurst parameter , and for , uniformly in fixed mesh , even extending to various general Gaussian drivers (Tang et al., 3 Apr 2025).
6. Applications, Optimization, and Computational Techniques
Berry–Esseen bounds have critical impact in:
- Small deviation and probability inequalities: By combining Berry–Esseen bounds with moment semidefinite programming, new sharp lower bounds for small-deviation probabilities (Feige’s conjecture) are established (Guo et al., 2020).
- Sequential decoding complexity: Berry–Esseen bounds enable uniform upper estimates for decoding complexity in communications (GDA, MLSDA algorithms), valid for arbitrary blocklength and all SNR regimes [0701026].
Computational methods—gridding, interpolation, and local mass approximations—are essential for sharp constant estimation, particularly for lattice laws and Bernoulli variables, achieving global bounds up to above theoretical minimums (Zolotukhin et al., 2018).
7. Extensions to Free Probability
In noncommutative probability, Berry–Esseen-type inequalities for freely independent with only fourth moments assume explicit rates (Kolmogorov distance to semicircle law) , nearly matching the commutative case (Neufeld, 30 Mar 2025). Subordination of F-transforms facilitates this analysis, and further research aims to remove the -loss under minimal moment conditions.
In summary, Berry–Esseen type inequalities provide optimal and explicit quantitative bounds for normal approximation under a spectrum of independence, dependence, moment, and structural assumptions. Advances include dimension-explicit multivariate results, nonuniform inequalities suited for tail regimes, computational optimization of constants, improved rates under symmetry/density, extensions to functional and free-probability contexts, and powerful tools for modern statistical estimation and probability theory.