Non-uniform Berry–Esseen Bounds
- The non-uniform Berry–Esseen bound refines classical CLT rates by providing pointwise error estimates with explicit dependence on the approximation point z.
- It employs techniques like Fourier smoothing, Stein’s method, and Malliavin calculus to achieve precise control over moderate deviations and tail probabilities.
- These bounds are crucial for accurate rare-event probability estimation and statistical inference in settings such as dependent, martingale, and self-normalized sequences.
A non-uniform Berry–Esseen (BE) bound is a refinement of classical central limit theorem (CLT) rates, providing pointwise bounds on the Kolmogorov distance between the distribution of a normalized sum or functional and the normal law, with an explicit dependence on the approximation point rather than only a global supremum. Such bounds take the form (error term decaying in ), and are crucial for precise quantitative control in the moderate and large deviations regimes, especially for rare-event probability estimation and statistical inference involving extreme quantiles. The literature provides a spectrum of techniques—Fourier smoothing, Stein's method, Malliavin calculus, and concentration inequalities—producing a variety of non-uniform BE bounds across classical, dependent, functional, martingale, and self-normalized settings.
1. Fundamental Forms and Historical Milestones
The archetype for non-uniform BE bounds arises from sums of independent real random variables with , , and . The original bound of Nagaev (1965/1976) and subsequent sharp versions state
where and . The uniform (classical) BE bound lacks the explicit 0-dependence and is typically, for iid, 1. The best-known uniform constant 2 is within 15% of optimality, but 3 has only recently been reduced to 4 (Pinelis, 2013).
Advancements include:
- Smoothing inequalities delivering optimal constants (Pinelis, 2013, Pinelis, 2013).
- Non-uniform bounds for functionals (chaos, martingales, Poisson, self-normalized, exchangeable pair regimes).
- Replacement of polynomial decay 5 by exponential 6 as achievable under additional tail or moment conditions.
2. Methodological Paradigms
2.1 Fourier Analytic Smoothing and Truncation
The classical approach by Nagaev involves a blend of truncation, Cramér–Esséen tilting for moderate deviations, and exponential tail inequalities beyond the uniform-case range. The introduction of smoothing inequalities (cf. Prawitz filter, symmetric kernels) enables direct passage from characteristic function bounds to non-uniform error estimates, bypassing delicate explicit density/Edgeworth expansions, and yielding improvements such as
7
with 8 as small as 9–0 for suitable filtering and numerical optimization (Pinelis, 2013, Pinelis, 2013).
2.2 Stein's Method and Concentration
Stein's method, when coupled with concentration inequalities, provides a flexible framework for both normal and non-normal approximation in classical and dependent settings. The central technical element is the construction and control of the solution 1 to the Stein equation,
2
with explicit bounds on 3, 4, and higher derivatives allowing one to obtain non-uniform Kolmogorov error bounds via tailored moment and concentration controls (Pinelis, 2011, Thành et al., 15 Feb 2025, Thành et al., 20 Jun 2025).
2.3 Malliavin–Stein Theory
In functionals of Gaussian, Poisson, or Rademacher processes (e.g., multiple Wiener–Itô integrals), the Malliavin–Stein approach gives non-uniform BE bounds depending on Malliavin-derivative-based quantities such as
5
and controls the error via
6
with 7 in an appropriate Sobolev space 8 (Dung et al., 2024, Butzek et al., 2024).
3. Key Theorems and Typical Non-uniform Bounds
3.1 Sums of Independent Variables
| Setting | Pointwise Bound | Reference |
|---|---|---|
| Classical iid sum | 9 | (Pinelis, 2013, Pinelis, 2013) |
| Exponential decay (3rd mom) | 0 | (Pinelis, 2011) |
| Higher moments 1 | 2 | (Pinelis, 2011) |
3.2 Exchangeable Pairs
For an exchangeable pair 3 with
4
and under finite 5-moment, unbounded 6, the general non-uniform BE bound reads
7
with 8 collecting 9 deviations from ideal conditional variance, regression remainders, and large/small jump controls (Thành et al., 15 Feb 2025, Liu et al., 2019).
3.3 Functionals of Gaussian and Poisson Processes
For 0, 1, 2,
3
with 4. For multiple Wiener–Itô integrals 5, 6 and explicit exponential tail controls are available for 7 (Butzek et al., 2024, Dung et al., 2024).
3.4 Martingales
For a martingale difference array satisfying the conditional Bernstein condition,
8
with model-specific expressions for 9 in terms of 0 controlling tail and quadratic variation deviations (Fan et al., 2016, Wu et al., 2021).
4. Applications and Model-Specific Instantiations
- Multiple Wiener–Itô integrals: Non-uniform bounds decay exponentially in 1, critical for CLTs in fixed Wiener chaos (Dung et al., 2024, Butzek et al., 2024).
- Exponential functionals of Brownian motion: Quantitative non-uniform bounds track the deviation of the normalized functional from normality in settings with heavy tailed or log-normal upper tails (Dung et al., 2024).
- Spin Model Macroscopic Observables: In mean-field Curie–Weiss and 2-vector models, non-uniform bounds for magnetization or squared spin length achieve optimal 3 uniform rates with an additional decay in 4 (Thành et al., 15 Feb 2025, Thành et al., 20 Jun 2025).
- Martingale Regression and Self-normalization: Adapted regression statistics and self-normalized CLTs inherit polynomial or exponential tail decay via non-uniform BE inequalities, sidestepping strong moment or independence assumptions (Fan et al., 2016, Wu et al., 2021).
- Studentized U-Statistics: Necessary correction terms of exponential type are introduced to avoid failures in naive non-uniform bounds due to vanishing denominators, ensuring valid rates for 5-statistic and higher-degree kernels (Leung et al., 2023).
- Weakly Dependent Sequences: Stationary Markov chains, dynamical systems, and products of random matrices allow non-uniform BE and Edgeworth expansion with rate 6 under general cumulant-derivative controls (Hafouta, 2022).
5. Technical Proof Elements and Optimality
5.1 Stein–Malliavin Integration by Parts
In Gaussian and Poisson functionals, the key representation
7
enables a split of the error over small and large 8 via tailored bounds for 9 and 0. The Cauchy–Schwarz step and concentration inequalities enable exponential or polynomial tail decay, with constants coming from precise operator norms or Malliavin derivatives (Dung et al., 2024, Butzek et al., 2024).
5.2 Moment Truncation and Smoothing
Smoothing inequalities using compactly supported filters applied to the characteristic function produce directly the necessary 1 factor and uniform constants, as in
2
with further refinements tied to the chosen filter, truncation scales, and analysis of remainder terms in the Edgeworth expansion (Pinelis, 2013, Pinelis, 2013).
6. Optimality, Limitations, and Extensions
- The 3 prefactor is optimal whenever only a finite 4th moment is assumed for 5, and cannot in general be replaced by exponential decay unless stronger sub-Gaussian cores or concentration hold (Butzek et al., 2024).
- In functionals of Poisson and Rademacher variables, second-order Poincaré inequalities enable more granular control involving Malliavin operators up to order 2, permitting explicit decomposition of the error into leading and higher-order components (Butzek et al., 2024).
- For Studentized statistics, naive non-uniform bounds may fail due to rare events where the denominator is vanishingly small. Here, adding a (sharp, necessary) exponentially small correction term restores validity (Leung et al., 2023).
- In exchangeable-pair-based normal approximation, unbounded difference settings are now included with explicit control on large jumps, polynomial tail factors, and remainders (Thành et al., 15 Feb 2025, Liu et al., 2019).
7. Summary Tables: Representative Non-uniform Berry–Esseen Bounds
| Class | Error Form | Decay in 6 | Key Condition | Reference |
|---|---|---|---|---|
| iid sum | 7 | Polynomial | 8 | (Pinelis, 2013) |
| Sums (exp decay) | 9 | Exponential | 0 | (Pinelis, 2011) |
| Martingale | 1 | Exponential | Conditional Bernstein condition | (Fan et al., 2016) |
| Functionals (Gaussian/Poisson) | 2 | Polynomial | 3, 4 | (Butzek et al., 2024) |
| Exchangeable pair | 5 | Polynomial | 6 finite | (Thành et al., 15 Feb 2025) |
References
- "More on the nonuniform Berry--Esseen bound" (Pinelis, 2013)
- "On the nonuniform Berry--Esseen bound" (Pinelis, 2013)
- "Non-uniform Berry-Esseen bounds via Malliavin-Stein method" (Dung et al., 2024)
- "Non-uniform Berry--Esseen bounds for Gaussian, Poisson and Rademacher processes" (Butzek et al., 2024)
- "Improved nonuniform Berry--Esseen-type bounds" (Pinelis, 2011)
- "Non-uniform Berry--Esseen bounds for exchangeable pairs with applications..." (Thành et al., 15 Feb 2025)
- "Non-uniform Berry-Esseen Bound by Unbounded Exchangeable Pair Approach" (Liu et al., 2019)
- "Nonuniform Berry-Esseen bounds for Studentized U-statistics" (Leung et al., 2023)
- "Nonuniform Berry-Esseen bounds for martingales..." (Fan et al., 2016)
- "Non-uniform Berry-Esseen theorem and Edgeworth expansions..." (Hafouta, 2022)
- "Nonuniform Berry-Esseen bound for self-normalized martingales" (Wu et al., 2021)
- "Non-uniform bounds for non-normal approximation via Stein's method..." (Thành et al., 20 Jun 2025)