Papers
Topics
Authors
Recent
Search
2000 character limit reached

The Exact Worst-Case Tail Probability under Bounded Kurtosis

Published 6 Jul 2026 in math.PR, math.ST, and stat.ML | (2607.05226v2)

Abstract: We determine exactly what a kurtosis bound buys for one-sided tail control. For the class C(κ)\mathcal{C}(κ) of real random variables with mean $0$, variance $1$, and fourth moment at most κκ, the skewness left free, we compute the worst-case tail probability V1(t,κ)=supXC(κ)P(Xt)V_1(t,κ)=\sup_{X\in\mathcal{C}(κ)}\mathbb{P}(X\geq t) for every threshold $t&gt;0$ and every κ1κ\geq 1. The answer is a four-regime map: a Cantelli tongue b(κ)tc(κ)b(κ)\le t\le c(κ) on which the two-moment bound $1/(1+t2)$ remains tight and the kurtosis constraint is worthless; a tail regime tc(κ)t\geq c(κ) with the closed form V1=(κ1)/((t<sup>21)<sup>2+κ1)V_1=(κ-1)/((t<sup>2-1)<sup>2+κ-1); a plateau regime, present only for κ3/2κ\le 3/2, on which the worst case freezes and the value does not depend on tt; and a central regime described exactly by an explicit algebraic system, provably admitting no closed form in nested square roots. Beyond c(κ)c(κ) the one-sided and two-sided worst cases coincide: Cantelli's improvement over Chebyshev is annihilated by fourth-moment information. The minimal degree of a sum-of-squares proof of the tight bound is $2$ on the closed tongue and $4$ everywhere else, an exact phase diagram of proof degree. Every closed-form regime carries an explicit dual certificate and an explicit extremal distribution, re-verified on parameter grids by an independent checker in exact arithmetic. The closed forms invert to exact worst-case quantiles, sharpen a median-of-means constant, and give the exact per-direction tail available to degree-4 reasoning under certifiable kurtosis. We found the map through an AI-guided search around the certifying pipeline, LemmaForge, which is validated on classical benchmarks, independently reproduces the symmetric-slice bound of Zelen (1954), and recovers the 2332\sqrt{3}-3 constant of He, Zhang, and Zhang (2010) at t=0t=0.

Summary

  • The paper precisely determines the worst-case tail probability under mean, variance, and bounded kurtosis constraints using explicit regime maps and matching extremal distributions.
  • It introduces a four-regime phase diagram with sharp expressions and minimal SOS proof degrees to certify each regime’s tail bound.
  • Applications include robust statistics, median-of-means estimation, and margin-based error bounds, improving high-confidence inference under weak moment assumptions.

Exact Worst-Case One-Sided Tail Probability with Bounded Kurtosis

Problem Formulation and Motivation

The paper "The Exact Worst-Case Tail Probability under Bounded Kurtosis" (2607.05226) addresses a longstanding open question regarding the tightest achievable upper bound on the one-sided tail probability of real random variables, subject to constraints on the first, second, and fourth moments (mean zero, unit variance, and bounded kurtosis, respectively), with the third moment (skewness) left completely unconstrained. This problem is highly relevant in robust statistics, learning theory (especially SoS-based algorithms), and applications where only partial moment information is available — a setting ubiquitous in modern subgaussianity certification pipelines.

Specifically, for the class

C={X:EX=0,EX2=1,EX4κ},κ1,C = \left\{ X : \mathbb{E}X = 0,\, \mathbb{E}X^2 = 1,\, \mathbb{E}X^4 \leq \kappa \right\},\quad \kappa \geq 1,

the goal is to determine, for any t>0t>0,

V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)

with the supremum taken over all distributions in CC.

This formulation is distinguished from classical results such as Zelen’s and Royden’s, which pin all moments up to degree four, including skewness, or only provide partial or asymptotic solutions in the kurtosis-constrained, skewness-free case. The current work resolves this gap by providing a closed-form complete answer across all (t,κ)(t, \kappa) pairs, together with explicit extremal distributions and sum-of-squares certificates, rendering every claim algorithmically verifiable and suitable for downstream application.

The Four-Regime Phase Map

The major contribution is a four-regime phase diagram partitioning the (t,κ)(t, \kappa) plane according to which moment constraints are active, and where closed-form, certified upper bounds coincide with explicit extremal distributions.

Immediately after the introduction, the global structure of V1(t,κ)V_1(t, \kappa) is illustrated. Figure 1

Figure 1: The regime partition of the (t,κ)(t, \kappa) map, with explicit boundaries. The "tongue" region identifies where kurtosis adds no power; outside, the structure transitions to regimes where kurtosis is tight.

The regimes are:

  • Regime I (Cantelli tongue, b(κ)tc(κ)b(\kappa) \le t \le c(\kappa), equivalently κθ(t)\kappa \ge \theta(t)): Kurtosis is irrelevant, and the two-moment Cantelli upper bound is tight:

t>0t>00

attained by a two-point law on t>0t>01.

  • Regime II (tail, t>0t>02): The kurtosis budget is binding, and the sharp value is

t>0t>03

with extremal distribution a skewed three-point law on t>0t>04 with explicit weights and t>0t>05 depending on t>0t>06 and t>0t>07.

  • Regime IIIa (plateau, only for t>0t>08): For thresholds t>0t>09 below V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)0 but above a computable lower bound, the maximum is frozen, independent of V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)1,

V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)2

with a two-point extremal measure.

  • Regime IIIb (central regime): For small V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)3 and moderate V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)4, the value is characterized by an explicit algebraic system for a three-point distribution; closed-form roots or nested radicals are provably impossible for generic points, a fact certified by explicit computation of minimal polynomials with degree exceeding two.

All regime transitions and boundaries are given by explicit algebraic expressions in V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)5 and V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)6 (e.g., V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)7).

Numerical Comparison With Classical and Non-Sharp Bounds

The obtained bounds strongly tighten classical Chebyshev-Cantelli and naive fourth-moment Markov inequalities as soon as the kurtosis constraint becomes binding. This is starkly evident in the regime V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)8:

  • Chebyshev’s two-sided bound decays as V1(t,κ)=supXCP(Xt)V_1(t, \kappa) = \sup_{X \in C} \mathbb{P}(X \geq t)9.
  • Cantelli’s one-sided, two-moment bound is CC0.
  • The fourth-moment Markov bound yields CC1.
  • The new sharp bound improves the coefficient of CC2 by a nontrivial factor of CC3, which can be significant for small CC4.

This relationship is made explicit for CC5 in the following log-scale plot. Figure 2

Figure 2: The sharp map for CC6 compared to Cantelli, the fourth-moment Markov bound, and Zelen’s symmetric bound. The multiplicative gap quantifies the effective value of kurtosis information for tail risk.

The third-moment (skewness) freedom in CC7 is essential: bounds for the skewness-pinned or symmetric class can be strictly smaller. At CC8, for example, the sharp value is CC9 under freedom, but (t,κ)(t, \kappa)0 with symmetry pinned — exactly the (provable) price of not knowing the skewness.

Structural Transitions of Extremal Distributions

The extremal (worst-case) distributions emanating from each regime reveal intricate structural transitions in support:

  • On the Cantelli tongue and the plateau—pure two-point laws.
  • In Regimes II and IIIb—genuine three-point laws, with or without an atom placed exactly at the threshold.

These transitions, and the differences in their support and skewness, are visualized: Figure 3

Figure 3: Extremal worst-case distributions (atoms and weights) across the regimes. Note the change from two-point supports (I, IIIa) to skewed three-point configurations (II, IIIb).

Sum-of-Squares Proof Degree and Certificate Complexity

A major theoretical innovation is the identification of a proof complexity phase transition for the sharp tail bound, quantified by the minimal degree of a sum-of-squares (SOS) polynomial certificate needed to certify each regime’s bound. On the Cantelli tongue, degree-2 suffices, whereas degree-4 is necessary and sufficient elsewhere, matching the combinatorial structure of extremal measures and the dual solution in the corresponding SDP.

This result provides both theoretical insight for proof-complexity and practical guidelines for SoS-based algorithm deployments: lower-degree proofs are optimal precisely where the kurtosis constraint is uninformative, while higher-degree certificates are necessary as soon as the kurtosis becomes binding.

Methodology: Certified Automation and Machine-Verified Certificates

The discovery and validation pipeline, LemmaForge, systematically integrates numerical SDP solving (Clarabel, SCS), integer relation detection, symbolic rationalization, and explicit sum-of-squares decomposition, capped by a fully independent exact arithmetic checker. All sharp values are certified with explicit polynomial certificates and extremal discrete laws, machine-verifiable line-by-line. Degenerate and unattainable cases are exhaustively and conservatively labeled. Every instance is cross-checked by discretized LPs and multiple code paths for reliability.

This approach enables:

  • Complete application-ready tables of certified tail bounds.
  • Error-resilient algorithms for downstream worst-case analysis, value-at-risk, and estimators.
  • Rigorous artifact archives (code, certificates, instances) for reproducibility and extension.

Theoretical and Practical Implications

These results have direct implications in multiple fields:

  • Robust high-dimensional statistics: Certifiable subgaussianity and robust moment estimators often invoke bounded kurtosis. These tight constants replace loose Markov/Chebyshev estimates, yielding tighter confidence intervals and sharper deviation inequalities.
  • Median-of-means and algorithmic construction: Precise Kurkosis-improved constants for block assignment in median-of-means estimators, improving the critical deviation exponent over Chebyshev from (t,κ)(t, \kappa)1 to (t,κ)(t, \kappa)2 in the i.i.d. case with bounded kurtosis.
  • Value-at-risk and stress testing: Closed-form quantile thresholds for chance constraints under fourth-moment information with skewness unknown; large improvements over traditional bounds.
  • Sum-of-squares algorithms: Degree-4 SoS certificates are precisely necessary and sufficient outside the tongue, providing templates for algorithm designers and complexity theorists regarding proof degree lower bounds.

Limitations and Potential Extensions

The central regime (IIIb) lacks a closed-form expression in nested radicals, a fact proven by explicit computation of irreducible minimal polynomials of degree exceeding two. For those points, certified algebraic system solutions and sandwich certificates are provided, but symbolic formulas are impossible. The regime map, proof-degree locus, and all downstream results generalize to the equality-constraint case and can be directly extended via the same machinery to higher moments, constrained supports (e.g., one-sided classes), and certain matrix settings, with promising implications for more complex measure concentration domains and SoS proof complexity landscapes.

Conclusion

This paper provides a complete, constructive solution to the worst-case one-sided tail probability problem under a kurtosis constraint with free skewness, filling a longstanding gap in the analytic and algorithmic literature. The multifaceted regime structure, sharp constants, explicit extremal measures, and machine-verifiable SoS certificates together constitute a robust toolkit for both theoretical analysis and practical algorithm design in robust statistics, learning theory, and risk management. The methodology and results serve as a template for future work at the intersection of probability, optimization, and proof complexity.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.