---
title: Sub-Weibull Random Variables
url: https://www.emergentmind.com/topics/sub-weibull-random-variables
type: topic
---

# Sub-Weibull Random Variables

Sub-Weibull random variables form a tail class characterized by Weibull-type decay and used to interpolate between sub-Gaussian, sub-Exponential, and heavier-tailed stochastic models. In a standard convention, they satisfy bounds of the form
\[
\mathbb P(|X|\ge x)\le 2\exp\!\left(-\left(\frac{x}{K}\right)^{1/\theta}\right),
\]
with equivalent moment and Orlicz-type formulations; this framework now appears in concentration theory, stochastic optimization, distributed learning, random matrix theory, and stretched-exponential large deviations [1905.04955, 2105.09884, 2108.03285].

## 1. Definitions and parameter conventions

A widely used definition declares a real random variable \(X\) to be sub-Weibull with tail parameter \(\theta>0\) if there exists \(K_1>0\) such that
\[
\mathbb{P}(|X| \ge x) \le 2\exp\left( - (x/ K_1)^{1/\theta} \right), \quad x\ge 0.
\]
This is equivalent to the moment-growth condition
\[
\|X\|_k \le K_2 k^\theta,\qquad \forall k\ge 1,
\]
to MGF control for \(|X|^{1/\theta}\),
\[
\mathbb{E}\!\left[\exp\!\left((\lambda |X|)^{1/\theta}\right)\right]
\le \exp\!\left((\lambda K_3)^{1/\theta}\right),\qquad 0<\lambda\le \frac1{K_3},
\]
and to the one-point Orlicz bound
\[
\mathbb{E}\!\left[\exp\!\left((|X|/K_4)^{1/\theta}\right)\right]\le 2.
\]
This convention is used directly in the shorthand \(X\sim \mathrm{subW}(\theta,K)\), and it identifies \(\theta=\tfrac12\) with sub-Gaussian behavior and \(\theta=1\) with sub-Exponential behavior [1905.04955, 2108.03285, 2105.09884, 2506.12901].

The same class also appears in conditional and norm-based forms. In distributed optimization and SGD analyses, the assumption is often that the norm of a random vector, conditionally on the past filtration, is sub-Weibull:
\[
\mathbb E\left[\exp\left\{\left(\frac{\|\xi_{i,t}\|_*}{K}\right)^{1/\theta}\right\}\Big|F_{t-1}\right]\le 2,
\qquad
\mathbb E[\xi_{i,t}\mid F_{t-1}]=0.
\]
This formulation is tailored to adapted stochastic processes rather than iid scalar variables [2506.12901, 2006.05610].

Another strand of the literature uses a reversed exponent convention. In that notation, \(X\) is sub-Weibull when \(\|X\|_{\psi_\theta}<\infty\) and
\[
\mathbb P(|X|\ge x)\le e^{-(x/K)^\theta},
\]
so that \(\theta=1\) is sub-exponential and \(\theta=2\) is sub-Gaussian. This suggests that comparisons of “tail index” across papers require checking whether the exponent is written as \(1/\theta\) or \(\theta\) [2102.02450].

## 2. Equivalent formulations and structural properties

The sub-Weibull class is useful partly because it is stable under common algebraic operations. Under the moment-growth convention, if \(x_i\sim subW(\theta_i,\nu_i)\), then scalar multiplication preserves the class,
\[
ax \sim subW(\theta, |a|\nu),
\]
addition yields
\[
x_1+x_2 \sim subW(\max\{\theta_1,\theta_2\},\, \nu_1+\nu_2),
\]
and, when independence is available, products satisfy
\[
x_1x_2 \sim subW(\theta_1+\theta_2,\, \nu_1\nu_2).
\]
A power rule also holds:
\[
x^a \sim subW\!\left(a\theta,\; \nu^a\max\{1,a^{a\theta}\}\right), \qquad a>0,
\]
with the frequently used special case
\[
x^2 \sim subW(2\theta, 4^\theta \nu^2).
\]
These rules underpin many optimization proofs, because gradient-noise terms often enter through sums, products, or squares [2105.09884, 2108.03285, 1905.04955].

The class is nested in the sense that
\[
\theta_1\le \theta_2 \implies subW(\theta_1)\subset subW(\theta_2)
\]
under the \(1/\theta\)-exponent convention, so larger \(\theta\) corresponds to heavier tails. Translation and scaling change constants but not the tail order, and bounded or finitely supported random variables are included as special cases, either directly or via their sub-Gaussian membership [1905.04955, 2105.09884, 2109.06343].

Several works also emphasize that centering is not intrinsic to the definition. A sub-Weibull variable need not be mean-zero, a constant random variable is still sub-Weibull in the scale-based definition, and centered versions remain sub-Weibull with modified constants. In stochastic-process settings, one may impose mean-zero only on the noise increment, while the sub-Weibull assumption is placed on its norm or on each coordinate [2506.12901, 2006.05610, 2109.06343].

## 3. Concentration theory and tail inequalities

A basic high-probability consequence of the tail bound is that if \(x\sim subW(\theta,\nu)\), then
\[
\mathbb{P}\!\left(|x|\le \nu\, c(\theta)\,\log^\theta(2/\delta)\right)\ge 1-\delta,
\qquad
c(\theta)=\left(\frac{2e}{\theta}\right)^\theta.
\]
Equivalent forms appear throughout the optimization literature and are a main reason sub-Weibull modeling yields polylogarithmic, rather than polynomial, confidence penalties [2105.09884, 2108.03285, 2109.06343].

For sums of independent centered variables, recent work develops a mixed-tail theory with a sub-Gaussian regime for smaller deviations and a sub-Weibull regime for larger deviations. One formulation uses the generalized Bernstein-Orlicz function
\[
\phi_{\alpha,L}(x):=\exp\!\big(\min\{x^2,(x/L)^\alpha\}\big)-1,
\]
and proves for weighted sums \(X^*=\sum_i a_iX_i\) that
\[
\Pr(|X^*|\ge t)
\le
2\exp\!\left(
-\frac{1}{C(\alpha)}
\min\left\{
\frac{t^2}{\|a\odot \bar L\|_2^2},
\frac{t^\alpha}{\|a\odot L\|_\beta^\alpha}
\right\}
\right),
\]
with matching lower bounds in the sharpness analysis. A related constant-specified result controls the GBO norm of \(\sum_i w_iX_i\) and yields deviation bounds of the form
\[
\Pr \Big(|\sum_i w_iX_i| \ge 2eC(\theta)\|\bm b_X\|_2\{\sqrt t + L_n(\theta,\bm b_X)t^{1/\theta}\}\Big)\le 2e^{-t}.
\]
These results recover the classical sub-Gaussian and sub-exponential regimes as special cases while retaining explicit constants [2302.03850, 2102.02450].

For dependent data, a major development is the self-normalized Freedman-type inequality for martingale difference sequences with conditional sub-Weibull tails. This extends concentration beyond the sub-exponential threshold. In particular, when \(\theta>1\), the ordinary MGF of \(X\) may be infinite for all \(\lambda>0\), so classical MGF-based martingale arguments fail; the proof instead uses truncation plus self-normalization [2006.05610].

These concentration results feed directly into statistical procedures. Tight mixed-tail inequalities improve graphical-model inference by changing the sample-size condition for a leading error term from
\[
m+\log(q)^2=o(n)
\quad\text{to}\quad
m+\log(q)=o(n),
\]
and a log-log quantile regression estimator for the tail index is proposed via the slope in
\[
\log Y_{n-i+1,n}
\quad \text{vs.} \quad
\log\log(n/i).
\]
The same 2019 study cites a theorem of Vladimirova et al. stating that, for Bayesian neural networks with standard Gaussian priors, units in layer \(\ell\) are sub-Weibull with tail parameter
\[
\theta=\frac{\ell}{2},
\]
showing that depth can induce progressively heavier tails at finite width [2302.03850, 1905.04955].

## 4. Sub-Weibull noise in optimization and learning

In online stochastic optimization, sub-Weibull assumptions allow nonasymptotic analyses under heavier-tailed gradient errors. For online gradient descent with
\[
\mathbf d_t=\nabla f_t(\mathbf x_t)+\mathbf e_t,
\qquad
\|\mathbf e_t\|\sim \mathrm{subW}(\theta,K_t),
\]
and step size \(\eta=1/L\), the regret recursion under the Polyak–Łojasiewicz condition takes the form
\[
r_{t+1}\le \left(1-\frac{\mu}{L}\right)r_t+\psi_{t+1}+\frac{1}{2L}\|\mathbf e_t\|^2.
\]
This yields expectation bounds, iteration-wise high-probability bounds with
\[
h(\theta,\delta)=\log^{2\theta}(2\delta^{-1})\left(\frac{e}{\theta}\right)^{2\theta},
\]
and the almost sure asymptotic estimate
\[
\limsup_{t\to\infty} r_t \le \frac{1}{2\mu}\bar e+\frac{L}{\mu}\bar\psi \quad \text{a.s.}
\]
The corresponding proximal-gradient recursion under the proximal-PL condition replaces the quadratic noise term by \(2D\|\mathbf e_t\|\), again giving linear convergence up to a noise- and variability-dependent floor [2108.03285].

A broader operator-theoretic framework models stochastic algorithms as iterated stochastic operators with additive sub-Weibull errors and random coordinate updates. In this setting the noise is persistent rather than vanishing, and the analysis gives mean and high-probability convergence to a neighborhood determined by the contraction factor, coordinate-update probabilities, temporal drift, and the sub-Weibull scale parameter. The same framework is motivated explicitly by federated learning, where stochastic gradients, compression, and asynchrony all produce non-Gaussian additive errors [2105.09884].

Sub-Weibull noise also appears in nonconvex SGD, feedback-based control optimization, and distributed mirror descent. For nonconvex SGD, conditional norm sub-Weibull gradient noise supports high-probability convergence with logarithmic dependence on failure probability, and the martingale part of the proof uses the sub-Weibull Freedman inequality. In feedback-based projected gradient with intermittent measurements, the combined gradient error norm satisfies a sub-Weibull bound and the tracking error obeys both expectation and high-probability estimates under Bernoulli update availability. In distributed composite stochastic mirror descent over time-varying multi-agent networks, conditional norm sub-Weibull gradient noise yields high-probability convergence rates of order \(O(1/\sqrt{T})\) up to polylogarithmic factors, without smoothness or strong convexity assumptions and without gradient clipping or truncation [2006.05610, 2109.06343, 2506.12901].

## 5. Related Weibull-type regimes and analytical models

One important sub-Weibull regime is the stretched-exponential case
\[
\mathbb P(X_i=k)=c\,e^{-k^\alpha},
\qquad \alpha\in(0,1),
\]
studied under conditioning on a large sum. These variables have finite moments of all orders but no finite positive exponential moment,
\[
\mathbb E[e^{tX_i}]=\infty \quad \text{for all } t>0.
\]
Under the conditioning
\[
S_n=\mu n+s\,n^\gamma,
\qquad
\gamma=\frac{1}{2-\alpha},
\]
the maximum and the reversed order statistics satisfy large deviation principles at speed
\[
n^{\gamma\alpha}=n^{2\gamma-1}.
\]
The resulting rate function for the maximum is non-convex and obeys a Bellman-type recursion, reflecting a competition between a big-jump mechanism and a Gaussian bulk mechanism [2405.17319].

A distinct but related regime arises for light-tailed Weibull-like sums with tails asymptotic to
\[
\exp\{-c x^\beta\}, \qquad \beta>1.
\]
Here the tail decays faster than exponential, and large values of \(S_n=\sum_{i=1}^n X_i\) are typically produced by all summands being of order \(x/n\). The asymptotics are governed by a Laplace or saddlepoint principle rather than the “single big jump” principle. This analysis is presented as a tail-based reformulation and extension of earlier density-based results of Rootzén (1987) and Balkema, Klüppelberg, and Resnick (1993) [1712.04070].

Weibull variables also serve as canonical models in geometric functional analysis. For iid symmetric Weibull variables with
\[
\mathbb P(|X|\ge t)=e^{-t^r},\qquad r\in[1,2],
\]
one has moment growth \(\|X\|_\rho\sim \rho^{1/r}\), and two-sided Chevet-type inequalities lead to sharp operator-norm estimates for random matrices and their submatrices. The parameter \(r\) interpolates continuously between the exponential and Gaussian regimes. A different line of work constructs asymmetric generalized Weibull laws as scale-location or variance-mean mixtures of normal laws, producing two-sided Weibull-type tails that are motivated by stopped random walks and financial modeling [2309.04214, 1506.06232].

## 6. Scope, special cases, and recurrent points of confusion

A recurrent source of confusion is that “sub-Weibull” is a family of parameterizations rather than a single universal notation. In the \(1/\theta\)-exponent convention, \(\theta=\tfrac12\) is sub-Gaussian and larger \(\theta\) means heavier tails; in the \(\psi_\theta\) convention, \(\theta=2\) is sub-Gaussian and larger \(\theta\) means lighter tails. Bounded or finitely supported variables are included in both viewpoints, either directly or through their sub-Gaussian membership [1905.04955, 2105.09884, 2109.06343].

A second point is that sub-Weibull control concerns transformed exponential moments or moment growth, not necessarily the ordinary MGF of \(X\). The condition
\[
\mathbb E\exp\!\left((|X|/K)^{1/\theta}\right)\le 2
\]
may hold even when
\[
\mathbb E[e^{\lambda |X|}]=\infty \quad \text{for all } \lambda>0,
\]
as happens in stretched-exponential regimes and in the martingale analysis beyond the sub-exponential threshold. This distinction is central to why sub-Weibull concentration requires different tools from classical Hoeffding-, Bernstein-, or Freedman-type arguments [2006.05610, 2405.17319].

A third point is terminological. Some papers use “Weibull-like” for stretched-exponential heavy tails with exponent in \((0,1)\), others for faster-than-exponential light tails with exponent \(>1\), and still others for canonical \(\psi_r\) variables with \(r\in[1,2]\). This suggests that the common feature is the functional form of the tail envelope rather than a single probabilistic regime. Across these settings, the main analytical benefit remains the same: sub-Weibull models preserve explicit, often sharp, dependence on tail parameters while covering phenomena that lie outside the strictly sub-Gaussian and sub-exponential classes [2102.02450, 1712.04070, 2309.04214].

Source: https://www.emergentmind.com/topics/sub-weibull-random-variables