---
title: 'Confidence Sequences: Time-Uniform Inference'
url: https://www.emergentmind.com/topics/confidence-sequences
type: topic
---

# Confidence Sequences: Time-Uniform Inference

A confidence sequence (CS) is a sequence of confidence intervals or sets that provide time-uniform, finite-sample, and nonasymptotic coverage for a parameter of interest—such as a mean, quantile, or regression coefficient—across all possible sample sizes. For a target parameter $\theta$, a CS $\{C_t\}_{t=1}^\infty$ satisfies $\mathbb{P}(\forall t\ge 1: \theta \in C_t) \ge 1 - \alpha$, guaranteeing the prescribed coverage under arbitrary, even data-dependent, stopping rules. Confidence sequences unify concepts from classical confidence intervals, the law of the iterated logarithm, sequential probability ratio testing, and martingale theory, and are now central to robust, sequential inference in modern applications such as A/B testing, bandits, off-policy evaluation, risk-limiting audits, and robust anomaly detection.

## 1. Probabilistic Principle: Time-Uniform, Anytime-Valid Inference

A confidence sequence provides time-uniform frequentist error control. Formally, for a stream of data $X_1, X_2, \dots$, a $(1-\alpha)$ confidence sequence for parameter $\theta^*$ (e.g., a mean or quantile) is a sequence of sets $\{C_t\}$ where
\[
\mathbb{P}(\forall\,t \ge 1: \theta^* \in C_t) \ge 1 - \alpha .
\]
This holds over all potential stopping rules, including fully adaptive, data-dependent monitoring ("anytime-validity") [2302.10108][1810.08240]. These guarantees are enabled by constructing nonnegative supermartingales (processes whose expected future value, conditional on the past, never increases) and leveraging Ville's maximal inequality:
\[
\mathbb{P}\Bigl(\sup_{t \ge 1} M_t \ge 1/\alpha \Bigr) \le \alpha
\]
for any nonnegative supermartingale $M_t$ with $M_0=1$ [1810.08240]. Inverting the event $\{M_t(\theta^*) < 1/\alpha~\forall t\}$ yields the set-valued process $C_t$.

## 2. Construction Methodologies for Confidence Sequences

Multiple, highly general construction methodologies for confidence sequences have been developed, all based on martingale or supermartingale constructions. The most important methods, which apply in various parametric and nonparametric settings, include:

- **Exponential Supermartingale Approach (Sub-$\psi$):** Given a convex function $\psi$ (often a cumulant generating function), construct $L_t(\lambda) \ge \exp\left(\lambda S_t - \psi(\lambda) V_t \right)$ as a supermartingale. Here $S_t$ is a (centered) martingale sum and $V_t$ an adapted variance proxy. The confidence boundary $u_\alpha(v)$ is then solved so that $\mathbb{P}(\exists t: S_t > u_\alpha(V_t)) \le \alpha$ [1810.08240, 2202.01250].

- **Mixture Martingale and Bayesian Prior-Posterior Ratio Techniques:** Using conjugate mixtures or the prior-to-posterior ratio martingale yields CSs for a general class of models, including sampling without replacement [2006.04347] and arbitrary exponential families [2002.03658, 2506.22925, 2006.04347]. This yields closed-form or readily computable boundaries in, e.g., Gaussian, Bernoulli, or hypergeometric models.

- **Stitching and Peeling Techniques:** Divide intrinsic time $V_t$ into epochs; construct piecewise-linear or curved (finite-LIL rate) boundaries by union-bounding over epochs [1810.08240]. This is critical for achieving minimax (iterated-logarithm) shrinkage rates.

- **Gambling and Wealth-Process Frameworks:** Vielled through the coin-toss/two-horse-race setup for univariate means and extended to categorical, multivariate, and probability-vector means using universal portfolio and mixture-Dirichlet weights [2402.03683, 2207.12382].

- **Robust and Heavy-Tail Approaches:** Catoni-style and robust exponential supermartingales extend CSs to finite $p$-th moment data [2202.01250, 2208.03185, 2301.09573].

- **Generalized Linear Models via Online-to-Confidence-Set Reductions:** Low online log-loss regret in sequential prediction is shown to imply time-uniform confidence sets for GLM parameters [2504.16555].

## 3. Coverage Properties, Rates, and Optimality

Confidence sequences achieve non-asymptotic, exact or sharp asymptotic time-uniform coverage. Their widths decay with $t$ at minimax rates under mild assumptions:

| Regime / Model                          | Width of CS                   | Reference            |
|------------------------------------------|-------------------------------|----------------------|
| Sub-Gaussian / bounded variance          | $O(\sqrt{(\log \log t)/t})$   | [1810.08240, 2202.01250] |
| Bounded $p$-th moment ($1 < p < 2$)      | $O(n^{-(p-1)/p}

Source: https://www.emergentmind.com/topics/confidence-sequences