Composite Ville's Theorem Overview
- Composite Ville's Theorem is a nonparametric extension that unifies classical martingale results across a family of probability measures using e-processes.
- It characterizes composite null sets by the divergence of e-processes, ensuring robust sequential testing and inference under uncertainty.
- The theorem underpins key applications such as strong laws, minimax duality in game-theoretic probability, and advances in online learning.
Composite Ville's Theorem provides a fundamental extension of Ville's classical martingale theorem, enabling measure-theoretic and game-theoretic probability to be unified under a flexible, nonparametric framework. Rather than working under a single probability measure, composite Ville's theorem applies to arbitrary families of probability measures and utilizes "e-processes" as the correct generalization of nonnegative martingales. In this setting, events of outer measure zero—composite nullsets—are characterized by the existence of an e-process which explodes to infinity precisely when those events occur. This duality underlies robust sequential inference, strong laws, and minimax theorems in game-theoretic probability frameworks (Ruf et al., 2022, Frongillo, 24 Dec 2025).
1. Foundations and Definitions
Composite Ville’s theorem is set in the context of a filtered measurable space , with . Instead of fixing a single law, one prescribes a (possibly large, nonparametric) collection of probability measures on . The set of all –stopping times is denoted .
Two key constructs generalize classical tools:
- Inverse Capital Outer Measure: For ,
is an outer measure; is a composite nullset if .
- –e-Process: A nonnegative, –adapted process with such that for every stopping time ,
For every , there exists a nonnegative –martingale with almost surely for all .
2. Formal Statement and Proof Outline
The composite Ville’s theorem provides necessary and sufficient conditions for an event being composite null and the existence of an e-process diverging on that event:
More generally, for ,
Outline of proof:
- If : For each , exist so that and . Construct ; this diverges on and satisfies the e-process expectation bound.
- Only if on : For , let . On , . Using the e-process property, . As , this ensures (Ruf et al., 2022).
3. Game-Theoretic Probability and Minimax Duality
Composite Ville's theorem can be interpreted in two-player game-theoretic probability, where the Gambler selects strategies and the World selects outcome paths or probability measures. Three "prices" are relevant:
| Price | Definition | Context |
|---|---|---|
| Game-theoretic (Gambler first) | betting replication | |
| Measure-theoretic (World first) | probabilistic | |
| Composite (worst-case P) | robust consistency |
Minimax duality for sequential gambling states:
where is the cumulative payoff of a strategy . This provides the foundation for supermartingale constructions that diverge on composite-null events (Frongillo, 24 Dec 2025).
4. Comparison with Classical Ville’s Theorem
Composite Ville subsumes the classical theorem:
- For singleton , and –e–processes are precisely –martingales. The theorem reduces to: iff exists nonnegative martingale on .
- For general , inverse capital measure replaces probability, and e-processes replace martingales. Stopping times become composite tests with uniform type-I error control across (Ruf et al., 2022).
5. Applications and Illustrative Examples
Composite Ville’s theorem underpins robust statistical inference and testing in nonparametric settings:
- Composite Strong Law of Large Numbers: For any class of i.i.d.\ laws with and uniform integrability,
satisfies . There exists an e-process which diverges on every violating sequence, unifying pathwise SLLNs across (Ruf et al., 2022).
- Sequential Testing & Anytime-Valid Inference: Events with admit e-processes yielding level- sequential tests, , robust under composite nulls.
- Azuma–Hoeffding Bound: For bounded increments, composite Ville recovers pathwise Azuma–Hoeffding inequalities; e.g., .
- Online Learning: Sequential composite Ville structures supermartingales for regret bounds, recovering algorithms like exponential weights and mirror descent.
- Extensions: Framework supports composite versions of other limit laws (LIL, ergodic theorems), and tighter confidence sequences under minimal moment assumptions.
6. Technical Innovations and Inequalities
The composite Ville framework justifies e-processes as versatile generalizations of martingales, crucial in scenarios where no single process behaves as a martingale under all . Notable technical results include a new –type line-crossing inequality for random walks:
where and only finite first moment is required. This sharpens the pathwise control over deviation probabilities in heavy-tailed, nonparametric regimes (Ruf et al., 2022).
7. Significance and Research Directions
Composite Ville’s theorem not only bridges measure-theoretic and game-theoretic probability, but constitutes the backbone for a minimax duality characterized in game-theoretic frameworks (Frongillo, 24 Dec 2025), advancing robust inference, law-of-large-numbers type results, and sequential testing in settings with uncertainty or adversarial data generation. This suggests further composite generalizations for other probabilistic limit laws and advances the use of e-processes in robust meta-analysis, exchangeability testing, and online learning methodologies. A plausible implication is that future research will refine minimax duality and extend composite Ville’s theorem to infinite-horizon and high-dimensional settings, leveraging e-processes and outer measures for nonparametric testing and confidence sequences.