Composite Ville's Theorem Overview
- Composite Ville's Theorem is a nonparametric extension that unifies classical martingale results across a family of probability measures using e-processes.
- It characterizes composite null sets by the divergence of e-processes, ensuring robust sequential testing and inference under uncertainty.
- The theorem underpins key applications such as strong laws, minimax duality in game-theoretic probability, and advances in online learning.
Composite Ville's Theorem provides a fundamental extension of Ville's classical martingale theorem, enabling measure-theoretic and game-theoretic probability to be unified under a flexible, nonparametric framework. Rather than working under a single probability measure, composite Ville's theorem applies to arbitrary families of probability measures and utilizes "e-processes" as the correct generalization of nonnegative martingales. In this setting, events of outer measure zero—composite nullsets—are characterized by the existence of an e-process which explodes to infinity precisely when those events occur. This duality underlies robust sequential inference, strong laws, and minimax theorems in game-theoretic probability frameworks (Ruf et al., 2022, Frongillo, 24 Dec 2025).
1. Foundations and Definitions
Composite Ville’s theorem is set in the context of a filtered measurable space , with . Instead of fixing a single law, one prescribes a (possibly large, nonparametric) collection of probability measures on . The set of all –stopping times is denoted .
Two key constructs generalize classical tools:
- Inverse Capital Outer Measure: For ,
is an outer measure; is a composite nullset if 0.
- 1–e-Process: A nonnegative, 2–adapted process 3 with 4 such that for every stopping time 5,
6
For every 7, there exists a nonnegative 8–martingale 9 with 0 almost surely for all 1.
2. Formal Statement and Proof Outline
The composite Ville’s theorem provides necessary and sufficient conditions for an event being composite null and the existence of an e-process diverging on that event:
2
More generally, for 3,
4
Outline of proof:
- If 5: For each 6, exist 7 so that 8 and 9. Construct 0; this diverges on 1 and satisfies the e-process expectation bound.
- Only if 2 on 3: For 4, let 5. On 6, 7. Using the e-process property, 8. As 9, this ensures 0 (Ruf et al., 2022).
3. Game-Theoretic Probability and Minimax Duality
Composite Ville's theorem can be interpreted in two-player game-theoretic probability, where the Gambler selects strategies and the World selects outcome paths or probability measures. Three "prices" are relevant:
| Price | Definition | Context |
|---|---|---|
| Game-theoretic (Gambler first) | 1 | betting replication |
| Measure-theoretic (World first) | 2 | probabilistic |
| Composite (worst-case P) | 3 | robust consistency |
Minimax duality for sequential gambling states:
4
where 5 is the cumulative payoff of a strategy 6. This provides the foundation for supermartingale constructions that diverge on composite-null events (Frongillo, 24 Dec 2025).
4. Comparison with Classical Ville’s Theorem
Composite Ville subsumes the classical theorem:
- For singleton 7, 8 and 9–e–processes are precisely 0–martingales. The theorem reduces to: 1 iff exists nonnegative martingale 2 on 3.
- For general 4, inverse capital measure replaces probability, and e-processes replace martingales. Stopping times become composite tests with uniform type-I error control across 5 (Ruf et al., 2022).
5. Applications and Illustrative Examples
Composite Ville’s theorem underpins robust statistical inference and testing in nonparametric settings:
- Composite Strong Law of Large Numbers: For 6 any class of i.i.d.\ laws with 7 and uniform integrability,
8
satisfies 9. There exists an e-process which diverges on every violating sequence, unifying pathwise SLLNs across 0 (Ruf et al., 2022).
- Sequential Testing & Anytime-Valid Inference: Events with 1 admit e-processes 2 yielding level-3 sequential tests, 4, robust under composite nulls.
- Azuma–Hoeffding Bound: For bounded increments, composite Ville recovers pathwise Azuma–Hoeffding inequalities; e.g., 5.
- Online Learning: Sequential composite Ville structures supermartingales for regret bounds, recovering algorithms like exponential weights and mirror descent.
- Extensions: Framework supports composite versions of other limit laws (LIL, ergodic theorems), and tighter confidence sequences under minimal moment assumptions.
6. Technical Innovations and Inequalities
The composite Ville framework justifies e-processes as versatile generalizations of martingales, crucial in scenarios where no single process behaves as a martingale under all 6. Notable technical results include a new 7–type line-crossing inequality for random walks:
8
where 9 and only finite first moment is required. This sharpens the pathwise control over deviation probabilities in heavy-tailed, nonparametric regimes (Ruf et al., 2022).
7. Significance and Research Directions
Composite Ville’s theorem not only bridges measure-theoretic and game-theoretic probability, but constitutes the backbone for a minimax duality characterized in game-theoretic frameworks (Frongillo, 24 Dec 2025), advancing robust inference, law-of-large-numbers type results, and sequential testing in settings with uncertainty or adversarial data generation. This suggests further composite generalizations for other probabilistic limit laws and advances the use of e-processes in robust meta-analysis, exchangeability testing, and online learning methodologies. A plausible implication is that future research will refine minimax duality and extend composite Ville’s theorem to infinite-horizon and high-dimensional settings, leveraging e-processes and outer measures for nonparametric testing and confidence sequences.