Stochastic Conditioning in Regenerative Processes
- Stochastic conditioning is a framework that generalizes regeneration by defining breakpoints using both past-dependent and future-dependent events.
- The methodology identifies regeneration times through intersecting events, ensuring i.i.d. or one-dependent cycles via stationarity and monotonicity conditions.
- Applications span particle systems, infinite-bin models, and Harris ergodic chains, enabling robust limit theorems and convergence results in stochastic processes.
Stochastic conditioning refers to techniques and frameworks where the conditional structure of random processes, or their regenerative properties, depend both on future and past events. This architecture enables the systematic identification of regeneration times (random break points) in stochastic sequences under broad conditions, extending beyond the classical domain of stopping times, which are adapted only to the past. The notion is especially powerful in ergodic theory, stochastic particle systems, and models with memory or path dependence.
1. Fundamental Concepts of Stochastic Conditioning
Stochastic conditioning generalizes classical regeneration by allowing regeneration or break-points to be defined by events that depend on both the entire past and the (possibly infinite) future trajectory of a process. Formally, for a discrete-time stochastic process, two families of events are defined for every :
- Past-dependent events: , measurable with respect to information up to and including time .
- Future-dependent events: , measurable with respect to information from time onwards.
The regeneration events are then given by . The process "regenerates" at times defined recursively by
Under suitable regularity (stationarity, strictly positive probability, and monotonicity) assumptions, the intervals (or cycles) between these regeneration times are shown to be i.i.d., or at least one-dependent under weaker separation conditions (Foss et al., 2012).
This framework subsumes various ad hoc constructions for identifying regenerative structures, bringing together approaches from renewal processes, Markov chains, and diskrete particle systems.
2. Stationarity and Monotonicity Conditions
The regenerative theory developed in (Foss et al., 2012) requires the following core conditions:
- Stationarity: The future event sequence is strictly stationary, and each occurs with positive probability.
- Monotonicity (future event linking): For all , , there exist "linking" events (stationary in ) such that
This ensures the conditioning on increasingly many future events does not corrupt the independence of cycles via accumulated dependencies.
A key distributional formula emerges:
for all and some normalizing constant . Thus, the inter-regeneration time law is governed by the distribution of the linking events.
3. Extension to Functionals and One-Dependence
Beyond identifying i.i.d. cycles, the theory encompasses functionals of the process that depend on the increments between regeneration times. Specifically, for a sequence of process increments , if after occurs depends only on the future—in the sense that can be written as a measurable function , with representing the i.i.d. driving noise—then the vectors
are themselves i.i.d. across cycles (or one-dependent if minimal separation is imposed and functionals can depend on a finite "window" into the past).
This structure is essential for proving strong limit theorems (LLNs, CLTs) for additive functionals in stochastic processes with history- or future-dependent randomization.
4. Applications to Particle Systems and Infinite-Bin Models
Discrete-time Contact Processes:
- Two-state contact process: The future event is defined as the event that the process starting from the configuration at time "survives" indefinitely (e.g., the infection propagates to infinity). With , the process's rightmost (or leftmost) infected site between regenerations is i.i.d., enabling direct proofs of laws of large numbers and central limit theorems for the infection front.
- Three-state process with immunisation: Here, monotonicity is lost due to immunisation. The past event (e.g., achieving a new record right endpoint) is intersected with to restore a usable regenerative structure, which is then applied to paper growth and fluctuation properties in non-monotonic dynamics.
Infinite-bin Models:
- In both discrete and continuous space, the process is modeled as particles jointly associated to "bins", updated by random selection and displacement. Conditioning on appropriate future events (e.g., finite projections of configurations "reset") defines regeneration events after which the system's subsequent evolution is independent of the past. This enables analysis of convergence of finite-dimensional projections and the derivation of limit theorems for growth processes in both discrete and continuous bin models.
5. Relation to Harris Ergodicity and Markov Chain Regeneration
A significant unification arises by casting classical Harris ergodicity in Markov chains within this framework. Harris recurrence is characterized by the existence of a "small set" such that upon hitting (past event ), a random coin flip (future event ) with positive probability "regenerates" the process. The classic coupling argument with randomization is realized as , fitting precisely into the general theory of stochastic regenerative conditioning.
For , a Harris-ergodic chain is representable as a stochastic recursion driven by an i.i.d. noise sequence, with regeneration emerging as a particular instance of the general theory.
6. Mathematical and Structural Synthesis
The theoretical synthesis is summarized by several central formulas:
Formula | Interpretation |
---|---|
Defining regeneration events via past and future events | |
Inter-regeneration time in terms of linking event | |
i.i.d. | i.i.d. structure on functionals over regeneration cycles |
These formal identities clarify the regenerative structure even in non-Markovian or non-monotonic processes, provided suitable monotonicity and stationarity conditions on the event families are met.
7. Impact and Generalizations
The unified framework presented in (Foss et al., 2012) generalizes previous application-specific constructions of regeneration, providing a systematic method for incorporating both future- and past-dependent information. This theory has yielded new results and deeper structural insight in:
- Particle system models, particularly for analyzing the speed, growth, and fluctuations of infection fronts in classical and immunising contact processes.
- Infinite-bin and many-particle models, for which new coupling and convergence results are derived, even under relaxed or number-theoretic conditions.
- The theory of regenerative Markov processes and the structure of Harris ergodic chains, extending classical regeneration to include additional randomization through future events.
This formalism underpins rigorous limit theorems in the paper of stochastic processes with both infinite memory and infinite anticipation, and invites new classes of models—where regeneration is defined through global path functionals—to be treated within a single probabilistic framework.