Step-Reinforced Random Walk
- Step-Reinforced Random Walk is a discrete-time non-Markovian process that combines fresh independent steps with uniformly repeated past increments.
- It employs an urn representation to track reinforced step counts and reveals a critical phase transition at the reinforcement parameter a = 1/2 across different dimensions.
- The model offers insights into recurrence versus transience behavior, linking classical random walks with advanced reinforcement mechanisms like elephant random walks.
A step-reinforced random walk (SRRW) is a discrete-time non-Markovian random walk in which the next increment is obtained either by drawing a fresh step from a fixed law or by repeating a uniformly chosen past increment. In the standard formulation on , the process remembers and reinforces past increments rather than past positions. This class includes the elephant random walk as a special case, and recent work establishes a sharp recurrence/transience phase diagram whose critical reinforcement value is : in dimensions there is a low-dimensional transition at one-half, whereas in dimensions the walk is transient for every reinforcement parameter in under suitable moment assumptions (Qin, 2024).
1. Definition and reinforcement mechanism
Let be the increment sequence and
The first increment is sampled from a fixed step distribution on ,
For each 0, independently of the past, one tosses a Bernoulli1 variable 2. With probability 3, the walk repeats one of its previous steps, chosen uniformly: 4 With probability 5, the walk makes a fresh independent step: 6 This is the standard step-reinforcement mechanism (Qin, 2024).
The dependence is global in time: the law of 7 depends on the entire increment history through the empirical multiset of previously realized steps. The model is therefore non-Markovian even when the underlying fresh-step law 8 is simple. At the same time, the reinforcement rule remains structurally tractable because the copied step is sampled uniformly from prior increments.
A useful representation is given by the step counts 9, which evolve like an infinite-color Pólya urn. In that representation the walk can be written as
0
This urn viewpoint isolates the reinforcement in the evolution of step frequencies and is central in the modern analysis of SRRWs (Qin, 2024).
2. Assumptions, nondegeneracy, and basic notions
The recurrence/transience theory is formulated for centered, non-degenerate increment laws with suitable moments. The centeredness assumption is
1
since nonzero drift trivially gives transience. The basic finite-variance condition is
2
and several results require the stronger 3 moment condition
4
In the critical two-dimensional case 5, a fourth-moment assumption is imposed: 6 These are the main regularity hypotheses in the phase-transition theorem (Qin, 2024).
The walk is assumed to be genuinely 7-dimensional. Under finite second moments, this is equivalent to
8
This excludes lower-dimensional support hidden inside 9, which would otherwise reduce the effective dimension of the recurrence/transience problem (Qin, 2024).
The same analysis uses the following definitions. Recurrence means
0
and transience means
1
These are the natural analogues of the classical dichotomy for ordinary random walks, but applied to a process whose increments are history-dependent rather than independent (Qin, 2024).
3. Phase transition at one-half
The critical reinforcement value is
2
This threshold separates diffusive or recurrent behavior from superdiffusive or transient behavior in low dimensions (Qin, 2024).
The phase diagram can be summarized as follows.
| Dimension | Reinforcement regime | Behavior |
|---|---|---|
| 3 | 4 | recurrent |
| 5 | 6 | transient |
| 7 | 8 | recurrent |
| 9 | 0 | transient |
| 1 | 2 with fourth moment | transient |
| 3 | all 4 | transient |
In dimension 5, if the SRRW is genuinely one-dimensional and 6 has a 7 moment, then the walk is recurrent for 8 and transient for 9. In dimension 0, if the SRRW is genuinely two-dimensional and 1 has a 2 moment, then the walk is recurrent for 3 and transient for 4. In dimensions 5, if the SRRW is genuinely 6-dimensional and 7 has a 8 moment, then the SRRW is transient for every 9 (Qin, 2024).
The critical two-dimensional case is borderline but still transient under the stronger fourth-moment condition. More precisely,
0
and
1
Thus the walk escapes to infinity, but with borderline growth rather than the clearer superdiffusive scaling seen above threshold (Qin, 2024).
For 2, only the second-moment assumption is needed to obtain a superdiffusive limit: 3 exists almost surely, and the limit is non-atomic: 4 This implies transience throughout the superdiffusive regime (Qin, 2024).
The same 2024 analysis explicitly resolves a conjecture of Bertoin: in dimensions 5, recurrence holds in the subcritical regime under mild moment assumptions, while higher dimensions are always transient. A common misconception is that reinforcement necessarily makes the walk more recurrent; the low-dimensional results show that this is only true below the threshold 6, whereas above that threshold reinforcement instead drives transience, and in 7 it never restores recurrence (Qin, 2024).
4. Proof architecture
The proof strategy combines an urn representation, Lyapunov-function arguments adapted to non-Markovian dynamics, and a quasi-martingale analysis at criticality (Qin, 2024).
The first component is the infinite-color Pólya urn or recursive-tree representation. Writing
8
the analysis studies weighted fluctuations
9
Decay estimates for 0, including almost sure convergence rates and 1 bounds, control the conditional moments of future increments. This converts the memory of the walk into a tractable empirical-process problem on reinforced step counts (Qin, 2024).
The second component adapts Lamperti’s method to a non-Markovian setting. Different Lyapunov functions are used in different dimensions: 2
3
and, in dimension 4, a decaying function such as
5
for large 6. These functions are chosen so that the expected one-step drift becomes negative, or otherwise suitable for a transience argument, after expansion in small increments and use of moment bounds together with urn estimates (Qin, 2024).
The third component addresses the critical two-dimensional case 7. There the argument uses the quasi-martingale
8
and proves 9 almost surely. This yields
0
which identifies the borderline growth rate and rules out recurrence at criticality (Qin, 2024).
5. Relation to elephant walks, counterbalancing, and fluctuation theory
The SRRW framework is broader than the original elephant random walk. The elephant model arises as a special case, but the general step distribution 1 need not be Rademacher, need not be bounded, and the state space can be genuinely multidimensional. In the superdiffusive regime 2, a general SRRW admits the deterministic normalization
3
for which 4 is a martingale, and the second-order fluctuations satisfy
5
for a non-degenerate random limit 6 (Bertenghi, 2021).
Subcritical positive and negative reinforcement also admit functional Gaussian limits. For centered 7 and 8, the triplet consisting of the ordinary walk and its positive and negative reinforced versions converges jointly to Gaussian processes that admit stochastic-integral representations. In the positive case there is a phase transition at 9, while in the negative case the walk remains diffusive for all 0 under finite second moments (Bertenghi et al., 2021).
A particularly important contrast is provided by the counterbalanced or negatively step-reinforced random walk, where reinforcement copies a uniformly chosen past step with the opposite sign. If 1,
2
and if 3,
4
In this negative-reinforcement setting there is no phase transition in 5: the walk is always diffusive at the 6 scale when 7 (Bertoin, 2020).
Pathwise limit theory has also been sharpened. Strong laws of large numbers and strong invariance principles have been proved for positively and negatively step-reinforced random walks via martingale difference sequences and truncation arguments (Hu et al., 2023). Under a finite third moment, Berry–Esseen bounds quantify the rates of convergence to normality for both positive and negative reinforcement: for the positive model in the Gaussian regime 8, and for the negative model for all 9 (Hu, 3 Apr 2025).
6. Generalizations, geometry, and continuous-time analogues
The classical SRRW on 00 has been extended in several directions. One recent generalization places the walk on groups and allows arbitrary transformations of copied steps. In that framework, when 01, 02 is genuinely 03-dimensional, and 04, one has the Euclidean upper bound
05
for every 06, which implies transience in all dimensions 07. On countable groups the decay of transition probabilities is controlled by the isoperimetric profile of the Cayley graph, and this framework includes counterbalanced steps, unbalanced step-reinforced walks, echoed-step random walks, and the elephant random walk (Peres et al., 8 Apr 2026).
On finite groups, step reinforcement interacts with mixing rather than recurrence. If the classical walk is irreducible and aperiodic, the SRRW converges exponentially fast to the uniform distribution. On odd cycles there is a phase transition at 08: for 09 the mixing time remains of order 10, at 11 it is at least of order 12, and for 13,
14
so reinforcement can accelerate mixing (Peres et al., 8 Apr 2026).
Continuous-time analogues replace the discrete reinforced increment sequence by reinforced Lévy noise. For a Lévy process with Blumenthal–Getoor index 15, the critical threshold is
16
and the admissible regime is 17. In that regime, the step-reinforced random walks obtained from discrete-time skeletons converge in finite-dimensional distributions to a noise reinforced Lévy process built from the Lévy–Itô decomposition and Yule–Simon multiplicities (Bertoin, 2018).
The memory rule itself can also be generalized. In step-reinforced random walks with regularly varying memory, the past index is not sampled uniformly but with probabilities proportional to a regularly varying sequence 18 of index 19. Under finite second moments this produces a new critical point
20
with diffusive behavior below 21, superdiffusive behavior above it, and a critical regime in which either almost sure convergence or Gaussian weak convergence can occur depending on the boundedness of a sequence associated with 22 (Majumdar et al., 9 May 2025).
Taken together, these developments show that step reinforcement is not a single asymptotic mechanism but a family of long-range dependence structures whose behavior depends jointly on dimension, group geometry, sign structure, moment assumptions, and the rule by which the past is sampled. The one-half threshold on 23 is the canonical result for the classical uniformly sampled model, but the broader literature demonstrates that this threshold can persist, disappear, or be replaced when the reinforcement scheme itself is modified (Qin, 2024).