---
title: Step-Reinforced Random Walk
url: https://www.emergentmind.com/topics/step-reinforced-random-walk
type: topic
---

# Step-Reinforced Random Walk

A step-reinforced random walk (SRRW) is a discrete-time non-Markovian random walk in which the next increment is obtained either by drawing a fresh step from a fixed law or by repeating a uniformly chosen past increment. In the standard formulation on \(\mathbb Z^d\), the process remembers and reinforces past **increments** rather than past positions. This class includes the elephant random walk as a special case, and recent work establishes a sharp recurrence/transience phase diagram whose critical reinforcement value is \(a_c=\frac12\): in dimensions \(d=1,2\) there is a low-dimensional transition at one-half, whereas in dimensions \(d\ge 3\) the walk is transient for every reinforcement parameter in \([0,1)\) under suitable moment assumptions [2402.16396].

## 1. Definition and reinforcement mechanism

Let \((X_n)_{n\ge1}\) be the increment sequence and
\[
S_0=0,\qquad S_n=\sum_{k=1}^n X_k.
\]
The first increment is sampled from a fixed step distribution \(\mu\) on \(\mathbb Z^d\),
\[
X_1\sim \mu.
\]
For each \(n\ge1\), independently of the past, one tosses a Bernoulli\((a)\) variable \(\xi_{n+1}\). With probability \(a\), the walk repeats one of its previous steps, chosen uniformly:
\[
X_{n+1}=X_{U[n]},\qquad U[n]\sim \mathrm{Unif}\{1,\dots,n\}.
\]
With probability \(1-a\), the walk makes a fresh independent step:
\[
X_{n+1}\sim \mu.
\]
This is the standard step-reinforcement mechanism [2402.16396].

The dependence is global in time: the law of \(X_{n+1}\) depends on the entire increment history through the empirical multiset of previously realized steps. The model is therefore non-Markovian even when the underlying fresh-step law \(\mu\) is simple. At the same time, the reinforcement rule remains structurally tractable because the copied step is sampled uniformly from prior increments.

A useful representation is given by the step counts \((b_n(x))_{x\in\mathbb Z^d}\), which evolve like an infinite-color Pólya urn. In that representation the walk can be written as
\[
\left(\sum_{x\in\mathbb Z^d} x\, b_n(x)\right)_{n\ge1}.
\]
This urn viewpoint isolates the reinforcement in the evolution of step frequencies and is central in the modern analysis of SRRWs [2402.16396].

## 2. Assumptions, nondegeneracy, and basic notions

The recurrence/transience theory is formulated for centered, non-degenerate increment laws with suitable moments. The centeredness assumption is
\[
\sum_{x\in\mathbb Z^d} x\,\mu(x)=0,
\]
since nonzero drift trivially gives transience. The basic finite-variance condition is
\[
\sigma^2:=\sum_{x\in\mathbb Z^d}\|x\|^2\mu(x)<\infty,
\]
and several results require the stronger \(2+\delta\) moment condition
\[
\sum_{x\in\mathbb Z^d}\|x\|^{2+\delta}\mu(x)<\infty
\qquad\text{for some }\delta>0.
\]
In the critical two-dimensional case \(d=2,\ a=1/2\), a fourth-moment assumption is imposed:
\[
\sum_{x\in\mathbb Z^d}\|x\|^4\mu(x)<\infty.
\]
These are the main regularity hypotheses in the phase-transition theorem [2402.16396].

The walk is assumed to be genuinely \(d\)-dimensional. Under finite second moments, this is equivalent to
\[
\operatorname{Rank}\bigl(\mathbb E[X_1X_1^{T}]\bigr)=d.
\]
This excludes lower-dimensional support hidden inside \(\mathbb Z^d\), which would otherwise reduce the effective dimension of the recurrence/transience problem [2402.16396].

The same analysis uses the following definitions. Recurrence means
\[
\mathbb P(S_n=i\ \text{i.o.})=1,\qquad \forall i\in\widehat{\mathcal R},
\]
and transience means
\[
\mathbb P(S_n=i\ \text{f.o.})=1,\qquad \forall i\in\widehat{\mathcal R}.
\]
These are the natural analogues of the classical dichotomy for ordinary random walks, but applied to a process whose increments are history-dependent rather than independent [2402.16396].

## 3. Phase transition at one-half

The critical reinforcement value is
\[
a_c=\frac12.
\]
This threshold separates diffusive or recurrent behavior from superdiffusive or transient behavior in low dimensions [2402.16396].

The phase diagram can be summarized as follows.

| Dimension | Reinforcement regime | Behavior |
|---|---|---|
| \(d=1\) | \(a\le \frac12\) | recurrent |
| \(d=1\) | \(a>\frac12\) | transient |
| \(d=2\) | \(a<\frac12\) | recurrent |
| \(d=2\) | \(a>\frac12\) | transient |
| \(d=2\) | \(a=\frac12\) with fourth moment | transient |
| \(d\ge3\) | all \(a\in[0,1)\) | transient |

In dimension \(d=1\), if the SRRW is genuinely one-dimensional and \(\mu\) has a \(2+\delta\) moment, then the walk is recurrent for \(a\le \frac12\) and transient for \(a>\frac12\). In dimension \(d=2\), if the SRRW is genuinely two-dimensional and \(\mu\) has a \(2+\delta\) moment, then the walk is recurrent for \(a<\frac12\) and transient for \(a>\frac12\). In dimensions \(d\ge3\), if the SRRW is genuinely \(d\)-dimensional and \(\mu\) has a \(2+\delta\) moment, then the SRRW is transient for every \(a\in[0,1)\) [2402.16396].

The critical two-dimensional case is borderline but still transient under the stronger fourth-moment condition. More precisely,
\[
\lim_{n\to\infty}\frac{\log \|S_n\|^2}{\log n}=1\quad\text{a.s.}
\]
and
\[
\mathbb P\Bigl(\lim_{n\to\infty} \frac{S_n}{\|S_n\|}\ \text{exists}\Bigr)=0.
\]
Thus the walk escapes to infinity, but with borderline growth rather than the clearer superdiffusive scaling seen above threshold [2402.16396].

For \(a>1/2\), only the second-moment assumption is needed to obtain a superdiffusive limit:
\[
\lim_{n\to\infty}\frac{S_n}{n^a}
\]
exists almost surely, and the limit is non-atomic:
\[
\mathbb P\!\left(\lim_{n\to\infty}\frac{S_n}{n^a}=x\right)=0
\quad\text{for every }x\in\mathbb R^d.
\]
This implies transience throughout the superdiffusive regime [2402.16396].

The same 2024 analysis explicitly resolves a conjecture of Bertoin: in dimensions \(d=1,2\), recurrence holds in the subcritical regime under mild moment assumptions, while higher dimensions are always transient. A common misconception is that reinforcement necessarily makes the walk more recurrent; the low-dimensional results show that this is only true below the threshold \(a=\frac12\), whereas above that threshold reinforcement instead drives transience, and in \(d\ge3\) it never restores recurrence [2402.16396].

## 4. Proof architecture

The proof strategy combines an urn representation, Lyapunov-function arguments adapted to non-Markovian dynamics, and a quasi-martingale analysis at criticality [2402.16396].

The first component is the infinite-color Pólya urn or recursive-tree representation. Writing
\[
\eta_n(x):=\frac{b_n(x)}{n}-\mu(x),
\]
the analysis studies weighted fluctuations
\[
I_n(g)=\sum_{x\in\mathbb Z^d} g(x)\eta_n(x).
\]
Decay estimates for \(I_n(g)\), including almost sure convergence rates and \(L^2\) bounds, control the conditional moments of future increments. This converts the memory of the walk into a tractable empirical-process problem on reinforced step counts [2402.16396].

The second component adapts Lamperti’s method to a non-Markovian setting. Different Lyapunov functions are used in different dimensions:
\[
L(x)=\log|x| \qquad (d=1),
\]
\[
f(x)=\sqrt{\log\|x\|} \qquad (d=2),
\]
and, in dimension \(d\ge3\), a decaying function such as
\[
h(x)=\|x\|^{-\delta/4}
\]
for large \(\|x\|\). These functions are chosen so that the expected one-step drift becomes negative, or otherwise suitable for a transience argument, after expansion in small increments and use of moment bounds together with urn estimates [2402.16396].

The third component addresses the critical two-dimensional case \(a=\frac12\). There the argument uses the quasi-martingale
\[
x_n=\frac{\log(\|S_n\|^2+n^\kappa)}{\log n},
\]
and proves \(x_n\to 1\) almost surely. This yields
\[
\frac{\log\|S_n\|^2}{\log n}\to 1,
\]
which identifies the borderline growth rate and rules out recurrence at criticality [2402.16396].

## 5. Relation to elephant walks, counterbalancing, and fluctuation theory

The SRRW framework is broader than the original elephant random walk. The elephant model arises as a special case, but the general step distribution \(\mu\) need not be Rademacher, need not be bounded, and the state space can be genuinely multidimensional. In the superdiffusive regime \(p\in(1/2,1)\), a general SRRW admits the deterministic normalization
\[
a_n=\frac{\Gamma(n+p)}{\Gamma(n)\Gamma(p+1)},
\qquad a_n\sim \frac{n^p}{\Gamma(p+1)},
\]
for which \(\hat S_n/a_n\) is a martingale, and the second-order fluctuations satisfy
\[
\frac{\hat S_n-nE(X)-a_n\hat W}{\sqrt n}
\implies
\mathcal N_d\!\left(0,\frac{\sigma^2}{2p-1}\right)
\]
for a non-degenerate random limit \(\hat W\) [2101.00906].

Subcritical positive and negative reinforcement also admit functional Gaussian limits. For centered \(X\in L^2\) and \(p<1/2\), the triplet consisting of the ordinary walk and its positive and negative reinforced versions converges jointly to Gaussian processes that admit stochastic-integral representations. In the positive case there is a phase transition at \(p=1/2\), while in the negative case the walk remains diffusive for all \(p\in[0,1)\) under finite second moments [2109.11298].

A particularly important contrast is provided by the counterbalanced or negatively step-reinforced random walk, where reinforcement copies a uniformly chosen past step with the opposite sign. If \(X_1\in L^1\),
\[
\frac{\check S(n)}{n}\xrightarrow{\mathbb P} \frac{p}{2-p}\,m_1,
\]
and if \(X_1\in L^2\),
\[
\frac{\check S(n)-\frac{p}{2-p}m_1\,n}{\sqrt n}
\;\xrightarrow{d}\;
\mathcal N\!\left(0,\,
\frac{m_2-\left(\frac{p}{2-p}m_1\right)^2}{3-2p}
\right).
\]
In this negative-reinforcement setting there is **no phase transition** in \(p\): the walk is always diffusive at the \(\sqrt n\) scale when \(m_2<\infty\) [2011.14069].

Pathwise limit theory has also been sharpened. Strong laws of large numbers and strong invariance principles have been proved for positively and negatively step-reinforced random walks via martingale difference sequences and truncation arguments [2311.15263]. Under a finite third moment, Berry–Esseen bounds quantify the rates of convergence to normality for both positive and negative reinforcement: for the positive model in the Gaussian regime \(p\in[1/2,1)\), and for the negative model for all \(p\in(0,1)\) [2504.02502].

## 6. Generalizations, geometry, and continuous-time analogues

The classical SRRW on \(\mathbb Z^d\) has been extended in several directions. One recent generalization places the walk on groups and allows arbitrary transformations of copied steps. In that framework, when \(G=(\mathbb R^d,+)\), \(\mu\) is genuinely \(d\)-dimensional, and \(\alpha<1\), one has the Euclidean upper bound
\[
P(\|S_n\|<r)\le C\,n^{-d/2},
\qquad n\ge1,
\]
for every \(r>0\), which implies transience in all dimensions \(d\ge3\). On countable groups the decay of transition probabilities is controlled by the isoperimetric profile of the Cayley graph, and this framework includes counterbalanced steps, unbalanced step-reinforced walks, echoed-step random walks, and the elephant random walk [2604.07227].

On finite groups, step reinforcement interacts with mixing rather than recurrence. If the classical walk is irreducible and aperiodic, the SRRW converges exponentially fast to the uniform distribution. On odd cycles there is a phase transition at \(\alpha=1/2\): for \(\alpha<1/2\) the mixing time remains of order \(L^2\), at \(\alpha=1/2\) it is at least of order \(L^2/\log L\), and for \(\alpha>1/2\),
\[
t_{\mathrm{mix}}^{(\alpha)}(\varepsilon)=\Theta(L^{1/\alpha}),
\]
so reinforcement can accelerate mixing [2604.07207].

Continuous-time analogues replace the discrete reinforced increment sequence by reinforced Lévy noise. For a Lévy process with Blumenthal–Getoor index \(\beta\), the critical threshold is
\[
p_c=\frac1\beta,
\]
and the admissible regime is \(p\beta<1\). In that regime, the step-reinforced random walks obtained from discrete-time skeletons converge in finite-dimensional distributions to a noise reinforced Lévy process built from the Lévy–Itô decomposition and Yule–Simon multiplicities [1810.08364].

The memory rule itself can also be generalized. In step-reinforced random walks with regularly varying memory, the past index is not sampled uniformly but with probabilities proportional to a regularly varying sequence \(\{\mu_n\}\) of index \(\gamma>-1\). Under finite second moments this produces a new critical point
\[
p_c=\frac{\gamma+\tfrac12}{\gamma+1}
\qquad (\gamma>-\tfrac12),
\]
with diffusive behavior below \(p_c\), superdiffusive behavior above it, and a critical regime in which either almost sure convergence or Gaussian weak convergence can occur depending on the boundedness of a sequence associated with \(\{\mu_n\}\) [2505.05921].

Taken together, these developments show that step reinforcement is not a single asymptotic mechanism but a family of long-range dependence structures whose behavior depends jointly on dimension, group geometry, sign structure, moment assumptions, and the rule by which the past is sampled. The one-half threshold on \(\mathbb Z^d\) is the canonical result for the classical uniformly sampled model, but the broader literature demonstrates that this threshold can persist, disappear, or be replaced when the reinforcement scheme itself is modified [2402.16396].

Source: https://www.emergentmind.com/topics/step-reinforced-random-walk