---
title: Step-Reinforced Random Walks
url: https://www.emergentmind.com/topics/step-reinforced-random-walk-srrw
type: topic
---

# Step-Reinforced Random Walks

A step-reinforced random walk (SRRW) is a discrete-time non-Markovian random walk with long-range memory in which each increment is either a fresh i.i.d. step or a copy of a previous effective increment chosen uniformly from the past. In its canonical positively step-reinforced form, one starts from i.i.d. increments \((X_n)_{n\ge1}\), Bernoulli reinforcement indicators, and uniform indices on the past; the resulting partial sums preserve the marginal step law while creating strong dependence across time. This mechanism contains the elephant random walk as a special case for Rademacher increments, and it has since been extended to negatively reinforced, unbalanced, amnesic, stable, and group-valued settings [2101.00906].

## 1. Canonical construction and basic properties

In the standard \(d\)-dimensional formulation, one fixes i.i.d. \(\mathbb{R}^d\)-valued random vectors \(\mathbf{X}_1,\mathbf{X}_2,\dots\) with common law \(\mu\), finite second moment, mean \(E(\mathbf{X})\), and covariance matrix \(\bm{\sigma}^2\). One also fixes i.i.d. Bernoulli variables \((\varepsilon_i)_{i\ge2}\) with parameter \(p\in(0,1)\), independent uniform indices \(U[i-1]\) on \(\{1,\dots,i-1\}\), and defines reinforced increments recursively by
\[
\hat{\mathbf{X}}_1=\mathbf{X}_1,\qquad
\hat{\mathbf{X}}_i=
\begin{cases}
\mathbf{X}_i,&\text{if }\varepsilon_i=0,\\
\hat{\mathbf{X}}_{U[i-1]},&\text{if }\varepsilon_i=1.
\end{cases}
\]
The SRRW is then the partial-sum process
\[
\hat{\mathbf{S}}_n=\hat{\mathbf{X}}_1+\cdots+\hat{\mathbf{X}}_n.
\]
With probability \(1-p\) the walk takes a new independent increment from \(\mu\); with probability \(p\) it reuses one of the past effective increments uniformly at random. A basic inductive property is that each reinforced step still has the same marginal law as the original increment, \(\hat{\mathbf{X}}_n\stackrel{d}{=}\mathbf{X}\), even though the increments are no longer independent [2101.00906].

In one dimension, the notation simplifies to
\[
\hat S_n=\hat X_1+\cdots+\hat X_n.
\]
If \(E(X)\neq0\), it is standard to center the walk by subtracting \(nE(X)\); the centered process is again a step-reinforced random walk with typical step \(X-E(X)\) [2101.00906].

The same reinforcement algorithm also admits a negatively step-reinforced version. If \((X_n)\) are i.i.d. real-valued increments and \((E_n)\), \((U_n)\) are as above, the negatively reinforced increments are
\[
\widetilde X_1=X_1,\qquad
\widetilde X_n=
\begin{cases}
X_n,&\text{if }E_n=0,\\
-\widetilde X_{U_n},&\text{if }E_n=1,
\end{cases}
\]
and the corresponding walk is \(\widetilde S(n)=\sum_{k=1}^n \widetilde X_k\). The positive model is also called noise-reinforced random walk, while the negative model repeats past increments with a sign flip [2311.15263].

A central identification is with the elephant random walk (ERW). For Rademacher increments, the positively reinforced SRRW corresponds to an ERW with memory parameter \(q=(p+1)/2\), while the negatively reinforced walk corresponds to the ERW with memory parameter \(q=(1-p)/2\). More generally, if \(\mathbf{X}\) is isotropic on \(\mathbb{R}^d\), the positively reinforced SRRW corresponds to a multidimensional ERW [2101.00906].

## 2. Scaling regimes and first-order asymptotics

For the positively step-reinforced walk, the reinforcement parameter induces a phase transition at \(p=1/2\). The diffusive regime is \(p<1/2\), the critical regime is \(p=1/2\), and the superdiffusive regime is \(p>1/2\). In the superdiffusive regime, the natural scaling sequence is
\[
a_n=\frac{\Gamma(n+p)}{\Gamma(n)\Gamma(p+1)},
\qquad
a_n\sim \frac{n^p}{\Gamma(p+1)}.
\]
The normalized process \(M_n=\hat S_n/a_n\) is a martingale, and in the one-dimensional centered case \(M_n\to \hat W\) almost surely and in \(L^2\), where \(\hat W\) is non-degenerate. Equivalently,
\[
\frac{\hat S_n}{n^p}\to \frac{\hat W}{\Gamma(p+1)}
\quad\text{a.s. and in }L^2.
\]
In higher dimension,
\[
\frac{\hat{\mathbf S}_n-nE(\mathbf X)}{n^p}\to \hat{\mathbf W}\quad\text{a.s.}
\]
with \(\hat{\mathbf W}\in L^2\) non-degenerate and non-Gaussian [2101.00906].

The strong-law behavior of positive and negative reinforcement differs. Under \(\mathbb E|X_1|<\infty\), the positively reinforced walk satisfies
\[
\frac{S(n)}{n}\to m_1\quad\text{a.s.},
\]
where \(m_1=\mathbb E[X_1]\), whereas the negatively reinforced walk satisfies
\[
\frac{\widetilde S(n)}{n}\to \frac{1-p}{1+p}\,m_1\quad\text{a.s.}
\]
Thus positive reinforcement preserves the LLN drift, while negative reinforcement reduces it by the factor \((1-p)/(1+p)\) [2311.15263].

A separate but closely related line of work establishes a spatial phase transition for genuinely \(d\)-dimensional SRRWs on \(\mathbb Z^d\). Under a \(2+\delta\) moment condition, the walk undergoes a phase transition between recurrence and transience in dimensions \(d=1,2\), and it is transient for all reinforcement parameters in dimensions \(d\ge3\). More precisely, in dimension \(1\) recurrence holds for \(a\le1/2\) and transience for \(a>1/2\); in dimension \(2\) recurrence holds for \(a<1/2\) and transience for \(a\ge1/2\); and in dimensions \(d\ge3\) the walk is transient for all \(a\in[0,1)\) [2402.16396].

## 3. Limit theorems and quantitative asymptotics

The principal second-order theorem for the superdiffusive positive model states that after subtracting the random leading term \(a_n\hat{\mathbf W}\), the remaining fluctuations are Gaussian on the \(\sqrt n\) scale. If \(p\in(1/2,1)\), \(\mathbf X\in L^2(P)\), and \(\bm{\sigma}^2\) is the covariance matrix of \(\mathbf X\), then
\[
\frac{\hat{\mathbf S}_n-nE(\mathbf X)-a_n\hat{\mathbf W}}{\sqrt n}
\Longrightarrow
\mathcal N_d\!\left(\mathbf 0,\frac{\bm{\sigma}^2}{2p-1}\right).
\]
In one dimension this becomes
\[
\frac{\hat S_n-nE(X)-a_n\hat W}{\sqrt n}
\Longrightarrow
\mathcal N\!\left(0,\frac{\sigma^2}{2p-1}\right).
\]
This extends the Kubota–Takei result for the elephant random walk from Rademacher steps to arbitrary \(L^2\) step distributions and to higher dimensions [2101.00906].

For the positively reinforced walk in the subcritical and critical regimes, and for the negatively reinforced walk on its full parameter range, strong invariance principles are available. Under \(\mathbb E[X_1^2]<\infty\), the positive walk with \(0<p<1/2\) admits a Brownian coupling after centering by \(m_1n\), and the critical case \(p=1/2\) has the \(\sqrt{n\log n}\) normalization. For the negatively reinforced walk, the fluctuation scale is \(n^{p+1/2}\) and a strong invariance principle holds for every \(p\in(0,1)\). As by-products, the law of the iterated logarithm and the functional central limit theorem are obtained for both signs of reinforcement [2311.15263].

Recent quantitative work goes beyond weak convergence and gives Berry–Esseen bounds. Under a finite third absolute moment, both positively and negatively step-reinforced random walks admit rates of convergence to normality. The proofs use randomly weighted sum representations, Berry–Esseen bounds for functionals of independent random variables, and comparison arguments between mixed normal laws and fixed Gaussian laws [2504.02502].

The critical parameter \(1/2\) also governs the asymptotic geometry of the two-dimensional positive model. At \(a=1/2\), under a fourth moment assumption,
\[
\lim_{n\to\infty}\frac{\log\|S_n\|^2}{\log n}=1\quad\text{a.s.},
\]
and
\[
\mathbb P\!\left(\lim_{n\to\infty}\frac{S_n}{\|S_n\|}\ \text{exists}\right)=0.
\]
This identifies the critical two-dimensional walk as transient but directionally non-convergent [2402.16396].

## 4. Variants, unifying formulations, and alternative memory schemes

The positive and negative models can be unified by allowing a reinforced step either to keep or to flip its sign. One recent formulation introduces parameters \(p\in[0,1]\) and \(r\in[0,1]\), takes a fresh step with probability \(1-p\), and under reinforcement reuses a uniformly chosen past step with probability \(r\) or flips it with probability \(1-r\). The effective parameter is
\[
a:=(2r-1)p.
\]
This framework contains the elephant random walk (\(p=1\)), the positively step-reinforced random walk (\(r=1\)), and the negatively step-reinforced random walk (\(r=0\)). In the subcritical regime \((2r-1)\alpha p<1\), it yields unified normal and stable central limit theorems for randomly weighted sums representing the walk [2510.10898].

A closely related two-parameter class writes the same effective quantity in the form
\[
a=(2p-1)\alpha,
\]
where \(\alpha\) is the probability of reinforcement and \(p\) is the probability of preserving the chosen sign. In that formulation, the law of large numbers is
\[
\frac{T_n}{n}\to \frac{(1-\alpha)\mu_1}{1-a}\quad\text{a.s.},
\]
and the model exhibits the same diffusive, critical, and superdiffusive trichotomy according to whether \(a<1/2\), \(a=1/2\), or \(a>1/2\). This gives a unified treatment of ERW, positive SRRW, and negative SRRW in a single martingale framework [2504.14767].

The standard uniform-memory SRRW has also been generalized to amnesic reinforcement. In that model, the choice of a past step is governed by a positive memory sequence \((\mu_n)\) with partial sums \((\nu_n)\), and the selection probability is proportional to \(\mu_k/\nu_n\). Under regular variation of \((\mu_n)\), the diffusive regime becomes
\[
0<p<\frac{2\alpha-1}{2\alpha},
\]
where \(\alpha\) is the regular variation index of \((\nu_n)\). The corresponding functional invariance principle shows that the limit process is always the sum of a noise-reinforced Brownian motion and a Brownian motion, with the two Gaussian components not independent [2402.09202].

The term “step-reinforced random walk” is also used more broadly for models where the law of the next increment depends on recent-step averages rather than on exact copying of a past increment. One such class consists of random walks reinforced by their recent history through threshold-based switching among increment distributions. This suggests that the expression “SRRW” can denote either the canonical uniform-copying model or a broader family of increment-based self-interacting walks, depending on context [1709.02215].

## 5. Functional extensions, empirical processes, and geometric generalizations

A notable application of the superdiffusive central limit theorem concerns reinforced empirical processes. If \((\hat U_i)\) is a reinforced sample on \([0,1]\) obtained by the same reinforcement algorithm, the reinforced empirical process
\[
\hat G_n(x)=\frac{1}{\sqrt n}\sum_{i=1}^n\bigl(\mathbf 1_{\{\hat U_i\le x\}}-x\bigr)
\]
admits a refined Donsker-type expansion. Bertoin had shown that for \(p>1/2\),
\[
n^{-p+1/2}\hat G_n \to B^{(p)}
\quad\text{in probability in }\mathbb D,
\]
where \(B^{(p)}\) has exchangeable increments. The second-order theorem then yields
\[
\bigl(\hat G_n(x)-a_n n^{-1/2}B^{(p)}(x)\bigr)_{x\in[0,1]}
\Longrightarrow_{\mathbb D}
\frac{1}{\sqrt{2p-1}}\,G(x),
\]
with \(G\) a standard Brownian bridge. The finite-dimensional covariance coincides with that of the Brownian bridge, and Kallenberg’s bridge theory upgrades finite-dimensional convergence to process convergence in \(\mathbb D[0,1]\) [2101.00906].

Geometric extensions now place SRRWs on groups. A generalized SRRW on a group allows a fresh step sampled from \(\mu\) or a transformed past step \(T_n(X_{u_n})\), unifying several previously studied models. Upper bounds on transition probabilities have been established for every reinforcement parameter \(\alpha<1\), with the decay rate linked to the geometry of the underlying group. On Euclidean space, the walk is transient in all dimensions \(d\ge3\) for any \(\alpha<1\). On finitely generated groups, isoperimetric-profile bounds imply polynomial, stretched-exponential, or exponential decay according to the group geometry, and on nonamenable Cayley graphs one obtains exponential decay of \(\sup_x P(S_n=x)\). In particular, this resolves the open problem of exponential decay for the elephant random walk on Cayley trees [2604.07227].

These functional and geometric results indicate that SRRW theory is not limited to one-dimensional martingale asymptotics. It also interfaces with empirical-process theory, exchangeable-increment bridges, recursive-tree representations, and heat-kernel-type estimates on groups. A plausible implication is that step reinforcement preserves a large amount of Gaussian second-order structure even when first-order behavior is non-Gaussian or geometry-dependent.

## 6. Terminology, related models, and open problems

Step-reinforced random walks belong to the broader class of reinforced processes in which transition rules depend on the past trajectory. The surrounding literature connects SRRWs to ERW and MERW, Pólya urns, preferential attachment, shark random swim, noise-reinforced Lévy processes, reinforced empirical processes, and other self-interacting models. One line of work studies preferential-attachment-type reinforcement where the probability of reusing a past step is itself reinforced by an additive weight \(b\ge0\), producing “memory-reinforced” and “strongly memory-reinforced” variants with additional phase transitions [1909.04633].

A common misconception is terminological rather than probabilistic: in some recent MCMC and stochastic-optimization papers, “SRRW” denotes **self-repellent random walk**, not **step-reinforced random walk**. Those models are nonlinear Markov chains that discourage revisiting heavily sampled states and are analytically unrelated to the copy-a-past-step mechanism, even though the acronym coincides [2305.05097].

Several open directions are explicitly identified in the SRRW literature. For superdiffusive positive reinforcement, the explicit law of the martingale limit \(\hat W\) is not known in general, and extensions to non-uniform choice of past steps or more general kernels remain natural problems. Strong invariance principles in the superdiffusive positive regime, multidimensional strong results for the models treated only in one dimension, and heavy-tailed extensions beyond finite variance are also stated as open directions. In the unbalanced setting, the critical and supercritical heavy-tailed regimes remain to be developed further [2101.00906; 2311.15263; 2510.10898].

Taken together, these developments show that SRRW is best understood not as a single theorem or a single scaling law, but as a family of long-memory increment processes organized around a robust structural idea: repeated recycling of past steps, sometimes with sign changes or generalized memory kernels, generates martingale normalizations, recursive-tree representations, and phase transitions whose critical value is often one-half, while still leaving room for Gaussian second-order limits and refined invariance principles across a surprisingly broad range of models.

Source: https://www.emergentmind.com/topics/step-reinforced-random-walk-srrw