---
title: Edge-Reinforced Random Walk (ERRW)
url: https://www.emergentmind.com/topics/edge-reinforced-random-walk-errw
type: topic
---

# Edge-Reinforced Random Walk (ERRW)

Edge-reinforced random walk (ERRW) is a self-interacting random walk on a graph in which transition probabilities depend on past edge traversals: an edge that has been crossed more often becomes more likely to be crossed again. In the standard linearly reinforced model on a locally finite, connected graph \(G=(V,E)\) with initial positive edge weights \((a_e)_{e\in E}\), the process is non-Markovian in the vertex variable because the transition kernel evolves with the trajectory. Over the last decade, ERRW has been linked to the Vertex-Reinforced Jump Process (VRJP), to random walks in random environments, to the supersymmetric hyperbolic sigma model, and to random Schrödinger operators; these representations have made possible sharp results on recurrence, transience, phase transitions, scaling limits, and statistical inference [1111.3991] [1403.6079].

## 1. Definition and reinforcement mechanism

For the standard ERRW, if \(X_n\) denotes the walker position at step \(n\), then
\[
P(X_{n+1}=j\,|\,\mathcal F_n)
=
\mathbf 1_{\{j\sim X_n\}}
\frac{Z_n(\{X_n,j\})}{\sum_{k\sim X_n} Z_n(\{X_n,k\})},
\]
where
\[
Z_n(e)=a_e+\text{(number of traversals of \(e\) up to time \(n\))}.
\]
Thus, each traversal increments the weight of the traversed edge, and the next-step law is proportional to current incident edge weights [1403.6079].

This is the linearly edge-reinforced random walk. A related formulation used in one-dimensional and tree settings writes the edge weight after \(\ell\) traversals as
\[
f(\ell,x)=f(0,x)+\ell \Delta,
\]
with reinforcement parameter \(\Delta\ge 0\); on the half-line, for the edge \(\{x,x+1\}\), one specific family of initial weights is \(f(0,x)=x^\alpha\vee 1\) [2005.11135]. In the general infinite-graph literature, the model is often described as losing the Markov property because transition probabilities evolve over time, while still admitting representation as a mixture of Markov chains on suitable state spaces [2309.02475].

The central qualitative feature is path dependence. ERRW favors previously used edges, but the effect of that preference depends strongly on the reinforcement regime and on graph geometry. The literature distinguishes at least three asymptotic regimes that should not be conflated: linearly reinforced ERRW, super-linearly reinforced ERRW, and directed or non-reversible generalizations. Their long-term behavior differs sharply, from recurrence to transience to localization on a single attracting edge [1509.00807].

## 2. Mixture representations, the magic formula, and operator methods

A decisive development was the representation of ERRW in terms of VRJP with random conductances. On any locally finite graph, ERRW is equal in law to the discrete-time process associated to VRJP in random conductances \(W_e\sim \mathrm{Gamma}(a_e,1)\), independently for each edge [1111.3991]. For VRJP, if \(Y_t=i\), the rate to jump to a neighbor \(j\) at time \(t\) is proportional to
\[
W_{\{i,j\}} L_j(t),
\qquad
L_j(t)=1+\int_0^t \mathbf 1_{\{Y_s=j\}}\,ds.
\]
After a time change, the corresponding rates can be written in the form \(W_{i,j}e^{T_i(t)+T_j(t)}\) [1111.3991].

This representation converts ERRW into a random walk in a random reversible environment. Conditionally on the mixing field \(U\), the effective conductances are
\[
W_{ij}^U = W_{ij} e^{U_i+U_j},
\]
and the corresponding Markov chain is reversible with respect to these conductances [1403.6079]. On finite graphs, the associated mixing measure is the classical “magic formula,” a density involving edge weights, vertex weights, and a spanning-tree factor \(D(y)\); via the VRJP connection and a new exponential family, the normalizing constant of this formula can be computed directly, answering a question raised by Diaconis [1507.04660].

The same structure has an operator-theoretic form. With \(P_{ij}=W_{ij}\) off the diagonal and \(0\) on the diagonal, the random Schrödinger operator is
\[
H_\beta = 2\beta - P,
\]
with Green function \(G=H_\beta^{-1}\) [1507.04660]. The field defining the VRJP mixing measure satisfies
\[
e^{u_j}\ \text{is in law}\ \frac{G(i_0,j)}{G(i_0,i_0)},
\]
which ties the ERRW/VRJP environment to a random potential problem [1507.04660]. On infinite graphs, a 1-dependent random potential \(\beta\) and a martingale-limit field \(\psi\) enter the mixture representation; in the transient case, \(\psi\) is a positive generalized eigenfunction with eigenvalue \(0\) for \(H_\beta\) [1507.07944].

A second decisive bridge is to the supersymmetric hyperbolic sigma model. The limiting measure of the centered occupation field of VRJP can be interpreted as a supersymmetric hyperbolic sigma model, and through the ERRW–VRJP equivalence this imports methods from mathematical physics, including Ward identities and effective-resistance estimates, into reinforced-walk analysis [1111.3991].

## 3. Recurrence, transience, and phase transition

The most prominent structural result is the existence of a nontrivial phase transition on \(\mathbb Z^d\) for \(d>2\). There exists \(a_c(d)>0\) such that if all \(a_e>a_c(d)\), the ERRW is transient almost surely; this proves transience for small reinforcement, establishes a phase transition between recurrent and transient behavior, and resolves the open problem posed by Diaconis in 1986 [1403.6079]. The proof adapts the quasi-diffusive analysis of the supersymmetric hyperbolic model, using the ERRW-as-VRJP-with-Gamma-conductances representation and Ward identities.

The key estimates are field-theoretic and electrical. One obtains bounds on fluctuations of \(U_x-U_y\), for instance
\[
\mathbb E[\cosh^m(U_x-U_y)]\le 2
\]
for \(a>a_c\), together with Ward identities such as
\[
\mathbb E\!\left[B_{xy}^m(1-mD_{xy})\right]=1,
\qquad m<a/4,
\]
where \(D_{xy}\) is an effective resistance in the corresponding conductance network [1403.6079]. Transience is then tied to the resistance formula
\[
w_0^U R(0,\partial V_n,w^U)
=
\frac{1}{\mathbb P_0^{w^U}(H_{\partial V_n}<\widetilde H_0)}.
\]

At the opposite end, recurrence for strong reinforcement had already been established. For any bound \(K\) on degree, there exists \(a_0>0\) such that the linearly edge-reinforced random walk is recurrent for \(a<a_0\) on graphs of bounded degree \(K\) [2309.02475]. On \(\mathbb Z^d\) with \(d\ge 3\), the monotonicity theorem shows that increasing initial weights makes ERRW more transient, so the recurrence/transience transition is unique [1911.02181].

Dimension \(2\) is exceptional. ERRW on \(\mathbb Z^2\) with constant weights is recurrent for all \(a\), and together with the \(d\ge 3\) weak-reinforcement transience result this gives a full answer to the old question of Diaconis [1507.07944]. In \(d\ge 3\), weak reinforcement also admits a functional central limit theorem: for sufficiently large constant weights, the diffusively rescaled walk converges to Brownian motion with non-degenerate isotropic diffusion matrix [1507.07944].

A common misconception is that reinforcement necessarily implies localization. The ERRW literature shows the contrary: linearly reinforced ERRW can be recurrent, transient, or diffusive depending on dimension and initial weights, whereas strong localization onto one edge is characteristic of super-linear reinforcement rather than of the standard linear model [1509.00807].

## 4. One-dimensional, tree, and random-tree regimes

On \(\mathbb Z\), the standard linearly edge-reinforced random walk is always recurrent irrespective of the initial edge weights [2309.02475]. On the half-line \(\mathbb Z_+\), with edge \(\{x,x+1\}\) given initial weight \(x^\alpha\vee 1\) and linear increment \(\Delta\), the walk is recurrent if and only if \(\alpha\le 1\) [2005.11135]. In the recurrent regime with \(\alpha<1\) and \(\Delta>0\),
\[
\limsup_{n\to\infty}
\frac{X_n}{\{K(\alpha,\Delta)\log n\}^{1/(1-\alpha)}}=1
\quad \text{a.s.},
\]
which is a law-of-the-iterated-logarithm-type statement showing that positive reinforcement drastically slows the walk relative to the unreinforced case [2005.11135]. In the critical case \(\alpha=1\), there is a phase transition in speed at \(\Delta=2\) [2005.11135].

On infinite trees, recurrence and transience are characterized in terms of the branching number and a reinforcement parameter. For a tree \(T\) with branching number \(\mathrm{br}(T)\), one introduces
\[
E(\Delta)
=
\frac{
\Gamma\!\left(\frac{2+\Delta}{4\Delta}\right)^2
}{
\Gamma\!\left(\frac{1}{2\Delta}\right)
\Gamma\!\left(\frac{1+\Delta}{2\Delta}\right)
},
\]
and the critical parameter \(\Delta_0\) is determined by \(E(\Delta_0)=1/\mathrm{br}(T)\). If \(\Delta<\Delta_0\), ERRW on \(T\) is transient; if \(\Delta>\Delta_0\), it is recurrent [2308.16394]. For Galton–Watson trees with mean offspring \(m>1\), the same formula applies with \(1/m\) in place of \(1/\mathrm{br}(T)\) [2308.16394].

On critical Galton–Watson trees in the recurrent regime \(\alpha\le 1\), an invariance principle holds: suitably rescaled linearly edge-reinforced random walks converge to a diffusion on the \(\gamma\)-stable tree, with resistance metric and speed measure expressed through a tree-indexed Gaussian field [2112.12037]. In the transient regime on these random trees, there is still no positive speed: the discrete ERRW never has positive speed, even when the initial edge weights are strongly biased away from the root [2112.12037]. This suggests that random fractal tree geometry can dominate directional bias.

## 5. Non-reversible, interacting, and strongly reinforced variants

A major non-reversible extension is the \(*\)-ERRW, defined on directed graphs endowed with an involution \( * \) on vertices and hence on edges. Its reinforced weights are
\[
\alpha_{i,j}(n)=\alpha_{i,j}+N_{i,j}(n)+N_{j^*,i^*}(n),
\]
and the process generalizes both the classical ERRW and random walk in Dirichlet environment [2102.08984]. Under the divergence condition
\[
\mathrm{div}(\alpha)=\delta_{i_0^*}-\delta_{i_0},
\]
the \(*\)-ERRW is partially exchangeable and hence a random walk in a random environment. Its mixing law is explicit and extends the classical magic formula from mixtures of reversible Markov chains to mixtures of Yaglom reversible Markov chains [2102.08984].

Interaction between finitely many walkers does not, in the available results, fundamentally alter the macroscopic dichotomy seen for a single walker. On a three-node segment with two walkers and linear reinforcement, the left-edge weight proportion is a bounded martingale at certain stopping times, hence converges almost surely to a random limit [2311.08796]. On \(\mathbb Z\) with arbitrary finite \(K\) and very general reinforcement, either all walkers are recurrent or all walkers have finite range; no mixed behavior occurs [2311.08796].

The strongly reinforced regime behaves differently from the linear one. For super-linear reinforcement on arbitrary infinite connected graphs of bounded degree, if the reinforcement weight function \(w\) is reciprocally summable, then the walk traverses a random attracting edge at all large times, settling a conjecture of Sellke [1509.00807]. This is genuine localization: eventually the walk moves back and forth across a single random edge forever.

These variants clarify that “ERRW” is not a single asymptotic universality class. Linearity, reversibility, and the number of interacting walkers each matter at the level of limiting behavior.

## 6. Statistical and information-theoretic viewpoints

Recent work treats ERRW not only as a probabilistic object but also as a statistical model. On finite connected graphs with positive initial edge weights, one can ask whether the initial weights \(\mathbf A=(a_e)_{e\in E}\) are identifiable from observed trajectories. Using the magic formula and explicit moment identities, a generalized method of moments estimator has been proposed for estimating \(\mathbf A\) from multiple independent sample trajectories [2503.06115]. The analysis is non-asymptotic and exploits a hyperbolic Gaussian representation of the random environment.

A central negative result is that a single trajectory, even infinitely long, is never sufficient for parameter identification [2503.06115]. By contrast, with multiple i.i.d. trajectories one obtains explicit sample-complexity bounds. The estimation method uses moment equations built from random variables such as
\[
U_e:=P_{ij}P_{ji},
\]
where \(P_{ij}\) is the environment-induced transition probability across edge \(e=\{i,j\}\) [2503.06115].

The environment laws themselves admit an information-theoretic analysis. For finite graphs, the magic-formula family forms a regular exponential family in the initial weights, enabling explicit formulas for the entropy rate and for Kullback–Leibler divergences between ERRW models [2605.21853]. The entropy rate has an annealed representation,
\[
r(v_0,A)=\mathbb E_W[r(P_W)],
\]
and the KL divergence between two environment laws \(\mu_0,\mu_1\) takes the form
\[
D(\mu_0\|\mu_1)
=
\sum_{e\in E}\Lambda(a_e^{(0)},a_e^{(1)})
-
\sum_{v\in V}\Lambda(b_v^{(0)},b_v^{(1)}),
\]
with
\[
\Lambda(p,q)=\log\Gamma(q)-\log\Gamma(p)-(q-p)\Psi(p).
\]
The trajectory-level KL divergence converges to the environment-level KL divergence, and the gap is described by an explicit posterior-gap identity [2605.21853].

These developments place ERRW within contemporary statistical theory for dependent data. A plausible implication is that the random-environment representation is not merely an analytical convenience: it is also the correct parameterization for inference, testing, and information measures.

Source: https://www.emergentmind.com/topics/edge-reinforced-random-walk-errw