---
title: Random Walk with Jumps in Graph Sampling
url: https://www.emergentmind.com/topics/random-walk-with-jumps-graph-sampling
type: topic
---

# Random Walk with Jumps in Graph Sampling

A random walk with jumps (RWJ) is a Markovian process on a graph where standard local transitions are augmented with a stochastic component allowing transitions (jumps) to remote or uniformly chosen nodes. This mechanism improves the exploration and mixing properties of random walks used for network sampling, estimation, statistical learning, and decentralized optimization on complex networks. RWJ and its numerous variants—random walk with escaping (RWE), random walk with weighted or indirect jumps, random multi-hopper, and combinations with Metropolis–Hastings (MH)—form a foundation for sampling and learning algorithms capable of efficiently traversing networks with pronounced bottlenecks, heavy-tailed degree distributions, and sparse connectivity.

## 1. Mathematical Formulation of Random Walk with Jumps

The canonical RWJ augments the adjacency structure of a graph $G=(V,E)$ by incorporating a jump probability—parameterized by $\alpha>0$—allowing a walk to transition to any node with nonzero probability. In the simplest undirected setting, let $A=(a_{ij})$ be the (possibly weighted) adjacency matrix, $d_i=\sum_j a_{ij}$ the degree of node $i$, and $n=|V|$. The transition kernel is

\[
P_{ij}(\alpha) = \begin{cases}
  \frac{1+\alpha/n}{d_i+\alpha}, & (i,j)\in E, \\
  \frac{\alpha/n}{d_i+\alpha},   & i\neq j,\,(i,j)\notin E.
\end{cases}
\]

The stationary distribution is

\[
\pi_i(\alpha) = \frac{d_i + \alpha}{2m + \alpha n},
\]
where $m=|E|$ for undirected graphs. For $\alpha\to 0$ this reduces to degree-proportional bias; for $\alpha\to\infty$, to the uniform distribution. The spectral gap

\[
\gamma(\alpha) = 1 - \max\{ |\lambda_2(\alpha)|, |\lambda_n(\alpha)| \}
\]
quantifies relaxation and mixing; introducing jumps guarantees $\gamma(\alpha)\geq\alpha/(d_{\max}+\alpha)$, and thus mixing time scales as $O(1/\gamma(\alpha))$ [1805.03260].

In directed graphs, the analogous process yields transition probabilities

\[
q_{u\rightarrow w} =
\begin{cases}
  \displaystyle \frac{1}{d_{\text{out}}(u)+\alpha} & \text{if }(u\rightarrow w)\in E, \\
  \displaystyle \frac{\alpha}{(d_{\text{out}}(u)+\alpha)N} & \text{if } w \text{ is reached by a jump}, \\
  0 & \text{otherwise}
\end{cases}
\]
with stationary $\pi(w) \propto d_{\text{in}}(w) + \alpha$ [2205.05885].

These processes are aperiodic and irreducible for $\alpha>0$, with ergodic averages supporting unbiased estimation of node statistics via bias-correction.

## 2. Impact on Mixing, Spectral Properties, and Practical Tuning

Introducing jumps dramatically enlarges the spectral gap, especially for graphs with pronounced clustering or structural bottlenecks. For the standard RWE (random walk with escaping), the kernel

\[
P_{uv} = \alpha \cdot \frac{1}{N} + (1-\alpha) \cdot \frac{1}{d_u}1_{(u,v)\in E}
\]
ensures $1-\lambda_2(P)\geq\alpha$, leading to total-variation mixing time $\tau_{\mathrm{mix}}\leq\frac{1}{\alpha}[\log(1/\epsilon) + \log(1/\pi_{\min})]$ [2209.13103]. Empirical studies report 5–10× faster mixing than simple random walk for $\alpha\sim0.15$ on OSNs [2209.13103, 1805.03260].

Optimal jump rate $\alpha$ is application- and topology-dependent. For degree-heterogeneous graphs, choosing $\alpha$ on the order of the mean or maximum degree balances local coverage and fast mixing [1805.03260, 2205.05885]. In WJRW, setting $C\sim0.4d_{\max}$–$0.7d_{\max}$ yields the best KL-divergence and coverage [2209.12767].

For nonuniform or weighted jumps, as in Ruelle–Bowen walks, continuous-time generators with maximal entropy rates (i.e., those equidistributing paths of a given length and end-points) provide alternative sampling processes, with invariant distributions related to Perron–Frobenius eigenvectors [1802.04436].

## 3. Advanced Variants: Weighted, Multi-hop, and Indirect Jumps

### Weighted Jump Random Walk (WJRW)

The WJRW introduces a tunable parameter $C$ to mediate between standard random walk and uniform node sampling without degrading conductance. The transition from node $i$ is:

- Walk to a neighbor: $p_{\mathrm{walk}}(i) = d_i/\max\{C,d_i\}$
- Jump to a low-degree node in $U = \{i: d_i<C\}$: $p_{\mathrm{jump}}(i) = [\max\{C,d_i\}-d_i]/\max\{C,d_i\}$

Stationary distribution interpolates between degree-proportional and uniform, with mixing rate and practical performance peaking at $C$ near $0.5 d_{\max}$ [2209.12767].

### Indirect Jumps via Two-Layer Structures

When uniform node sampling is infeasible, a two-layer graph model with a target, auxiliary, and bipartite coupling graph enables indirect jumps. Here, jumps are realized by sampling on the auxiliary graph and mapping via the bipartite structure [1708.09081]. The stationary distribution and unbiased estimation are guaranteed by detailed balance, and performance matches or exceeds traditional RWJ if the coupling is sufficiently mixing.

### Multi-hopper and Power-law Distance Kernels

In the random multi-hopper model, the walk jumps to any node with probability decaying with shortest-path distance:

\[
P_{ij}^\tau = \frac{f_\tau(d_{ij})}{\sum_{k\neq i} f_\tau(d_{ik})},\quad f_\tau(d) = d^{-s}\ \text{(Mellin)},\ f_\tau(d)=e^{-l d}\ \text{(Laplace)}
\]
As $s\to 0$ or $l\to 0$, the process converges to the complete-graph RW, achieving optimal mixing ($H_{uv}\to n-1$ for all node pairs). Intermediate values offer tunable trade-offs between locality and mixing [1612.08631].

## 4. Random Walk with Jumps for Decentralized Learning and Metropolis–Hastings

Weighted transition matrices, e.g., via MH to match node-wise smoothness or data heterogeneity, enable importance sampling in decentralized stochastic gradient descent. However, such walks are susceptible to "entrapment": getting stuck on high-weight vertices, causing slow mixing and sample correlation [2604.12260, 2407.20611].

Metropolis–Hastings with Lévy Jumps (MHLJ) addresses this by interleaving MH steps with random-length jump sequences sampled from a truncated geometric on graph distance. The composite kernel

\[
P_{\mathrm{MHLJ}} = (1-p_J)P_{\mathrm{MH}} + p_J P_{L\acute e vy}
\]
retains desired stationary law up to $O(p_J)$ bias, while enhancing the spectral gap and eliminating entrapment. Theoretical results show convergence bounds with mixing-time factors, and the error gap induced by jumps decays as $O(p_J^2)$ [2604.12260].

Empirical and theoretical recommendations set $p_J\sim0.05$–$0.1$, with adaptive decay as sampling saturates. Long-range jumps implemented as short uniform neighbor-to-neighbor sequences are both decentralization-compatible and effective under locality constraints [2604.12260, 2407.20611].

## 5. Applications and Estimation Techniques

RWJ and its extensions are applied in:

- Social network sampling: robust degree, motif, and order estimation via bias-corrected estimators, e.g., Horvitz–Thompson or Hansen–Hurwitz, with sample weights determined by stationary distribution [2205.05885, 1703.08252].
- Decentralized machine learning: token-based model propagation and data-parallel SGD under heterogeneity are accelerated via weighted RWJ or MHLJ to ensure representative and fast exploration [2604.12260].
- Max-entropy path sampling and motif analysis: Ruelle–Bowen continuous-time models are essential when uniform path coverage is required [1802.04436].
- Network exploration and crawling: multi-hopper models, indirect jumps, and WJRW provide approaches to fast coverage, especially when access to uniform sampling is limited or expensive [1612.08631, 1708.09081, 2209.12767].

## 6. Estimator Construction and Practical Guidelines

Given the non-uniform stationary law, unbiased estimators for any function $f$ are constructed as

\[
\widehat{f} = \frac{\sum_{t=1}^T f(v_t)/\pi(v_t)}{\sum_{t=1}^T 1/\pi(v_t)}
\]
where $\pi(v)$ is specified by the transition kernel (e.g., $\pi(v)\propto d_{\text{in}}(v)+\alpha$ for RWwJ on directed graphs) [2205.05885, 1708.09081, 2209.13103].

For tuning:

- Choose the jump parameter to balance estimator variance and bias; higher jump rates accelerate mixing but reduce locality.
- When possible, apply hybrid initial sampling (multiple seeds) plus jumps to optimize estimator variance across degree ranges [1703.08252].
- Burn-in: discard initial samples up to the empirical mixing time, often $O((1/\alpha)\log n)$ [2209.13103, 2205.05885].
- For highly clustered or large-diameter networks, prioritize higher jump rates or longer-range kernels to prevent correlated samples [1612.08631, 2209.12767].

## 7. Related Models and Extensions

RWJ connects to PageRank (with restart), continuous-time Markov jump processes (Ruelle–Bowen, maximal entropy), and multi-walker and multi-hopper models. Each imbues the random walk process with additional flexibility, adapting coverage, bias, and mixing rates to task and topology. DUFS and related multi-walker jump schemes further generalize the paradigm to allow stratification over initial placements, parallelization, and adaptive hybrid estimators [1703.08252].

Empirical evidence consistently documents the superior mixing, coverage, and estimator variance properties of RWJ and its variants, especially in power-law, clustered, or otherwise structurally heterogeneous graphs [1805.03260, 2209.12767, 1612.08631]. Constraints arise in situations disallowing uniform sampling; indirect or multi-hop jump methodologies mitigate these limitations at the expense of more intricate estimator structures [1708.09081]. In decentralized learning, RWJ combined with MH and Lévy-type jumps is currently the state-of-the-art solution for overcoming entrapment and heterogeneity-induced mixing bottlenecks [2604.12260, 2407.20611].

Source: https://www.emergentmind.com/topics/random-walk-with-jumps-graph-sampling