---
title: Diversity-Driven RandomWalks for News Recommenders
url: https://www.emergentmind.com/topics/diversity-driven-randomwalks-d-rdw
type: topic
---

# Diversity-Driven RandomWalks for News Recommenders

Searching arXiv for the named method and closely related random-walk diversification papers.
arXiv search query: "D-RDW Diversity-Driven Random Walks news recommender systems random walks with erasure directed random walks negative reinforcement"
Diversity-Driven RandomWalks (D-RDW) denotes a family of recommendation and ranking methods that use modified random-walk dynamics or random-walk-based selection procedures to improve diversity without discarding graph-based relevance signals. In the most explicit formulation, D-RDW is a lightweight algorithm and re-ranking technique for news recommendation that combines random walks on a user–article graph with customizable **Normative Target Distributions (NTDs)** over article properties such as sentiment and political party mentions, thereby treating diversity as a controllable in-processing objective rather than only a post-hoc constraint [2508.13035]. In a broader historical sense, D-RDW also describes a line of work in which diversity is induced by directing similarity flow toward low-degree users, by propagating negative reinforcement in Personalized PageRank, or by selectively erasing walk mass and reinjecting it to the source, all with the shared aim of counteracting popularity concentration, redundancy, or ideological homophily [1201.6278], [1207.6600], [2102.09635].

## 1. Conceptual scope and historical lineage

The explicit term **“D-RDW”** appears in “D-RDW: Diversity-Driven Random Walks for News Recommender Systems” [2508.13035], where it names a news recommender that integrates random-walk candidate generation with constraint-based sampling over interpretable article properties. The paper frames the method as a **societal recommender** and links it to **normative** and **democratic** news recommender systems, emphasizing that diversity in political news is not merely a secondary utility metric but a mechanism for operationalizing editorial and societal values [2508.13035].

Earlier work established closely related mechanisms without using the D-RDW label. “Solving the accuracy-diversity dilemma via directed random walks” introduced the **NCF algorithm**, a collaborative filtering method based on **directed random walks** on a user–object bipartite graph, where the key intervention is to use similarity **from neighbors to the target user** so that low-degree users exert greater influence and niche items are more likely to surface [1201.6278]. The paper’s central theoretical identity,
\[
\frac{s_{ij}}{s_{ji}}=\frac{k_{u_i}}{k_{u_j}},
\]
shows that directed similarity is reverse to the initial node’s degree and provides a formal explanation for why changing the direction of random-walk similarity can improve diversity while maintaining or improving accuracy [1201.6278].

A second branch is “Diversity in Ranking using Negative Reinforcement,” which proposed **Negative Reinforcement Ranking (NR2)**, an iterative top-\(k\) graph ranking method based on repeated Personalized PageRank solves with negative prior mass assigned to already selected nodes [1207.6600]. NR2 is not a one-shot random walk but a greedy diversity-driven procedure in which anti-redundancy signals are propagated over the graph through the restart vector. A third related branch is “Random Walks with Erasure: Diversifying Personalized Recommendations on Social and Information Networks,” which introduced **Random Walk with Erasure (RWE)**, where source–destination-specific erasure probabilities suppress some walk mass and reinject it to the source, shifting recommendations toward ideologically diverse or long-tail items [2102.09635].

These papers do not define a single unified D-RDW formalism. This suggests that the term functions both as the proper name of the 2025 news method and as a useful umbrella for diversity-aware random-walk recommenders that modify walk direction, restart behavior, endpoint retention, or candidate selection in order to alter the composition of the final ranking.

## 2. Core formulation in news recommendation

In the 2025 formulation, D-RDW operates on a **bipartite graph** of user nodes and item or article nodes, with edges representing **clicks** [2508.13035]. The method is organized into three stages: **pre-processing**, **in-processing**, and **post-processing**. Pre-processing constructs and augments the graph; in-processing performs random walks and distribution-constrained sampling; post-processing ranks the selected items and may optionally apply graph coloring for more homogeneous category presentation [2508.13035].

The random-walk stage begins from the target user and uses **3 hops** on the user–article graph. Because the graph is bipartite, odd hop counts terminate on articles, and the pseudocode increases hop count by \(2\) when necessary, yielding the sequence
\[
3,5,7,\dots,\texttt{maxHops}.
\]
The paper states that candidate items can be sorted by **random walk transition probability or prediction score**, but it does **not** provide an explicit transition-matrix equation, personalized PageRank equation, teleportation term, or restart law [2508.13035]. Accordingly, the walk is specified procedurally rather than through a closed-form Markov formulation.

The distinctive mechanism is the **Normative Target Distribution (NTD)**. After walk-based candidate generation and filtering of items already in the user’s history, D-RDW selects a subset whose composition matches specified target proportions over interpretable article properties. The paper presents this as a binary selection problem with a binary vector \(X\), where \(x_i\in\{0,1\}\) indicates whether candidate item \(i\) is chosen. In the illustrative example,
\[
\begin{pmatrix}
I^\intercal \\
P^\intercal \\
S^\intercal
\end{pmatrix}
X=
\begin{pmatrix}
20\\
15\\
10
\end{pmatrix},
\]
so the list must contain exactly \(20\) items, \(15\) satisfying the political criterion, and \(10\) satisfying the sentiment criterion [2508.13035]. The sampling objective is
\[
\max \sum_i c_i \cdot x_i,
\]
where \(c_i\) can be **random walk transition probability** or another numeric item feature such as **recency** [2508.13035].

If the constraints are infeasible, D-RDW reduces the target size by one until it finds the maximum-sized subset satisfying both the NTD ratios and the adjusted target size [2508.13035]. If there are still fewer than `targetSize` items after the walk-and-sample loop, the system fills the remaining positions with **randomly selected articles** and then ranks the final recommendations [2508.13035].

This architecture differs from standard re-ranking because diversity is imposed during recommendation generation rather than only after a candidate list is fixed. It also differs from earlier walk diversification methods because the diversity criterion is encoded as an explicit distribution over article attributes rather than only through altered transition dynamics.

## 3. Normative target distributions and controllable diversity

A defining property of D-RDW is that diversity is specified through editorially interpretable distributions over article properties. In the main experiment, the target dimensions are **sentiment** and **political party mentions** [2508.13035]. Sentiment is discretized into four buckets with target proportions:
- \([-1,-0.5)\): \(20\%\)
- \([-0.5,0)\): \(30\%\)
- \([0,0.5)\): \(30\%\)
- \([0.5,1]\): \(20\%\)

Political party mentions are divided into five buckets:
1. government parties (including supporting parties): \(15\%\)
2. opposition parties: \(15\%\)
3. both government and opposition: \(15\%\)
4. independent/foreign parties: \(15\%\)
5. no political parties: \(40\%\) [2508.13035]

The paper treats these distributions as one operationalization of a **deliberative recommender** and explicitly associates party mentions with **viewpoints** and sentiment with **emotion** [2508.13035]. Editors can also choose **which dimensions matter**, **what proportion of the list each bucket should occupy**, **how large the recommendation list should be**, and **what objective should be optimized among feasible items** [2508.13035]. The paper discusses **category** as another interpretable property, although it is not included in the main NTD [2508.13035].

This degree of controllability is central to the method’s normative interpretation. Rather than leaving diversity as an emergent property of graph structure, D-RDW makes recommendation composition directly parameterizable in human-readable terms such as “15% opposition-party articles” or “20% strongly negative sentiment” [2508.13035]. A plausible implication is that D-RDW shifts part of recommender design from latent optimization toward explicit policy specification.

The constraint-based sampling mechanism also sharply distinguishes D-RDW from diversity-aware methods that encode diversity indirectly. In NCF, diversity emerges because low-degree users receive more influence under directed similarity [1201.6278]. In NR2, diversity emerges because negative prior mass demotes nodes near already selected ones [1207.6600]. In RWE, diversity emerges because source–destination-specific erasure probabilities suppress ideologically similar or high-degree endpoints [2102.09635]. D-RDW instead exposes target diversity as a user- or editor-defined output distribution [2508.13035].

## 4. Relation to precursor random-walk diversification methods

The D-RDW name is most precise for the 2025 news recommender, but its design belongs to a broader methodological lineage of diversity-aware random walks.

### Directed random walks and NCF

In the NCF algorithm, the system is represented as a user–object bipartite graph
\[
G(U,O,E),
\]
with adjacency matrix
\[
A=\{a_{\alpha j}\}\in R^{m,n},
\]
where \(a_{\alpha j}=1\) if object \(o_\alpha\) is collected by user \(u_j\), and \(0\) otherwise [1201.6278]. The directed similarity from user \(u_j\) to user \(u_i\) is
\[
s_{ij}=\frac{1}{k_{u_j}}\sum_{l=1}^m\frac{a_{li}a_{lj}}{k_{o_l}},
\]
and the prediction rule is
\[
v_{i\alpha}=\frac{\sum_{j=1}^n s_{ij}^{\beta} a_{\alpha j}}{\sum_{j=1}^n s_{ij}^{\beta}}.
\]
Because
\[
\frac{s_{ij}}{s_{ji}}=\frac{k_{u_i}}{k_{u_j}},
\]
the similarity is inversely related to the degree of the source user. Reorienting similarity from neighbors to the target user therefore amplifies low-degree users, which the paper argues helps reveal niche objects and solve the **accuracy-diversity dilemma** [1201.6278].

### Negative reinforcement in Personalized PageRank

NR2 uses a row-normalized similarity matrix \(W\), a preference vector \(r\), and damping factor \(\lambda\), with Personalized PageRank defined by
\[
p=(1-\lambda)r+\lambda W' p
\]
or equivalently
\[
(I-\lambda W')p=(1-\lambda)r.
\]
After each selection, the prior is modified so that already selected nodes receive negative mass, unselected nodes receive the remaining positive mass, and an absorbing node \(d\) receives mass \(\beta\):
\[
r^*(d)=\beta,\qquad r^*(A)=(-\alpha)\,r^*(A),\qquad r^*(B)=(1+\alpha-\beta)\,r^*(B).
\]
This propagates negative influence to nearby vertices and causes the next argmax to come from a different central region [1207.6600]. Relative to D-RDW, NR2 is diversity-driven in mechanism but **greedy and iterative**, not a unified recommender over the full candidate space.

### Random Walk with Erasure

RWE starts from a finite odd-length walk on a user–item graph with transition matrix
\[
P=D^{-1}A^\mathcal{G},
\]
and then applies a source–destination-specific **erasure matrix**
\[
Q\in[0,1)^{(m+n)\times(m+n)}.
\]
If walk mass \(p\) reaches destination \(j\) from source \(i\), the method erases \(p\times q\), retains \(p(1-q)\), and returns the erased mass to the source for the next iteration [2102.09635]. For long-tail diversification,
\[
Q^D_{i,j}=1-\frac{1}{D_{j,j}^{\beta}},
\]
so high-degree items receive higher erasure. For ideological bridging,
\[
Q^B_{u,i}=
\begin{cases}
sim(u,i), & \text{if } i \text{ is a bridge with respect to } u\\
\epsilon, & \text{otherwise}
\end{cases}
\]
with \(\epsilon<1\) [2102.09635]. The method thus implements diversity by selective endpoint suppression and source reinjection.

Across these variants, the common principle is that a random walk’s default bias toward popular, central, or nearby regions is modified so that underrepresented regions of the graph receive more probability mass or more final-list representation.

## 5. Experimental evaluation and empirical behavior

The most detailed D-RDW evaluation concerns news recommendation on **EB-NeRD small**, drawn from the RecSys 2024 Challenge benchmark [2508.13035]. The reported test setup includes **15,339 users**, an article pool of **4,400+ articles**, a median of **11 impression items per user session**, and a median of **1 clicked item per session** [2508.13035]. Because diversity metrics require larger lists, the evaluation ranks over the **entire test pool** to generate **top-20 recommendation lists** rather than limiting ranking to the original impressions [2508.13035].

The baselines comprise neural news recommenders (**LSTUR**, **NPA**, **NRMS**), re-ranking baselines (**G-KL**, **PM-2**, **MMR**), random-walk baselines (**3**, **RWE-D**), and a **Random** baseline [2508.13035]. Accuracy is measured by **AUC**, while diversity is evaluated using **RADio** metrics, **Gini**, **ILD**, and computational cost metrics [2508.13035].

### Accuracy and cost

Reported AUC values are:
- **3**: **0.565**
- **LSTUR**: **0.564**
- **D-RDW**: **0.554**
- **RWE-D**: **0.554**
- **NPA**: **0.554**
- **NRMS**: **0.549**
- **Random**: **0.500** [2508.13035]

These results show that D-RDW is competitive but not the strongest pure-accuracy model. The paper’s claim is therefore not that D-RDW dominates AUC, but that it offers a better overall compromise between accuracy, diversity, and cost [2508.13035].

Training and recommendation cost were reported in watt-seconds:

| Method | Train Cost | Recommendation Cost |
|---|---:|---:|
| LSTUR | 351.12 | 69.84 |
| NPA | 523.05 | 51.25 |
| NRMS | 326.55 | 63.23 |
| D-RDW | 2.81 | 11.76 |
| 3 | 2.75 | 1.27 |
| RWE-D | 3.15 | 0.27 |

These numbers support the claim that random-walk methods are about **one order of magnitude cheaper** than the neural baselines in this setting [2508.13035]. D-RDW is more expensive than simpler random-walk baselines because the NTD sampling step adds overhead, but it remains much cheaper than the neural models [2508.13035].

### Diversity results

On the norm-relevant dimensions, D-RDW exactly matches the **NTV** targets on both **Gini** and **ILD**:
- **Sentiment Gini = 0.133**
- **Party Gini = 0.250**
- **Sentiment ILD = 0.779**
- **Party ILD = 0.789** [2508.13035]

The paper also reports strong **RADio** values for D-RDW:
- Activation: **0.374**
- Category Calibration: **0.407**
- Complexity Calibration: **0.229**
- Fragmentation: **0.394**
- Alternative Voices: **0.107**
- Representation: **0.556** [2508.13035]

The interpretation given in the paper is that D-RDW is the **best overall compromise** across normative diversity, traditional diversity, computational cost, and AUC, with “consistent scores in the top 3 across all four dimensions” [2508.13035]. At the same time, the results do not imply that D-RDW is the best on every metric. For example, **3** has slightly higher AUC and lower recommendation cost, and **Random** has the strongest category ILD and category Gini, which is unsurprising because category is not part of D-RDW’s NTD [2508.13035].

A related point is that the underlying corpus distribution is highly imbalanced. For party mentions, the EB-NeRD distribution is \(2.66\%\) government/supporters, \(0.88\%\) opposition, \(0.41\%\) both, \(16.96\%\) independent/foreign, and \(79.09\%\) no political entities; sentiment is \(9.51\%\) negative, \(58.01\%\) somewhat negative, \(30.01\%\) somewhat positive, and \(2.48\%\) positive [2508.13035]. Any method that matches the target distribution therefore diverges substantially from the raw corpus. This suggests that D-RDW’s diversity gains depend not only on walk-based exploration but on the ability of its sampling stage to impose a composition that the data distribution would not naturally produce.

## 6. Interpretation, limitations, and adjacent theory

D-RDW occupies a distinctive position among random-walk recommender methods because it combines graph-based recommendation with explicit distributional control. This makes it transparent and controllable in a way that is atypical of latent-factor or neural ranking models [2508.13035]. It also differs from most prior diversity-aware random-walk methods by exposing what counts as diversity in externally specified, interpretable dimensions.

Several limitations are explicit in the literature. The D-RDW paper does **not** provide formal transition equations, normalization details, teleportation or restart mechanics, or a complete probabilistic derivation of the random walk itself [2508.13035]. This limits reproducibility from the text alone. The same paper also acknowledges that diversity outcomes depend strongly on the dataset distribution, that the chosen NTD is normative and contestable, that personalization of diversity is limited because the same NTD is broadly applied, and that offline gains do not establish user acceptance or engagement effects [2508.13035].

The earlier walk-diversification papers expose complementary limitations. NCF depends on the degree structure of the user–item graph and is especially compelling when many users have low degree [1201.6278]. NR2 is iterative and optimized for top-\(k\) selection, not full-list ranking over a large candidate space [1207.6600]. RWE offers an expressive source–destination-specific erasure policy but does not provide a full pseudocode specification, a closed-form converged score equation, or explicit complexity analysis [2102.09635].

A broader theoretical perspective on random-walk diversity comes from “Revisiting Random Walks for Learning on Graphs,” which studies **Random Walk Neural Networks (RWNNs)** rather than recommendation directly [2407.01214]. That paper does not define D-RDW, but it argues that random-walk learning can be understood in terms of **coverage**, **cover time**, and **probabilistic under-reaching**, with non-backtracking, degree-biased walks, and restart mechanisms improving exploration efficiency [2407.01214]. This suggests a theoretical lens for D-RDW-like systems: diversity can be interpreted not only as distributional balance in the output list but also as non-redundant exploration of graph regions that standard walks would under-sample.

A further adjacent development is “Information Geometry of Absorbing Markov-Chain and Discriminative Random Walks,” which analyzes **Discriminative Random Walks (DRWs)** through class-specific hitting-time laws, Fisher information, and sensitivity geometry [2602.08185]. That work is not a D-RDW method, but it provides a mathematical framework for reasoning about identifiable perturbation directions and nonredundant node selection. A plausible implication is that future D-RDW variants could combine output diversity with geometrically diverse seed, node, or edge perturbations [2602.08185].

Taken together, the literature shows that D-RDW can refer narrowly to a 2025 news recommender with NTD-constrained random-walk sampling, or more broadly to a class of methods that alter random-walk recommendation so that diversity becomes a first-class design objective rather than a side effect of graph proximity [2508.13035], [1201.6278], [1207.6600], [2102.09635]. In the explicit news setting, its defining contribution is the insertion of interpretable, editor-controllable target distributions into the recommendation pipeline. In the broader methodological lineage, its significance lies in demonstrating that changes to random-walk direction, restart mass, endpoint retention, or constrained selection can redistribute recommendation exposure away from popularity-dominated or homogeneous regions of the graph.

Source: https://www.emergentmind.com/topics/diversity-driven-randomwalks-d-rdw