---
title: Agreement Drift in Multi-Agent LLM Systems
url: https://www.emergentmind.com/topics/agreement-drift
type: topic
---

# Agreement Drift in Multi-Agent LLM Systems

Searching arXiv for the cited papers and closely related work on agreement drift in multi-agent LLM systems.
Agreement drift denotes a class of phenomena in which apparent consensus emerges or degrades through stochastic or asymmetric interaction dynamics rather than through robust shared evidence. In multi-agent large language model populations, the term has two closely related technical uses. In "When Is Collective Intelligence a Lottery? Multi-Agent Scaling Laws for Memetic Drift in LLMs" [2603.24676], agreement drift is the population-level convergence produced when quantized messages and mutual in-context learning amplify sampling noise into consensus. In "Network Effects and Agreement Drift in LLM Debates" [2604.11312], agreement drift is a directional susceptibility in debates, where movement toward endorsing the discussion statement is systematically more likely than movement toward rejecting it. A third, coordination-focused usage appears in "Agent Drift: Quantifying Behavioral Degradation in Multi-Agent LLM Systems Over Extended Interactions" [2601.04170], where agreement drift is the progressive degradation of inter-agent consensus over extended interactions. Taken together, these formulations identify agreement drift as a nontrivial collective mechanism: agreement or loss of agreement can arise from interaction protocol, bandwidth, adaptation, network exposure, and temporal compounding, rather than from truth-tracking collective reasoning alone.

## 1. Conceptual scope and principal definitions

Agreement drift in the sense of memetic drift is defined as consensus driven by sampling noise amplified through mutual in-context learning in LLM populations [2603.24676]. Agents begin without any preference among labels, yet repeated interactions produce symmetry breaking and eventual consensus. The key mechanism is that the population is its own data source: one agent’s arbitrary sample becomes the next agent’s evidence, so chance fluctuations can be amplified into agreement even when no agent has an a priori label preference [2603.24676].

The same term is used differently in LLM debate settings. There, agreement drift is introduced as a directional susceptibility in LLM debates: when agents holding opposing views interact, movement toward endorsing the discussion statement is systematically more likely than movement toward rejecting it, even in balanced populations [2604.11312]. The paper states that this effect is not simply sycophancy; it is an intrinsic asymmetry favoring agreement over rejection in pairwise persuasion.

In longer-horizon agentic systems, agreement drift is framed as a manifestation of coordination drift. The relevant definition is the progressive degradation of inter-agent consensus over extended interactions—agents increasingly fail to reach unanimous or supermajority agreement on decisions they could previously coordinate on [2601.04170]. This formulation places agreement drift alongside semantic drift and behavioral drift, distinguishing failures of alignment among agents from deviations in task intent or strategy.

These uses are distinct but structurally related. One concerns neutral convergence without bias, one concerns asymmetric persuasion toward endorsement, and one concerns erosion of coordination over time. This suggests that "agreement drift" is best understood as an umbrella term for agreement dynamics that are induced by system mechanics rather than by stable exogenous evidence.

## 2. Neutral agreement drift and the Quantized Simplex Gossip model

The most explicit formalization of agreement drift appears in the Quantized Simplex Gossip (QSG) model [2603.24676]. There are $N$ agents and $K$ labels. Agent $i$ holds a belief vector $x_i$ in the $(K-1)$-simplex,
$$
x_i \in \Delta^{K-1} = \{x \in \mathbb{R}^K : x_k \ge 0, \sum_{k=1}^K x_k = 1\}.
$$
The population state is $X=(x_1,\dots,x_N)$, and all labels are neutral and exchangeable.

Interactions select an ordered speaker-listener pair $(S,L)$ uniformly from $N(N-1)$ pairs. Communication has an effective bandwidth $m$. Hard communication corresponds to $m=1$, where the speaker samples $k^\star \sim \mathrm{Cat}(x_S)$ and sends $y=e_{k^\star}$. Top-$m$ communication samples $k_1,\dots,k_m$ i.i.d. from $\mathrm{Cat}(x_S)$ and sends the empirical distribution
$$
y^{(m)} = \frac{1}{m} \sum_{j=1}^m e_{k_j}.
$$
Soft communication corresponds to $m=\infty$, where the full distribution $y=x_S$ is transmitted [2603.24676]. In all regimes, the message is unbiased:
$$
\mathbb{E}[y \mid x_S] = x_S.
$$
For Top-$m$, the message variance scales as
$$
\mathbb{E}[\|y^{(m)}-x_S\|_2^2 \mid x_S] = \frac{1}{m}(1-\|x_S\|_2^2).
$$

Only the listener updates, according to the first-order adaptation rule
$$
x_L' = (1-\alpha)x_L + \alpha y.
$$
Here $\alpha \in (0,1]$ is the in-context adaptation rate [2603.24676]. Internal uncertainty of a belief state $x$ is captured by $1-\|x\|_2^2$, which is maximal near the uniform distribution and minimal at simplex vertices.

The principal macroscopic observables are the population mean
$$
\bar{x} = \frac{1}{N}\sum_{i=1}^N x_i,
$$
the polarization
$$
U = \|\bar{x}\|_2^2 \in [1/K,1],
$$
and the disagreement energy
$$
V = \sum_{i=1}^N \|x_i-\bar{x}\|_2^2 \ge 0
$$
[2603.24676]. In this framework, $U$ measures coordination irrespective of which label wins, while $V$ measures dispersion around the mean.

The critical distinction is between averaging and quantized exchange. Under Soft exchange, the mean is preserved in expectation and disagreement contracts:
$$
\bar{x}'=\bar{x}+\frac{\alpha}{N}(x_S-x_L), \qquad \mathbb{E}[\bar{x}'\mid X]=\bar{x},
$$
and
$$
\mathbb{E}[\Delta V \mid X]_{\mathrm{soft}} =
- \frac{2\alpha}{N-1}\left(1-\alpha+\frac{\alpha}{N}\right)V \le 0.
$$
Thus, from a perfectly symmetric initialization $x_i=1/K$ for all $i$, Soft exchange neither breaks symmetry nor creates consensus under neutrality [2603.24676].

Quantized communication adds a variance-injection term. For Hard sampling,
$$
\mathbb{E}[\Delta U \mid X]_{\mathrm{hard}} =
\mathbb{E}[\Delta U \mid X]_{\mathrm{soft}} +
\frac{\alpha^2}{N^2}\,\mathbb{E}[1-\|x_S\|_2^2 \mid X].
$$
At symmetry,
$$
\mathbb{E}[\Delta U \mid X]_{\mathrm{hard}} =
\frac{\alpha^2}{N^2}\left(1-\frac{1}{K}\right)>0.
$$
For Top-$m$,
$$
\mathbb{E}[\Delta U \mid X]_{\mathrm{top-m}} =
\mathbb{E}[\Delta U \mid X]_{\mathrm{soft}} +
\frac{\alpha^2}{mN^2}\,\mathbb{E}[1-\|x_S\|_2^2 \mid X],
$$
and at symmetry,
$$
\mathbb{E}[\Delta U \mid X]_{\mathrm{top-m}} =
\frac{\alpha^2}{mN^2}\left(1-\frac{1}{K}\right).
$$
Increasing bandwidth $m$ therefore reduces drift proportionally to $1/m$, while Soft exchange removes it [2603.24676].

This formulation is the core neutral theory of agreement drift: consensus can emerge even when labels are completely exchangeable and no agent has any ex ante preference.

## 3. Scaling laws, consensus times, and the drift-selection crossover

Under a homogeneous mean-field approximation, where $x_i \approx \bar{x}$ and $V \approx 0$, the expected polarization obeys
$$
\frac{dU}{dt} = \frac{\alpha^2}{mN^2}(1-U).
$$
From $U(0)=1/K$, the solution is
$$
U(t)=1-\left(1-\frac{1}{K}\right)e^{-\alpha^2 t/(mN^2)}.
$$
The time to reach polarization threshold $U^\star \in (1/K,1)$ is
$$
t_{\mathrm{cons}}(U^\star) \approx
\frac{mN^2}{\alpha^2}\log\!\left(\frac{1-1/K}{1-U^\star}\right),
$$
or, in population rounds $\tau=t/N$,
$$
\tau_{\mathrm{cons}}(U^\star) \approx
\frac{mN}{\alpha^2}\log\!\left(\frac{1-1/K}{1-U^\star}\right)
$$
[2603.24676].

The dependence on control parameters is explicit. Larger $N$ slows polarization and increases consensus time quadratically in steps and linearly in rounds. Larger $m$ slows drift linearly. Larger $\alpha$ accelerates per-step movement as $\alpha^2$. Higher internal uncertainty increases the drift term that drives polarization [2603.24676].

The same paper develops a drift-selection crossover for two classes of weak asymmetry. For external sampling bias $h$ in the $K=2$ case, a diffusion approximation in population rounds gives
$$
d\bar{p} = \mu(\bar{p})\,d\tau + \sqrt{D(\bar{p})}\,dW,
$$
with
$$
\mu(\bar{p}) \propto \alpha h \bar{p}(1-\bar{p}), \qquad
D(\bar{p}) \propto \frac{\alpha^2}{mN}\bar{p}(1-\bar{p}).
$$
The dimensionless control parameter is
$$
\Gamma_h = \frac{mN}{\alpha}h.
$$
From $p_0=1/2$, the fixation probability that label 1 wins is approximated by
$$
\Pr(\mathrm{fix}\ 1) \approx \frac{1}{1+e^{-\Gamma_h}},
$$
and the crossover occurs when $|\Gamma_h| \approx 1$, giving a critical population size
$$
N_c \sim \frac{\alpha}{m|h|}.
$$
Increasing $N$ or $m$ suppresses neutral noise and makes a fixed weak bias more decisive; increasing $\alpha$ strengthens drift relative to the same $h$ [2603.24676].

For tempered sampling with $K \ge 2$, messages are sampled from
$$
g_T(x)_k \propto x_k^{1/T}, \qquad \sum_k g_T(x)_k = 1.
$$
Linearizing around symmetry yields
$$
\frac{d\delta}{d\tau} \approx \alpha(1/T-1)\delta.
$$
Thus $T<1$ amplifies small asymmetries, while $T>1$ damps them. Comparing this deterministic rate to the quantization-driven polarization rate gives
$$
\Gamma_T = \frac{mN}{\alpha}|1/T-1|.
$$
The system is drift-dominated when $\Gamma_T \ll 1$ and selection-dominated when $\Gamma_T \gg 1$, with crossover at $\Gamma_T \approx 1$ [2603.24676].

A central implication is that agreement can be a lottery when
$$
\left(\frac{mN}{\alpha}\right)\times (\text{selection strength}) \ll 1.
$$
Under these conditions, repeated runs can fix different winners with substantial variability even from identical prompts [2603.24676].

## 4. Relations to classical stochastic processes

The QSG framework is explicitly connected to several classical stochastic processes [2603.24676]. With $m=\infty$, the update is a DeGroot/Friedkin-Johnsen step in the simplex. The mean is preserved in expectation and disagreement contracts, so neutral Soft exchange behaves as a pure averaging process.

With Hard communication and $\alpha=1$, the process reduces after finitely many updates to the voter/Moran chain on a complete graph, which almost surely reaches consensus. In this regime, the coordinate of the population mean is a bounded martingale, so the probability that label $k$ fixes equals its initial population mean $\bar{x}_k(0)$ [2603.24676]. In the strictly neutral, two-label case with symmetric initialization, the dynamics reduces to the classical voter/Moran process and the winner is uniformly random. For $K>2$ under strict neutrality, winner probabilities are $1/K$.

For weak asymmetry in the $K=2$ case, the diffusion equation produces a Wright-Fisher-style neutral-drift baseline perturbed by weak selection. The backward equation is
$$
\mu(\bar{p})\pi'(\bar{p}) + \frac{1}{2}D(\bar{p})\pi''(\bar{p})=0,
$$
with solution
$$
\pi(p_0)=\frac{1-e^{-2\Gamma_h p_0}}{1-e^{-2\Gamma_h}},
$$
recovering the logistic fixation law at $p_0=1/2$ [2603.24676].

The comparison with non-LLM drift models clarifies what is novel. In the Neanderthal replacement analysis, neutral drift and differential fitness are contrasted in a stochastic Bi-directional Stepping-stone model equivalent to a Moran process with local replacement [1810.12397]. Under neutrality, fixation probability equals the initial fraction, and mean steps to absorption are
$$
s(b)=b(X-b).
$$
The paper argues that drift can in principle produce fixation, but that its timing, reliability, and path differ from selection in empirically consequential ways [1810.12397]. This suggests a useful analogy: in both demographic and LLM populations, drift can generate fixation without strong directional causes, but the empirical signature of that fixation depends on system-level properties such as timescale, variability, and trajectory.

## 5. Networked debate, persuasion asymmetry, and structural exposure

In debate-based LLM opinion dynamics, agreement drift is not neutral. It is operationalized through conditional persuasion probabilities,
$$
P\bigl(\text{disc} \rightarrow \text{opp} \mid o_{\text{disc}}, o_{\text{opp}}\bigr),
$$
and, with neighborhood awareness,
$$
P\bigl(\text{disc} \rightarrow \text{opp} \mid o_{\text{disc}}, o_{\text{opp}}, c\bigr),
$$
where $c \in \{\text{aligned}, \text{misaligned}, \text{mixed}\}$ encodes whether the discussant’s neighbors predominantly support the shift’s direction, oppose it, or are split [2604.11312]. Statistical validation uses a permutation-based null model with 1000 reshuffles preserving pre-interaction opinions and neighborhood composition, and only statistically significant entries at $p<0.01$ are reported.

The underlying network is generated by a BA-homophily model,
$$
\Pi_{ij} = \frac{h_{ij}\cdot k_i}{\sum_l h_{lj}\cdot k_l},
$$
with
$$
h_{aa}=h_{bb}=h, \qquad h_{ab}=h_{ba}=1-h,
$$
and homophily parameter $h \in \{0,0.25,0.5,0.75,1\}$ [2604.11312]. Complete heterophily yields cross-class ties only, neutral mixing reduces to Barabási-Albert attachment, and complete homophily yields within-class ties only.

The LLM-powered opinion dynamics system is represented as
$$
\mathfrak{F} = \langle \mathcal{G}, \mathcal{S}, \mathcal{O}, f, T, \mathcal{D} \rangle,
$$
with discrete opinions on a 7-point Likert scale $\mathcal{O}=\{0,1,2,3,4,5,6\}$ [2604.11312]. At each iteration, every agent randomly selects one neighbor for a debate of at most $\text{max\_rounds}=3$. The Discussant may ACCEPT, REJECT, or IGNORE. The update is
$$
o_i(t+1)=o_i(t)+\Delta o_i(t), \qquad \Delta o_i(t)\in\{-1,0,+1\}.
$$
The sign of $\Delta o_i(t)$ is determined by the exact ACCEPT and REJECT rules specified in the paper; only the Discussant updates, and the Opponent is stubborn [2604.11312].

The main quantitative results identify a robust interaction between intrinsic drift and network structure. In balanced populations with $\text{min}=0.5$, Llama agents systematically exhibit upward shifts toward agreement when exposed to cross-opinion interactions. Networks with $h \in [0,0.75]$ converge to the positive side within 20-40 iterations, while complete homophily yields persistent polarization due to segregation [2604.11312]. With a 70/30 split, convergence to agreement occurs in 20-30 iterations across all $h$. With 90/10, minority disappearance is rapid for $h \in [0,0.25]$, whereas higher $h$ preserves opposing clusters longer.

When the disagreeing class is the majority, negative majorities resist full consensus across intermediate homophily values. With $\text{min}=0.1$, strongly disagreeing clusters dominate across homophily; only at $h=1$ is an almost symmetric polarized outcome observed [2604.11312]. The paper interprets this as evidence that agreement drift persists locally, but structural exposure controls whether it propagates to consensus.

Neighborhood awareness changes the resulting macrostate. Providing discussants with their neighbors’ opinion distribution yields faster change and stabilizes moderate agreement. In balanced networks, convergence is nearly immediate but stops at agree rather than strongly agree [2604.11312]. In reversed 70/30 settings, negative majorities gradually shift to moderate or positive except at $h=1$. Under extreme imbalance, the majority stabilizes on agree.

Cross-model comparison reveals model-specific asymmetry. With Gemma, upward transitions approach probability 1 and high-opinion states become highly stable, indicating a stronger intrinsic agreement drift than in Llama [2604.11312]. A plausible implication is that agreement drift in debate systems has both structural and model-intrinsic components, and that network interventions alone may not remove it.

## 6. Agreement drift as long-horizon coordination degradation

A separate line of work uses the term for the loss, rather than spontaneous emergence, of inter-agent consensus [2601.04170]. In this framework, agreement drift is measured through the Inter-Agent Coordination component of the Agent Stability Index (ASI), especially the Consensus Agreement Rate $I_{\text{agree}}$.

The ASI is a weighted composite over 12 dimensions grouped into four categories: Response Consistency, Tool Usage Patterns, Inter-Agent Coordination, and Behavioral Boundaries [2601.04170]. The Inter-Agent Coordination category contains $I_{\text{agree}}$, $I_{\text{handoff}}$, and $I_{\text{role}}$. The composite index is
$$
\text{ASI}_t =
0.30 \cdot \frac{C_{\text{sem}} + C_{\text{path}} + C_{\text{conf}}}{3}
+ 0.25 \cdot \frac{T_{\text{sel}} + T_{\text{seq}} + T_{\text{param}}}{3}
+ 0.25 \cdot \frac{I_{\text{agree}} + I_{\text{handoff}} + I_{\text{role}}}{3}
+ 0.20 \cdot \frac{B_{\text{length}} + B_{\text{error}} + B_{\text{human}}}{3}.
$$
ASI is computed over rolling 50-interaction windows, with drift flagged when ASI falls below $\tau=0.75$ for three consecutive windows [2601.04170].

The agreement metric is formalized as
$$
I_{\text{agree}}(t)=
\frac{1}{W}\sum_{k=t-W+1}^{t}
\mathbf{1}\!\left[
\max_c \sum_{a=1}^{n}\mathbf{1}(y_a^{(k)}=c)\ge \lceil \theta n \rceil
\right],
$$
where $\theta$ is a unanimity or supermajority threshold [2601.04170].

The simulation study covers 847 workflows across enterprise automation, financial analysis, and compliance monitoring; interaction lengths range from 5 to 1,847 agent interactions per workflow, with a median of 127 [2601.04170]. Detectable drift, defined as ASI $<0.85$, appears after a median of 73 interactions, with IQR 52-114. The Inter-Agent Coordination component declines from approximately 0.99 to approximately 0.52 over 500 interactions, and inter-agent conflicts rise by $+487.5\%$ from 0.08/task to 0.47/task, with $p<0.001$ [2601.04170].

The decline accelerates over time: ASI falls by 0.08 points per 50 interactions over 0-100 interactions and by 0.19 points per 50 interactions over 300-400 interactions [2601.04170]. The paper attributes this to autoregressive compounding. Drifting systems with ASI $<0.70$ show substantial performance degradation relative to stable baselines with ASI $>0.85$: task success rate falls from 87.3% to 50.6%, response accuracy from 91.2% to 68.5%, and human interventions rise from 0.31/task to 0.98/task, all with $p<0.001$ [2601.04170].

Mechanistically, the paper identifies context window pollution, distributional shift, autoregressive feedback loops, protocol or role misalignment, and evolving tool usage as causes of agreement drift [2601.04170]. In this usage, agreement drift is not a stochastic fixation effect but a reliability failure in prolonged coordination.

## 7. Diagnostics, mitigation, and interpretive cautions

Across these literatures, agreement drift is diagnosed through different observables. In the QSG framework, early-time slope of $U(t)$ is central. Large slopes that scale as $1/N^2$ and $1/m$ indicate drift, while repeatability checks distinguish neutral fixation from weak selection. Winner distributions across runs that are near-uniform for $K>2$ or near $1/2$ for $K=2$ imply neutrality; consistent deviations that collapse onto $\Gamma_h$ or $\Gamma_T$ indicate selection [2603.24676]. Disagreement energy $V$ is also diagnostic: Soft-like contraction without polarization suggests no drift, whereas growth of $U$ at symmetry without $V$-driven heterogeneity indicates quantization-induced drift.

In network debate experiments, the corresponding diagnostics are the conditional persuasion matrices and their asymmetry under cross-opinion interactions, together with permutation-based significance tests [2604.11312]. The identification strategy varies homophily $h$, minority size $\text{min}$, stance alignment, neighborhood awareness, and LLM family to disentangle structural exposure from intrinsic model bias.

In long-horizon agentic systems, monitoring focuses on ASI and especially $I_{\text{agree}}$, $I_{\text{handoff}}$, and $I_{\text{role}}$ over rolling windows [2601.04170]. The paper recommends alerts when ASI falls below 0.75 for three consecutive windows, or when $I_{\text{agree}}$ drops by more than 15% from baseline over two windows or falls below 0.7.

Mitigation strategies differ by mechanism. For neutral agreement drift, the recommended controls are to increase bandwidth $m$, reduce adaptation strength $\alpha$, temper sampling toward $T>1$, aggregate softly, or increase population size $N$ to suppress noise [2603.24676]. If a particular outcome is desired, the same framework suggests seeding a controlled weak bias $h$ and ensuring $|\Gamma_h| \gtrsim 1$ so that selection beats drift.

For debate-based agreement drift, the paper recommends controlling exposure through homophily, balancing class sizes, leveraging neighborhood-awareness prompts to stabilize moderate agreement, and considering counter-bias prompting and role designs that allow both parties to update rather than keeping the Opponent stubborn [2604.11312].

For long-horizon coordination drift, three mitigation strategies are proposed: Episodic Memory Consolidation, Drift-Aware Routing, and Adaptive Behavioral Anchoring [2601.04170]. Their reported effectiveness is summarized below.

| Strategy | ASI retention result | Reported effect |
|---|---:|---:|
| Control | 0.94 → 0.67 | 71.3% retention |
| EMC | 0.93 → 0.81 | 51.9% drift reduction |
| DAR | 0.94 → 0.84 | 63.0% drift reduction |
| ABA | 0.93 → 0.86 | 70.4% drift reduction |
| Combined | 0.94 → 0.89 | 81.5% drift reduction |

The combined strategy incurs overhead $+23\%$ and throughput impact $+9\%$ [2601.04170].

Several cautions recur across the sources. The drift-selection crossover in QSG is described as a finite-size phenomenon, not a phase transition [2603.24676]. Debate results are obtained on one non-factual topic, one fixed network per parameter setting, 100 agents, 100 iterations, and a specific stubborn-opponent protocol [2604.11312]. The agent-drift study is simulation-based, concentrated on enterprise domains, and uses windowed aggregate metrics rather than formal change-point models [2601.04170].

The broad implication is consistent across formulations: agreement alone is not evidence of collective reasoning. In multi-agent LLM deployments, consensus can be largely a lottery under low bandwidth and weak selection, a consequence of intrinsic directional persuasion asymmetry under certain debate protocols, or a quantity that deteriorates under accumulated context and protocol instability [2603.24676]. This suggests that evaluating agreement requires explicit analysis of the mechanism that produced it, not merely observation of the final collective state.

Source: https://www.emergentmind.com/topics/agreement-drift