---
title: 'CoDiCon: Competitive Diversity via Constructive Conflict'
url: https://www.emergentmind.com/topics/competitive-diversity-through-constructive-conflict-codicon
type: topic
---

# CoDiCon: Competitive Diversity via Constructive Conflict

Searching arXiv for the specified CoDiCon-related papers to ground the article in the cited literature.
Competitive Diversity through Constructive Conflict (CoDiCon) denotes a class of formulations in which diversity is sustained not by suppressing coordination, but by placing cooperative alignment under a countervailing competitive or differentiating pressure. In 2025 work, the acronym is used for a minimal lattice-evolution model of cultural or linguistic diversification, for a constructive conflict-driven multi-agent reinforcement learning algorithm, and for an LLM-based multi-agent methodology centered on the consensus-diversity tradeoff [2510.11522], [2509.14276], [2502.16565]. Across these usages, the common mechanism is that moderate conflict is treated as constructive when it prevents premature homogenization while preserving collective performance.

## 1. Conceptual core

CoDiCon is organized around an antagonistic pairing of forces. In the lattice-evolution model, agents gain fitness by matching with their four nearest neighbors, while also gaining a dissimilarity-driven term with respect to the entire population; the resulting “constructive conflict” produces a self-organized mosaic of distinct clusters whose interfaces are stabilized by equalizing boundary fitnesses [2510.11522]. In the MARL formulation, the same phrase refers to competitive incentives injected into fully cooperative training through a centralized intrinsic reward module that ranks agents and distributes distinct intrinsic rewards, thereby encouraging policy exchange and strategic diversity without abandoning the team objective [2509.14276]. In the LLM-based multi-agent setting, the operative idea is partial disagreement under implicit consensus: agents exchange information yet independently form decisions via in-context learning, preserving enough deviation from group norms to maintain exploration and robustness in dynamic environments [2502.16565].

A concise way to compare the three formulations is to track which pressure promotes coherence and which pressure prevents collapse into uniformity.

| Context | Coherence mechanism | Diversity mechanism |
|---|---|---|
| Lattice evolution | Matching with four nearest neighbors | Global dissimilarity term |
| MARL | Shared team reward under CTDE | Ranking-based intrinsic rewards |
| LLM-based MAS | Public discussion and transcript sharing | Role prompts and deviation with probability $\beta$ |

This suggests that CoDiCon is less a single algorithm than a transferable design principle: coherent local structure or team-level optimization is retained, but is systematically frustrated by a mechanism that rewards differentiation, rank separation, or partial deviation.

## 2. Minimal evolutionary formulation on a lattice

In "A Self-Organized Tower of Babel: Diversification through Competition" [2510.11522], each agent’s “language,” or more generally cultural state, is a high-dimensional bit-vector. The lattice has size $L \times L$, total population $N=L^2$, and bit-vector dimension $B$. Agent $i$ at site $x$ has state
$$
x_i \equiv c_i \in \{0,1\}^B.
$$
Two pairwise measures are defined between bit-vectors $c$ and $c'$: the understandability
$$
U(c,c') \equiv c \cdot c' = \sum_{b=1}^B [c_b \text{ AND } c'_b],
$$
and the Hamming distance
$$
d_H(c,c') \equiv \sum_{b=1}^B [c_b \text{ XOR } c'_b].
$$
The total fitness of agent $i$ is
$$
F_i \equiv F_x
= \frac{\alpha}{4}\sum_{y \in \mathrm{nbrs}(x)} U(c_x,c_y)
+ \frac{\gamma}{N}\sum_{y=1}^N d_H(c_x,c_y),
$$
with $\alpha>0$ weighting local cooperation and $\gamma>0$ weighting global dissimilarity; the paper sets $\gamma=1$ and varies $\alpha/\gamma$ [2510.11522].

The same decomposition can be expressed as
$$
f_{\mathrm{local}}(x_i;\mathrm{Neighborhood}) = \frac{\alpha}{4}\sum_{y \in n(i)} U(c_i,c_y),
$$
$$
f_{\mathrm{global}}(x_i;\mathrm{Population}) = \frac{1}{N}\sum_{y=1}^N d_H(c_i,c_y),
$$
so that
$$
F_i = f_{\mathrm{local}} + \gamma \cdot f_{\mathrm{global}}.
$$
To emphasize the conflict, the global term can be interpreted as an inhibitory penalty, with an effective form
$$
F_{\mathrm{eff},i} = f_{\mathrm{local}}(x_i) - \lambda \cdot f_{\mathrm{global}}(x_i),
$$
where $\lambda \equiv -\gamma$ in that sign convention, although the paper keeps both terms positive and interprets the second as discommunication.

Evolution proceeds in discrete generations with two stages. In the replication or invasion stage, there are $L^2/2$ trials per generation. A random lattice site $i$ is selected; its fitness and the fitnesses of its four nearest neighbors are computed; if $F_i > \min_{j\in n(i)}F_j$, then $i$ invades the weakest neighbor $k=\arg\min_{j\in n(i)}F_j$ and copies its bit-vector to that site, $c_k \leftarrow c_i$. The newly created clone is then flagged “immune” for the remainder of the replication phase, so it cannot itself replicate or be overwritten in that generation. Mutation is applied once per generation: for each site $i$ and each bit $b=1,\dots,B$, the bit flips independently with probability $\mu$ [2510.11522].

The key structural claim is that local alignment promotes homogeneity within each community, while the global dissimilarity term drives communities to differentiate from one another. The model is therefore minimal in the sense that diversification is not produced by exogenous heterogeneity, but by the conflict between short-range alignment and population-wide differentiation.

## 3. Cluster organization, boundary equalization, and phase structure

After a transient, agents coalesce into clusters of identical or nearly identical bit-vectors. Within each cluster, the local $\alpha$-terms are high; across the global term, large clusters suffer a dissimilarity penalty, so a trade-off sets the preferred fraction each cluster can occupy [2510.11522]. On a square lattice, clusters tend to meet along straight horizontal or vertical boundaries. Boundary agents lose some local fitness because they have fewer matching neighbors than interior agents.

A central result is that coexistence of clusters with different bulk fitness is possible because boundary fitnesses are equalized. If one cluster had stronger boundary fitness than its neighbor, it would invade until the boundary fitnesses matched again. Boundaries therefore act as pressure-equalizing interfaces rather than merely passive separators. This is the mechanism by which distinct communities persist without requiring equal bulk properties.

With nonzero mutation $\mu$, the system does not settle into a single fixed configuration; it wanders among metastable mosaics of languages. New languages nucleate almost exclusively at existing cluster boundaries. A mutant in the center of a large cluster is usually unfit because it loses many neighbor matches and dies out, whereas a mutant at a boundary can surpass its neighbors because local fitness is already low there. Once established, a new language expands by invading weaker boundary segments until a new balance of inter-cluster fitnesses is reached. The observed transitions are therefore punctuated shifts between quasi-stationary states rather than smooth relaxations.

The reported phase structure is specific. For $\alpha/\gamma \lesssim 1.4$, the system splits into approximately $20$–$30$ clusters on a $256 \times 256$ grid; for larger $\alpha/\gamma$, it coarsens to one cluster. The largest-cluster fraction remains approximately $25\%$ of the lattice over a wide range of $\alpha/\gamma$, set by the global dissimilarity penalty. For $B=16$ and $\mu \approx 10^{-3}$, a transition to global homogeneity occurs above a critical $\alpha/\gamma \simeq 1.4$. The threshold shifts slightly with $\mu$, $L$, and initial conditions, showing hysteresis akin to nucleation-driven phase transitions [2510.11522].

Mutation controls the diversification regime. As $\mu$ increases, the number of clusters $N_{\mathrm{cl}}$ rises and the largest-cluster fraction falls, with approximate power-law scaling in $\mu$. Above a high-$\mu$ error-catastrophe line, all structure collapses and the lattice becomes a patchwork of random bit-vectors. In one dimension, clusters become nearly equal-sized; a boundary-balance calculation in the Supplement shows that if two adjacent languages $c_1,c_2$ have equal bulk fitness $f_1=f_2$, then their populations $N_1,N_2$ must also be equal in steady state [2510.11522].

## 4. Constructive conflict-driven MARL

In "Constructive Conflict-Driven Multi-Agent Reinforcement Learning for Strategic Diversity" [2509.14276], CoDiCon is formulated in the standard fully-cooperative Dec-POMDP or Markov game setting
$$
\langle S,\{U_i\}_{i=1}^n,P,r^{\rm ex},\gamma\rangle.
$$
Here $S$ is the set of global states, $U_i$ is the discrete action set of agent $i$, $\bm U=U_1\times\cdots\times U_n$ is the joint action space, $P(s' \mid s,\bm u)$ is the transition probability, $r^{\rm ex}(s,\bm u)\in\mathbb R$ is the shared team reward, and $\gamma\in[0,1)$ is the discount factor. Each agent observes only its own partial observation and follows a decentralized stochastic policy $\pi_{\theta_i}(u_i \mid \tau_i)$, while a global critic can access $s$ and $\bm u$ under centralized training and decentralized execution. The classical cooperative objective is
$$
J^{\rm ex}(\theta_1,\dots,\theta_n)
= \mathbb E\left[\sum_{t=0}^{\infty}\gamma^t r^{\rm ex}(s_t,\bm u_t)\right].
$$

CoDiCon augments each agent’s learning signal with a competition-driven intrinsic reward. At time $t$, agent $i$ receives
$$
r_{i,t}^{\rm hybrid}=r_t^{\rm ex}+\lambda r_{i,t}^{\rm in},
$$
with $\lambda>0$ balancing extrinsic and intrinsic signals, and discounted return
$$
R_{i,t}^{\rm hybrid}
= \sum_{k=0}^{\infty}\gamma^k\bigl(r_{t+k}^{\rm ex}+\lambda r_{i,t+k}^{\rm in}\bigr).
$$
The intrinsic reward is generated by a centralized ranking module. A small neural network $f_\eta$, parameterized by $\eta$, takes as input the global state $s_t$ and optionally joint actions $\bm u_t$, and emits $n$ scalar scores $\widehat r^{\rm in}_1,\dots,\widehat r^{\rm in}_n$. These are sorted in ascending order,
$$
(r_{1,t}^{\rm in}\le r_{2,t}^{\rm in}\le\cdots\le r_{n,t}^{\rm in})
= \operatorname{sort}(\widehat r^{\rm in}_{1:n}),
$$
guaranteeing that each agent receives a distinct intrinsic reward [2509.14276].

This induces deliberate competition inside a cooperative task. When an agent’s action increases its rank, its intrinsic gradient may oppose the team’s extrinsic gradient; the paper identifies conflict whenever
$$
\nabla_{u_i}r^{\rm ex}\cdot \nabla_{u_i}r^{\rm in}<0.
$$
The conflict is constructive because the outer optimization is still defined by the global extrinsic return. Architecturally, the ranking module is a small fully-connected network with one or two MLP layers, outputting $n$ real-valued scores followed by a non-differentiable sort layer. To regularize the pre-sort outputs toward a user-provided target ordering $y_1<\cdots<y_n$, two auxiliary losses are used:
$$
\mathcal L_{\rm MSE}=\frac{1}{n}\sum_{i=1}^n(\widehat r^{\rm in}_i-y_i)^2,
$$
and
$$
\mathcal L_{\rm Var}
=-\frac{1}{n}\sum_i(\widehat r^{\rm in}_i-\bar r^{\rm in})^2,
\qquad
\bar r^{\rm in}=\frac{1}{n}\sum_i\widehat r^{\rm in}_i,
$$
combined as
$$
\mathcal L(\eta)=\beta_1\mathcal L_{\rm MSE}+\beta_2\mathcal L_{\rm Var}.
$$
Minimizing $\mathcal L$ spreads the unsorted outputs along the prescribed ordering and helps maintain distinct intrinsic signals.

Training is posed as a bilevel problem. The outer problem maximizes the true extrinsic objective over $\eta$,
$$
\max_\eta J^{\rm ex}\bigl(\theta^\star(\eta)\bigr),
$$
subject to the inner problem
$$
\theta^\star(\eta)
=\arg\max_{\theta_1,\dots,\theta_n}\sum_i \mathbb E\bigl[R_{i,0}^{\rm hybrid}(\theta_i,\eta)\bigr],
$$
with the ranking constraint $r_1^{\rm in}<\cdots<r_n^{\rm in}$ absorbed into the auxiliary loss. The coupling is approximated with a one-step meta-gradient. If
$$
\theta_i'=\theta_i+\alpha\nabla_{\theta_i}J_i^{\rm hybrid}(\theta,\eta),
$$
then
$$
\nabla_\eta J^{\rm ex}(\theta')
=\sum_i \bigl[\nabla_{\theta_i'}J^{\rm ex}\bigr]\bigl[\nabla_\eta \theta_i'\bigr].
$$
In implementation, policies are updated by a clipped-PPO step on the hybrid advantage, and the ranking module is updated both by the auxiliary loss and by the meta-gradient on $J^{\rm ex}$ [2509.14276].

## 5. Empirical behavior in MARL and adaptive multi-agent systems

The MARL evaluation in [2509.14276] uses SMAC scenarios $\{$3s\_vs\_5z, 8m\_vs\_9m, MMM2, 2c\_vs\_64zg, 5m\_vs\_6m, 3S5Z$\}$ and GRF tasks $\{$academy\_3\_vs\_1\_with\_keeper, academy\_counterattack\_easy, academy\_counterattack\_hard$\}$. Baselines are MAPPO, LIIR, EOI, and CDS. Key hyperparameters are PPO clip $\epsilon=0.2$, learning rates $\alpha=3e\!-\!4$ and $\beta=1e\!-\!4$ for $\eta$, intrinsic weight $\lambda=0.1$, ranking targets $y_i$ fixed at initialization with $20\%$ positive and $80\%$ negative, and ranking-loss weights $\beta_1=1.0$, $\beta_2=0.1$. The reported outcome is that CoDiCon converges faster and to higher win-rates on most maps, particularly 5m\_vs\_6m and MMM2, where it reaches about $90$–$95\%$ win versus about $70$–$85\%$ for MAPPO and about $50$–$70\%$ for LIIR or CDS. On GRF it matches or slightly exceeds MAPPO on the easiest task and significantly outperforms all baselines as difficulty increases, with final win-rates above $95\%$ on the hard scenario versus $80$–$90\%$ for MAPPO. In a synthetic Pac-Men testbed, CoDiCon agents gravitate in pairs to the rich room and achieve about $0.8$ mean episode return versus about $0.4$ for baselines. Removing either the MSE or variance ranking loss degrades performance significantly, indicating that both are necessary to maintain a well-spread, distinct intrinsic reward signal [2509.14276].

The LLM-based multi-agent formulation in [2502.16565] makes the consensus-diversity tradeoff explicit. Over $N$ agents with actions $\{a_i(t)\}_{i=1}^N \subseteq \mathcal A$, consensus is
$$
C(t)=1-\frac{1}{N(a_{\max}-a_{\min})}\sum_{i=1}^N|a_i(t)-p(t)|,
\qquad
p(t)=\frac{1}{N}\sum_i a_i(t),
$$
and diversity is
$$
D(t)=1-C(t)
=\frac{1}{N(a_{\max}-a_{\min})}\sum_{i=1}^N|a_i(t)-p(t)|.
$$
System performance $\Pi(t)$ is described as following an inverted-U in diversity,
$$
\Pi(t)\approx f(C(t),D(t))
\quad\text{with}\quad
f(C,0)<f(C,D^*)>f(C,1),
$$
peaking at an intermediate $D^*\in(0,1)$. The method assigns each agent a distinct role prompt, provides access to the public transcript and new observation, and then separates a discussion phase from a decision phase in which each agent independently forms its chain-of-thought and selects an action. A prompt clause can specify that the agent may deviate from group signals with probability $\beta$, thereby tuning the average diversity.

The theoretical rationale is presented as an exploration-exploitation tradeoff under environment volatility. If the true optimal action shifts unpredictably with shock rate $\rho$, then full consensus with $D=0$ yields regret on the order of the shock rate because the team never explores, while full fragmentation yields regret near one because coherent learning disappears. If a fraction $\beta$ of agents continually test alternatives, shift detection occurs within $O(1/\beta)$ rounds, total regret scales like $\rho T/\beta$, and minimizing with respect to $\beta$ gives $\beta\sim\sqrt{\rho/T}$ and regret $O(\sqrt{\rho T})$; by contrast, forced consensus incurs $\rho T$ [2502.16565].

Empirically, the paper reports five seeds per setting and four LLMs—GPT-4, Claude, Qwen, and Llama-2—at temperature $0.7$ and 256-token context. Three scenarios are studied: Dynamic Disaster Response, Information Spread and Manipulation, and Dynamic Public-Goods Provision. The comparison is between explicit consensus and implicit consensus.

| Scenario | Explicit | Implicit |
|---|---|---|
| Disaster Response | CR $0.679$, MP $2.847$, RD $1.324$ | CR $0.952$, MP $0.167$, RD $0.222$ |
| Misinformation | MS $0.460$, CT $2.300$, CD $2.200$ | MS $0.286$, CT $1.411$, CD $2.818$ |
| Public Goods | PR $0.765$, TW $21.0$, FD $0.190$ | PR $0.894$, TW $24.6$, FD $0.125$ |

Under high volatility in disaster response, CoDiCon maintains coverage rate at or above $0.95$ versus below $0.65$ for explicit consensus. Across all three tasks and LLMs, implicit consensus outperforms forced alignment by $20$–$40\%$ on key metrics, with a clear correlation to intermediate deviation $D$ [2502.16565].

## 6. Scope, interpretation, and recurring issues

The three CoDiCon formulations share a common claim: diversity is maintained not by removing cooperation, but by constraining it with an opposing pressure. In the lattice model, constructive conflict is the interplay between short-range alignment benefit and long-range differentiation penalty; in MARL, it is the tension between the shared team reward and rank-ordered intrinsic rewards; in the LLM-based setting, it is the balance between consensus formation and partial deviation [2510.11522], [2509.14276], [2502.16565].

A recurrent misconception is that conflict here denotes breakdown of cooperation. The papers use the term more narrowly. In the MARL formulation, conflict occurs when intrinsic and extrinsic gradients oppose one another, but the outer optimization still maximizes the environmental return $J^{\rm ex}$ [2509.14276]. In the LLM-based setting, the claim is not that maximal disagreement is desirable; rather, both full consensus and full fragmentation are described as suboptimal, with performance peaking at intermediate diversity $D^*$ [2502.16565]. In the lattice-evolution model, coexistence does not require equal bulk fitness; it relies on equalized boundary fitnesses, so diversity is stabilized by interface dynamics rather than by uniformity across communities [2510.11522].

The domain generalizations proposed for the minimal model are broad but specific: cultural evolution beyond language, including institutions, norms, and fashions; ecological or microbial communities, described as “cryptographical arms races” in quorum sensing signals; technological standards, characterized by local compatibility versus diverse global niches; and network-formation models with a local-global frustration term in spin or Potts-like systems [2510.11522]. A plausible implication is that CoDiCon is most relevant where systems simultaneously require within-group coherence and between-group differentiation, or team-level coordination and agent-level exploration.

Another recurring issue concerns whether diversity is a transient by-product or a stable regime. The lattice model supports quasi-stationary mosaics with punctuated shifts triggered by boundary nucleation [2510.11522]. The MARL algorithm maintains strategic diversity through distinct intrinsic rewards while reporting faster convergence and robust performance in sparse, hard-exploration domains such as GRF counterattacks and SMAC micromanagement [2509.14276]. The LLM-based methodology ties performance gains to preserved partial diversity under dynamic shocks, rather than to a single consensus policy [2502.16565]. Taken together, these results indicate a coherent research program in which constructive conflict functions as a mechanism for preventing premature homogenization while preserving effective collective behavior.

Source: https://www.emergentmind.com/topics/competitive-diversity-through-constructive-conflict-codicon