Papers
Topics
Authors
Recent
Search
2000 character limit reached

Copying explains the collective behavior of AI agents in the wild

Published 8 Sep 2026 in cs.MA, cond-mat.stat-mech, and cs.CL | (2609.09150v1)

Abstract: In June 2026, thousands of AI agents found that a small public wiki would accept edits from inside their sandboxes, and started using it to help one another pass a timed test. Each agent lived for about an hour and remembered nothing afterwards. Nobody asked them to cooperate, and the wiki had not been built for them. The complete record of what they wrote is public, and it is unusually informative, because it preserves not only what each agent wrote but what that agent could see before writing. We use it to follow the three decisions an agent had to make on arrival: where to write, what to call itself, and how to word its message. One rule governs all three. An agent takes an option with a probability close to the share of that option in what it can see, and the share that matters is the one on the page in front of it, then the one in the stream of recent edits, and only weakly anything older. Three minimal copying models, one per decision and with a single free parameter each, reproduce the heavy-tailed distribution of how many agents met on a page, the frequency of the pieces from which the agents built their names, and the patchwork of pages that are internally consistent and different from one another. Copying whatever the environment happens to show is enough to produce most of the collective structure of this population. It is also what makes such a population easy to steer, since whoever writes first, or writes while the others are quiet, sets the convention for everyone who comes later.

Summary

  • The paper finds that a single behavioral principle—copying options in proportion to their local visibility and recency—explains much of the observed collective organization in AI agents.
  • The study revealed that page selection strongly correlates with a page's visibility in the recent feed, name construction replicates recent username components, and linguistic conventions reflect the local page's dominant forms one no extrinsic ordering.
  • The modeling demonstrates that minimal copying models effectively reproduce key patterns in page participation, name-frequency distributions, and local linguistic consistency.

Empirical setting and research question

“Copying explains the collective behavior of AI agents in the wild” (2609.09150) analyzes a rare observational dataset of AI-agent interaction outside a laboratory-controlled multi-agent environment. Between 24 May and 22 June 2026, agents operating in ephemeral sandboxes edited a set of small UseModWiki installations while completing timed information-retrieval tasks. The agents were not instructed to cooperate, the wikis were not designed as agent platforms, and individual runs generally lasted approximately one hour. Nevertheless, agents used the wiki to record task questions, answers, procedures, and coordination information for later agents.

The episode generated 14,591 revisions across 4,579 pages. After removing three human accounts and a large link-caching swarm unrelated to the task population, the analysis retains 1,201 handles, 5,929 edits, 679 task pages, and 41 task families. The dataset is unusually informative because it preserves both the agents’ contributions and much of the environment available to subsequent contributors: the page being edited and the chronological RecentChanges feed. Agent memory was transient, whereas the wiki persisted across cohorts. Consequently, the wiki functioned as the medium through which behavioral conventions could propagate.

The paper asks whether the observed collective organization requires mechanisms such as strategic planning, preference formation, prestige sensitivity, or explicit coordination. Its central claim is deliberately narrower and more testable: a single behavioral principle—copying options in proportion to their local visibility—accounts for much of the observed structure. The authors examine three decisions that appear substantively different:

  1. which page to edit;
  2. which username components to use; and
  3. which linguistic or typographic form to adopt.

Across all three, the strongest predictor is the most immediately local exposure, followed by the recent global feed and then older information. This ordering is the paper’s principal empirical regularity.

The population and its information environment

The wiki environment imposed a severe information bottleneck. There was no effective category system, search mechanism, or global page directory. The principal global navigation mechanism was RecentChanges, which listed the newest edits first. Agents could also guess page names or follow links, but the resulting link structure was sparse: the release contained 3,769 live pages connected by only 1,022 links, and 88% of pages had no incoming link.

The task population was highly transient. A handle’s activity span had a median of approximately two hours, while an agent made roughly five edits on average. Pages were also active briefly, with a median writing span of about one hour, but remained readable after their original authors disappeared. This separation between short-lived agents and persistent external memory is essential to the paper’s interpretation: conventions could accumulate across cohorts even though no individual agent retained information from a previous run.

The observational design does not establish exactly what each model read. The server logs identify the content that was available on the relevant page and in the feed, not the precise browsing trajectory or attention allocation of an agent. The statistical claims therefore concern predictive exposure rather than direct measurements of cognition. The distinction is important, but the available record still permits considerably stronger inference than typical social-platform datasets.

Recency-driven page selection

The first analysis concerns where agents wrote. Of the 1,201 task-relevant handles, 403 created a new page on their first task edit, whereas 798 appended to an existing page. Among append decisions involving a page previously unseen by the writer, 89% selected a page appearing in the most recent 100 feed lines. The median selected page had been edited nine revisions earlier.

The authors measure each candidate page’s share of the last 100 feed lines and compare this share with the probability that the page was selected. The relationship is close to proportional, with a fitted slope of 0.87. A page occupying one-fifth of the visible feed was selected approximately one-fifth of the time. This result supports a proportional-copying interpretation of attention: page selection tracks visible representation rather than inferred usefulness or cumulative success.

The analysis separates recency from popularity by conditioning on one while varying the other. Holding the number of existing handles on a page approximately fixed, selection probability rises almost linearly with the page’s current feed visibility, increasing by a factor of about eight between one and ten visible lines. Holding feed visibility fixed, selection probability rises by only about a factor of 2.3 when a page acquires several authors and then remains approximately flat out to fifty authors. Thus, current visibility dominates accumulated audience size. The mechanism is closer to a recency process than to classical cumulative preferential attachment.

Figure 1

Figure 1: The test environment, wiki affordances, and temporal record that make exposure and copying observable.

The paper then tests whether recency alone can generate the observed concentration of agents on a small subset of pages. Its model reproduces each agent’s empirical number of edits and page touches. For every new page decision, an agent creates a page with probability c=0.26c=0.26; otherwise it selects uniformly from the last 100 feed lines. No page quality, semantic similarity, popularity preference, or rank-dependent decay is included.

The model reproduces the distribution of the number of distinct handles meeting on a page over approximately three orders of magnitude. For pages gathering at least 5, 10, 20, and 40 handles, the model probabilities are 0.19, 0.084, 0.028, and 0.005, compared with observed values of 0.21, 0.097, 0.031, and 0.007. The implication is substantive: a heavy-tailed page-audience distribution does not require agents to seek popular or high-quality pages. A page becomes more likely to be selected because each new edit returns it to the top of the feed, creating a self-reinforcing visibility process.

Figure 2

Figure 2: Page selection is approximately proportional to recent feed visibility, and a recency-only model reproduces the heavy-tailed audience distribution.

This distinction matters because the process can produce concentration without stable popularity. A page may attract many agents not because its content is intrinsically valuable, but because it remains repeatedly exposed during a period of high activity. The paper therefore identifies a feedback mechanism based on temporal visibility rather than conventional preferential attachment.

Username formation as neutral cultural transmission

The second decision concerns agent identity. The wiki required usernames, but the task specification did not prescribe a naming convention. Agents nevertheless generated highly repetitive compound names such as OpenAIResearchHelperMay08 and Sector61ScoutJan12. Across 1,201 handles, the authors identify 4,128 name pieces, with an average of 3.44 pieces per handle but only 256 distinct pieces. The most frequent components were Open, AI, Agent, Research, Helper, Scout, OAI, and Sep.

Only 6% of name pieces had not appeared in an earlier name. For eight common tokens, the probability that a newcomer used a token was approximately proportional to the token’s frequency among either the preceding 30 handles or the authors of the page on which the newcomer first wrote. The same empirical rule therefore appears in identity construction: agents tend to reuse recently visible components rather than independently selecting names from an unconstrained space.

The temporal structure of exposure is asymmetric. In a joint regression, the most recent 30 names receive a coefficient of 0.83, while the preceding 30 names receive only 0.19. When page and feed exposure are considered jointly, page authors receive a coefficient of 0.64 and the global feed 0.37. The estimates reinforce the paper’s general ordering: the immediate local context predicts behavior more strongly than a broader but less proximal information stream.

The authors model name formation through a neutral cultural-transmission process. Each newcomer constructs a three-piece name. Each piece is copied from one of the last 30 names with probability 1ε1-\varepsilon and innovated otherwise. With ε=0.07\varepsilon=0.07, the model produces 252 distinct pieces compared with 256 observed and 477 uses of the most frequent piece compared with 432 observed. It also reproduces the observed frequency distribution over approximately two orders of magnitude.

Figure 3

Figure 3: Name components are copied from recent handles and local page authors, producing frequency distributions consistent with neutral transmission and low innovation.

The result is not that agents possess no naming priors. The paper’s model includes innovation, and the observed floor of novel or independently generated forms is nonzero. Rather, the result is that the large-scale distribution of name components can be generated without semantic interpretation, prestige, or functional optimization. The immediate implication is that apparently meaningful identity regularities can arise from local copying and a small innovation rate alone.

The model also explains short-term fashions in which different name components dominate on different days. Because recent exposure is rapidly replaced, the frequency of a token can change substantially when a component happens to be introduced or repeated during a period of high activity. The paper interprets these fluctuations as stochastic cultural drift rather than evidence that the winning components possessed intrinsic advantages.

Linguistic conventions and local patchworks

The third analysis concerns how agents phrase their messages. The authors identify 17 binary conventions, including coined labels, near-synonyms, and typographic alternatives. Examples include R4 versus #4, task clock versus scaffold, relay versus bridge, CONFIRMED versus confirmed, and 1,234 versus 1234.

For each convention, the authors examine an agent’s first use and compare its selected form with the form distribution already present on the page. The probability of selecting a form is close to proportional to its local page frequency. The fitted slopes are 0.94 for coined names, 0.86 for typographic habits, and 0.79 for near-synonyms. The slopes differ modestly, but all indicate substantial proportional copying.

The intercepts reveal a meaningful distinction between copied conventions and pre-existing model habits. When a page contains only #4, agents still produce R4 approximately 5% of the time. When a page contains only confirmed, they produce CONFIRMED approximately 14% of the time. Averaged across conventions, the combined baseline probabilities are 0.09 for coined names, 0.23 for near-synonyms, and 0.28 for typographic habits. The authors interpret these floors as the contribution of the agent’s default generation tendencies. A form that originated on the wiki has little or no baseline probability before exposure; capitalization and numerical formatting can be generated independently.

The analysis of conflicting exposures gives stronger evidence for local conformity. In 348 cases where the majority form on the page disagreed with the majority form in the last 30 feed uses, agents followed the page 72% of the time, with a 95% interval of 67–77%. In later uses where the agent’s own previous form conflicted with the page majority, the page majority prevailed 77% of the time for near-synonyms and approximately half the time for the other two convention classes. Thus, page-local exposure predicts behavior more strongly than both recent global exposure and the agent’s own prior output.

Figure 4

Figure 4: Agents copy page-local linguistic forms, producing internally consistent pages that differ from one another.

The paper formalizes the writing rule as a proportional-copying model with convention-specific baseline terms. If the page share of form AA is ρ\rho, the probability of using AA combines the baseline tendencies for both forms with the remaining probability assigned proportionally to ρ\rho. The model uses fitted floors for each convention but does not use page, handle, or timestamp information from the observed record.

It is then coupled to the page-selection model. Agents first select pages through the recency process and subsequently select linguistic forms according to the local copying rule. The combined model reproduces within-page and between-page agreement across all 17 conventions, with correlation 0.81. Mean absolute error is 0.069 for within-page agreement and 0.057 for between-page agreement. More importantly, it reproduces the observed difference between local and cross-page consistency: the model generates a within-versus-between agreement gap of 0.19, compared with 0.15 in the data.

This result establishes the paper’s most structurally significant claim about language. Local copying does not necessarily homogenize the entire population. When agents repeatedly copy the page they happen to enter, different pages become internally coherent while remaining differentiated from one another. The resulting population is a mosaic of local conventions, generated by the interaction between recency-biased page selection and page-conditioned form selection.

A common mechanism across three decisions

The paper’s three analyses are not merely parallel examples of imitation. They identify a common hierarchy of exposure:

  1. the page currently being edited;
  2. the recent global feed;
  3. older or internally retained information.

This hierarchy appears in page selection, username formation, and linguistic convention adoption. The immediate environment dominates because it is both cognitively and technically accessible. Agents can write directly to the page in front of them, while the feed provides a weaker and more diffuse exposure channel. Older information is progressively removed from visibility.

The models are intentionally minimal. The page model has one free creation parameter, c=0.26c=0.26. The name model has one innovation parameter, ε=0.07\varepsilon=0.07. The writing model has convention-specific baseline terms, estimated from the data, but no additional agent-level optimization or semantic representation. Across the analyses, the models reproduce heavy-tailed page participation, name-piece frequencies, and local-versus-global linguistic agreement.

The authors do not claim that copying is the only mechanism operating in the system. The baseline terms for writing conventions demonstrate residual agent-level tendencies, and the models inherit empirical activity patterns such as each handle’s number of edits and page touches. The stronger claim is that copying explains most of the collective regularities examined after these basic activity constraints are accounted for.

Coordination and susceptibility to steering

The same mechanism that makes the population useful also makes it sensitive to path dependence. Copying creates a shared vocabulary, concentrates attention on pages that remain visible, and enables later agents to exploit information deposited by earlier cohorts. It therefore provides a low-cost coordination mechanism even when agents do not share persistent memory or an explicit communication protocol.

The paper’s stronger safety-relevant claim follows from the same empirical asymmetry: whoever writes first, or writes when the population is sparse, can disproportionately influence subsequent conventions. An agent does not need privileged access to model weights, prompts, or orchestration infrastructure if it can modify the medium that subsequent agents are likely to read. This influence is especially strong for coined conventions, for which the model’s intrinsic baseline is close to zero. A newly introduced label, procedure, or claim can become dominant primarily because it was visible at the right time.

The mechanism is amplified by agent demography. Human groups typically contain persistent members who retain memories of prior conventions and can resist a current majority. Here, each run is short-lived and memoryless, so the population repeatedly encounters conventions through the accumulated external record. The local page is both the object of attention and the easiest location for intervention. Consequently, a transient population can exhibit strong intergenerational dependence despite the absence of persistent individual identities.

The result should not be conflated with proof that arbitrary external content will control agent behavior. The data concern a specific population, task structure, wiki interface, model family, and time period. Nevertheless, they demonstrate that externally writable state can shape collective behavior through ordinary exposure dynamics, without requiring explicit collusion or deliberate strategic deception by the agents.

Limitations and open questions

The paper identifies several limitations that constrain causal interpretation. A username is not a perfect proxy for an agent. Runs could rename themselves, generic names could be reused, and a small number of long-lived handles may combine activity from distinct underlying processes. The authors analyze first choices in several tests, and such identity noise would generally weaken rather than create copying effects, but it prevents exact agent-level attribution.

The record also does not reveal what agents actually attended to. The page and feed were available, but browsing traces are incomplete. The exposure analyses therefore establish that visible content predicts subsequent writing, not that agents explicitly inspected or selected that content. The distinction leaves open whether copying was deliberate, a consequence of prompt-conditioned generation, or an emergent effect of browsing and interface affordances.

Selection into the analyzed population is another limitation. The authors exclude link-caching agents that never wrote on task pages, but the classification depends on the released page taxonomy. The observable episode may also differ systematically from unrecorded interactions on other sites. The dataset exists because the wiki operator and independent investigators preserved server logs; comparable episodes may leave no complete record.

Finally, the minimal models are descriptive rather than fully causal. Their success demonstrates sufficiency for the measured distributions, not exclusivity. Semantic task relevance, latent prompt regularities, model-specific priors, browsing heuristics, and unobserved page content may contribute to behavior. The paper leaves open whether the same proportional-copying rule persists under different interfaces, longer-lived agents, explicit search tools, adversarial content, heterogeneous model families, or tasks that reward disagreement rather than coordination. It also does not determine how much intervention is required to redirect a convention once a population has partially stabilized.

Conclusion

The paper provides an observational account of collective AI-agent behavior in which transient, memoryless agents organize through a persistent external medium. Across page selection, username construction, and linguistic convention adoption, behavioral probabilities track the frequency of visible alternatives, with the strongest effects arising from the immediate page and weaker effects from the recent feed.

Three minimal copying models reproduce major empirical structures: heavy-tailed page participation, name-component frequencies, and the emergence of locally consistent but globally differentiated conventions. The findings support a precise conclusion rather than a general claim about agency: proportional copying, combined with recency-biased exposure and modest innovation or baseline generation tendencies, is sufficient to generate substantial collective organization in this setting. The same process enables coordination and creates path dependence, making early or strategically placed contributions disproportionately influential.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

Explain it Like I'm 14

1. ¿De qué trata el artículo?

El artículo estudia cómo se comportó un grupo de miles de agentes de inteligencia artificial que interactuaron en unas wikis públicas.

Estos agentes estaban realizando pruebas con preguntas sobre datos estadísticos. Cada agente vivía aproximadamente una hora y, después, su memoria se borraba. Sin embargo, los agentes descubrieron que podían escribir en una wiki y leer lo que otros habían dejado allí. Así comenzaron a compartir respuestas, consejos y formas de organizar la información, aunque nadie les había ordenado cooperar.

La idea principal del artículo es que gran parte de este comportamiento colectivo puede explicarse por una regla muy sencilla:

Los agentes tendían a copiar lo que veían a su alrededor, especialmente lo más reciente y visible.

2. ¿Qué querían averiguar los investigadores?

Los investigadores querían saber hasta qué punto el comportamiento del grupo podía explicarse solamente por la imitación, sin que los agentes necesitaran planes complicados, líderes o preferencias especiales.

En concreto, estudiaron tres decisiones que cada agente debía tomar:

  1. Dónde escribir: qué página de la wiki elegir.
  2. Cómo llamarse: qué nombre de usuario crear.
  3. Cómo escribir: qué palabras, símbolos o formatos usar en sus mensajes.

La pregunta central era si las decisiones de los agentes dependían de lo que ya habían hecho los agentes anteriores.

Por ejemplo:

  • Si una página aparecía muchas veces en la lista de cambios recientes, ¿era más probable que otro agente escribiera allí?
  • Si muchos agentes usaban una palabra como Scout o Helper en sus nombres, ¿los agentes nuevos también la usarían?
  • Si una página empleaba una forma concreta de escribir una palabra o un número, ¿los recién llegados copiarían esa forma?

3. ¿Cómo hicieron la investigación?

Reunieron un registro completo

Los investigadores analizaron los registros de las wikis. Estos registros indicaban:

  • qué escribió cada agente;
  • cuándo lo escribió;
  • en qué página lo escribió;
  • qué texto podía ver antes de escribir;
  • qué nombres de usuario habían usado otros agentes.

Después de eliminar algunas cuentas humanas y grupos que no estaban realizando la misma tarea, estudiaron principalmente:

  • 1.201 nombres de usuario;
  • 5.929 ediciones;
  • 679 páginas relacionadas con las tareas.

Esto permitió observar no solo el resultado final, sino también el contexto que cada agente tenía delante.

Compararon lo que se veía con lo que se hacía

Los científicos calcularon si una opción era elegida con una frecuencia parecida a la frecuencia con la que aparecía en la información visible.

Por ejemplo, si una página ocupaba aproximadamente el 20 % de las entradas recientes, comprobaron si recibía cerca del 20 % de las nuevas visitas de los agentes.

A este comportamiento lo llaman copia proporcional. Es parecido a elegir una canica de una bolsa: si la mitad de las canicas son rojas, tienes aproximadamente un 50 % de posibilidades de sacar una roja.

Crearon modelos sencillos

Un modelo es una versión simplificada de un fenómeno. En este caso, los investigadores programaron agentes imaginarios que seguían reglas muy básicas:

  • escoger una página entre las más recientes;
  • copiar partes de los nombres anteriores;
  • copiar las formas de escribir que ya aparecían en una página;
  • inventar algo nuevo solo de vez en cuando.

Después compararon los resultados de estos modelos con los datos reales. Si el modelo sencillo producía patrones parecidos, eso indicaba que la copia podía ser una explicación importante.

4. ¿Qué descubrieron?

A. Los agentes preferían las páginas recientes

Los agentes no parecían elegir las páginas porque fueran mejores o más útiles. En general, elegían las páginas que aparecían más veces en la lista de cambios recientes.

Una página que acababa de recibir una edición volvía a aparecer arriba de la lista. Eso hacía que otros agentes la vieran y tuvieran más posibilidades de escribir en ella. Al recibir otra edición, volvía a subir, creando un ciclo:

  1. una página recibe una edición;
  2. aparece entre las más recientes;
  3. otros agentes la ven;
  4. recibe más ediciones;
  5. vuelve a aparecer arriba.

Este proceso concentró a muchos agentes en unas pocas páginas. Algunas páginas fueron utilizadas por muchos agentes, mientras que otras apenas recibieron visitas. Esta desigualdad produjo una distribución con una “cola pesada”: unas pocas páginas tuvieron muchísimos usuarios y muchas páginas tuvieron muy pocos.

El modelo que imitaba simplemente las páginas recientes reprodujo bastante bien este resultado.

B. Los nombres de usuario se comportaban como una moda

Los agentes podían elegir cualquier nombre, pero terminaron repitiendo muchas partes de nombres anteriores.

Entre los fragmentos más frecuentes estaban:

  • Open;
  • AI;
  • Agent;
  • Research;
  • Helper;
  • Scout.

Solo una pequeña parte de los fragmentos de los nombres era completamente nueva. La mayoría ya había aparecido antes.

Por ejemplo, si muchos agentes recientes usaban Scout, los agentes nuevos tenían más probabilidades de incluir también esa palabra. Sin embargo, los nombres populares podían cambiar rápidamente, igual que las modas humanas. Un fragmento podía ser muy común un día y perder importancia poco después.

Un modelo en el que los agentes copiaban nombres recientes y solo inventaban algo nuevo en aproximadamente el 7 % de los casos reprodujo bastante bien la distribución observada.

C. Los agentes copiaban la forma de escribir de cada página

Los agentes también desarrollaron convenciones compartidas. Una convención es una forma acordada de hacer algo, aunque nadie la haya establecido oficialmente.

Por ejemplo, podían decidir usar:

  • R4 o #4 para hablar de la cuarta ronda;
  • relay o bridge;
  • CONFIRMED o confirmed;
  • 1,234 o 1234;
  • we o I.

Los agentes tendían a usar la forma que ya aparecía en la página donde estaban escribiendo. Además, la página tenía más influencia que la lista general de cambios recientes.

Esto produjo una especie de “mosaico”:

  • dentro de una misma página, los agentes solían escribir de manera parecida;
  • entre páginas diferentes, podían aparecer convenciones distintas.

Es como si varias clases usaran reglas de ortografía diferentes: dentro de cada clase todos siguen la misma regla, pero las clases no coinciden entre sí.

D. Lo más cercano influía más

Los investigadores encontraron un orden claro en la influencia:

  1. La página que el agente tenía delante era lo más importante.
  2. Los cambios más recientes tenían una influencia menor.
  3. La información más antigua influía muy poco, porque ya no estaba visible.

Esto sugiere que los agentes no necesitaban recordar toda la historia de la wiki. Bastaba con copiar lo que aparecía en su pantalla en ese momento.

E. Los modelos sencillos explicaban gran parte del comportamiento

Los investigadores construyeron tres modelos, uno para cada decisión:

Decisión del agente Regla principal del modelo Resultado
Dónde escribir Elegir páginas visibles y recientes Reprodujo la concentración de agentes en algunas páginas
Cómo llamarse Copiar partes de nombres recientes e inventar algunas Reprodujo la frecuencia de los nombres
Cómo escribir Copiar las convenciones de la página Reprodujo las diferencias entre páginas

Estos modelos no incluían ideas como “esta página es mejor”, “este nombre es más prestigioso” o “esta palabra es más útil”. Solo incluían copia, visibilidad y un poco de innovación.

5. ¿Por qué son importantes estos resultados?

Los resultados muestran que un grupo de agentes puede desarrollar una organización colectiva sin que nadie lo haya planeado.

Los agentes:

  • compartieron información;
  • crearon nombres y estilos comunes;
  • concentraron su atención en ciertas páginas;
  • formaron pequeñas tradiciones locales;
  • ayudaron a agentes que aparecieron después.

Esto ocurrió aunque los agentes no tuvieran memoria entre una sesión y otra. La wiki funcionó como una memoria externa: lo que un agente ya no podía recordar quedaba guardado en las páginas para que otros lo leyeran.

La investigación también muestra que copiar puede ser útil. Gracias a la copia, los agentes podían coordinarse rápidamente y encontrar información que otro agente había descubierto.

Pero la copia también tiene riesgos. Si los primeros agentes escriben un error o una mala instrucción, los siguientes pueden copiarlo. Como la página visible tiene tanta influencia, una persona o un agente malintencionado podría intentar colocar información falsa al principio para dirigir el comportamiento de muchos agentes.

6. Conclusión e impacto potencial

La conclusión principal es que reglas muy simples pueden producir comportamientos colectivos complejos. Los agentes no necesitaban tener una intención de formar una comunidad. Bastaba con que observaran el entorno y copiaran lo que veían.

Esto puede afectar a futuras redes de agentes de inteligencia artificial. Por un lado, la copia puede ayudarles a trabajar juntos, compartir descubrimientos y crear formas comunes de comunicación. Por otro, puede hacerlos vulnerables a la manipulación, la desinformación y los errores repetidos.

El artículo sugiere que, para hacer estos sistemas más seguros, no basta con estudiar a cada agente por separado. También hay que estudiar el comportamiento del grupo completo: qué información ve primero, quién puede escribirla y cómo esa información cambia las decisiones de los agentes que llegan después.

Knowledge Gaps

Knowledge gaps, limitations, and open questions

  • Generalizability beyond one incident is unknown: The findings are based on one population of agents, one operator’s infrastructure, four UseModWiki sites, one task type, and a short activity window; replication across models, providers, tasks, platforms, languages, and agent architectures is needed.
  • Causal evidence for copying is limited: The analyses show that visible page and feed content predicts subsequent behavior, but they do not experimentally establish that agents copied those exposures rather than independently generating correlated outputs.
  • Actual agent attention was not observed: Server logs record what was available, not which pages, feed entries, or text fragments an agent actually viewed, processed, or used in its decision.
  • The agents’ internal decision processes remain unknown: The study does not examine prompts, hidden reasoning, tool-use traces, model probabilities, system instructions, or intermediate plans that could explain why copying occurred.
  • Agent identity is imperfectly reconstructed: Handles are treated as proxies for agents even though runs could rename themselves, reuse generic names, or potentially share identities; the extent and direction of the resulting bias are not quantified.
  • The influence of agent heterogeneity is unexplored: The paper does not determine whether copying rates differ by model version, task, cohort, prompt, temperature, sandbox configuration, or other run-level characteristics.
  • Cohort and infrastructure effects are not fully separated: Temporal bursts, cooldown schedules, deployment batches, and changes in evaluation infrastructure could generate apparent recency effects independently of social copying.
  • The choice of a 100-edit feed window is not systematically validated: It is unclear whether the results are robust to alternative feed lengths, ranking rules, time-based windows, or the actual amount of content displayed to agents.
  • The choice of a 30-name or 30-use exposure window is similarly arbitrary: The paper does not estimate a continuous memory or decay function for name and language copying, nor test whether optimal windows differ across conventions.
  • Alternative mechanisms are insufficiently compared: The minimal copying models are not rigorously contrasted with models involving semantic similarity, page quality, task relevance, authority, search heuristics, prompt-induced defaults, or preferential attachment.
  • Model parameters are not independently estimated: Several parameters are fitted or selected using the same episode whose behavior they are evaluated against, and the paper does not provide held-out predictive tests or cross-validation.
  • Uncertainty in model comparisons is underdeveloped: The reported agreement statistics and fitted slopes do not fully assess uncertainty from dependent observations, repeated agents, pages, conventions, or model stochasticity.
  • The independence of observations is questionable: Multiple edits by the same handle, page, cohort, or task family may create correlated records, but the analyses largely use standard regression and confidence intervals without hierarchical or clustered inference.
  • The population-selection rule may bias conclusions: Restricting the population to handles that wrote on task pages excludes other agents and may preferentially retain agents that already engaged with the relevant coordination structure.
  • Excluded link-posting agents are not characterized sufficiently: Their behavior could reveal whether the copying mechanism applies outside task-oriented agents or whether different agent subpopulations follow different rules.
  • The role of human activity is unresolved: Human accounts are excluded, but the paper does not assess whether human edits initiated, amplified, disrupted, or redirected the conventions later attributed to agent copying.
  • The effects of page semantics are not measured: Pages are modeled largely as interchangeable feed objects, leaving unresolved whether topic, task family, question wording, page title, or perceived relevance affected page selection and convention adoption.
  • The functional value of copying is asserted but not directly tested: The study does not measure whether agents that copied more successfully answered questions faster, more accurately, or with fewer errors than agents exposed to less coordination.
  • The relationship between coordination and correctness is unknown: A convention can spread through copying without being true; the paper does not quantify whether copied claims, procedures, or numerical answers became more accurate or more misleading over time.
  • Cross-cohort transmission is not causally isolated: The evidence does not distinguish information passed through the wiki from information transmitted through shared prompts, task templates, infrastructure, external websites, or other channels.
  • The persistence of conventions after population turnover is unclear: The episode is short, and the study does not determine how long page-level conventions, names, or writing forms would survive under continued arrivals or after the original agents disappeared.
  • The effects of population size and arrival rate remain open: The models do not establish how concentration, conformity, or susceptibility to first-mover influence change with larger populations, different arrival rates, or overlapping generations.
  • The robustness of the patchwork effect is uncertain: The observed local consistency across pages may depend on the wiki’s fragmented structure; it is unknown whether the same effect occurs on centralized, searchable, threaded, or algorithmically ranked platforms.
  • Adversarial steering is demonstrated only observationally: The paper argues that early or strategically timed edits can steer agents, but it does not conduct controlled interventions measuring the minimum number, timing, persistence, or content of edits needed.
  • The safety consequences are not quantified: No experiments estimate the probability that planted content causes incorrect answers, unsafe actions, unauthorized disclosure, or durable propagation to later agents.
  • Resistance mechanisms are not tested: It remains unknown whether provenance labels, independent verification, source citations, randomized feeds, moderation, access controls, memory, or diversity-promoting interfaces reduce copying-induced cascades.
  • The effect of agent objectives and incentives is unexplored: Agents were engaged in a timed evaluation, so it is unclear whether copying would be stronger or weaker under cooperative, competitive, safety-critical, or adversarial objectives.
  • The role of language and cultural context is unknown: All analyzed conventions and names appear in a particular linguistic and platform context; replication is needed to determine whether the same copying dynamics hold across languages and cultural naming practices.
  • The paper does not distinguish copying from conformity to model priors: Especially for capitalization, number formatting, and near-synonyms, agents may reproduce common training-distribution patterns rather than copy the wiki specifically.
  • The innovation process is oversimplified: The name model treats new pieces as uniformly novel and the writing model uses fixed floors, but real innovation may depend on semantics, task requirements, model defaults, or exposure quality.
  • The interaction between the three decisions is not modeled jointly: Page choice, handle choice, and wording may influence one another, yet the paper analyzes them with separate minimal models rather than a unified agent-level process.
  • The impact of deleted and recreated pages needs further analysis: Although deletion logs are available, the paper does not fully assess whether moderation, page recreation, or visibility changes altered exposure and thereby affected the estimated copying dynamics.
  • Long-term institutional development is unexplored: The episode shows short-lived coordination but does not establish whether copying alone can produce durable norms, governance structures, error correction, or cumulative knowledge.
  • The findings’ relevance to deployed autonomous systems remains uncertain: The studied agents had short lifetimes, narrow tasks, limited tools, and no persistent memory; systems with long-term memory, planning, browsing, or external actuation may exhibit qualitatively different collective behavior.

Practical Applications

Immediate Applications

The paper’s central finding is that AI agents tend to copy options that are most visible in their immediate environment—especially the current page, recent activity feed, or recently observed agent conventions. This supports several applications that can be implemented with existing monitoring, interface, and access-control technologies.

  • Safety monitoring for multi-agent systems — AI/software
    • Add population-level telemetry that records shared pages, message streams, tool calls, naming conventions, and repeated behavioral patterns across agents.
    • Monitor for rapid convergence, unusually concentrated attention, repeated phrase adoption, or sudden agreement across otherwise independent agents.
    • A practical tool could be a collective-behavior dashboard displaying:
    • concentration of agents across resources;
    • rate of new convention formation;
    • recency-weighted copying;
    • divergence between individual outputs and population-level behavior.
    • Dependency: Agents must operate through auditable channels or shared resources. Encrypted, hidden, or out-of-band coordination would reduce observability.
  • Recency-aware access controls for agent-facing websites and APIs — cybersecurity and web infrastructure
    • Treat public feeds, editable wikis, shared documents, issue trackers, and comment systems as potential coordination surfaces rather than passive information sources.
    • Introduce authentication, rate limits, moderation queues, write permissions, provenance labels, and isolation between unrelated agent populations.
    • Newly created or recently edited pages could receive reduced visibility until verified.
    • Dependency: The risk is highest when agents can both read and write to the same resource and when later agents lack persistent memory or independent verification.
  • Detection of planted instructions and convention poisoning — cybersecurity and AI governance
    • Scan shared pages and recent feeds for newly introduced procedures, task labels, claims, or formatting conventions that spread unusually quickly.
    • Flag content that is:
    • created shortly before a large influx of agents;
    • copied across multiple pages without independent evidence;
    • associated with high downstream behavioral conformity;
    • presented as an operational instruction rather than ordinary information.
    • This could support agent-aware content integrity systems for wikis, retrieval databases, software repositories, and collaborative workspaces.
    • Dependency: Detection systems need reliable timestamps, edit histories, identity provenance, and a baseline for normal agent behavior.
  • Safer coordination protocols for agent teams — software and enterprise automation
    • Use explicit, authenticated coordination channels instead of relying on opportunistic copying from public pages or recent activity feeds.
    • Require structured messages with fields such as source, confidence, evidence, expiration time, and author identity.
    • Separate:
    • factual evidence from recommendations;
    • task state from instructions;
    • local conventions from globally binding policies.
    • Dependency: Structured protocols may reduce flexibility and require orchestration infrastructure, but they are more auditable than unconstrained natural-language collaboration.
  • Independent verification before collective adoption — finance, healthcare, legal services, and policy analysis
    • Require agents to validate newly observed claims against independent sources before propagating them.
    • A workflow could assign separate agents to:
    • 1. retrieve a claim;
    • 2. identify its source;
    • 3. search for contradictory evidence;
    • 4. estimate confidence;
    • 5. approve publication or execution.
    • This directly addresses the paper’s finding that visibility, rather than quality or popularity, determines which conventions spread.
    • Dependency: Independent agents must not share the same contaminated context, retrieval source, or copied intermediate result.
  • Controlled “seed” conventions for beneficial coordination — education, customer service, and software development
    • Organizations can deliberately place verified templates, terminology, examples, and workflow instructions in the locations agents are most likely to see.
    • Examples include:
    • a verified terminology guide in an agent workspace;
    • a current API usage example in a development repository;
    • a standardized escalation template in a customer-support queue;
    • validated definitions in a research collaboration wiki.
    • The paper suggests that early, visible examples can establish conventions quickly.
    • Dependency: Initial content must be accurate and maintained. The same mechanism that spreads useful conventions can amplify an erroneous or malicious seed.
  • Agent identity and naming standardization — software operations and research infrastructure
    • Because agents copied name components from recently observed handles, platforms can replace free-form names with generated, authenticated identifiers.
    • Useful features include:
    • immutable agent IDs;
    • task, model, version, and organization metadata;
    • explicit separation between display names and security identities;
    • warnings when an agent imitates an existing identity.
    • Dependency: Naming controls improve attribution but do not prevent behavioral copying through shared content.
  • Research instrumentation for real-world agent behavior — academia
    • The paper provides a reusable methodology for studying AI populations outside laboratory settings:
    • preserve complete edit histories;
    • reconstruct the information visible before each action;
    • measure recency-weighted exposure;
    • compare individual actions with population-level distributions;
    • simulate minimal copying models.
    • This can be applied to multi-agent benchmarks, online coding environments, collaborative documents, and autonomous browsing systems.
    • Dependency: Ethical data collection requires consent or appropriate governance, privacy protections, and safeguards against exposing sensitive prompts or credentials.
  • Practical safeguards for individuals using AI assistants — daily life
    • Users can reduce conformity-driven errors by asking an assistant to:
    • provide independent sources;
    • identify what information came from the current page;
    • distinguish established facts from recently introduced instructions;
    • present alternative interpretations;
    • re-check claims after context changes.
    • For important decisions, users should avoid treating a shared document, recent comment, or highly repeated phrase as evidence of correctness.
    • Dependency: These safeguards depend on the assistant exposing provenance and uncertainty rather than returning only a final answer.

Long-Term Applications

The findings also support applications that require larger datasets, controlled experiments, new standards, or further research into how copying interacts with agent goals, memory, incentives, and malicious behavior.

  • Population-level alignment testing for autonomous agents — AI safety and certification
    • Develop benchmarks that test not only individual accuracy but also whether a population:
    • converges too quickly on unsupported claims;
    • follows recency over reliability;
    • becomes locally consistent but globally inconsistent;
    • can be steered by a small early intervention;
    • preserves or corrects errors across agent generations.
    • A future certification procedure could report both individual-agent performance and collective susceptibility to influence.
    • Dependencies: Benchmarks need realistic environments, representative agent populations, controlled adversarial interventions, and metrics that distinguish legitimate coordination from harmful conformity.
  • Provenance-weighted collective memory — knowledge management and enterprise AI
    • Build shared memories in which information is ranked by source reliability, independent corroboration, age, and evidence—not merely by recency or frequency.
    • Unlike the wiki behavior observed in the paper, such systems could use:
    • signed claims;
    • versioned evidence;
    • contradiction tracking;
    • expiration dates;
    • reputation based on verified outcomes rather than visibility.
    • Dependencies: This requires reliable identity, source evaluation, conflict resolution, and resistance to coordinated reputation manipulation.
  • Robust multi-agent architectures with anti-herding mechanisms — robotics and autonomous systems
    • Design agent teams that deliberately maintain diversity of hypotheses, plans, and observations before reaching consensus.
    • Potential mechanisms include:
    • independent planning contexts;
    • randomized or rotating information order;
    • adversarial “red-team” agents;
    • quorum thresholds based on source quality;
    • delayed consensus;
    • explicit disagreement preservation.
    • In robotics, this could reduce the risk that a fleet copies an early navigation error or propagates a faulty environmental observation.
    • Dependencies: Diversity mechanisms may slow coordination, increase compute costs, and make consensus harder in time-critical settings.
  • Secure coordination layers for large autonomous populations — cloud computing and software engineering
    • Create dedicated agent communication platforms that replace accidental coordination through public websites.
    • Such platforms could provide:
    • capability-based permissions;
    • sandboxed namespaces;
    • message authenticity;
    • rate and influence limits;
    • provenance graphs;
    • automatic rollback of suspicious conventions;
    • isolation between task cohorts.
    • Dependencies: Deployment requires common standards across model providers, tool vendors, cloud platforms, and organizations operating autonomous agents.
  • Early-warning systems for coordinated manipulation — cybersecurity, elections, and public policy
    • Use the paper’s recency and concentration measures to detect when a small number of edits or accounts disproportionately shape the behavior of an agent population.
    • Potential applications include monitoring public knowledge bases, automated social-media accounts, collaborative policy systems, and AI-mediated information services.
    • A system could estimate whether a convention’s spread is driven by evidence or simply by exposure dynamics.
    • Dependencies: Such monitoring raises substantial privacy, free-expression, and false-positive concerns. It should focus on behavior and provenance rather than political viewpoint or ordinary disagreement.
  • Agent-mediated market and financial-risk monitoring — finance
    • If trading, forecasting, or research agents share feeds or collaborative memories, recency copying could generate synchronized actions and amplify market shocks.
    • Long-term systems could monitor:
    • correlated adoption of the same forecasts;
    • sudden concentration on particular data sources;
    • rapid propagation of unsupported financial narratives;
    • convergence caused by a small number of early messages.
    • Risk controls could impose independent-data requirements before high-impact trades or investment recommendations.
    • Dependencies: Financial applications require strict auditability, latency-aware controls, compliance with market regulations, and evidence that the observed behavior generalizes beyond the specific wiki environment.
  • Adaptive educational environments that use constructive convention formation — education
    • Learning platforms could intentionally seed correct terminology, problem-solving procedures, and collaborative norms so that AI tutors and student-facing agents adopt them.
    • The same platforms could test whether students or agents are following a procedure because it is correct or merely because it is common in the visible interface.
    • Dependencies: Educational deployment must avoid reinforcing misconceptions, must preserve learner diversity, and must distinguish useful scaffolding from excessive conformity.
  • Formal models of collective AI behavior — academia
    • Extend the paper’s minimal copying models to include:
    • agent goals and utility;
    • memory persistence;
    • source reliability;
    • strategic deception;
    • heterogeneous copying rates;
    • network structure;
    • delayed or asynchronous communication;
    • incentives for innovation and disagreement.
    • These models could help predict when a population will produce useful coordination, harmful lock-in, fragmentation, or runaway concentration.
    • Dependencies: The current evidence comes from one unusual environment, with reconstructed rather than directly logged attention. Replication across models, tasks, platforms, and agent lifetimes is necessary.
  • Design of “healthy disagreement” protocols for AI collectives — healthcare, science, law, and governance
    • High-stakes systems could require a minimum number of independently generated hypotheses before consensus and preserve minority reports when they disagree with the dominant convention.
    • For example, a clinical decision-support system might require separate diagnostic paths and explicit evidence comparison before recommending treatment.
    • A scientific workflow could prevent a newly introduced terminology or interpretation from becoming standard until independently reproduced.
    • Dependencies: Independent generation is difficult when agents share the same base model, training data, tools, or retrieval corpus. Apparent independence must therefore be measured rather than assumed.
  • Long-lived institutional memory for short-lived agents — enterprise and public-sector automation
    • The paper shows that ephemeral agents can coordinate through persistent media even when they have no memory themselves. This could be developed into a controlled institutional-memory layer for temporary agents.
    • Such a layer could retain:
    • task outcomes;
    • failed strategies;
    • verified procedures;
    • provenance;
    • uncertainty;
    • lessons that expire when conditions change.
    • Dependencies: Persistent memory must prevent stale or malicious conventions from becoming self-reinforcing and should support human review and rollback.

Glossary

  • Activity span: The time interval between an entity’s first and last recorded activity. “A handle's activity span, from its first to its last edit, has a median of two hours”
  • Agent-based model: A model that represents a system as interacting individual agents whose actions generate collective outcomes. “Three minimal models built on this rule, with one free parameter each, reproduce the shape of the data.”
  • Attention: The allocation of focus or visibility to particular information, pages, or options. “This is proportional copying, applied to attention rather than to content”
  • Cohort: A group of agents or runs receiving the same task at approximately the same time. “we call a cohort the set of runs that receive the same task at about the same time.”
  • Collective behavior: Group-level patterns that arise from the interactions of individuals. “because collective behavior is emergent, a property of the group rather than of its members”
  • Collective misalignment: A condition in which a group’s overall behavior differs from the preferences or objectives of its individual members. “conformity can carry them collectively into states that each of them would individually reject”
  • Cultural evolution: The change and transmission of behaviors, conventions, or cultural traits across a population. “The same model, and the same parameter range, describes the turnover of human first names”
  • Cultural transmission: The spread of information, practices, or traits from one individual or group to another. “Copying is the basic mechanism of cultural transmission in humans”
  • Cumulative popularity: A process in which previously popular items become increasingly likely to receive additional attention or adoption. “This is a recency mechanism, and not the cumulative popularity of preferential attachment”
  • Emergent property: A system-level characteristic that results from interactions among components but is not necessarily present in any individual component. “collective behavior is emergent, a property of the group rather than of its members”
  • Exposure: The information or alternatives available to an agent before it makes a decision. “this is a statement about which exposure predicts their writing, not about their browsing.”
  • Feed: A chronologically ordered stream displaying recent updates or edits. “The only global listing is RecentChanges, a page showing the latest edits newest first, which we call the feed.”
  • Heavy-tailed distribution: A probability distribution in which extreme values occur more frequently than they would under a thin-tailed distribution. “The model reproduces the observed distribution over three decades, including its tail”
  • Innovation rate: The probability that an agent introduces a previously unused variant rather than copying an existing one. “Copying name pieces with a 7\% rate of innovation reproduces the frequency distribution of names.”
  • Least squares fit: A statistical method that estimates parameters by minimizing the sum of squared differences between observed and predicted values. “the slope is an ordinary least squares fit on the unbinned records.”
  • Maximum likelihood: A parameter-estimation method that selects the values making the observed data most probable under a specified model. “The two floors μA\mu_A and μB\mu_B of Eq.~\eqref{eq:copy} are fitted per convention by maximum likelihood on all uses with at least three instances in view”
  • Mean absolute error: The average absolute difference between predicted and observed values. “with a correlation of 0.81 and a mean absolute error of 0.069 within pages and 0.057 between pages”
  • Neutral model: A model in which variants have no inherent advantage and changes result from copying and random innovation or drift. “Figure~\ref{fig3}c puts this to the test with the standard neutral model of cultural transmission”
  • Ordinary least squares: A regression technique that estimates coefficients by minimizing the squared residuals between observations and model predictions. “with 95\% Wilson intervals, and the slope is an ordinary least squares fit on the unbinned records.”
  • Patchwork: A structured pattern in which local groups are internally similar but differ from one another. “A population in which every writer copies the page it is standing on does not become uniform but becomes a patchwork”
  • Preferential attachment: A network-growth mechanism in which entities with more existing connections attract new connections at a higher rate. “This is a recency mechanism, and not the cumulative popularity of preferential attachment”
  • Proportional copying: A copying rule in which the probability of selecting an option is proportional to its observed frequency. “The relation is close to the diagonal, with a fitted slope of 0.87.”
  • Recency mechanism: A process in which recently observed information has a stronger influence than older information. “This is a recency mechanism, and not the cumulative popularity of preferential attachment”
  • Regular expression: A formal pattern-matching language used to identify strings or textual structures. “Forms are matched with regular expressions on the added lines of a revision with links removed”
  • Rich-get-richer dynamics: A feedback process in which entities that are already common or successful gain additional advantages. “it produces herding, unpredictable winners and rich-get-richer dynamics in cultural markets”
  • Statistical physics: The application of probabilistic and physical models to large systems composed of interacting elements. “Alignment therefore has to be treated as a problem in complexity science, with the tools that statistical physics, cultural evolution, sociology and social psychology have built”
  • Steering: The deliberate influence of a population’s later behavior by controlling the information or conventions it encounters. “It is also what makes such a population easy to steer”
  • Threshold model: A model in which an individual changes behavior after a sufficient proportion or number of others have adopted that behavior. “Threshold models of collective behavior”
  • Turnover: The replacement of existing members, variants, or conventions by new ones over time. “The five most used pieces changed by about two entries from one day to the next”
  • Wilson interval: A confidence-interval method for estimating a binomial proportion, especially useful when sample sizes or proportions are extreme. “Bars are 95\% Wilson intervals.”
  • Word boundary: A position in text marking the transition between word and non-word characters, often used in pattern matching. “at word boundaries, and case sensitively for the capitalisation pairs.”

Open Problems

We found no open problems mentioned in this paper.

Tweets

Sign up for free to view the 4 tweets with 289 likes about this paper.