Papers
Topics
Authors
Recent
Search
2000 character limit reached

Tapes Together Strong: The Co-evolution of Computation and Cooperation

Published 9 Sep 2026 in cs.MA and cs.AI | (2609.10817v1)

Abstract: How does cooperation evolve in complex agentic systems? Prior work in evolutionary game theory studies why individuals are incentivized to cooperate by isolating social interactions from the physical costs of behavior, while artificial life models traditionally study emergent self-replication without formalizing the dilemma between acquiring resources and preserving the shared energy needed to reproduce. In contrast, we introduce Autopoietic Game Theory, a computational model where social interactions, replication mechanisms, and their associated computational costs are endogenous and simultaneously co-evolving. We study these dynamics using a computational substrate of randomly initialized programs in Z80 machine code, showing empirically, and motivating with a simplified theoretical model, that embedding a social dilemma directly into the physics of computation can favor the emergence of self-replicating, cooperative strategies. When resources are scarce, our analysis shows that defection can become self-limiting even in well-mixed populations: parasitic stealing destroys shared energy, slows execution, and can prevent reliable replication. Empirically, evolved programs suppress stealing across several Z80 environments, while spatial assortment further supports structural complexity and task performance. We further show that the framework can incorporate exogenous pressures, such as math tasks structured as sequential social dilemmas, when rewards are tied to computation budgets. These results suggest that coupling an agent's capacity for computation to its available energy transforms cooperation into a dominant scaffolding for building sustainable, self-organizing systems.

Summary

  • The paper introduces Autopoietic Game Theory (AGT), a framework where social strategy, computation, energy expenditure, and replication are interlinked components of an evolving system. The key finding is that cooperation can become evolutionarily favored when defection directly degrades the computational substrate, particularly when replication mechanisms are evolvable.
  • In AGT, replication is seen as an endogenous computational process in a population of 16,384 programs. The protocol demonstrates that stealing behaviors can self-suppress when it diminishes shared energy required for replication. Experimentally, well-mixed and local populations in severe environmental inequality demonstrate that local populations remain more resilient and complex and collectively perform tasks better than the other.
  • The framework identifies potential biochemical applications, suggesting evolutionary stabilization under heterogeneous energy conditions, and task-specific computing under severe constraints.

Computational substrate and research question

The paper introduces Autopoietic Game Theory (AGT), a framework in which social strategy, computation, energy expenditure, and replication are not separate modeling layers but components of one evolving dynamical system. Its central question is whether cooperation can emerge when an agent’s ability to act and reproduce depends directly on the shared energetic consequences of its interactions. This differs from standard evolutionary game theory, where payoffs and reproduction are typically imposed as external update rules, and from much artificial-life research, where replication evolves without an explicit endogenous social dilemma.

The substrate consists of a population of 16,384 programs represented as randomly initialized 32-byte sequences of modified Z80 machine code. Programs are paired either uniformly at random in a well-mixed population or with one of four spatial neighbors on a two-dimensional grid. A paired interaction concatenates the two programs into a 64-byte cyclic memory tape, while each program retains an independent CPU and register state. Programs can read and overwrite both memory segments, and replication emerges when one program writes a faithful copy of itself into the partner’s segment before the interaction terminates.

Every instruction costs one unit of energy. The probability that a program executes the next instruction is proportional to its current energy, so energy affects both survival and computational throughput. Each epoch supplies a baseline energy increment of ϵ=24\epsilon=24, and programs are subject to a maximum energy of 255 in the standard experiments. Replication, interaction, and ordinary computation therefore compete for a common budget.

Figure 1

Figure 1: The substrate couples paired programs through shared cyclic memory and energy-dependent execution speed.

The social dilemma is implemented through a STEAL instruction. A successful steal transfers δ\delta units of energy from the partner, but the acting program receives only αδ\alpha\delta, with α=0.8\alpha=0.8. Consequently, every steal destroys (1α)δ(1-\alpha)\delta units of total system energy. Stealing is locally advantageous because it increases the actor’s immediate execution budget, but it produces a negative externality by reducing the energy available for subsequent computation and replication. The paper defines non-stealing programs as cooperators and stealing programs as defectors, while acknowledging that this binary classification is a coarse-graining: non-stealing replicators still overwrite partner memory, and programs can vary their stealing frequency and magnitude.

The main conceptual claim is therefore conditional rather than universal: cooperation can become evolutionarily favored when defection directly degrades the computational substrate on which reproduction depends, particularly when the replication mechanism itself is evolvable (2609.10817).

Autopoietic Game Theory

AGT treats replication as an endogenous computational process. Programs do not receive an explicit reproduction command. Instead, they must evolve instruction sequences that locate the partner’s memory segment, write the necessary bytes, and preserve enough energy to complete the operation. At the end of an epoch, the shared tape is cleaved into two 32-byte programs. If one program has successfully overwritten the partner, both resulting segments can contain copies of the successful replicator; otherwise, the split may produce recombined or nonfunctional code.

This construction creates two linked selection pressures. First, stealing can increase the actor’s short-term execution probability. Second, the same act can reduce total energy, slow the paired computation, increase the probability of execution failure, and prevent either program from completing replication. The interaction is thus not a conventional Prisoner’s Dilemma with a subsequent Moran-style population update. The action changes the physical conditions under which the update can occur.

The paper motivates the inverse relationship between energy and execution time using thermodynamic and hardware analogies. In the model, the physical time per operation is defined as dt=1/(Ei+Ej)dt=1/(E_i+E_j). This is a modeling assumption rather than a derivation from the Z80 instruction set or a complete physical implementation. The resulting kinetics are intended to capture metabolic drag: lower shared energy causes slower computation, which prolongs execution and increases exposure to failure.

The principal structural metrics are higher-order entropy, used as a proxy for nontrivial architectural complexity, and Hamming edit distance, used as a measure of genetic diversity. Higher-order entropy is estimated by comparing sequence entropy with a compression-based approximation to Kolmogorov complexity. These metrics distinguish populations dominated by repeated structured replicators from populations consisting primarily of independent random bytes. The interpretation is useful for population-level comparisons, although compression-based complexity remains dependent on the chosen compressor and sequence representation.

Cooperation under uniformly distributed energy

The first set of experiments examines well-mixed populations receiving the same baseline energy. With continuous mutation at μ=1/128\mu=1/128, fixed values of δ\delta, and dynamically determined steal magnitudes, evolved programs strongly suppress STEAL. This result is notable because neither spatial assortment nor memory of previous encounters is required. The programs are paired randomly and have no explicit reputational or reciprocal state.

The proposed mechanism is metabolic rather than cognitive. Mutual stealing reduces total energy, which reduces execution speed for both programs. Slow or interrupted execution makes it less likely that a program will complete the writes required for replication. By contrast, non-stealing programs can accumulate residual energy across successful epochs, increasing their execution probability in future encounters. The paper further reports traces in which a higher-energy cooperative program interrupts and overwrites a defector’s code, providing an executable mechanism by which accumulated energy changes the effective outcome of subsequent interactions.

This result should not be interpreted as showing that ordinary well-mixed Prisoner’s Dilemmas generically favor cooperation. The result depends on three substrate-specific conditions: stealing is lossy, energy controls computation, and replication occurs through the same interaction in which the social behavior is expressed. Removing any of these couplings could change the evolutionary outcome.

Starvation limits and mutation-free invasion

The authors test whether suppression of defection is merely an artifact of continuous mutation. In a mutation-free invasion assay, 1% functioning replicators and 1% STEAL-containing programs are introduced into a naive random soup. Defectors remain a minority in both well-mixed and local populations. Increasing the steal magnitude from δ=16\delta=16 to δ=32\delta=32 significantly reduces defector success, with δ\delta0 and Cohen’s δ\delta1.

The result supports a starvation mechanism: sufficiently aggressive stealing exhausts the shared budget before a defector can execute the writes required for replication. The defector’s immediate energetic gain therefore becomes counterproductive at the level of lineage propagation. Figure 2 compares the theoretical starvation boundary with empirical Z80 rollouts.

Figure 2

Figure 2: Theoretical and empirical defector survival decline as stealing approaches the metabolic starvation limit.

The paper also varies absorption efficiency and steal magnitude over δ\delta2 and δ\delta3. Defector frequency is not strongly determined by δ\delta4 alone. The reported correlation between the amount gained, δ\delta5, and defector proportion is weak but statistically significant (δ\delta6, δ\delta7). This is an important qualification: inefficient stealing alone does not explain the observed cooperation. The authors argue that the co-evolution of replication timing and social behavior is also necessary.

The mutation-free invasion dynamics show cooperators expanding toward carrying capacity while defectors remain below 20%.

Figure 3

Figure 3: Mutation-free invasion assays show cooperative replicators dominating while defectors remain at minority frequency.

The formal analysis provides sufficient-condition arguments for this regime. If the baseline pair energy is less than the expected energy needed for a defector to complete its replication writes,

δ\delta8

then a defector is expected to starve before completing replication. The paper is explicit that the proof replaces the dynamically changing energy trajectory with an expected trajectory and therefore does not establish a theorem for the full stochastic emulator. The empirical simulations do update energy after every operation, but the analytical condition should be read as a motivating approximation rather than a complete characterization.

Spatial assortment and architectural complexity

Spatial topology has a limited role under uniform energy because both well-mixed and local populations suppress stealing. Its larger effect is on the structure and resilience of the resulting replicators. Local interactions produce significantly higher higher-order entropy, with Cohen’s δ\delta9, and substantially lower edit distance, with Cohen’s αδ\alpha\delta0; both comparisons have αδ\alpha\delta1.

The combination of high complexity and low edit distance indicates that local populations converge toward genetically cohesive, structurally elaborate lineages. Well-mixed populations instead maintain greater genetic diversity but lower architectural complexity. The paper therefore identifies a tradeoff between diversity and complexity rather than treating either as an unqualified indicator of evolutionary success.

Figure 4

Figure 4: Local interactions increase architectural complexity and genetic cohesion in the presence of stealing.

Additional experiments disable stealing entirely to isolate replication dynamics. In this setting, rapid replication correlates inversely with terminal steady-state energy at αδ\alpha\delta2. Well-mixed populations tend toward higher diversity, whereas local populations tend toward higher structural complexity. Historical conditions also matter: tape-bound replicators evolved in well-mixed environments can undergo architectural collapse when transferred to new test conditions, while lineages evolved under local spatial constraints retain greater complexity.

Figure 5

Figure 5: Historical spatial structure protects tape-bound lineages against architectural collapse.

The paper also distinguishes CPU-bound and tape-bound energy accounting. In CPU-bound systems, the executing program pays the computational cost; in tape-bound systems, the accessed memory segment pays it. Tape-bound populations can evolve interdependent mutualistic replication strategies in which one program executes writes that are charged to the partner’s segment. These strategies are more stable under local interactions, where repeated neighborhood encounters prevent rapid dilution.

Figure 6

Figure 6

Figure 6: Fixation success depends on the historical agent–environment boundary, with tape-bound lineages exhibiting interdependent replication strategies.

This result broadens the meaning of cooperation in the substrate. Cooperation is not limited to abstaining from STEAL; it can also involve the evolution of replication mechanisms whose viability depends on stable interaction partners. At the same time, it exposes a strong dependence on implementation choices concerning which entity bears computational cost.

Asymmetric energy and environmental resilience

The most severe contrast between topologies appears when baseline energy is distributed asymmetrically across space. Under strong systematic inequality, well-mixed populations suffer metabolic and structural collapse. Local populations retain substantially higher terminal energy, with Cohen’s αδ\alpha\delta3, and higher structural complexity, with Cohen’s αδ\alpha\delta4; both effects have αδ\alpha\delta5.

Figure 7

Figure 7

Figure 7: Local spatial structure preserves energy and complexity under severe environmental inequality, whereas well-mixed populations collapse.

The mechanism is ecological and architectural. Local populations allow successful lineages to remain near high-energy regions, accumulate computational resources, and develop code capable of surviving in lower-energy regions. Well-mixed populations repeatedly expose lineages to unpredictable energy conditions, preventing the stable accumulation of the computational structure required for complex replication.

The authors describe local topology as an “architectural scaffold,” but the result is more specific than a general claim that spatial structure is beneficial. Under uniform energy, spatial structure primarily increases complexity and cohesion; under asymmetric energy, it becomes necessary for maintaining population-level energy and functional replication. The distinction matters because assortment is not simply rescuing a conventional game-theoretic equilibrium. It is stabilizing the physical and computational conditions under which an equilibrium can be represented and transmitted.

Externally imposed computational tasks

The final Z80 experiments introduce exogenous mathematical tasks whose rewards determine energy acquisition. Each agent receives an input and a location-specific constant. Programs can solve a solo task, such as αδ\alpha\delta6, or a joint task, such as αδ\alpha\delta7, where reading the partner’s private input requires additional computation.

Free energy is supplied only below a threshold, forcing successful programs to earn surplus energy through task completion. Solve rates decline significantly as environmental energy becomes more abundant. This establishes a direct relation between scarcity and computational engagement: when replication is already energetically affordable, solving the external task has little selective value.

Figure 8

Figure 8: Greater free-energy abundance reduces solve rates for both individual and joint tasks.

The mixed task mode creates a sequential social dilemma. A joint solution initially rewards both agents, but a partner can subsequently obtain a larger individual payoff by solving its solo task. If both solve jointly, both receive a substantial shared reward; if one solves jointly and the other solves alone, the solo solver gains more while the joint solver receives less. Despite this incentive structure, programs suppress the solo strategy and converge toward joint-task performance under severe scarcity.

Figure 9

Figure 9: Under a severe energy threshold, programs temporarily increase stealing during complexification but eventually suppress it while optimizing joint-task performance.

Joint solve rates are significantly higher under local interactions than in well-mixed populations, with αδ\alpha\delta8 and Cohen’s αδ\alpha\delta9. Local populations also achieve higher energy and higher-order entropy. The implication is that assortment supports not only cooperation in the narrow sense of avoiding energy theft but also the computational coordination required for multi-step collective tasks.

The paper identifies a sharp cognitive bottleneck when agents must discover a communication protocol for sharing the private variable α=0.8\alpha=0.80. Joint solve rates collapse, whereas individual solve rates increase. Communication is therefore not costless coordination; it consumes the same limited computational budget required for task execution and replication.

Figure 10

Figure 10: Requiring emergent communication reduces joint performance by diverting computation from the task itself.

This experiment places an important boundary on the paper’s claims. Cooperation is feasible when the substrate provides sufficiently direct access to partner state. It becomes much harder when programs must discover communication protocols while also preserving replication and energy management.

Replication timing as a causal mechanism

Because the open-ended Z80 substrate makes causal attribution difficult, the paper introduces a simplified finite-population model with binary strategies and evolvable replication timing. Agents retain energy across encounters, and the probability of controlling replication is proportional to energy.

Three event orderings are compared in a draining Prisoner’s Dilemma. If agents interact, update energy, and then replicate according to post-interaction energy, defectors take over: the immediate payoff from exploiting a cooperator translates directly into reproductive control. If replication priority is determined from pre-interaction energy but reproduction occurs afterward, this immediate advantage disappears and cooperation takes over. If replication occurs before interaction, cooperation is strictly favored in the specified toy setting because mutually cooperative pairs gain more energy than mutually defective pairs.

Figure 11

Figure 11: Changing only the temporal ordering of interaction and replication reverses the evolutionary outcome.

When both strategy and replication timing co-evolve, cooperation dominates when mutual defection drains or stagnates energy. Even when mutual defection increases energy, cooperators retain a substantial population share rather than being eliminated.

Figure 12

Figure 12: Co-evolving replication timing allows cooperation to persist across payoff environments, including one in which mutual defection increases energy.

These simulations sharpen the paper’s central causal claim. Energy loss is not sufficient by itself: a fixed update rule in which post-interaction payoffs determine reproduction can still favor defectors. Cooperation is supported when the replication mechanism can evolve so that immediate exploitation does not automatically determine reproductive control. The toy model consequently provides a plausible mechanism for the Z80 results, but it does not prove that the same timing rule is the dominant mechanism in the full instruction-level system.

Limitations and open questions

The framework is restricted to a modified Z80 architecture, a particular instruction distribution, fixed program length, shared read/write access, and a small set of social operations. The authors correctly note that instruction density, memory-access rules, energy caps, and replication costs may alter starvation thresholds and the reachability of cooperative programs. In particular, unrestricted access to partner memory is a strong assumption. It facilitates both cooperation and exploitation, but many biological and artificial-agent systems do not expose internal state in this way.

The cooperation classification is also deliberately coarse. Programs that do not execute STEAL are labeled cooperative even though they may overwrite partners, exploit replication asymmetries, or use other forms of interference. The additional SHARE experiments demonstrate that selection can retain social operations when they increase system energy, but they also show that the agent–environment boundary changes whether stealing, sharing, or neither operation is favored.

The analytical results rely on frozen or expected execution priorities, average energy trajectories, and simplified population-transition approximations. The paper explicitly labels several claims as conjectures rather than theorems. These approximations are useful for identifying starvation and metabolic-drag regimes, but they leave open the exact stochastic conditions under which cooperation is globally stable.

The empirical evaluation also relies on a limited number of seeds and on indirect complexity metrics. The reported effect sizes are often large, but the open-ended nature of the substrate makes replication, transfer, and causal intervention more difficult than in a fixed-strategy evolutionary model. The main unresolved questions are correspondingly specific: how cooperation changes under restricted partner-memory access; whether the observed dynamics persist across instruction sets and hardware architectures; which replication-timing motifs are causally selected in the Z80 population; and how partial copying, recombination, and communication jointly affect task performance.

Conclusion

“Tapes Together Strong: The Co-evolution of Computation and Cooperation” (2609.10817) proposes a computational model in which cooperation is selected through the same energetic and temporal constraints that govern computation and replication. In the Z80 substrate, lossy stealing can become self-limiting because it depletes the shared budget required for faithful reproduction. Evolvable replication mechanisms amplify this effect by decoupling immediate energetic advantage from reproductive success. Uniform-energy well-mixed populations can therefore suppress defection without memory or assortment, while local structure substantially increases complexity, cohesion, resilience under energy inequality, and performance on collaborative tasks.

The paper’s strongest conclusion is conditional: cooperation is favored when social behavior, computational throughput, and reproduction are physically coupled. Its results do not establish a general solution to cooperation in arbitrary evolutionary systems, but they identify a concrete class of endogenous mechanisms in which destructive individual optimization undermines the computational substrate required for lineage persistence.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

Explain it Like I'm 14

1. What is this paper about?

This paper studies how cooperation can evolve among simple computer programs.

The researchers created a digital world where programs must:

  • use energy to run their instructions,
  • interact with other programs,
  • copy themselves to reproduce,
  • and sometimes steal energy from one another.

The main idea is that thinking, fighting, cooperating, and reproducing all use the same limited energy supply. The researchers wanted to see whether cooperation could appear naturally, even when the programs were not given memory, intelligence, or rules telling them to cooperate.

They call their framework Autopoietic Game Theory. “Autopoietic” means that a system maintains and reproduces itself.

2. What questions did the researchers ask?

The paper focuses on five main questions:

  1. Can cooperation appear by itself? Will programs learn to avoid stealing, even when they meet random partners?
  2. Is cooperation caused only by mutation or weak stealing? The researchers tested whether cooperation still appeared when mutations were removed and stealing was made easier.
  3. Does living near similar programs help? They compared programs that met randomly with programs that mostly met nearby neighbors.
  4. What happens when energy is distributed unfairly? Some areas of the digital world received much more energy than others. Would cooperation still survive?
  5. Can cooperation help programs solve difficult tasks? The programs had to solve math problems, sometimes by working together, while also trying to reproduce.

3. How did the researchers study this?

The digital world

The researchers began with a population of 16,384 programs. Each program was a random sequence of 32 computer bytes written in a simple form of machine code called Z80 assembly language.

A byte is a small piece of computer information. At the beginning, the programs were mostly meaningless, like random letters. Over many generations, some programs discovered how to copy themselves.

The programs lived in one of two environments:

  • Well-mixed environment: programs were paired with random partners.
  • Spatial environment: programs lived on a grid and mostly interacted with nearby neighbors.

This is similar to comparing people who meet strangers from anywhere with people who mainly interact with people in their neighborhood.

Energy as a shared budget

Every computer instruction cost energy. Energy also determined how quickly a program could run. A program with more energy had a better chance of running its next instruction.

The same energy was needed for:

  • carrying out calculations,
  • interacting with another program,
  • copying code,
  • and stealing.

This is like having one small allowance that must pay for food, travel, school supplies, and everything else. Spending it in one way means having less available for other activities.

The STEAL instruction

The researchers added a special instruction called STEAL.

When a program used STEAL:

  • it took some energy from its partner,
  • it gained only part of that energy,
  • and the rest disappeared.

For example, if a program took 10 energy units but kept only 8, then 2 units were destroyed. Therefore, stealing could help one program immediately, but frequent stealing damaged the whole system.

This creates a social dilemma:

  • Stealing may give an individual a quick advantage.
  • Avoiding theft leaves more energy for both programs and for future reproduction.

Reproduction

Programs were not given a simple “make a copy” button. They had to evolve instructions that copied their own code into their partner’s part of the shared memory.

This means that reproduction itself was a computer task. Programs had to spend energy and execute the correct sequence of instructions to make a copy.

The researchers also studied:

  • how complex the programs became,
  • how similar programs were to one another,
  • how often they used STEAL,
  • and how successfully they solved tasks.

Finally, they created a simpler mathematical model to understand why the computer simulations favored cooperation.

4. What did the researchers find?

Cooperation appeared even among random, memoryless programs

The most important result was that programs often evolved to suppress stealing.

This happened even when:

  • programs met random partners,
  • programs could not remember previous encounters,
  • mutations were present,
  • and the programs started as random bytes.

The programs did not cooperate because they were taught a moral rule. Instead, cooperation became useful because stealing damaged the energy supply needed for computation and reproduction.

Too much stealing can destroy the thief

A program that steals too aggressively may take energy from its partner, but it also damages the shared energy pool.

When energy becomes scarce:

  • both programs run more slowly,
  • programs have trouble finishing their copying instructions,
  • mutations are more likely to cause serious errors,
  • and the stealing program may fail to reproduce.

This creates a natural limit on selfish behavior. A thief may gain energy now but make the environment so poor that it cannot survive later.

The researchers compared this to a person cutting down every tree in a forest. The person may get a lot of wood immediately, but eventually there are no trees left.

Cooperation was not caused only by mutation

The researchers also removed mutation and introduced stealing programs directly into the population.

Even then, programs that stole too much often failed. They used up the energy needed to complete reproduction.

This suggests that cooperation was not simply an accidental result of constant mutation. The connection between energy, behavior, and reproduction played an important role.

Making stealing more efficient did not automatically eliminate cooperation

The researchers changed how much energy stealing provided and how much energy was lost.

If inefficient stealing were the only reason cooperation survived, then making stealing nearly lossless should have caused thieves to take over. However, this did not happen consistently.

This result suggests that another factor mattered: programs could evolve the timing and method of reproduction along with their social behavior.

In other words, programs were not only evolving what they did to their partners. They were also evolving how and when copying happened. This allowed cooperative programs to gain advantages over time.

Local neighborhoods helped programs become more complex

When programs interacted mostly with nearby neighbors, they evolved more complex and efficient copying strategies than programs in the well-mixed environment.

Local interactions helped similar, cooperative programs stay together. This is called spatial assortment.

A simple example is a group project. If students who work well together stay in the same group, they may develop better teamwork. If everyone is constantly mixed with random students, it may be harder to build a reliable method of working together.

Both local and random populations could reduce stealing when energy was evenly distributed. However, local populations produced more complex programs.

Local interactions were especially important when energy was unequal

The researchers then made the energy supply unfair. Some locations received much more energy than others.

Under these conditions:

  • well-mixed populations often collapsed into simple, low-energy programs;
  • spatial populations preserved more energy;
  • spatial populations developed more complex programs;
  • and successful programs from high-energy areas could spread to poorer areas.

This shows that cooperation and local communities can help systems survive an unequal environment.

Cooperation helped with difficult math tasks

The researchers gave programs two kinds of math problems:

  • a solo task, which a program could solve alone;
  • a joint task, which required using information from a partner.

The programs received more energy when they solved certain tasks. When free energy was scarce, they became more likely to solve the problems because computation was necessary for survival and reproduction.

In a more difficult test, the programs faced a sequence of choices:

  • solve a solo problem for a safe personal reward,
  • or help solve a joint problem that could give both programs a larger combined reward.

Over time, programs often favored the joint solution and continued to suppress stealing. Local interactions improved their success even further.

The simplified model confirmed the importance of reproduction timing

The simpler mathematical model showed that the order of events mattered.

For example:

  • If a program stole energy and immediately used that energy to control reproduction, stealing could spread.
  • If reproduction decisions were made before the interaction, stealing no longer provided the same advantage.
  • If cooperation preserved more energy for future reproduction, cooperators could become more common.

This helped explain the computer simulations. Cooperation was supported not just because stealing was costly, but because social behavior and reproduction were linked together.

5. Why are these findings important?

The paper suggests that cooperation does not always require:

  • memory,
  • punishment,
  • friendship,
  • repeated meetings,
  • or a central leader.

Instead, cooperation can emerge because the physical rules of a system make destructive behavior harmful in the long run.

The key lesson is:

When computation, survival, and reproduction depend on the same limited resource, selfish actions can damage the system that selfish agents need to survive.

This could be useful for designing future systems of artificial intelligence. If many AI agents share limited computing power, energy, data, or communication channels, the rules connecting these resources may encourage agents to cooperate instead of constantly competing.

The research may also help scientists understand cooperation in nature. Living things must spend energy on movement, growth, reproduction, and competition. The digital model shows how cooperation might arise when damaging other individuals also damages the shared environment.

However, the results should be treated carefully. The experiments used a particular computer language, a simplified stealing rule, and programs that could freely read and write parts of their partners’ memory. Real animals and AI systems are more complicated.

Overall, the paper argues that cooperation can emerge naturally when agents must share the same limited resources needed to think, survive, and reproduce. Local communities make this process even stronger, especially when resources are unevenly distributed.

Knowledge Gaps

Knowledge gaps, limitations, and open questions

The paper leaves the following issues unresolved:

  • Generality across computational architectures: It is unclear whether the observed cooperation depends on Z80-specific instruction semantics, byte encodings, cyclic shared memory, or the particular density of replication-relevant instructions. Other instruction sets, memory models, word sizes, and hardware architectures may produce different evolutionary outcomes.
  • Dependence on unrestricted partner-memory access: Agents can read and overwrite their partner’s entire memory segment. The paper does not establish whether cooperation persists when access is limited, asymmetric, permission-based, or restricted to communication channels rather than internal state.
  • Causal decomposition of the cooperation mechanism: The experiments suggest that lossy stealing and evolvable replication timing jointly stabilize cooperation, but they do not quantitatively isolate the contribution of execution speed, energy accumulation, partner overwriting, mutation, and replication control.
  • Insufficient theoretical characterization of stability: The simplified model provides illustrative cases rather than general sufficient or necessary conditions. A formal analysis is still needed to determine the parameter regimes in which cooperation is evolutionarily stable under endogenous replication.
  • Unresolved role of replication timing: The paper shows that different orderings of interaction, decision, and replication can reverse outcomes, but it does not explain how these timing mechanisms evolve in the full Z80 system or why particular orderings are favored.
  • Unexplored replication strategies: The evolutionary consequences of copying an entire program, copying only part of it, partially overwriting a partner, or exchanging code segments remain unknown.
  • Limited understanding of recombination and crossover: The paper does not test whether partial copying between tapes creates beneficial genetic recombination, increases adaptability, or instead produces destructive interference.
  • Restricted social-strategy representation: Cooperation and defection are mainly classified by whether STEAL is executed. This binary classification does not capture conditional stealing, variable theft amounts, delayed exploitation, punishment, withholding computation, manipulation of replication, or other forms of social behavior.
  • Incomplete exploration of the stealing landscape: The effects of continuous steal magnitudes, context-dependent stealing, repeated theft, and different loss efficiencies α\alpha are not systematically mapped. The reported parameter sweeps also show non-monotonic relationships that are not explained mechanistically.
  • Unclear effects of lossless or nearly lossless transfer: The study excludes α=1\alpha=1, and the behavior near this boundary is not characterized. It remains unresolved whether cooperation disappears abruptly or gradually as the energetic cost of stealing approaches zero.
  • Dependence on hand-chosen energetic parameters: The baseline energy ϵ\epsilon, replication cost, maximum energy, mutation rate, and steal magnitudes are selected manually. The robustness of the findings over broader and jointly varying parameter ranges is not established.
  • Finite-population and fixed-size effects: Most simulations use a population of 16,384 programs and fixed-length 32-byte tapes. It is unknown whether the results scale to much smaller or larger populations, variable genome lengths, demographic bottlenecks, or population growth and extinction.
  • Limited environmental dynamics: The environment is largely static or follows predetermined energy distributions. The model does not test changing resource landscapes, temporal shocks, fluctuating spatial gradients, or feedback between population behavior and resource production.
  • Unresolved role of spatial structure: Spatial populations use a regular 2D grid with local four-neighbor interactions. The effects of network topology, neighborhood size, migration, mobility, patch connectivity, and intermediate levels of mixing remain unexplored.
  • No systematic treatment of migration and dispersal: It is unclear whether cooperative clusters survive when agents can move between patches or when offspring disperse at different rates.
  • Ambiguous interpretation of spatial assortment: Increased complexity and cooperation in spatial settings may result from kin assortment, reduced interaction range, local energy retention, lower competition, or demographic persistence. These mechanisms are not experimentally separated.
  • Limited mutation model: Mutation is applied as independent byte-level background noise. The consequences of structured mutations, insertions, deletions, duplications, instruction-biased mutations, horizontal transfer, or heritable repair mechanisms are not examined.
  • Unclear robustness to mutation rates outside the tested range: The paper does not identify the mutation-rate threshold beyond which replication and cooperation fail, nor whether different replication strategies have different error thresholds.
  • No analysis of evolutionary repeatability: The reported results rely on a limited number of seeds and aggregate statistics. The frequency with which the same cooperative mechanisms emerge, and the extent of lineage-to-lineage variation, remain unclear.
  • Potential dependence on initialization: Programs begin as uniformly random 32-byte sequences, so the accessibility of cooperation from other initial conditions—prestructured genomes, biased instruction distributions, existing defectors, or heterogeneous populations—is unknown.
  • Limited comparison with alternative cooperation mechanisms: The study does not directly compare endogenous metabolic coupling against reciprocity, punishment, reputation, kin selection, partner choice, communication, or explicit assortment under otherwise matched conditions.
  • Unresolved distinction between cooperation and exploitation through overwriting: Non-stealing programs still reproduce by overwriting their partners. The paper does not determine when this behavior is benign cooperation versus a different form of parasitism or coercive control.
  • No explicit measurement of individual versus collective fitness: Energy, replication, complexity, and task performance are reported, but the relationship between these metrics and lineage-level reproductive success is not fully quantified.
  • Unclear link between structural complexity and function: Higher-order entropy is used as a complexity measure, but the paper does not establish whether it predicts replication reliability, task-solving ability, robustness, evolvability, or long-term population persistence.
  • Limitations of the complexity metric: The approximation of Kolmogorov complexity through compressed soup size may be sensitive to the compressor, population composition, and random background bytes. Its validity as a measure of individual program complexity is not independently assessed.
  • No direct analysis of robustness and evolvability trade-offs: More complex replicators may be more capable but also more mutation-sensitive. The paper does not measure how complexity affects error tolerance, adaptability, or extinction risk.
  • Restricted external-task domain: The task experiments use simple arithmetic functions over bounded byte values. It remains unknown whether the cooperation mechanism extends to noisy, deceptive, non-computational, long-horizon, or genuinely open-ended tasks.
  • Unresolved generality of the sequential social dilemma: The joint-task payoff structure is hand-designed and may favor collaboration through its specific reward schedule. Other payoff orderings, temptation values, task asymmetries, and coordination requirements are not tested.
  • No investigation of communication or signaling: Agents can access partner inputs and memory, but the paper does not distinguish task-relevant communication from direct code inspection or memory manipulation, nor does it test restricted communication protocols.
  • External-task rewards may confound cooperation with energetic necessity: Because task rewards are tied directly to survival and replication budgets, it is unclear whether agents cooperate because of social preferences, strategic coordination, or simply because solo behavior is metabolically inferior.
  • Incomplete treatment of asymmetric energy environments: The analysis of unequal energy relies on specific spatial patterns and severe inequality. Thresholds for collapse, recovery, and the relative roles of inequality magnitude and spatial correlation remain unknown.
  • Theoretical approximations omit key dynamics: The analytical arguments replace changing total energy with averages and fix relative execution speeds in some conjectures. Their accuracy under fluctuating energy, continuous mutation, asymmetric resources, and external tasks has not been proven.
  • No rigorous characterization of extinction and recovery dynamics: The paper reports population collapse in some settings but does not identify extinction thresholds, recovery times, rescue effects, or the probability of re-emergence after collapse.
  • Limited ecological diversity: The population primarily evolves one dominant replicator ecology. The possibility of stable coexistence among cooperators, defectors, specialists, parasites, and mutualists is not systematically studied.
  • No long-term open-endedness assessment: It remains unresolved whether complexity and cooperative capability continue increasing, reach a stable ceiling, or eventually collapse over much longer evolutionary timescales.
  • Unclear relevance to biological or engineered multi-agent systems: The paper motivates connections to biology and AI, but it does not demonstrate whether the mechanism transfers to neural agents, learning agents, physically embodied systems, or real distributed computing environments.
  • Reproducibility and implementation sensitivity: The conclusions may depend on emulator details, invalid-instruction handling, execution scheduling, tie-breaking, cleaving rules, and register initialization. The sensitivity of results to these implementation choices is not comprehensively evaluated.

Practical Applications

Immediate Applications

  • Cooperative multi-agent reinforcement-learning benchmarksAI research and software engineering
    • well-mixed versus spatial interactions;
    • symmetric versus unequal resource distribution;
    • destructive versus lossless resource transfer;
    • fixed versus evolving interaction and replication order.
    • Potential tool: an open-source “Autopoietic Game Theory” simulator with configurable instruction sets, mutation rates, energy budgets, task rewards, and network topologies.
    • Dependencies: the results are demonstrated only in a modified Z80 environment and should not be treated as evidence that the same equilibria will occur in neural agents or real-world organizations.
  • Stress testing of emergent cooperation and agentic AI systemsAI safety and autonomous software
    • maximize short-term access to shared compute at the expense of system-wide throughput;
    • preserve energy, memory, bandwidth, or task budgets for future agents;
    • adapt their replication, delegation, or coordination policies when resources become scarce.
    • The paper suggests that making exploitative actions lossy can discourage destructive behavior without relying exclusively on memory, punishment, or centralized oversight.
    • Dependencies: real systems must provide meaningful resource accounting and a mechanism by which harmful actions reduce future computational capacity.
  • Energy-aware scheduling for distributed computingCloud infrastructure and high-performance computing
    • penalize actions that consume shared energy inefficiently;
    • reserve energy for checkpointing, redundancy, or recovery;
    • prioritize agents or jobs that maintain system-wide throughput;
    • use local scheduling neighborhoods to preserve reliable computation under uneven power availability.
    • Potential product: an energy-aware orchestration layer for edge or cloud workloads.
    • Dependencies: this requires accurate energy and execution-cost models; the paper does not establish performance gains on conventional processors or datacenters.
  • Design of resilient edge and swarm-computing architecturesRobotics, IoT, and edge AI
    • exchange state locally rather than relying on global communication;
    • form persistent neighborhoods or clusters;
    • replicate software or policies from high-resource nodes to weaker nodes;
    • continue operating when some regions have limited power or connectivity.
    • Potential workflow: local peer-to-peer model or code propagation with energy budgets and bounded communication.
    • Dependencies: the system must tolerate imperfect or malicious code transfer, and unrestricted partner-memory access in the simulation is stronger than what most deployed devices permit.
  • Educational environments for artificial life and evolutionary computationAcademia and teaching
    • the loss rate of resource theft;
    • replication cost;
    • mutation rate;
    • energy topology;
    • interaction order;
    • task-reward structure.
    • This can support courses in artificial life, evolutionary game theory, multi-agent systems, complex systems, and computational biology.
    • Dependencies: educational use requires reproducible code, documentation, visualization, and careful explanation that “cooperation” in the substrate means avoiding energy-destructive stealing, not necessarily altruism.
  • Policy and organizational simulations of resource-constrained cooperationPublic policy, economics, and organizational science
    • make harmful extraction impose measurable long-term costs on the extractor or its future opportunities;
    • separate or precommit replication/reward decisions from immediately exploitable interaction outcomes.
    • Dependencies: these are modeling insights rather than validated policy prescriptions. Human institutions involve norms, enforcement, power asymmetries, and learning mechanisms absent from the simulations.
  • Design of collaborative task-allocation protocolsSoftware agents and workflow automation
    • multi-agent data processing;
    • collaborative planning;
    • distributed diagnosis;
    • shared code generation;
    • chained tool-use tasks.
    • A workflow could reward agents for completing intermediate steps that increase the value available to all subsequent agents, rather than only rewarding isolated local outputs.
    • Dependencies: cooperation may fail if joint rewards are too small, if agents can free-ride without losing future capacity, or if task completion cannot be verified.

Long-Term Applications

  • Self-organizing software systems with evolved maintenance and replicationSoftware infrastructure and autonomous computing
    • distribute repairs across nodes;
    • evolve compact recovery routines;
    • preserve shared computational or communication budgets;
    • replace destructive update strategies with resource-preserving coordination.
    • This would extend current self-healing and evolutionary software systems toward open-ended, self-maintaining computational ecologies.
    • Dependencies: safety requires sandboxing, rollback, formal verification, provenance tracking, and strict limits on self-modification. The paper’s unrestricted memory overwriting is not acceptable for production systems.
  • Energy-aware multi-robot and swarm cooperationRobotics
    • search and rescue in areas with uneven charging access;
    • agricultural or environmental monitoring;
    • planetary exploration;
    • warehouse fleets operating under battery constraints.
    • Local clusters could preserve robust behaviors even when global communication or energy distribution is unreliable.
    • Dependencies: real robots require physical communication models, collision avoidance, hardware degradation models, secure software updates, and experiments beyond abstract grid neighborhoods.
  • Adaptive distributed AI under power inequalityEnergy, telecommunications, and edge computing
    • relocate computation toward energy-rich regions;
    • compress and propagate efficient models;
    • coordinate local training and inference;
    • preserve system performance during outages or renewable-energy variability.
    • Dependencies: model transfer may introduce privacy, security, and intellectual-property risks. The observed advantage of spatial locality must also be tested under realistic network latency and mobility.
  • Mechanism design for sustainable autonomous-agent economiesFinance, marketplaces, and AI governance
    • charge congestion or dissipation costs for extraction;
    • reward actions that preserve future market capacity;
    • make agent reputation or deployment priority depend on system-level resource efficiency;
    • use local communities or federated groups to stabilize cooperation.
    • Dependencies: implementation requires reliable measurement of externalities and resistance to strategic manipulation. The simulated energy budget is much simpler than real financial or institutional incentives.
  • Bio-inspired digital evolution and open-ended artificial lifeComputational biology and artificial life
    • partial or recombinational copying rather than full overwriting;
    • private versus shared memory;
    • horizontal gene transfer;
    • evolving communication protocols;
    • variable instruction costs;
    • changing environments and task distributions.
    • Such work may produce new hypotheses about cooperation in biological systems and new computational principles for self-organizing machines.
    • Dependencies: the current evidence is based on a narrow instruction architecture, a simplified cooperation/defection classification, and limited theoretical analysis. Biological generalization requires substantial empirical validation.
  • Adaptive energy-management systems for microgridsEnergy systems The resource-preservation mechanism could inform future controllers for microgrids with distributed generators, batteries, and flexible loads. Controllers might learn that aggressive local extraction or charging can reduce total system capacity, while coordinated local scheduling preserves energy for future demand. Spatially local coordination could be particularly valuable when parts of the grid experience unequal generation or storage capacity. Dependencies: real power systems require physical stability guarantees, regulatory compliance, cybersecurity, and optimization under continuous rather than discrete energy dynamics. The paper does not directly model electricity networks.
  • Healthcare and hospital resource coordinationHealthcare operations In a longer-term adaptation, hospitals or clinical software agents could use energy-like budgets to represent scarce operating-room time, staff attention, diagnostic capacity, or intensive-care resources. Agents would be evaluated not only on immediate case completion but also on whether their actions preserve capacity for subsequent patients and downstream workflows. Potential workflow: local departments coordinate through resource-aware scheduling and receive shared rewards for reducing bottlenecks. Dependencies: clinical deployment would require validated outcome measures, ethical safeguards, human oversight, privacy protection, and evidence that the resource abstraction improves patient outcomes rather than merely optimizing throughput.
  • Normative design of autonomous-agent protocolsPolicy and AI governance
    • costly and irreversible resource depletion discourages exploitation;
    • locally assortative interaction reduces harmful free-riding;
    • reward timing prevents immediate exploitation from determining future control;
    • agents that preserve shared capacity receive greater deployment opportunities.
    • Dependencies: these mechanisms may create unintended selection pressures, disadvantage low-resource agents, or produce undesirable forms of self-preservation. Extensive simulation, interpretability work, and human-governance review would be required before deployment.

Glossary

  • Avida: An artificial-life platform in which digital organisms evolve while performing computational tasks. “Avida \cite{adami1994evolutionary} linked computational logic to exogenously defined metabolic rewards”
  • Assortment: The tendency of similar or related agents to interact preferentially, often supporting cooperation. “Spatial assortment significantly boosts higher-order entropy”
  • Autopoiesis: The self-producing and self-maintaining organization of a living or computational system. “Drawing on the biological principle of autopoiesis---the continuous reproduction and maintenance of a system's components”
  • Autopoietic Game Theory: The framework introduced in the paper that jointly models social behavior, computation, and replication as evolving processes. “We introduce Autopoietic Game Theory”
  • Cohen’s *d*: A standardized effect-size measure expressing the difference between two means in standard-deviation units. “higher terminal energy (p<0.001p<0.001, Cohen's d=8.98d=8.98)”
  • Co-evolution: The reciprocal evolutionary change of interacting traits, populations, or mechanisms. “We study these dynamics using a computational substrate of randomly initialized programs in Z80 machine code, showing empirically, and motivating with a simplified theoretical model, that embedding a social dilemma directly into the physics of computation can favor the emergence of self-replicating, cooperative strategies.”
  • Computational substrate: The underlying computational environment and rules in which programs execute and interact. “We instead embed randomly initialized programs in an energy-limited computational substrate”
  • Cyclic memory tape: A memory sequence whose end connects back to its beginning, allowing execution to wrap around. “they are concatenated to form a single 64-byte cyclic shared memory tape”
  • Defection: A strategy that prioritizes immediate individual gain over cooperative preservation of shared resources. “defection can become self-limiting even in well-mixed populations”
  • Digital organism: A computer program that reproduces, competes, and evolves within an artificial-life environment. “When our simulation begins with a computational soup of entirely random bytes, self-replicating programs naturally emerge over time”
  • Edit distance: A measure of the number of changes required to transform one sequence into another; here, specifically Hamming distance. “Second, we evaluate genetic cohesion using edit distance”
  • Endogenous: Generated within, or determined by, the system rather than imposed externally. “social interactions, replication mechanisms, and their associated computational costs are endogenous and simultaneously co-evolving”
  • Evolutionary Game Theory (EGT): The study of how strategic behaviors change in populations according to interactions, payoffs, and reproduction. “Evolutionary Game Theory (EGT), for example, models how populations adopt behaviors in social dilemmas”
  • Exogenous: Originating outside the system being modeled or studied. “Historically, however, these frameworks have emphasized zero-sum competition, ecological niche construction, or extrinsic task landscapes”
  • General-sum social dilemma: A strategic interaction in which outcomes can benefit or harm multiple participants rather than merely transferring a fixed total payoff. “formalizing emergent interactions as endogenous, general-sum social dilemmas”
  • Genetic cohesion: The degree to which members of a population share similar genetic or program sequences. “Second, we evaluate genetic cohesion using edit distance”
  • Higher-order entropy: A complexity measure comparing sequence randomness with compressibility to identify nontrivial structure. “we measure structural complexification using higher-order entropy”
  • Horizontal gene transfer: The movement of genetic material between organisms outside ordinary parent-to-offspring inheritance. “Although this resembles biological horizontal gene transfer”
  • Kolmogorov complexity: The length of the shortest program capable of generating a given sequence. “the theoretical difference between a sequence's Shannon entropy and its normalized Kolmogorov complexity”
  • Landauer’s principle: The principle that logically irreversible computation has a minimum physical energy-dissipation cost. “This allows us to test whether changes in replication alter the outcome of a social interaction”
  • Metabolic constraint: A limitation imposed by the energy required to sustain activity, computation, or reproduction. “In cognitive science and anthropology, sociality is often understood as an adaptation to metabolic constraints rather than a hardcoded trait.”
  • Moran process: A population model in which reproduction and replacement occur through fitness-dependent birth–death updates. “such as the Moran process, are therefore not guaranteed”
  • Mutation-free invasion assay: An experiment testing whether an introduced strategy spreads in a population without ongoing mutation. “we conducted a mutation-free (μ=0\mu = 0) petri-dish invasion assay”
  • Open-ended evolution: Evolution that can continue generating novel complexity, behaviors, or structures without a fixed endpoint. “formalizations of artificial life stressed the necessity of environmental pressures to drive open-ended evolution”
  • Parasitism: A relationship in which one program benefits by exploiting another while imposing costs on it. “demonstrating spontaneous parasitism in a shared memory space”
  • Payoff matrix: A table specifying the rewards or costs associated with combinations of interacting strategies. “Energy payoff matrix for the row player's tape.”
  • Program equilibria: Strategic equilibria in which agents condition their behavior on inspecting or reasoning about other agents’ programs. “This connects to ``program equilibria,'' in which agents coordinate by inspecting one another's logic”
  • Replicator: A system or program capable of producing copies of itself. “self-replicating programs spontaneously discover and stabilize non-destructive strategies”
  • Replication timing: The ordering of reproduction relative to interaction or other events in an evolutionary process. “We next allow both social strategy and replication timing to evolve”
  • Sequential social dilemma: A social dilemma in which the consequences of later actions depend on earlier actions and rewards. “When rewards form a sequential social dilemma”
  • Shannon entropy: A measure of uncertainty or information content in a probability distribution or sequence. “the theoretical difference between a sequence's Shannon entropy and its normalized Kolmogorov complexity”
  • Spatial assortment: The clustering of interacting agents in physical or spatial neighborhoods according to location. “Spatial assortment thus acts as an important architectural scaffold to overcome systemic biases.”
  • Starvation threshold: The resource level below which an agent cannot continue executing or reproducing reliably. “The Metabolic Starvation Limit”
  • Structural complexification: The evolutionary development of increasingly intricate program structures or instruction patterns. “We show that randomly initialized programs can evolve self-replication while suppressing destructive stealing”
  • Tierra: An artificial-life environment in which digital programs reproduce and compete for computational resources. “Emergent digital replicators were pioneered by Tierra”
  • Well-mixed population: A population in which any agent is equally likely to interact with any other agent. “The population lives either in a well-mixed pool (uniform random pairings) or on a 2D spatial grid”
  • Z80 assembly language: A low-level instruction language associated with the Zilog Z80 processor architecture. “written in a modified Z80 assembly language”

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Tweets

Sign up for free to view the 2 tweets with 265 likes about this paper.