Core War: Adversarial Program Evolution

• Core War is a Turing-complete adversarial game where assembly-like programs, known as warriors, contest control of a virtual machine.
• It employs innovative self-play strategies—specifically the Digital Red Queen algorithm with MAP-Elites—to continually evolve robust and adaptive warriors.
• Empirical studies demonstrate convergent evolution toward generalist strategies, validated by human-designed benchmarks and diverse performance metrics.

Core War is a computational environment and competitive programming game in which assembly-like programs, known as warriors, compete for control of a virtual machine. Originating in the field of artificial life, Core War offers a Turing-complete, fully sandboxed testbed for studying adversarial program evolution, self-play, and the dynamics of continual adaptation. The environment has found renewed significance as a model for open-ended adversarial processes and as a benchmark for evolutionary algorithms, including those driven by LLMs (Kumar et al., 6 Jan 2026).

1. Formalizing the Adversarial Objective in Core War

Traditional evolutionary or program synthesis frameworks typically employ static optimization—searching for a solution that maximizes a fixed fitness function. In contrast, Core War research, and specifically the Digital Red Queen (DRQ) algorithm, instantiates a continually shifting adversarial “Red Queen” arms race. Rather than optimizing against a single static objective, each new warrior is evolved to outperform an ever-expanding set of prior champions. Formally:

$$w_t = \arg\max_{w} \; \mathbb{E}_{\text{seed}}\left[ Fitness(w; \{w_0, ..., w_{t-1}\}) \right]$$

where $w_0$ denotes the seed warrior, $\{w_1, ..., w_{t-1}\}$ are previous champions, and the expectation averages over randomized battle initializations. In contrast, static-target optimization seeks

$$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$

with a fixed opponent.

Fitness in DRQ is context-dependent and based on survival and elimination: in an $N$-way match of up to $\mathcal{T}$ timesteps, each living warrior shares $N/\mathcal{T}$ per timestep, yielding

$$Fitness(i; \text{opponents}) = \sum_{\tau=1}^{\mathcal{T}} \frac{N}{\mathcal{T}} \cdot \frac{A_i(\tau)}{\sum_j A_j(\tau)}$$

where $A_i(\tau) = 1$ if warrior $i$ is alive at time $w_0$0, and 0 otherwise.

2. Algorithmic Structure: The Digital Red Queen Self-Play Loop

The DRQ algorithm is structured as a multilevel self-play loop operating over a sequence of evolutionary rounds. At each round, a new warrior is evolved to defeat the current population of opponents selected from history. Optimization within a round uses MAP-Elites to preserve quality-diversity. The high-level pseudocode is summarized below:

$$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$7

Key hyperparameters include the total number of rounds $w_0$1 (e.g., 10), the number of inner iterations $w_0$2 (e.g., 1,000), opponent-history length $w_0$3 (e.g., 1, 3, or all previous), and the number of stochastic seeds $w_0$4 per evaluation (e.g., 20) (Kumar et al., 6 Jan 2026).

3. Warrior Representation and LLM Mutation

Core War warriors are encoded in Redcode, a low-level language with approximately 20 opcodes (such as DAT, SPL, MOV, ADD), a set of modifiers, and diverse addressing modes. In the DRQ framework:

• New generation: An LLM (GPT-4.1-mini) is prompted with the Redcode specification and tasked with producing a novel warrior.
• Mutation: Given a $w_0$5, the LLM receives the parent’s Redcode and is asked for a variant aimed at improved performance.

No fine-tuning is applied; the model leverages its pretrained knowledge augmented by context-specific instructions. The LLM thus samples from a conditional distribution $w_0$6, guiding search over the high-dimensional space of Redcode programs.

4. Experimental Protocol and Evaluation Metrics

The Core War simulation in DRQ is specified as follows:

• Core size: 8,000 memory cells arranged circularly.
• Maximum timesteps: 80,000 per match.
• Thread cap: 8,000 per warrior.
• Program constraint: $w_0$7 100 instructions.
• Placement: Warriors seeded $w_0$8100 cells apart, evaluated over 20 random initializations.

Baseline performance is assessed using a held-out set of 317 human-designed warriors. Generality of a warrior $w_0$9 is the fraction of these human opponents defeated or tied by $\{w_1, ..., w_{t-1}\}$0 in zero-shot 1-on-1 matches.

MAP-Elites employs behavior descriptors $\{w_1, ..., w_{t-1}\}$1, where:

• $\{w_1, ..., w_{t-1}\}$2: Total number of threads spawned (SPL) by $\{w_1, ..., w_{t-1}\}$3.
• $\{w_1, ..., w_{t-1}\}$4: Number of unique addresses written/read.

Additional metrics include:

• Phenotype: Warrior’s fitness vector against all 317 human benchmarks.
• Genotype: Text embedding of Redcode via OpenAI text-embedding-3.
• Across-run diversity: Principal component and variance analyses on phenotype/genotype.
• Cycle counts: Number of $\{w_1, ..., w_{t-1}\}$5 triplets forming rock–paper–scissors cycles in dominance relations.
• Rate of change: $\{w_1, ..., w_{t-1}\}$6.

5. Empirical Observations and Analysis

A. Static vs. Red Queen Baselines

In one-round (static) settings:

• Zero-shot LLM: Defeats $\{w_1, ..., w_{t-1}\}$7 of 294 human warriors.
• Best-of-8: Defeats $\{w_1, ..., w_{t-1}\}$8.
• Evolved specialist collectives: can defeat $\{w_1, ..., w_{t-1}\}$9.
• Single evolved specialist: Defeats $$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$0 on average.

B. Dynamics of Continual DRQ

Across 96 runs of multi-round DRQ:

• Generality of warriors increases monotonically with round index ($$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$1), with $$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$2 under log-linear fit.
• Across-run phenotypic variance and phenotype-change rates decrease as DRQ progresses, while genotypic variance remains roughly stable.
• This pattern suggests convergent evolution toward generalist strategies—distinct underlying codes, but increasingly similar phenotypic profiles.

C. Opponent History Length

• $$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$3 (last opponent): Many dominance cycles observed.
• $$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$4 or full history: Reduces cycles by $$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$5; arms race stabilizes.

D. Quality-Diversity Role

Replacing MAP-Elites with a greedy single-cell approach degrades champion quality, especially in later rounds. This highlights the necessity of intra-round exploration and diversity preservation in adversarial evolution.

E. Code-Generality Predictiveness

Linear regression from text embeddings to final generality achieves $$w^* = \arg\max_{w} \; \mathbb{E}\left[ Fitness(w; \{w_{target}\}) \right]$$6, evidencing nontrivial structure in the code underlying robustness and offering a foothold for future surrogate modeling and interpretability.

6. Broader Implications and Limitations

The DRQ approach positions Core War as a controllable, Turing-complete arena for adversarial program evolution. The algorithm demonstrates that even minimal self-play—sequential LLM-based generation, MAP-Elites-based search, and historical evaluation—yields robust generalist solutions. Advantages include clear parallels to cybersecurity arms races, safe sandboxed experimentation, and insight into open-ended adaptation (Kumar et al., 6 Jan 2026).

Several limitations are acknowledged:

• The linear lineage (one champion per round) does not fully recapitulate the diversity and concurrency of complex ecosystems.
• Computational expense may constrain scalability; surrogate-based fitness approximation may be required.
• Behavioral descriptor and core parameter choices may bias evolutionary search; domain-agnostic alternatives remain an open question.

Ultimately, Core War’s integration with modern LLM-driven and quality-diversity techniques illustrates the transition from brittle specialization under static objectives to robust generalism via continual adaptation, and suggests that similar minimal Red Queen dynamics may have application in cybersecurity defense, red-teaming, and even models of biological resistance.