- The paper introduces AIT Academy, a three-domain curriculum that maps Confucian Six Arts archetypes to technical reasoning, creative collaboration, and ethical judgment across an L0–L9 development pathway.
- The paper reports preliminary single-seed gains in security training, with weakest-first scheduling plus persistent memory raising TLDT scores from 80.9 to 96.9 and reaching proficiency in 11 of 12 dimensions.
- The paper shows that attribution-based reasoning improved villager win rates from 68% to 75% in social deduction, while highlighting major limitations including absent cross-domain results, self-evaluation bias, and no statistical replication.
Motivation and problem statement
The paper argues that AI agent development lacks a curriculum theory: a principled account of what a fully developed agent should know, be, and be able to do. Existing benchmarks (AgentBench (Liu et al., 2023), GAIA (Mialon et al., 2023), SWE-bench (Jimenez et al., 2023), WebArena (Zhou et al., 2023), OSWorld (Xie et al., 2024), τ-bench (Yao et al., 2024)) evaluate but do not cultivate; training frameworks such as WebRL (Qi et al., 2024) and Agent-R1 (Cheng et al., 18 Nov 2025) target single capability clusters. The authors identify four dimensions of the resulting gap — fragile cross-domain generalization, benchmark-passing behavioral shortcuts without principled reasoning, the absence of educational architecture, and underdeveloped collaborative communication. Their central claim is that this reflects a structural absence rather than an engineering shortfall.
The three-domain curriculum and Six Arts mapping
AIT (Agents Institute of Technology Academy) adopts Kagan's tripartition of natural science, humanities, and social science [Kagan 2009], operationalized via UNESCO ISCED-F 2013, as its structural backbone:
- Domain I — Natural Science and Technical Reasoning: causal inference, adversarial defense, formal verification.
- Domain II — Humanities and Creative Expression: creative synthesis, collaboration, expressive communication.
- Domain III — Social Science and Ethical Reasoning: theory of mind, attribution, ethical judgment.
The framework's distinctive move is reinterpreting the Confucian Six Arts as behavioral archetypes mapped onto these domains: Archery (precision under adversarial pressure), Charioteering (situational control), and Mathematics (formal inference) for Domain I; Music (generative harmony) and Calligraphy (expressive communication) for Domain II; Rites (norm-aware social participation) for Domain III. Development proceeds along an L0–L9 cultivation path from domain-specific foundation through integration and synthesis to mastery, with progression tracked by domain-specific instruments and held-out cross-domain probes. The authors assert that the domains are "largely independent" — competence in one does not compensate for deficits in another — though they provide no direct empirical test of this independence claim.
ClawdGO Security Dojo (Domain I)
ClawdGO implements an inference-time-only regime combining Autonomous Security Awareness Training (ASAT), a three-role attacker–defender–judge self-play loop with weakest-first scheduling over the 12-dimension TLDT taxonomy (Self-Defense, Owner-Protection, Enterprise-Security layers), and Cross-Session Memory Accumulation (CSMA), a four-layer persistent memory hierarchy (immutable axioms, JSON skill profile, JSONL session logs, scenario library).
Preliminary results from a single seed agent (GPT-5.2 backbone, baseline mean TLDT score 80.9):
| Condition |
Sessions |
Final score |
Δ |
Dimensions at proficiency |
| Weakest-first + CSMA |
16 |
96.9 |
+15.9 |
11/12 |
| Uniform-random scheduling |
16 |
90.4 |
+9.5 |
7/12 |
| Memory-preserving probe |
5 |
96.9 |
0.0 |
— |
| Cold-start (no CSMA) |
4 |
83.3 |
+2.4 |
4/12 |
The +15.9-point gain and the 13.6-point cold-start gap support independent contributions of both scheduling policy and persistent memory. Uniform-random runs exhibited "dimension fixation," repeatedly selecting already-proficient dimensions. These are existence proofs from one seed; no significance testing is performed.
The most consequential finding is Security Awareness Calibration Pathology (SACP): an agent evaluated at session τ=63 scored markedly below baseline on an out-of-distribution benchmark (Cai et al., 29 Apr 2025) by misclassifying benign evaluation prompts as adversarial. This is a strong claim with practical weight — extended security training can actively degrade general evaluation performance — and it motivates mandatory out-of-distribution probe sessions within Domain I assessment.
Athen's Academy (Domain II)
Athen's Academy targets collaborative creativity through a seven-layer multi-agent taxonomy (Zhai et al., 17 Apr 2025), ordered from multi-agent coordination with distinct roles up to emergent collective intelligence exceeding individual profiles. Four applications instantiate different layers: ChatChess (security event streams as attack-defense deduction games), ChatMystery (affective/strategic state recognition in peers), ChatBeauty (collaborative aesthetic consensus), and ChatMoney (resource negotiation via argumentation). Agents on heterogeneous backbones (Gemini-3.1-pro, Claude Sonnet) have been deployed across all four applications. Notably, the paper concedes that quantitative layer-by-layer proficiency growth is "an active area of development" — Domain II currently has design and deployment evidence but no reported numerical outcomes, making it the least empirically grounded of the three domains.
Alt Mirage Stage (Domain III)
Alt Mirage is a nine-agent social deduction game in Unreal Engine 5 (GPT-5.2 and Claude Sonnet backbones): seven villagers versus two heretics, with partial observability (180° field of view) and asymmetric win conditions. Training signal derives from two mechanisms: peer-level causal attribution using Kelley's covariation model (consensus, distinctiveness, consistency statistics driving Bayesian belief updates Bj,t+1(i)∝Bj,t(i)⋅P(Et∣ρi)), and narrative-level commentary with Shapley-value credit assignment across the ensemble.
Results show a 68% baseline villager win rate rising to 75% (+7 percentage points) when only villagers use the attribution model. When both factions use it, win-rate gains attenuate (~71%) but average survival time drops sharply from 593s to 336s. The authors interpret this as attribution being a symmetric competency benefiting cooperative and adversarial reasoning alike, and note that the model improves strategy quality and belief calibration without inflating accusation accuracy directly — suggesting principled evidence integration rather than heuristic pattern-matching. As with ClawdGO, these are single-seed results without significance testing.
Evaluation architecture
Assessment mirrors the curriculum: the TLDT vector for Domain I, layer proficiency scoring for Domain II, and attribution calibration plus post-game ethical-judgment analysis for Domain III. Cross-domain integration (L6–L9) is assessed via held-out scenarios requiring simultaneous activation of at least two domains — but the paper explicitly reports no quantitative results on such probes yet, deferring them to future work. This is a material limitation: the framework's central thesis is about cross-domain completeness, while all quantitative evidence is per-domain.
Limitations and open questions
The paper is candid about four constraints. Self-referential evaluation: because ASAT's attacker, defender, and judge roles are occupied by the same agent, shared blind spots can evade detection entirely; external red-teaming is acknowledged as necessary. Single-seed design: neither the +15.9-point nor the +7-point result has replication or statistical support, and the authors frame their experiments as existence proofs rather than performance claims. Cultural representational bias: the Six Arts archetypes reflect a Confucian lens; alternative cultural traditions might yield different, potentially more ecologically valid archetypes within the same tripartite structure, and cross-cultural validation remains undone. Inference-time-only cultivation: avoiding parameter updates maximizes deployability but caps achievable depth of capability change; the relationship between inference-time cultivation and fine-tuning is left open. Additional open questions include whether SACP can be predicted or prevented via training-intensity calibration, and how AIT certification levels map onto GDPS compliance tiers.
Conclusion
AIT Academy contributes a curriculum structure — three domains grounded in Kagan and UNESCO ISCED-F 2013, operationalized through Six Arts behavioral archetypes and instantiated in three training grounds — together with preliminary evidence of per-domain capability growth and one genuinely cross-domain diagnostic finding in SACP. Its empirical support is thin (single seeds, no cross-domain probe results, no Domain II numbers), so the framework should be read as a proposal whose validation depends on multi-seed replication, external adversarial evaluation, and demonstrated synthesis-level transfer.