Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems

Abstract: LLM-based autonomous agents have demonstrated strong capabilities in reasoning, planning, and tool use, yet remain limited when tasks require sustained coordination across roles, tools, and environments. Multi-agent systems address this through structured collaboration among specialized agents, but tighter coordination also amplifies a less explored risk: errors can propagate across agents and interaction rounds, producing failures that are difficult to diagnose and rarely translate into structural self-improvement. Existing surveys cover individual agent capabilities, multi-agent collaboration, or agent self-evolution separately, leaving the causal dependencies among them unexamined. This survey provides a unified review organized around four causally linked stages, which we term the LIFE progression: Lay the capability foundation, Integrate agents through collaboration, Find faults through attribution, and Evolve through autonomous self-improvement. For each stage, we provide systematic taxonomies and formally characterize the dependencies between adjacent stages, revealing how each stage both depends on and constrains the next. Beyond synthesizing existing work, we identify open challenges at stage boundaries and propose a cross-stage research agenda for closed-loop multi-agent systems capable of continuously diagnosing failures, reorganizing structures, and refining agent behaviors, extending current coordination frameworks toward more self-organizing forms of collective intelligence. By bridging these previously fragmented research threads, this survey aims to offer both a systematic reference and a conceptual roadmap toward autonomous, self-improving multi-agent intelligence.

• The paper introduces a unified LIFE framework that integrates agent capabilities, collaboration strategies, failure attribution, and self-evolution for LLM-based multi-agent systems.
• It presents detailed taxonomies for individual intelligence and collaborative orchestration, comparing roles, communication methods, and centralized versus distributed control.
• The study highlights benchmarking challenges and advocates for closed-loop feedback between error diagnosis and evolution to enhance system resilience and adaptability.

Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems

Introduction and LIFE Framework Overview

This paper presents a comprehensive and unified survey of the operational lifecycle of LLM-based multi-agent systems (MAS), introducing the LIFE framework: Lay the capability foundation, Integrate agents through collaboration, Find faults through attribution, and Evolve through autonomous self-improvement. Unlike prior compartmentalized reviews, this survey explicitly characterizes dependencies and causal links among agent capability, collaboration organization, anomaly diagnosis, and self-evolution, arguing that progress in each dimension constrains and enables advancements in the others.

Figure 1: Overview of LLM-based multi-agent systems organized along an operational lifecycle from individual agent action to system evolution.

Foundation: Individual Intelligence in LLM-based Agents

The survey first formalizes LLM-based agents as modular sequential decision-makers with explicit decomposition of reasoning, memory, planning, and tool-use capabilities. Memory acts as a cross-cutting module consolidating prior experience and external context, planning bridges goal abstraction to actionable subgoals, and tool use grounds agentic output via integration with structured environments and API calls.

Figure 2: Architecture of individual agent capabilities with memory as a persistent, cross-cutting component influencing all reasoning and execution.

The reasoning pipeline taxonomy extends from RAG and multi-modal CoT input augmentation, through tree/graph-based search and PRM-based verification, to advanced output-level regulation using contrastive decoding and failure abstention. These approaches have achieved measurable improvements in mathematical reasoning and factuality, e.g., process-supervised LLMs surpassing outcome-supervised baselines without annotation bottlenecks.

Memory mechanisms progress from flat episodic buffers to typed, graph-structured, or algorithmically maintained stores with utility-driven maintenance. However, inter-module coupling remains underexplored—most advancements independently optimize reasoning, memory, planning, or tool use without cross-module feedback, resulting in bottlenecks in long-horizon deployments. The paper highlights the lack of benchmarks that capture joint capability requirements and why improvements in one module may not transfer systemically.

Collaboration: Multi-Agent System Organization

The core of the survey covers collaborative MAS construction, taxonomized along four primary axes: roles (homogeneous/heterogeneous and static/dynamic allocation), communication (explicit/implicit and protocol specification), orchestration topology (centralized, distributed, hybrid), and execution/interaction (sequential or parallel).

Figure 3: Multi-agent collaboration system highlighting foundation, structure, and execution layers for organization and system lifecycle.

Functional specialization via heterogeneous roles consistently outperforms homogeneous configurations for complex tasks, yet increases error propagation risks and overhead. Static role allocation facilitates division of labor in structured domains, while emerging dynamic systems support on-the-fly agent instantiation, recruitment, and even topology search via RL or evolutionary strategies.

Explicit communication—token-based message exchange—is the prevalent pattern, providing interpretability and modularity, but encountering scalability and redundancy challenges in larger agent teams. Implicit coordination, leveraging shared state, environmental cues, or multi-agent RL, is noted as an underexplored vector for future efficiency gains.

Orchestration is not a solved design variable; for different tasks, global control (centralized), autonomy and robustness (distributed), or a mix (hybrid) provide distinct benefits and failure modes. Temporal organization (sequential vs. parallel execution pipeline) dictates error propagation risk, epistemic diversity, and solution aggregation complexity.

Figure 4: Multi-agent collaboration evaluation benchmarks, comparing coverage of task components and evaluation criteria.

Diagnosis: Multi-Agent Failure Attribution

As agentic collaboration grows more structured and interdependent, error propagation and cascading failures become the norm rather than the exception. The paper synthesizes a formal failure attribution framework: attribution models operate over complete execution trajectories, system configurations, and queries to localize the responsible agent(s) and causal steps upon trajectory-level failure.

Figure 5: Mechanism of failure attribution in multi-agent systems, illustrating the mapping from trajectory to responsible entity and temporal step.

Failure taxonomies are organized around system structure (design and communication faults), execution stages (reasoning, tool use, planning, etc.), and causal lifecycle (agent-, workflow-, and platform-level propagation). The survey identifies a gap in universal, fine-grained, and multi-causal attribution standards. Current approaches rely on:

• Data-driven models: Labeled trajectory replay, RL, and contrastive techniques distilled from synthetic, counterfactually generated, or manual annotations
• Constraint-guided pipelines: Hierarchical search space decomposition, scope delineation, error taxonomy, and evidence-based validation
• Causal inference: Counterfactual graph analysis, causal tracing via Shapley values, and multi-granularity propagation path reconstruction

  Figure 6: Attribution scenario cases, illustrating single-point, cascade, and multi-cause failures and mapping to attribution targets.

Persistent challenges include incomplete agreement on the attribution target (responsibility vs. manifestation), insufficient modeling of coupled propagation chains (multi-step, multi-module, delayed exposure), limited dataset realism, and lack of a robust evaluation–repair feedback loop. The survey advocates for unified classification frameworks, structured causal modeling, and closed-loop evaluation/repair protocols as future foundations.

Evolution: Autonomous Self-Evolution of Multi-Agent Systems

The final stage addresses self-evolution, pushing MASs from statically engineered to dynamically adaptive collectives, capable of modifying agent parameters, team topology, orchestration, and even system meta-architecture in response to failure feedback and task distribution drift.

Figure 7: Self-evolution cycle for MASs, including variation, selection, and retention, and taxonomy of targets: agentic, systemic, and meta.

Self-evolutionary mechanisms span three loci:

• Agentic: Prompt, memory, and neural parameter refinement using reflection, RL, and interaction-based feedback
• Systemic: Autonomous search over communications topology, team composition, and distributed/shared memory structures, using RL, textual gradients, heuristic update, and EA
• Meta: Population-based system design, archive/generator-based meta-agent search, open-ended optimization of architectures using RL, EA, and offline retrospection

A key claim is that closed-loop coupling between failure attribution and self-evolution is necessary, as diagnosis narrows the space of effective exploration in evolution, and emergent structures condition the kinds of failures that can be both observed and remedied. Evaluation protocols are not yet mature: static accuracy benchmarks cannot measure ongoing adaptation, diversity, or resilience, and adversarial and persistent environments are required for robust validation.

Discussion and Implications

The survey identifies several open directions:

• Persistent, lifelong self-evolution with explicit memory consolidation and hybrid parametric/structural adaptation, overcoming catastrophic forgetting and retrieval bottlenecks.
• Efficient, scalable evolutionary search using neuro-symbolic generators blended with population-based search or RL; balancing computation, sample efficiency, and transferability.
• Safety and alignment under evolving objectives: Evolution itself poses emergent risks beyond single-agent RLHF alignment; adversarial arms, reward gaming, and unsafe collusive behaviors are observed under certain objective functions.
• Standardized, open-ended evaluation environments: Static datasets are insufficient; the field requires task distributions that support measurement of adaptation speed, behavioral diversity, and longitudinal performance.

The survey contends that MAS research will shift its focus from optimizing coordination among individually specified agents to engineering collective organizational principles and feedback loops that enable resilient, interpretable, and continually adapting intelligence.

Conclusion

This survey provides a formal, cross-stage taxonomy and synthesis for LLM-based MASs, systematically connecting individual agent capabilities, collaborative architectures, failure attribution methodologies, and self-evolution strategies into a coherent LIFE operational lifecycle. By highlighting dependencies, identifying current bottlenecks, and specifying required advances in unification and evaluation, the work offers a foundation for closed-loop research agendas in future collective machine intelligence.

Reference: "Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems" (2605.14892)