---
title: Single-Agent Systems (SAS) in LLM Architectures
url: https://www.emergentmind.com/topics/single-agent-systems-sas
type: topic
---

# Single-Agent Systems (SAS) in LLM Architectures

A single-agent system (SAS) refers to an agentic architecture in which a single large language model (LLM) is responsible for all aspects of reasoning, planning, and action selection, either via monolithic chain-of-thought or through internal selection among a curated library of specialized skills. This contrasts with multi-agent systems (MAS), where specialized agents interact and coordinate via explicit message passing. Recent literature rigorously formalizes, analyzes, and benchmarks SAS in the context of modularity, efficiency, scalability, fault localization, and its comparative performance under controlled computation budgets [2601.04748][2604.02460][2505.18286][2601.12307].

## 1. Formal Models of Single-Agent Systems with Skill Libraries

The canonical SAS comprises a single LLM $a$ endowed with a fixed skill library $S = \{s_1, \ldots, s_K\}$ and a selection mechanism $\sigma$. Each skill is a tuple $s = (\delta, \pi, \xi)$, where $\delta$ is a natural-language descriptor, $\pi$ denotes policy (internal prompt or instructions), and $\xi \in T \cup \{\emptyset\}$ is either an external tool $t \in T$ or $\emptyset$ for purely internal reasoning. 

Skill selection is often modeled as a softmax policy:
$$
P(s \mid h) = \sigma(s \mid h) \propto \exp f_\theta(h, \delta_s)
$$
where $h$ is the context and $f_\theta$ a compatibility function scoring the match between context and descriptor.

The canonical SAS execution loop proceeds as:
```python
h ← x
while not Term(h):
    s ← σ(h, D)               # D = {δ₁,…,δ_K}
    y ← Execute(s, h)         # run π and ξ
    h ← h ⊕ y
return h
```
The total cost over $T'$ steps is decomposed as:
$$
C_{\text{SAS}}(x) = \sum_{t=1}^{T'} \left[ C_{\text{select}}(\sigma, |S|) + C_{\text{exec}}(s^{(t)}) \right]
$$
[2601.04748].

## 2. Compilation and Simulation of Multi-Agent Workflows in SAS

A MAS is formalized as $M = \langle A, G, \Pi \rangle$ with agent set $A = \{a_i\}$, communication graph $G$, and protocol $\Pi = (\text{Init}, \text{Route}, \text{Term})$. Each agent's specialized behavior is internalized as one or more SAS skills using a compilation mapping $\Phi: M \to S$, where
$$
S_\Phi = \bigcup_{a_i \in A} \text{Decompose}(\rho_i)
$$
and $\rho_i$ is the $i$th agent's role description. The resulting skill policies explicitly enforce communication requirements as part of the skill prompt.

Correctness is established via behavioral fidelity:
$$
\forall \tau,\; P_M(y \mid \tau) = P_{\Phi(M)}(y \mid \tau)
$$
Efficiency is ensured as long as the cumulative overhead of skill selection is less than MAS communication cost.

For homogeneous MAS (all agents use the same LLM), a single-LLM simulator can role-play all agents in a continuous conversation, leveraging key/value cache sharing for computational savings. Under deterministic tools, prompts, and routing, the single-agent simulation achieves joint distributional equivalence with multi-agent execution [2601.12307].

## 3. Empirical Evaluation: Efficiency and Accuracy

Quantitative benchmarks consistently reveal that SAS matches or exceeds MAS in task accuracy while achieving substantial reductions in computational overhead—primarily due to the elimination of inter-agent communication and enhanced KV cache reuse.

| Task          | Acc_M | Acc_S | Tokens_M | Tokens_S | Lat_M   | Lat_S   | Calls |
|---------------|-------|-------|----------|----------|---------|---------|-------|
| GSM8K         | 94.0  | 92.0  | 1407     | 616      | 10,565  | 7,537   | 3→1   |
| HumanEval     | 100.0 | 100.0 | 1400     | 749      | 7,227   | 2,970   | 3→1   |
| HotpotQA      | 84.0  | 88.0  | 4359     | 1816     | 11,671  | 4,559   | 4→1   |
| **Avg. Δ Acc**| —     | +0.7% | —        | –53.7%   | —       | –49.5%  | —     |

Findings are robust across mathematics, program synthesis, and multi-hop reasoning [2601.04748][2505.18286][2601.12307]. SAS incurs $4\times$ to $35\times$ fewer token costs compared to MAS, with equivalent or slightly higher accuracy. Notably, under controlled “thinking token” budgets, single-agent reasoning consistently matches or outperforms multi-agent variants, particularly as LLMs improve in long-context handling and tool integration [2604.02460].

## 4. Scaling Limits and Skill Selection Capacity

Empirical studies show that as the number of skills $N=|S|$ increases, SAS selection accuracy $A(N)$ remains near-perfect until a critical threshold $\kappa$ (typically $50 \leq \kappa \leq 100$ for current LLMs), beyond which accuracy collapses sharply:
$$
A(N) \approx \frac{\alpha}{1 + (N/\kappa)^{\gamma}}
$$
where $\alpha \approx 0.964$, $\kappa \approx 91.8$, $\gamma \approx 1.71$ for GPT-4o-mini [2601.04748]. This phase transition mirrors human capacity limits for menu selection and response latency (Hick's Law) and highlights semantic confusability as a dominant factor.

When skills are semantically similar—quantified via the average cosine similarity of skill descriptors—accuracy degrades linearly with interference:
$$
A(N, I) \approx \alpha / (1 + (N/\kappa)^\gamma) - \epsilon \cdot I(S)
$$
Controlled experiments show that a single competitor per skill can induce drops of 7–30 percentage points; two competitors cause even sharper accuracy loss (up to 63 pp at high $N$).

## 5. Information-Theoretic Foundations and Context Utilization

A rigorous perspective frames SAS vs MAS through the Data Processing Inequality:
$$
I(Y;C) \geq I(Y;M)
$$
where $Y$ is the answer, $C$ the full context, and $M$ the message passed in MAS. If a SAS fully utilizes $C$, the MAS cannot gain information through communication. However, as context retention degrades (due to model limitations or context length), MAS may outperform by filtering or factoring the information into focused sub-messages. Empirically, SAS dominates for low degradation; MAS gains relevance only when the SAS’s context access is severely compromised [2604.02460].

## 6. Mitigating Capacity and Confusability: Hierarchical and Hybrid Approaches

Hierarchical skill routing, where selection is divided into coarse-to-fine categories, restores high-accuracy selection even as $|S| \gg \kappa$:
```python
def HierarchicalSelect(h, Clusters):
    c ← σ_cat(h, {name(c) for c in Clusters})
    s ← σ_sub(h, {δ_s | s ∈ C_c})
    return s
```
Empirical gains show up to 85% selection accuracy at $N=120$ with hierarchy, compared to 45–70% for flat selection [2601.04748].

A hybrid request-cascading paradigm invokes SAS first, automatically verifies its output, and escalates to MAS only on failure, reducing expected cost by up to 20% while achieving MAS-level accuracy [2505.18286].

## 7. Design Best Practices and Deployment Considerations

Key guidelines for scalable and robust SAS include:
1. Monitor $|S|$ relative to model capacity $\kappa$; stay within $50$–$100$ skills if possible.
2. Audit and merge semantically overlapping skills; invest in distinctive descriptors.
3. Use hierarchical organization for $|S| \gg \kappa$; limit selection clusters to under $\kappa$ options.
4. Upgrade to stronger LLMs when using large, confusable libraries is unavoidable.
5. Employ hybrid cascades to retain efficiency while safeguarding accuracy.
6. Reconsider MAS only for extremely complex workflows, tool orchestration, or severe context degradation.

On practical terms, SAS is now the default baseline for most modular reasoning applications, offering substantial reductions in latency and compute, while retaining fine-grained transparency for error localization via chain-of-thought step-level self-reporting [2505.18286].

## Limitations and Future Research Directions

SAS cannot simulate heterogeneous multi-agent workflows (mixing different base LLMs), as KV caches do not transfer across models. While SAS saturates empirical performance on most benchmarks when capacity is not exceeded, the design space for true heterogeneous and cross-model orchestration remains open. End-to-end training of single agents on multi-role dialogues and efficient hybridization of MAS/SAS offer promising avenues for further research [2601.12307].

Source: https://www.emergentmind.com/topics/single-agent-systems-sas