Optimal Organization of Multi-Agent Collaboration Topologies for Maximizing Research Efficiency

Determine how to organize multi-agent collaboration topologies to maximize research efficiency in automated machine learning research conducted by large language model–based agents.

Background

The paper studies how multi-agent systems can overcome limitations of single-agent LLM workflows in automated machine learning research. While prior efforts demonstrate promise, the community lacks consensus on the best way to structure collaboration among multiple agents to achieve efficient progress under compute and time constraints.

This work empirically compares a single-agent baseline, a subagent architecture (parallel exploration with post-hoc consolidation), and an agent team architecture (experts with pre-execution handoffs). The authors explicitly flag the broader question of how to organize multi-agent collaboration to maximize research efficiency as an open question motivating their study.

References

In the specific context of automated machine learning research, which is highly dynamic and empirically driven, a critical open question remains: {\it how should multi-agent collaboration topologies be organized to maximize research efficiency?

— An Empirical Study of Multi-Agent Collaboration for Automated Research  (2603.29632 - Shen et al., 31 Mar 2026) in Introduction (Section 1)

The choice is nonetheless load-bearing: which fixed graph wins changes with the setting (fully connected on MATH, star on homogeneous HumanEval, chain on MMLU), with gaps up to 4.3 accuracy points and a $2.9{\times}$ token factor (chain vs.\ fully connected on MATH). Identifying the winner for a new setting requires real LLM executions---the same cost class as our one-time 300-record collection---so a designer earns its keep by amortizing that selection per query.

— Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems  (2609.02264 - Yu et al., 2 Sep 2026) in Section 5, Subsection “Main Results,” Q2