---
title: Adaptive Collaboration of Argumentative LLMs (ACAL)
url: https://www.emergentmind.com/topics/adaptive-collaboration-of-argumentative-llms-acal
type: topic
---

# Adaptive Collaboration of Argumentative LLMs (ACAL)

Searching arXiv for the cited ACAL and related adaptive argumentative LLM papers to ground the article in current literature.
Adaptive Collaboration of Argumentative LLMs (ACAL) is a neuro-symbolic framework that integrates adaptive multi-agent collaboration with an Arena-based Quantitative Bipolar Argumentation Framework (A-QBAF) for explainable and contestable legal reasoning. In the formulation introduced for legal reasoning, ACAL dynamically deploys expert agent teams to construct arguments, employs a clash resolution mechanism to adjudicate conflicting claims, and utilizes uncertainty-aware escalation for borderline cases. Its defining move is to transform LLM-generated legal reasoning from loose text into a formal argumentation graph whose final judgment can be recomputed when the graph is modified, rather than leaving the decision embedded in an unstructured debate transcript or a free-form Chain-of-Thought [2602.18916].

## 1. Conceptual basis and problem setting

ACAL is motivated by the claim that legal reasoning is not only a predictive task. It must also be **justified**, **verifiable**, **contestable**, and **traceable to evidence and legal rules**. On this view, a high-performing legal LLM system is insufficient if it cannot expose why a conclusion was reached, identify which arguments support or undermine that conclusion, and permit a user to challenge or revise parts of the reasoning in a principled way [2602.18916].

The framework is presented against the limitations of three common paradigms. **Chain-of-Thought (CoT)** provides step-by-step reasoning, but that reasoning is described as free-form text that is hard to verify logically, not directly editable by users, and not mathematically linked to the final decision. **Retrieval-Augmented Generation (RAG)** improves grounding by retrieving relevant texts, yet the decision logic remains implicit: citations do not by themselves yield a structured argument graph or a contestable inference procedure. **Multi-Agent Debate (MAD)** introduces diversity of perspectives, but debate transcripts remain unstructured, performance gains are inconsistent, and there is no principled mechanism for propagation, scoring, or contestability [2602.18916].

This orientation places ACAL within a broader shift from answer generation to structured adjudication. Related work on “Argumentative Large Language Models” likewise treats the LLM as a generator of structured pros and cons, while the final decision is computed by formal semantics rather than by the model’s raw output stream [2405.02079]. ACAL extends that line by making collaboration adaptive, by adding arena-style adjudication for close clashes, and by exposing a Human-in-the-Loop contestation workflow [2602.18916].

## 2. Adaptive multi-agent workflow

The end-to-end ACAL workflow is explicitly staged. It proceeds by identifying the legal task and case context, selecting specialized legal agents adaptively, retrieving legal evidence via hybrid RAG, generating supporting and attacking arguments, assigning intrinsic strength scores, identifying support/attack/neutral relations between arguments, resolving clashes in close cases, propagating scores through an A-QBAF, deciding Yes/No from the claim score, escalating borderline cases to a Final Judge agent, and then allowing users to inspect and contest the graph before recomputing the verdict [2602.18916].

The adaptive component begins with a pool of legal agents
$$
\mathcal{A} = \{a_1, a_2, \ldots, a_n\},
$$
where each agent $a_i$ is characterized by a tuple $\{r_i, E_i, P_i, S_i\}$ consisting of role, expertise areas, focus priorities, and argument style. The paper lists 10 legal roles grouped into four categories: **Adjudication** (Judge, Law Clerk / Judicial Clerk), **Litigation Advocacy** (Private Practice Lawyer, Prosecutor, Public Defender), **Advisory Transactional** (Corporate Counsel, Compliance Officer, IP Attorney), and **Research Support** (Legal Analyst, Paralegal) [2602.18916].

Agent selection is polarity-sensitive. Given a legal task $\mathcal{T}$, context $c$, and claim $\phi$, ACAL selects
$$
\mathcal{A}^{+} = \text{Select}(\mathcal{A}, \mathcal{T}, c, \text{support}); \quad \mathcal{A}^{-} = \text{Select}(\mathcal{A}, \mathcal{T}, c, \text{attack}).
$$
Here, $\mathcal{A}^{+}$ is the team for constructing supporting arguments and $\mathcal{A}^{-}$ is the team for constructing attacking arguments. The selection function uses an LLM to match expert profiles to the legal case, so the system does not deploy all agents uniformly on every instance [2602.18916].

Grounding is supplied by a **hybrid retrieval module** that combines vector search over a legal database for statutes with external web search for recent case law. The top-$k$ relevant passages are aggregated into the evidentiary context $c$. Argument generation for an agent $a$ is then defined as
$$
\text{Args}(a) = \text{LLM}\left(a, \phi, c, \mathcal{C}, \text{type}(a)\right),
$$
where $\text{type}(a) \in \{\text{support}, \text{attack}\}$. Each agent typically generates **2–5 arguments**, depending on evidence and case complexity [2602.18916].

## 3. Formal argumentative structure and arena-based adjudication

ACAL’s symbolic core is an Arena-based Quantitative Bipolar Argumentation Framework,
$$
\langle \mathcal{X}, \mathcal{R}^{-}, \mathcal{R}^{+}, \tau \rangle,
$$
where $\mathcal{X} = \{\phi\} \cup \{\alpha_1,\ldots,\alpha_n\}$, $\mathcal{R}^{-}$ is the attack relation, $\mathcal{R}^{+}$ is the support relation, and $\tau:\mathcal{X}\to[0,1]$ is the base strength function. The central claim is initialized neutrally with $\tau(\phi)=0.5$, and each generated argument is attached to $\phi$ as either support or attack [2602.18916].

Each generated argument $\alpha_i$ receives an intrinsic score $\tau(\alpha_i)$ from an LLM-based strength estimate. The scoring rubric ranges from **0.1–0.2** for incorrect legal analysis or misidentification of key elements up to **0.9–1.0** for exceptional precision with authoritative citations and flawless logic. The intermediate bands distinguish partially correct analysis, sound analysis with minor gaps, and strong analysis with specific facts and correct legal reasoning [2602.18916].

Inter-argument relation identification is handled either heuristically or semantically. The heuristic mode treats same stance as mutual support and opposite stance as mutual attack, but the paper rejects this as too simplistic for legal reasoning because legally opposing arguments may still be unrelated. In the LLM-based semantic mode, each pair $(\alpha_i,\alpha_j)$ is classified as **attack**, **support**, or **neutral** with a confidence score. If the confidence is below **0.6**, the relation is demoted to **neutral**. Relations are made bidirectional, and pairwise analysis is batched with size $b$ and default $b=10$ to reduce API calls [2602.18916].

A distinctive component is **Clash Resolution via Arena Debating Round**. When a support argument and an attack argument have similar scores,
$$
|\tau(\alpha_s) - \tau(\alpha_a)| < \delta,
$$
with default $\delta = 0.2$, the two arguments are sent to an arena debate in which an LLM acting as a legal expert determines which is stronger on the basis of facts and law. Scores are then updated by
$$
\Delta\tau(\alpha) = \beta \cdot (2w - 1),
$$
where $\beta$ is the base adjustment magnitude and $w \in [0,1]$ is the win rate across clashes. The paper reports the best $\beta$ as **0.15** [2602.18916].

Final strengths are propagated with **Quadratic Energy (QE) semantics**. For argument $j$,
$$
E_{j} = \sum_{i \in \text{Sup}_j} \sigma_{i} - \sum_{i \in \text{Att}_j} \sigma_{i},
$$
and the equilibrium score satisfies
$$
\sigma_{j}^{*} = \tau(j) + (1 - \tau(j)) \cdot h(E_{j}) - \tau(j) \cdot h(-E_{j}).
$$
The claim score then determines the answer by
$$
\text{Answer} =
\begin{cases}
\text{Yes}, & \text{if } \sigma(\phi) \geq \theta \\
\text{No}, & \text{otherwise}
\end{cases}
$$
with default threshold $\theta = 0.5$ [2602.18916].

## 4. Uncertainty-aware escalation and contestability

ACAL does not treat every propagated score as equally stable. The framework introduces **uncertainty-aware escalation (UAE)** for borderline cases. If the claim score falls in the interval
$$
\sigma(\phi) \in [0.49, 0.51],
$$
the system bypasses the standard decision rule and invokes a **Final Judge** agent. The Final Judge independently reviews the evidence, re-evaluates the legal standards, resolves key conflicts, and outputs a binding decision. The paper motivates this mechanism as a way to address “same-score saturation” and to prevent arbitrary verdicts near the neutral boundary [2602.18916].

The second major feature is the **Human-in-the-Loop (HITL) contestation workflow**. ACAL exposes the argument text and stance, the originating agent role, evidence passages, intrinsic score $\tau(\alpha)$, propagated score $\sigma(\alpha)$, the local neighborhood in the graph, and a “why it matters” trace for the claim score. These are the objects through which the graph becomes auditable rather than merely inspectable in prose form [2602.18916].

The paper identifies five contestation types: factual issues, legal rule issues, precedent issues, missing exceptions/defenses, and procedural fairness concerns. Users may accept or reject arguments, edit arguments, add missing arguments, adjust argument strength, and adjust support/attack relations when mis-specified. Accepted edits produce an updated structure
$$
(\mathcal{X}^H,\mathcal{R}^{+H},\mathcal{R}^{-H},\tau^H),
$$
after which the same propagation is rerun to obtain $\sigma^H(\cdot)$ and $\sigma^H(\phi)$. The system also records who changed what and how the change affected $\sigma(\phi)$, providing an audit log for traceability and accountability [2602.18916].

A common misconception is that contestability is equivalent to attaching an explanation after prediction. ACAL rejects that interpretation. In the framework, contestation is an intervention on the reasoning graph that can materially change the result when the graph is recomputed. This is structurally closer to the claim-verification setting of ArgLLMs, where a user may add arguments, remove arguments, or modify argument strengths before the final decision is produced by formal semantics [2405.02079].

## 5. Empirical evaluation and ablation findings

The reported evaluation uses **LegalBench** and focuses on two tasks. **Hearsay** predicts whether a statement is hearsay under FRE 801(c), with labels *hearsay* and *not_hearsay*. **Courts** uses the Learned Hands taxonomy with labels *yes* and *no*. Two backbone models are tested: **Gemini-2.5-Flash-Lite** and **Gemini-2.5-Flash**. Baselines are **SP** (few-shot standard prompting), **CoT**, **RAG**, and **MAD**. For RAG, legal texts are embedded with **OpenAI text-embedding-3-large** and top-$k=5$ chunks are retrieved. The reported metrics are **Accuracy (Acc)**, **Precision (Prec)**, **Recall (Rec)**, and **Macro-F1 (F1)** [2602.18916].

On **Gemini-2.5-Flash-Lite**, the **Learned Hands Courts** results for ACAL are **Acc 70.8**, **Prec 71.2**, **Rec 70.8**, and **F1 70.7**; the paper states that this is the best overall among compared methods. On **Hearsay**, ACAL achieves **Acc 74.5**, **Prec 77.1**, **Rec 76.3**, and **F1 74.4**, described as best or tied-best on key metrics and best on precision/recall/F1. On **Gemini-2.5-Flash**, ACAL reaches **Acc 75.5**, **Prec 76.4**, **Rec 75.5**, and **F1 75.3** on **Learned Hands Courts**, and **Acc 76.7**, **Prec 77.1**, **Rec 77.6**, and **F1 76.7** on **Hearsay**; the paper characterizes the latter as the best recall and F1 among the reported methods [2602.18916].

The ablation study is particularly important for understanding the framework’s internal mechanisms. On **Gemini-2.5-Flash-Lite** for **Hearsay**, a vanilla-ish setting gives **64.9% accuracy**. Adding **CR only** yields **72.8% accuracy**, a **+7.9 points** gain. Using **UAE alone** gives **62.8% accuracy**, which the paper interprets as evidence that uncertainty handling is unreliable if the argument scores themselves are not well calibrated. The full ACAL configuration with both **CR** and **UAE** gives **74.5% accuracy** and **74.4% F1**. Performance rises as $\beta$ increases from **0.05** to **0.15**, then drops when $\beta$ becomes too large, suggesting that over-aggressive score updates cause volatility [2602.18916].

These results support the paper’s central claim that formal conflict adjudication matters more than simply adding multi-agent interaction. The empirical pattern suggests that ACAL’s gain is not reducible to debate alone; rather, it depends on coupling adaptive expert selection with explicit score calibration and symbolic propagation [2602.18916].

## 6. Relation to adjacent research and broader significance

ACAL sits at the intersection of several strands of recent LLM research. One strand uses formal computational argumentation without adaptiveness. **MQArgEng** constructs a Dung-style abstract argumentation framework $\mbox{AF} = \langle \mbox{AR}, \mathcal{C} \rangle$, computes the grounded extension or preferred extension with **ASPARTIX**, and feeds acceptable arguments back into the LLM; on MT-Bench it reports **MQInstruct 5.96 → MQArgEng 6.09**, a **+0.13 absolute points** or **+2.18%** relative improvement [2405.13036]. Another strand, **ArgLLMs**, builds quantitative bipolar frameworks from support and attack arguments and resolves them with **DF-QuAD** or **QEM** semantics for explainable and contestable claim verification [2405.02079]. ACAL inherits the formal-argumentation logic of these systems but adds adaptive expert deployment, arena-based clash resolution, and uncertainty-aware escalation [2602.18916].

A second strand emphasizes adaptive collaboration without a formal editable reasoning graph. In medicine, **MDAgents** routes cases by a moderator-assigned complexity label $c \in \{\text{low}, \text{moderate}, \text{high}\}$ to a **Solo PCP agent**, **MDT**, or **ICT**, reporting the **highest accuracy in 7 out of 10 benchmarks** and up to **4.2% improvement** over both solo and group/static settings [2411.00248]. In general reasoning, **DiMo** selects between **Divergent Thinking Mode** and **Logical Thinking Mode**, uses **four rounds of debate**, and reports its largest gains on math under an **Exact Match (EM)** evaluation regime [2510.16645]. In document understanding, an adaptive orchestration framework combines **dynamic task routing**, **bidirectional feedback**, and **parallel agent evaluation**, with an evaluator selecting
$$
o^* = \arg\max_{i \in \{1, ..., k\}} \mathcal{E}(o_i)
$$
and reporting improvements in factual coverage, coherence, and efficiency over static and partially adaptive baselines [2507.17061]. These systems share ACAL’s commitment to task-aware collaboration, but not its insistence on a formally contestable argument graph.

A third strand studies the learning of collaboration itself. **ACC-Collab** trains an **actor-agent** and **critic-agent** with guided-debate trajectories and **Direct Preference Optimization (DPO)**, rather than assuming collaboration will emerge from off-the-shelf models [2411.00053]. **HILA** goes further by learning a metacognitive policy over **EVAL**, **CREATE**, and **DEFER**, combining **Group Relative Policy Optimization (GRPO)** with continual learning from expert feedback in a **Dual-Loop Policy Optimization** scheme [2603.07972]. A plausible implication is that future ACAL systems could combine formal argumentation graphs with learned collaboration policies, rather than relying on fixed prompting and hand-specified escalation rules.

In that broader landscape, ACAL is best understood as a specific legal instantiation of a wider research program: adaptive collaboration should not merely increase the number of agents or produce longer deliberation traces. It should determine which expert roles to activate, formalize how supporting and attacking claims interact, resolve close conflicts through explicit adjudication, and preserve a reasoning object that users can audit and change. Within the current literature, that combination of adaptiveness, formal argumentation, and contestability is the framework’s distinctive contribution [2602.18916].

Source: https://www.emergentmind.com/topics/adaptive-collaboration-of-argumentative-llms-acal