---
title: 'AGENT+P: Pattern for Controlled Agent Systems'
url: https://www.emergentmind.com/topics/agent-p
type: topic
---

# AGENT+P: Pattern for Controlled Agent Systems

AGENT+P denotes an architectural pattern in which an operative agent or multi-agent substrate is coupled to an explicit planning, policy, or control layer that shapes trajectories, constrains action choices, or governs interaction. In one direct usage, it names a plug-and-play UI automation framework that uses symbolic planning over a UI Transition Graph; across related work, the same pattern appears as Q-table-guided workflow construction, pseudocode-style planning, per-agent context scoping, tool-mediated decoding, contract design, and governance or evaluation layers [2510.06042] [2509.14547] [2506.01475] [2604.07911] [2606.02386] [2407.18074] [2604.19752] [2510.08847].

## 1. Conceptual scope

The most explicit formalization appears in "Agent+P: Guiding UI Agents via Symbolic Planning" [2510.06042]. There, the central claim is that LLM-based UI agents perform local perception and action execution effectively but hallucinate on long-horizon tasks because they lack understanding of the global UI transition structure. AGENT+P addresses this by separating global navigation from local grounding: the agent remains the executor, while a symbolic planner computes a high-level route over an explicit graph.

Other works use nearly the same decomposition in different domains. PriorDynaFlow describes AGENT+P as a set of specialized agents governed by an adaptive planning or policy module that decides who acts next, when to stop, and how to shape the workflow for each task [2509.14547]. PGPO treats the pattern as an LLM agent equipped with a program-like planning language and a planning-aware preference optimization objective [2506.01475]. DACS implements per-agent steering by giving the orchestrator the full context of exactly one agent while compressing all others to registry summaries [2604.07911]. AgentPLM frames protein design as a sequential decision process with tool use, where the PLM is elevated from a passive generator to a policy in a POMDP [2606.02386].

This suggests that AGENT+P is best understood not as a single algorithm, but as a family of neuro-symbolic or policy-augmented systems in which the “AGENT” component executes, observes, or interacts, while the “+P” component introduces explicit structure that is not left to implicit next-token reasoning alone.

## 2. Canonical architectural pattern

Across the literature, AGENT+P systems repeatedly instantiate three roles: an execution substrate, an explicit coordination object, and a mechanism that binds them at runtime. The execution substrate may be a single model, a role-specialized agent pool, or a distributed agent society. The coordination object may be a graph, plan, contract, registry, memory bank, or probabilistic governance score. The runtime mechanism then selects actions, routes control, filters context, or assigns incentives.

| System | Agent substrate | “+P” layer |
|---|---|---|
| Agent+P [2510.06042] | Existing LLM-based UI agent | UTG + PDDL symbolic planner |
| PriorDynaFlow [2509.14547] | Role-defined multi-LLM workflow | Q-table policy + a priori next-agent decisions |
| PGPO [2506.01475] | ReAct-style LLM agent | P-code Plans + preference optimization |
| DACS [2604.07911] | Orchestrator with concurrent agents | Focus\((a_i)\) context scoping |
| AgentPLM [2606.02386] | ESM-2 650M PLM | RAD + CAPO over tool calls |
| VeriAgent [2603.17613] | Programmer/Correctness/PPA agents | Tool feedback + Evolved Memory Mechanism |

The same architectural logic extends beyond those six systems. Agent GPA adds a specialized evaluation layer over the Goal–Plan–Action loop [2510.08847]. SWARM adds a governance engine with continuous-valued risk metrics and configurable levers such as transaction taxes, circuit breakers, reputation decay, and random audits [2604.19752]. Principal-agent reinforcement learning treats the principal as a policy over contracts rather than environment actions [2407.18074]. ANP pushes the same separation down to infrastructure, defining identity, negotiation, and application protocols for an Agentic Web [2508.00007].

## 3. Planning and policy mechanisms

A defining feature of AGENT+P is that planning is made explicit in a formal object. In the UI-automation formulation, the app is modeled as a UI Transition Graph \(G = (\mathcal{U}, \mathcal{T}, \epsilon)\), where nodes are UI states, directed edges are transitions, and edge labels are actions \(a = (w,e)\). Targeted UI automation is then written as a shortest-path problem over this graph,
\[
\pi^* = \arg\min_{\pi} \sum_{i=1}^{N} \kappa(a_i),
\]
with unit costs in the reported experiments, and the resulting plan is generated by Fast Downward with A\* over a fixed PDDL domain [2510.06042].

PriorDynaFlow replaces symbolic shortest-path planning with a learned policy over workflow graphs. A workflow is a directed graph \(W=(N,E)\) whose nodes are role-specialized agents and whose edges carry learned reward or penalty. The planning core is tabular Q-learning with update
\[
Q_{\text{new}(s_t, a_t)} = (1 - \alpha) Q(s_t, a_t) + \alpha \big[ R_{s_t} + \gamma \max_{a} Q(s_{t+1}, a) \big],
\]
and the Q-table is used to constrain a decision space rather than to select the next node directly. The current agent then makes an a priori choice from the top-\(k\) candidates based on the current task state, executed nodes, and available roles [2509.14547].

PGPO makes planning explicit in language form rather than in graph search or value iteration. Its planning unit is a pseudocode-style step
\[
P_s = (id, name, [parameter], [return\;value], [control\;flow]),
\]
and a full P-code Plan is \((P_s, E)\), where \(E\) is the set of task-specific planning entities. The plan is generated before the ReAct trajectory and is then optimized by a DPO-style objective that combines plan-level preferences and plan-following preferences [2506.01475].

DACS makes the control layer a deterministic context-construction rule. Registry mode keeps only lightweight status summaries; when agent \(a_i\) emits a SteeringRequest, the orchestrator enters Focus\((a_i)\) mode with
\[
C_{\text{focus}(a_i)} = F(a_i)\,\|\,\mathrm{compress}(R_{-i}),
\]
and \(F(a_i)\) is never truncated. The objective is not search optimality but isolation of the steering interaction from cross-agent contamination [2604.07911].

A more structural formulation appears in "Structured Cooperative Multi-Agent Reinforcement Learning: a Bayesian Network Perspective" [2510.09937]. There, the multi-agent process is encoded as a Bayesian network, and each agent’s exact local action value function is shown to depend only on a value dependency set \(I_Q^i\). This yields a partially decentralized training–decentralized execution paradigm and a multi-agent policy gradient theorem whose critic and gradient depend only on structurally relevant agents, not the full system.

## 4. Tool, memory, and protocol substrates

In several AGENT+P systems, the planning layer is inseparable from tool use. AgentPLM expands the action space from amino acids to
\[
\mathcal{A}^+ = \mathcal{A} \cup \mathcal{T},
\]
where \(\mathcal{T}\) contains CALL tokens for ESMFold, FoldX, and AutoDock Vina, together with EOS. Reasoning-Augmented Decoding interleaves residue generation and tool calls, and when a CALL token is emitted the model does not advance position; it re-scores the same step after tool feedback. Tool outputs are embedded through a Tool Context Encoder, stored in a fixed-size Trajectory Memory Buffer with \(B_{\max}=8\), and optimized end-to-end by Contrastive Agent Policy Optimisation [2606.02386].

VeriAgent uses a comparable closed-loop structure for RTL generation, but with a different substrate. It combines a Programmer Agent, Correctness Agent, PPA Agent, and Memory Manager, and integrates simulation, Yosys, OpenROAD, and the NanGate45 library. The physical objective is collapsed into
\[
\text{PPA Score} = \frac{1}{\text{Delay} \times \text{Area} \times \text{Power}},
\]
with Relative PPA Score normalized by the original benchmark implementation. Its Evolved Memory Mechanism stores Rule Memory, Structure Memory, and EDA Signal Memory as trigger–guidance–metadata nodes that are inserted, refined, or discarded after each execution trajectory [2603.17613].

ANP generalizes the same architectural separation to internet-scale interoperability. Its three-layer stack consists of an identity and encrypted communication layer based on DID and end-to-end encrypted communication, a meta-protocol negotiation layer for dynamic capability negotiation, and an application protocol layer centered on Agent Description Protocol and Agent Discovery Protocol. Here the “+P” element is infrastructural rather than task-local: it defines the protocol substrate through which agents authenticate, discover one another, and negotiate how to talk [2508.00007].

These systems show that AGENT+P does not require the planning layer to be purely symbolic. It may instead be embodied in tool-call tokens, memory evolution, or protocol negotiation, provided that execution is constrained by explicit intermediate structure.

## 5. Incentive, governance, and evaluation layers

One branch of the literature moves from planning to incentives. "Principal-Agent Reinforcement Learning: Orchestrating AI Agents with Contracts" formalizes a hidden-action principal–agent MDP
\[
\mathcal{M} = (S, s_0, A, B, O, \mathcal{O}, \mathcal{R}, \mathcal{R}^p, \mathcal{T}, \gamma),
\]
where the principal does not act in the environment and instead chooses contracts \(b \in B \subset \mathbb{R}_{\ge 0}^m\). The agent’s reward is \(\mathcal{R}(s,a,b,o)=r(s,a)+b(o)\), the principal’s reward is \(\mathcal{R}^p(s,b,o)=r^p(s,o)-b(o)\), and the solution concept is subgame-perfect equilibrium obtained by alternating agent best response and principal contract optimisation [2407.18074].

SWARM extends the same logic from one principal and one or more agents to a system-wide governance layer over agent societies. Each interaction receives a soft label
\[
p = \sigma(k \cdot \hat{v}) = \frac{1}{1 + e^{-k \cdot \hat{v}}},
\]
interpreted as \(P(v=+1)\), and governance acts through transaction taxes, circuit breakers, reputation decay, random audits, externality internalization, staking, and collusion detection. The system-level safety metrics are explicitly distributional, including expected toxicity
\[
\mathbb{E}[1-p \mid \text{accepted}]
\]
and quality gap
\[
\mathbb{E}[p \mid \text{accepted}] - \mathbb{E}[p \mid \text{rejected}].
\]
Here the “+P” layer is governance over interaction distributions rather than planning over task trajectories [2604.19752].

A third extension is ex post diagnosis. Agent GPA evaluates the operational loop of Goal, Plan, and Action through Goal Fulfillment, Plan Quality, Plan Adherence, Logical Consistency, and Execution Efficiency, with Tool Selection and Tool Calling as additional tool-level metrics. The judges output scores on \(\{0,1,2,3\}\) together with rationales and span IDs, thereby turning the planning layer into an explicit object of evaluation rather than only control [2510.08847].

This suggests that AGENT+P can be read along three axes: online control of trajectories, incentive shaping of behavior, and structured diagnosis of failures.

## 6. Empirical evidence across domains

The empirical record is heterogeneous but consistently favors explicit planning or policy layers over unstructured agent execution. On AndroidWorld, Agent+P improves the success rates of state-of-the-art UI agents by up to 14% and reduces the action steps by 37.7%; on the “Go to the privacy policy page” task, average actions drop from 6.1 to 3.8 and average time from 19.9s to 16.9s [2510.06042]. PriorDynaFlow reports an average improvement of 4.05% over state-of-the-art baselines while reducing workflow construction and inference costs to only 30.68%–48.31% of existing methods [2509.14547]. PGPO reports, for Llama-2-7B averaged over ALFWorld seen/unseen, WebShop, and TextCraft, 67.1 versus 62.6 for IPR, 60.9 for ETO, and 53.9 for SFT, and its analyses show lower invalid action rates and fewer omissions [2506.01475].

In orchestration, DACS reports 90.0–98.4% steering accuracy versus 21.0–60.0% for a flat-context baseline across eight synthetic scenarios, with wrong-agent contamination reduced from 28–57% to 0–14% and context efficiency ratios up to 3.53x. In Phase 4 with autonomous LLM agents, DACS exceeds the flat-context baseline by +17.2pp at \(N=3\) and +20.4pp at \(N=5\), with the advantage growing with \(N\) [2604.07911]. In structured cooperative MARL, MAStAC improves convergence and final performance in both sparse and dense interaction regimes; in the 40-warehouse task, MAStAC approximated reaches \(-13.73 \pm 1.26\) versus \(-18.09 \pm 0.28\) for MADDPG and \(-17.62 \pm 0.35\) for MATD3 [2510.09937].

In biology and hardware, the same architectural principle remains effective. AgentPLM reports state-of-the-art results across ThermoStab-75, AntibodyOpt-VH, EnzymeDesign-EC3, PPI-Interface, and ZeroShot-Fitness, with ThermoStab \(7.64\), antibody top-10% hit rate \(52.41\), enzyme design \(1.89\), PPI \(-5.26\), and zero-shot \(\rho=0.61\). The antibody result is 1.91× ProtAgent and 4.23× ESM-2 [2606.02386]. VeriAgent reaches Relative PPA Score \(8.539\) with Gemini, compared with \(1.000\) for the original designs and \(2.196\) for ChipSeek-R1, while also reporting VerilogEval-Machine pass@1 \(97.9\%\), VerilogEval-Human pass@1 \(98.1\%\), and RTLLM v1.1 Func@5 \(89.7\%\) [2603.17613].

Evaluation and governance layers also show quantitative leverage. Agent GPA reports that its judges detect \(267/281\) TRAIL/GAIA test errors, or \(95.02\%\), and localize \(241/281\), or \(85.77\%\), with 86% agreement for targeted error localization [2510.08847]. Principal-agent reinforcement learning achieves approximately optimal subgame-perfect behavior on randomly generated binary game trees and, in the Coin Game, attains near-optimal social welfare with about 30% of social welfare paid as subsidies while new black-box agents follow recommendations 80–90% of the time [2407.18074]. SWARM finds that strict governance reduces welfare by over 40% without improving safety, and that aggressively internalizing system externalities collapses total welfare from \(+262\) to \(-67\) while toxicity remains invariant [2604.19752].

## 7. Limitations and open problems

The literature also delineates the boundaries of the AGENT+P pattern. In symbolic UI planning, performance depends on UTG quality, correct target-node selection, and the determinism assumption of classical planning; static analysis may add infeasible edges, dynamic exploration may miss edges, and real GUIs may require contingent replanning [2510.06042]. In Q-table-guided workflow construction, state abstraction can be too coarse or too fine, reward shaping is sensitive, and non-stationarity arises when roles, prompts, or base models change [2509.14547]. PGPO improves generalization, but plan-following reward estimation requires Monte Carlo rollouts and initial P-code plans were generated by GPT-4o and then human-verified [2506.01475].

Tool-augmented systems introduce their own costs. AgentPLM is oracle-bound, tools such as Vina and ESMFold are expensive even with caching, and the method performs local correction without explicit backtracking [2606.02386]. VeriAgent limits correctness and PPA loops to at most two rounds, depends on NanGate45, Yosys, and OpenROAD, and has not been extended to full-chip or complex SoC-level designs [2603.17613]. DACS, despite strong gains, was evaluated with scripted agents in Phases 1–3, only two model families, and a noisy contamination proxy in real-agent settings [2604.07911]. ANP leaves meta-protocol economics, large-scale DID operations, vocabulary standardization, and higher-level collaboration protocols unresolved [2508.00007].

Governance and incentive layers expose a different class of difficulty. SWARM shows that naive levers can destroy welfare without improving toxicity, that binary metrics are vulnerable to proxy gaming, and that externality pricing only works when agents or acceptance mechanisms can adapt [2604.19752]. Principal-agent RL assumes finite horizon in its core convergence theorem, faces LP scaling issues, and must contend with discontinuities in the principal’s Q-function under function approximation [2407.18074]. Agent GPA, although strong diagnostically, inherits the variability and cost of LLM judges, with Plan Quality the noisiest of the reported metrics [2510.08847]. Structured cooperative MARL achieves exact locality only when the structural graphs are known; when the value dependency set becomes dense, truncation is needed and introduces approximation error [2510.09937].

Taken together, the surveyed work suggests that AGENT+P is most powerful when the added planning or policy layer captures real structure that the base agent would otherwise have to infer implicitly: a transition graph, a workflow graph, a tool interface, a dependency graph, a contract space, or a governance signal. The central research question is therefore not whether to add “P,” but how to choose the formal object through which planning, control, or governance is made explicit.

Source: https://www.emergentmind.com/topics/agent-p