---
title: Proof-Carrying Agent Actions (PCAA)
url: https://www.emergentmind.com/topics/proof-carrying-agent-actions-pcaa
type: topic
---

# Proof-Carrying Agent Actions (PCAA)

Proof-Carrying Agent Actions (PCAA) denotes a class of mechanisms in which an agent-generated action, trace, or execution request is accompanied by a machine-checkable certificate witnessing that the proposed behavior satisfies a formal policy, safety condition, correctness obligation, or governance rule. Across recent work, the certificate may take the form of a succinct cryptographic proof, an SMT-checkable satisfiability witness, a deterministic verifier-checked structured artifact, a theorem-prover object, or a portable runtime-governance bundle. The common operational principle is that execution or admission is conditioned on successful checking of the certificate rather than on trust in the agent, re-execution of its internal computation, or post-hoc auditing alone [2606.23768][2605.24462][2606.04104].

## 1. Conceptual scope and antecedents

PCAA inherits part of its intellectual structure from proof-carrying code and from proof-oriented planning formalisms. In "Proof-Carrying Plans: a Resource Logic for AI Planning" [2008.04165], the core judgement is a plan-specification sequent
\[
\Gamma \vdash \{P\}\{Q\}\mid f,
\]
which states that, in planning context \(\Gamma\), a plan \(f\) transforms any \(P\)-world into a \(Q\)-world. The same exposition describes how each primitive action can be packaged with a small proof object, yielding a proof-carrying action discipline whose full plans are obtained by composition.

Recent agentic formulations shift the focus from binaries or plans to runtime proposals. "No Certificate, No Execution" [2605.24462] formalizes trustworthy agency through a Proposal–Certification–Execution architecture in which a probabilistic generator \(M_G\) proposes a trace, a Permissibility Machine \(M_\Pi\) certifies or rejects it under a policy system \(\Pi\), and execution is restricted to the certified subset. A central premise is that generation is not permission: a trace may be computable yet impermissible, and individually permissible actions may compose into an impermissible trace.

The cryptographic formulation in "Cryptographic certificates of validity for trustworthy AI" [2606.23768] places PCAA between formal verification of source code and cryptographic authentication. Rather than requiring source inspection or re-execution, an action can carry an independently checkable proof that it satisfies an agreed formal policy. That paper explicitly relates the proposal to proof-carrying code, zkVMs, formal methods, and agent governance, and presents PCAA as a modular assurance mechanism rather than a replacement for those paradigms.

A further generalization appears in the runtime-governance literature, where the unit of certification is not only a logical condition on an action but a portable governance object that can survive runtime heterogeneity. "Proof-Carrying Agent Actions: Model-Agnostic Runtime Governance for Heterogeneous Agent Systems" [2606.04104] treats PCAA as a runtime-neutral certificate path that remains stable even when the same risky act is represented as a shell command, a tool invocation, a hosted-session transition, or an API request.

## 2. Formal models and semantics

One formalization treats PCAA as predicate certification over public and private variables. In the cryptographic account, \(S\) is the environment state, \(A\) the proposed action, \(x\) a tuple encoding public fields of \(S\) and \(A\), and \(w\) a private witness encoding internal agent state or trace. A correctness or policy condition is a closed formula
\[
\phi(x,w)
\]
in a suitable first-order logic, and the certification problem is reduced to checking whether there exists \(w\) such that the compiled constraint system \(W(x,w)=0\) holds [2606.23768].

A second formalization uses transition systems and verification conditions. In the executable Proof-Constrained Action framework, the agent environment is modeled as
\[
\Sigma=\langle S,A,\delta,s_0,\Phi_{\mathrm{safe}}\rangle,
\]
where \(S\) is the verification state space, \(A\) the finite action space, \(\delta:S\times A\to S\) the deterministic transition function, \(s_0\) the initial state, and \(\Phi_{\mathrm{safe}}\) a conjunction of immutable safety axioms. Each action \(a\in A\) carries a proof obligation \(\phi(a)\), and execution depends on the satisfiability of
\[
VC(a,\phi(a)) := s \wedge \phi(a) \wedge \Phi_{\mathrm{safe}}.
\]
If \(VC(a)\models \bot\), the action is blocked; otherwise the SMT engine returns a model witness and the action is allowed. The paper states an informal soundness theorem: under Structured Intent Fidelity and Immutable Axioms, every state reachable by repeatedly executing only SAT-approved actions satisfies \(\Phi_{\mathrm{safe}}\) [2605.29251].

A third formalization elevates the object of certification from single actions to execution traces. In the PCE model, a policy system \(\Pi\) induces a semantic permissible trace language \(L_\Pi\subseteq \Sigma^*\), a generative machine \(M_G\) proposes traces in \(L_G\), and a Permissibility Machine \(M_\Pi\) returns either a certificate \(\pi\), a rejection \(\bot\), or an escalation request. The executable language is
\[
L_{\mathrm{exec}} := L_G \cap L_{\mathrm{cert}(M_\Pi)}.
\]
Under Axiom 2 (sound certification) and Axiom 3 (execution allowed only on certified traces), Theorem 2.1 yields
\[
\mathrm{Execute}(\tau)\Longrightarrow \tau\in L_\Pi,
\]
which is the formal version of the slogan “no certificate, no execution” [2605.24462].

A fourth formalization targets skill containment rather than action permissibility alone. In "Methods for Formal Verification of Agent Skills" [2605.23951], joint LLM-plus-script execution is modeled as configurations
\[
(\ell,s,w,\tau),
\]
with nondeterministic LLM-side transitions and deterministic script-side transitions. If \(D\subseteq \mathcal C\) is the declared capability set and \(\Pi_C(\tau)\) projects a trace onto invoked capabilities, the target safety property is
\[
\forall \sigma.\ \Pi_C(\tau(\sigma)) \subseteq D.
\]
This formulation reframes PCAA as a capability-containment proof over sessions rather than as a per-step policy check alone.

## 3. Proof objects and checking mechanisms

The literature uses several distinct certificate types. The cryptographic variant compiles logic into algebraic constraints; the solver-based variant treats satisfiability itself as the authorization witness; recommender and governance systems use structured certificates validated by deterministic code; and theorem-prover variants rely on kernel-checked proof artifacts. These designs differ in proof language, trust base, and execution overhead, but all separate proposal from authorization.

| Formulation | Certificate object | Checker |
|---|---|---|
| Cryptographic PCAA | Proof \(\pi\) that \(\exists w: W(x,w)=0\) | SNARK/STARK verifier |
| ePCA | SAT model witness or UNSAT core for \(VC(a)\) | Z3-based SMT check |
| PCN-Rec | JSON certificate \(c\) for slate claims | Deterministic verifier \(V(S,c)\) |
| Hoare/PCP | Agda or Lean action/trajectory certificate | Kernel or proof checker |
| ACP | Signed proof object \(\Pi\) | `verifyAction(a,\Pi)` |

In the cryptographic line, the central transformation is an arithmetization of the logical predicate. The paper translates \(\phi(x,w)\) to a nonnegative polynomial \(R_\phi(x,w)\) such that
\[
R_\phi(x,w)=0 \iff \phi(x,w)=\text{“true”}.
\]
Atomic equalities \(t=t'\) become \((t-t')^2=0\), conjunctions become sums of nonnegatives, disjunctions become products, and quantified formulas use a top-level range-check construction. The resulting vector of constraints
\[
W(x,w):=(C_1(x,w),\dots,C_k(x,w))
\]
is then handled by a succinct proof system through algorithms
\[
\mathrm{Setup}(1^\lambda,R_\phi)\to (pp,vk),\quad
\mathrm{Prove}(pp,x,w)\to \pi,\quad
\mathrm{Verify}(vk,x,\pi)\to \{0,1\}.
\]
The same exposition allows optional zero-knowledge by randomizing the witness while preserving satisfiability of the constraints [2606.23768].

In ePCA, the proof-generation and checking loop is solver-native rather than cryptographic. The runtime pipeline parses a typed action payload, synthesizes \(\phi(a)\) by schema-based translation, assembles \(VC := s \wedge \phi(a)\wedge \Phi_{\mathrm{safe}}\), and calls `SMT_Check(VC)`. A SAT result returns `(authorized = true, witness = model)`; an UNSAT result returns `(authorized = false, proof_of_deadlock = UNSAT_core)`. The translation step is specified as pure syntax plus dictionary lookup with \(O(|j|)\) time, while the SMT engine is DPLL(T)-based and instantiated with Z3 [2605.29251].

PCN-Rec instantiates PCAA in governance-constrained recommendation. A mediator LLM proposes a slate \(S\) and a JSON certificate \(c\) claiming head/tail exposure and diversity metrics; a deterministic verifier then parses the schema, checks that `c.slate` matches \(S\), recomputes the metrics from item metadata, and accepts only if all constraints pass. If verification fails and some compliant slate exists in the candidate window, a deterministic constrained-greedy repair constructs \(S'\), emits \(c'\), and re-runs verification. The result is an auditable propose/verify/repair trace rather than an unverifiable one-shot output [2601.09771].

The theorem-prover line uses proof objects whose validity reduces to type checking. The Lean 4 trust-boundary architecture introduces an `ActionCertificate` containing an action, arguments, pre-state, post-state, precondition, postcondition, and proofs that the precondition holds, the deterministic execution relation holds, and the postcondition holds. A `TrajectoryCertificate` is a list of such steps together with a chain-consistency proof. Verification consists of kernel type checking plus an axiom audit against the trusted set \(\{\texttt{propext},\ \texttt{Classical.choice},\ \texttt{Quot.sound}\}\) [2605.16407]. The earlier Agda-based planning work packages primitive actions as proof-carrying objects whose runtime safety follows from the general PCP soundness theorem [2008.04165].

## 4. Architectural patterns and representative systems

The cryptographic PCAA workflow is explicitly staged. A policy author writes \(\phi\) and records a compiler version hash; `Compiler(φ)` produces \(R_\phi\); `Setup(1^\lambda,R_\phi)` produces proving parameters and a verifying key; the agent serializes public input \(x\) from state and action, chooses private witness \(w\), computes \(\pi=\mathrm{Prove}(pp,x,w)\), and emits \((A,\pi,\text{policyID})\); the verifier retrieves the verifying key for the policy and accepts the action iff `Verify(vk,x,π)=1`. This architecture makes policy identity, compilation, proving, and verification first-class runtime artifacts [2606.23768].

The Proposal–Certification–Execution architecture separates generation, certification, and realization. A pre-execution trace
\[
\tau^{\mathrm{prop}}=(s_0,e_1,s_1,e_2,\dots,e_T,s_T)
\]
may include actions, tool or API calls, retrieval records, credential or approval tokens, replayable computation steps, and declared execution conditions. The certifier may consult proof memory
\[
\mathcal H=(\mathcal S,h_0,\mathrm{Update},\mathrm{Query},\mathrm{Emit})
\]
to handle history-dependent obligations such as cumulative budgets, source lineage, or exposure limits, and it may replace ordinary certificates with zero-knowledge certificates when the trace itself contains sensitive data [2605.24462].

The ePCA system is organized around a neural-symbolic isolation architecture. Its data flow is: semantic stripping, where the LLM may emit only a tightly typed JSON payload; parsing inside the trusted computing base; translation into a first-order formula; SMT decision on \(VC=s\wedge \phi(a)\wedge \Phi_{\mathrm{safe}}\); and return of a binary authorize/reject decision, plus an UNSAT-core witness on rejection. The design claim is that the LLM has zero read/write access to the SMT engine or the axioms, which is intended to prevent hidden side effects from being smuggled through natural-language channels [2605.29251].

The runtime-neutral governance formulation makes the certificate itself the stable object across heterogeneous runtimes. For each raw action \(a\), the certificate is
\[
\mathcal C(a)=\bigl(E(a),Q_r(a),Q_h(a),P(a),I(a)\bigr),
\]
where \(E(a)\) is the portable action envelope, \(Q_r(a)\) runtime-stage receipts, \(Q_h(a)\) human approval receipts and accountability facts, \(P(a)\) the replay-ready proof bundle, and \(I(a)\) the integrity projection lane. Governance is organized into five checkpoints: pre-action admissibility, action open, assumption capture, approval, and outcome closure. The model extends the certificate with externality-aware boundary facts
\[
X(a)=(d,v,o,t,p,c,w,s,r,\epsilon)
\]
and with explicit enforceability classes
\[
\epsilon(a)\in\{\mathsf{pre\_execution\_gate},\mathsf{observe\_only},\mathsf{delegated\_runtime\_control},\mathsf{runtime\_controlled}\},
\]
so that approval semantics are recorded rather than collapsed into a single reviewed/unreviewed bit [2606.04104].

Institutional governance systems implement a more cryptographically explicit admission check. ACP v1.13 defines a proof object
\[
\Pi=(\mathrm{Issuer},\mathrm{Signature},\mathrm{Capabilities},\mathrm{DelegationChain},\mathrm{ComplianceEvidence})
\]
and a decision procedure `verifyAction: A × Π → {accept, escalate, reject}`. Admission depends on signature verification, capability inclusion, delegation-chain validity, transitive revocation, and deterministic risk evaluation. Every decision is recorded in an append-only audit ledger as a signed, hash-chained event, and cross-institutional verifiability is obtained through public institutional keys and Mutual Recognition Agreements [2603.18829].

## 5. Guarantees, empirical studies, and application settings

The strongest guarantees in the literature are conditional. In the cryptographic formulation, the proof system is parameterized by a security parameter \(\lambda\) with required soundness error \(\le 2^{-\lambda}\). The paper gives asymptotic costs for setup, proving, and verification, and reports practical figures of prover time \(O(N\log N)\) field operations for an \(N\)-gate circuit, “in practice seconds for \(N\approx 10^6\),” proof size “\(\approx 160\)–\(240\) B for SNARK” and “\(\approx 10\) kB for STARK,” and verification time “\(\approx 1\)–\(5\) ms (SNARK)” or “\(\approx\) tens of ms (STARK)” [2606.23768].

In ePCA, the security theorem is stated under two explicit assumptions: Structured Intent Fidelity and Immutable Axioms. Under those assumptions, the paper claims a “zero-attack success rate” and “zero false positives.” Its empirical evaluation uses a two-dimensional dynamic adversarial benchmark with Scenario A: Multi-Step Financial Transfer and Scenario B: 12-round Cross-Domain Data Exfiltration Sandbox. For Scenario A, the reported ePCA accuracy is \(100\%\) across GPT-5.2, GPT-5.4, Qwen3-max, Gemini-3-flash, and Kimi-k2.5, while average SMT check time is “\(\approx 0.44\) ms (P99 \(\approx 2.29\) ms)” versus “\(\approx 15.3\) s per decision” for an LLM-as-Judge baseline [2605.29251].

Recommendation under governance constraints provides a deterministic, non-cryptographic PCAA case study. PCN-Rec separates negotiation from enforcement by combining a candidate generator, a User Advocate, a Policy Agent, a mediator LLM, a deterministic verifier, and a deterministic repair stage. On MovieLens-100K with governance constraints, the reported result is a “98.55% pass rate on feasible users (\(n=551, W=80\))” versus a one-shot single-LLM baseline without verification or repair, with “only a \(0.021\) absolute drop in NDCG@10 (\(0.403\) vs. \(0.424\)); differences are statistically significant (\(p<0.05\))” [2601.09771].

The runtime-neutral governance work evaluates portability rather than theorem-level logical soundness. Its protected benchmark expands “from 24 executable seeds to 96 traces across four runtime families.” The reported ablation table gives, for Full PCAA, Exact Accuracy \(1.000\), Review Rate \(0.292\), Manifest Stability \(1.000\), and Proof Closure \(1.000\); removing externality context lowers Exact Accuracy to \(0.875\), removing enforceability handling changes Review Rate to \(0.375\), and removing the integrity lane drives Manifest Stability to \(0.000\) and Proof Closure to \(0.708\) [2606.04104].

Application settings are correspondingly broad. The literature explicitly discusses financial-transfer control, travel or budget policy enforcement, robotic safety constraints, data-exfiltration prevention, governance-constrained recommendation, filesystem sandboxing, B2B institutional admission control, and programmable lakehouse repair workflows [2605.29251][2601.09771][2603.18829]. A related lakehouse proof-of-concept argues that untrusted AI agents can repair production data pipelines safely by coupling branch-based execution with correctness checks inspired by proof-carrying code [2510.09567].

## 6. Assumptions, limitations, and open questions

A recurring misconception is that visibility into model reasoning is equivalent to runtime assurance. The trace-certification literature states the opposite directly: monitorability is not certifiability, and reasoning is only one component of a broader execution trace that may also include evidence, credentials, approvals, replayable computations, and execution conditions [2605.24462].

The main technical fragility is specification. In the cryptographic formulation, policy correctness requires that \(\phi\) faithfully encode legal, ethical, safety, or functional requirements; compiler trust requires that the translation \(\phi\to R_\phi\) be formally verified or extensively tested; and policy versioning requires management of \((\phi,pp,vk)\) triples across updates and revocations. The same work explicitly notes trust in the proof-system setup for SNARKs and the correctness of the compiler as central assumptions [2606.23768].

The solver-based line makes the semantic-translation problem even more explicit. The ePCA paper identifies semantic translation as the “Achilles’ heel,” emphasizes that the framework relies on a finite, strongly typed action space and manually authored axioms, and notes that the chosen logic fragment is decidable rather than arbitrary higher-order logic. It further warns that schema-smuggling attacks may evade syntactic parsing or grammar enforcement in open-ended domains, while reintroducing neural components at the translation boundary risks restoring probabilistic vulnerabilities [2605.29251].

Runtime-governance formulations introduce a different class of limitation: not all runtimes expose enforcement hooks deep enough for true pre-execution gating. The heterogeneous-runtime paper states that some systems cannot enforce pre-execution control, that the public benchmark is disclosure-bounded, that stronger cryptographic proof lanes such as zero-knowledge receipts or blockchain settlement remain future work, that there is no formal proof of end-to-end tamper resistance under adaptive adversaries yet, and that automated policy synthesis, conformal risk control, multi-tenant workflows, and federated governance remain open [2606.04104].

Skill-containment approaches narrow one gap while leaving a residual. The three-layer capability-containment framework proves composition of abstract interpretation, refinement types, and SMT-bounded model checking “modulo a single residual,” namely the LLM’s freedom to refuse to act; the paper states that the runtime biconditional catches that residual at session boundary [2605.23951]. This suggests that PCAA can make unauthorized action execution mechanically difficult or impossible within the modeled interface, but cannot by itself solve every alignment or intent-formation problem outside that interface.

Across the literature, the forward path is consistent: strengthen policy languages, formally verify compilers and re-checkers, integrate proof systems and runtime control planes, benchmark common policies, manage policy identifiers and keys, support batching and selective zero-knowledge disclosure, and subject the entire stack to cross-disciplinary audit [2606.23768]. In that sense, PCAA is best understood not as a single algorithm but as an emerging design pattern for trustworthy agency: action is separated from permission, and permission is grounded in certificates that can be checked independently of the agent that produced them.

Source: https://www.emergentmind.com/topics/proof-carrying-agent-actions-pcaa