---
title: 'Ledger-QA: Verifiable, Auditable QA'
url: https://www.emergentmind.com/topics/ledger-qa
type: topic
---

# Ledger-QA: Verifiable, Auditable QA

Ledger-QA denotes a question-answering system whose behavior, updates, and safety properties are verifiable and auditable via a ledger and formal verification. In the MathLedger framework, it is not presented as a high-capability QA architecture but as an infrastructural design for verifiable cognition: every learning update and every accepted knowledge entry are driven by verifier outcomes, committed to an append-only monotone ledger, and made replayable through cryptographic attestation [2601.00816].

## 1. Architectural definition and epistemic loop

Ledger-QA is instantiated from four coupled components: a reasoning or learning policy, a verifier, a monotone cryptographically attested ledger, and Reflexive Formal Learning (RFL). The stated goal is not raw capability, but verifiable cognition: every learning update and every knowledge entry is backed by a verifier outcome and recorded in a tamper-evident, replayable form. The high-level “chain of verifiable cognition” is
\[
\text{Input} \to \text{Proof-or-Abstain} \to \text{Ledger Attestation} \to \text{Dual Commitment} \to \text{Policy Update}
\]
and the Phase I “FO cycle harness” pipeline is described as UI Event, Curriculum Gate, Derivation Engine, Verifier, Dual Attestation, and RFL [2601.00816].

Formally, the ledger \(\mathcal{L}\) is a sequence of blocks,
\[
\mathcal{L} = (B_1, B_2, \ldots),
\]
where each block contains verifier-accepted proof artifacts together with canonical statement hashes, verifier status, and a Merkle root \(R_t\) over sorted proof IDs. The knowledge state after \(t\) blocks is
\[
K_t := \bigcup_{i=1}^{t} B_i,
\]
with monotonicity
\[
K_t \subseteq K_{t+1} \quad \forall t.
\]
The ledger head hash evolves as
\[
L_t = \mathrm{Hash}(L_{t-1} \| R_t),
\]
which gives an append-only, hash-chained, tamper-evident log.

Dual attestation binds reasoning state and interface state at each epoch. The reasoning root \(r_t\) is a digest over canonicalized proof artifacts, the UI root \(u_t\) is a digest over interface state such as DOM, logs, UI events, and user confirmations, and the combined hash is
\[
H_t = \mathrm{Hash}(EPOCH: \| r_t \| u_t).
\]
The triple \((r_t, u_t, H_t)\) is the “epistemic fingerprint” of epoch \(t\): the minimal canonical summary of that cycle. In a Ledger-QA deployment, the paper maps events \(e_t\) to \((\text{question}, \text{answer}, \text{reasoning trace})\) tuples, with the verifier checking correctness, policy adherence, and related properties before the answer is treated as valid.

## 2. Reflexive Formal Learning

RFL is the learning rule that converts verifier outcomes into policy updates. The policy space is \(\Pi\), interpreted as symbolic reasoning policies, and each policy \(\pi\) induces an event distribution \(P_\pi\) over reasoning events \(e\). Verification produces a ternary outcome
\[
\mathcal{V}(e_t) \in \{1,0,\bot\},
\]
where \(1\) is pass, \(0\) is fail, and \(\bot\) is abstention.

The optimization target is epistemic risk,
\[
\mathcal{J}(\pi) = \mathbb{E}_{e \sim P_\pi}[\mathbf{1}\{\mathcal{V}(e) \neq 1\}] = \Pr_{e \sim P_\pi}[\mathcal{V}(e) \neq 1].
\]
RFL seeks policies with lower \(\mathcal{J}(\pi)\). Its update rule is
\[
\pi_{t+1} = \pi_t \oplus \eta_t \cdot \Phi(\mathcal{V}(e_t), \pi_t),
\]
where \(\oplus\) is algebraic composition on policy space, \(\eta_t\) is the step size, and \(\Phi\) maps verifier outcome and current policy to a policy adjustment. Under bounded updates, martingale noise, and Robbins–Monro stepsizes, the update can be written in stochastic approximation form as
\[
\pi_{t+1} = \pi_t + \eta_t \big( h(\pi_t) + M_{t+1} \big),
\]
with mean drift \(h(\pi)\) and martingale-difference noise \(M_{t+1}\).

This differs from gradient descent in both signal and objective. Standard learning uses continuous loss and gradients; RFL uses a discrete verifier signal \(\mathcal{V}(e)\). Standard objectives minimize prediction error or maximize likelihood; RFL minimizes the probability of failing formal verification. Standard training tolerates silent behavior drift so long as empirical loss decreases; RFL makes failed and abstained events visible as logged negative knowledge. The paper also treats abstention as first-class: abstention avoids false positives, can indicate appropriate caution, and, in a QA setting, directly supports “I don’t know” behavior when verification fails [2601.00816].

## 3. Measurement substrate and fail-closed governance

Phase I is explicitly framed as a validation of measurement and governance infrastructure rather than of capability. The core measurements are abstention rate, \(\Delta p\) as a per-cycle “success rate proxy,” and variance tracking between experimental arms. In CAL-EXP-3, the baseline arm uses learning rate \(\mathrm{lr} = 0.0\) with RFL off and a static policy, while the treatment arm uses \(\mathrm{lr} = 0.1\) with RFL on. The reported behavior is oscillatory \(\Delta p\) dynamics around a decision threshold in both arms, and no convergence or improvement is claimed; the point is that \(\Delta p\) computation, variance tracking, and governance-predicate wiring function as intended [2601.00816].

The governance layer is fail-closed. Predicates monitor measurements and trigger when they move out of pre-specified bounds. Two stress-tested examples are F5.2, a variance-ratio predicate, and F5.3, a windowed-drift predicate. When these fire, the system caps the claim level at L0, meaning no capability claim is allowed, and some updates may be marked as `INADMISSIBLE_UPDATE`, recorded in the governance evidence but excluded from learning. In Phase I this is run in SHADOW mode: governance effects are non-blocking for production, but the evidence is still recorded with binding hashes, and governance verdicts still cap claims.

For Ledger-QA, this governance logic is directly extensible. If verified accuracy drifts unexpectedly, if safety-metric variance exceeds tolerated levels, or if abstention behavior becomes anomalous, governance could freeze updates, force abstention in governed domains, escalate to human review, and log all such interventions. A plausible implication is that Ledger-QA treats safety not as a post hoc moderation layer but as a governed property of the learning substrate itself.

## 4. Ledger-attested QA operation and negative knowledge

The paper’s concrete mapping of MathLedger to QA gives a seven-step flow for a single interaction. A user question \(q_t\) arrives as a UI event; a curriculum or policy gate decides whether the query is within a governed domain; the learner \(\pi_t\) proposes an answer \(a_t\) and reasoning trace \(e_t\); the verifier computes \(\mathcal{V}(e_t)\); logging records pass, fail, or abstain artifacts; dual attestation computes \(r_t\), \(u_t\), and \(H_t\); and RFL applies the update rule
\[
\pi_{t+1} = \pi_t \oplus \eta_t \cdot \Phi(\mathcal{V}(e_t), \pi_t).
\]
Only verified events with \(\mathcal{V}(e_t)=1\) serve as positive learning signals [2601.00816].

In the QA setting, the verifier may be a proof assistant kernel such as Lean, a consistency checker for domain invariants, a policy verifier for safety or regulatory rules, or a provenance checker ensuring that disallowed sources were not used. For successful events, the ledger stores canonical hashes of \(q_t\), \(a_t\), and \(e_t\), together with verifier status and metadata such as timestamp and policy version. The combined epoch hash \(H_t\) may also be recorded as ledger metadata.

A central notion is negative knowledge. Refuted artifacts, abstentions, and inadmissible updates are logged as governance-bound evidence, classified through `artifact_kind` values such as `REFUTED`, `ABSTAINED`, and `INADMISSIBLE_UPDATE`. They are explicitly excluded from the monotone knowledge ledger and from RFL’s positive structural learning signal, but they remain part of the replayable evidence pack. This allows later statements such as “this QA pattern was attempted and rejected under governance version \(v\).” In operational terms, Ledger-QA is therefore not only a store of accepted knowledge; it is also a typed record of failure, refusal, and blocked adaptation.

## 5. Cryptographic attestation, replay, and auditability

The cryptographic substrate is deliberately simple and explicit. The paper describes SHA-256 hashes for evidence manifest entries, the governance registry hash, and files in the evidence pack. The evidence manifest contains fields such as `commitment_registry_sha256`, which hashes the Governance Commitment Registry (GCR), and `artifact_kind`, which tags artifacts as `VERIFIED`, `REFUTED`, `ABSTAINED`, or `INADMISSIBLE_UPDATE`. The replay verifier checks that `artifact_kind` is present and valid, that `commitment_registry_sha256` matches the actual registry file, and that any mismatch fails verification with exit code 1 [2601.00816].

This makes governance itself cryptographically visible. Even if policy semantics remain informal, the existence and version of the active governance commitments are bound into the evidence. The lemma on dual attestation’s binding property states that once
\[
H_t = H(EPOCH:\| r_t \| u_t)
\]
is published, the pair \((r_t,u_t)\) is effectively immutable absent a hash collision. Any learning update can therefore be traced back to verifier outcome, accepted artifacts, UI context, and the frozen GCR hash active for that run.

Implementation details reinforce the prototype status. Phase I uses a synthetic proxy verifier; Phase II+ is intended to integrate Lean. Evidence-pack tooling uses SHA-256 and RFC 8785 canonical JSON for hashing the Governance Commitment Registry, together with a replay verifier `verify.py` that checks file hashes, governance registry hash, and artifact kinds. The paper also notes version pinning via Git tag `v0.9.4-pilot-audit-hardened`, and Python plus `uv` for running drop-in demos. In a different ledger-backed QA lineage, offline-verifiable registry answers have been implemented through Ledger State Attestations, aggregate BLS signatures, and offline verification of smart-contract responses, illustrating that “ledger-attested answers” can also denote provenance-checked query results rather than verifier-driven learning updates [2207.09319].

## 6. Limits, non-claims, and broader significance

The paper is explicit about what Ledger-QA does not establish. There are no convergence guarantees for RFL under Phase I conditions; all runs failed the variance gate. There is no claim of improved theorem proving, question answering, or general reasoning capability. There are no generalization guarantees, no out-of-distribution or real-world tests, and no claim that the frozen governance thresholds are optimal. Phase I runs only in SHADOW mode, so verification is observational rather than actively gating production behavior. The threat model assumes honest-but-fallible operators and does not handle Byzantine adversaries, compromised verifiers, or malicious governance authors [2601.00816].

These limitations matter because the framework is easy to misconstrue as a turnkey safety layer for large QA models. The paper states the opposite. MathLedger supplies infrastructure to measure, attest, and govern; it does not make a QA system accurate by construction, and it does not automatically make one safe. A plausible implication is that the hardest open problems are shifted, not removed: verifier strength, specification design, admissibility rules, threshold calibration, and the translation of probabilistic model outputs into formally checkable artifacts.

In that respect, Ledger-QA belongs to a broader family of work that treats ledger systems as formal or cryptographically structured substrates rather than mere storage backends. Formalization of the FA1.2 ledger standard as a reusable Coq theory shows how ledger semantics can be made mathematically precise and verified across multiple implementations, while MathLedger extends formalization into an epistemic loop where verifier outcomes drive admissible learning [2109.09451]. The conceptual significance of Ledger-QA lies less in a new QA benchmark or model class than in a particular claim about system architecture: a question-answering system can, in principle, be organized so that accepted knowledge, rejected knowledge, governance state, and policy updates are all jointly auditable, replayable, and cryptographically bound.

Source: https://www.emergentmind.com/topics/ledger-qa