---
title: Finite-Type Bayesian Conditioning
url: https://www.emergentmind.com/topics/finite-type-bayesian-conditioning
type: topic
---

# Finite-Type Bayesian Conditioning

Searching arXiv for the cited papers to ground the article.
arXiv search: 1511.09230
arXiv search: 2606.20351
Finite-type Bayesian conditioning is the finite set-based realization of Bayesian updating in which a prior state on a finite type is transformed by an “assert-then-normalize” operation induced by a fuzzy predicate. In the type-theoretic formulation of probabilistic reasoning, states, predicates, normalization, and conditioning are internalized as typed constructions, and conditioning is tied to a bijective correspondence between predicates and side-effect-free actions. In this setting, Bayes’ rule is not added externally; it is obtained directly from the definitions of assert and normalization [1511.09230].

## 1. Finite types, states, and fuzzy predicates

The basic carrier is a fixed finite set \(A\), referred to as a finite type. A probability state on \(A\) is a map
\[
\omega:A\to[0,1]
\]
satisfying
\[
\sum_{a\in A}\omega(a)=1.
\]
Such states are written \(\omega\in D(A)\), using the finite distribution monad. A fuzzy predicate on \(A\) is a map
\[
p:A\to[0,1].
\]

A substate \(\alpha\) on \(A\) is a map \(\alpha:A\to[0,1]\) with total weight
\[
\mu=\sum_a \alpha(a)
\]
satisfying \(0<\mu\le 1\). Normalization is defined by
\[
\operatorname{norm}(\alpha)(a)=\alpha(a)/\mu,
\]
where \(\mu=\sum_{a\in A}\alpha(a)\), so that \(\operatorname{norm}(\alpha)\) is a full state in \(D(A)\) [1511.09230].

| Object | Definition | Role |
|---|---|---|
| State \(\omega\) | \(\omega:A\to[0,1]\), \(\sum_a\omega(a)=1\) | Prior or posterior distribution |
| Fuzzy predicate \(p\) | \(p:A\to[0,1]\) | Soft event or likelihood |
| Substate \(\alpha\) | \(\alpha:A\to[0,1]\), \(0<\sum_a\alpha(a)\le1\) | Unnormalized updated state |
| Normalization | \(\operatorname{norm}(\alpha)(a)=\alpha(a)/\sum_b\alpha(b)\) | Converts substate to state |

The logic associated with this setting is quantitative, with fuzzy predicates. This is significant because conditioning is formulated for graded evidence rather than only for sharp events, so likelihood-style updating is handled in the same formal language as Boolean conditioning. A plausible implication is that finite-type Bayesian conditioning serves simultaneously as a semantic account of posterior formation and as a proof-theoretic account of probabilistic inference.

## 2. Assert maps and the predicate–instrument correspondence

Given a state \(\omega\) and a predicate \(p\), the assert substate is defined pointwise by
\[
(\operatorname{assert}_p\,\omega)(a)=p(a)\cdot \omega(a).
\]
Its total weight is
\[
\sum_a p(a)\omega(a)=E_{a\sim\omega}[p(a)],
\]
which is \(>0\) whenever conditioning is performed on an event of positive probability [1511.09230].

In the formal type theory, this assert map arises as a partial map
\[
\operatorname{assert}_{\lambda x.p(x)}(t):A+1,
\]
with the property that its underlying substate on \(A\) is exactly \(p\cdot\omega\). Equivalently, at the level of partial maps,
\[
\operatorname{assert}_p(a)=\operatorname{inl}(a)\ \text{with probability }p(a),\ \text{diverge otherwise}.
\]

A central structural fact is the bijection between fuzzy predicates on \(A\) and side-effect-free instruments \(\operatorname{instr}_p:A\to A+A\), or equivalently asserts \(A\to A+1\). The correspondence is given by
\[
p\mapsto \operatorname{instr}_p,
\qquad
\operatorname{instr}_p(a)=p(a)\cdot\operatorname{inl}(a)+(1-p(a))\cdot\operatorname{inr}(a).
\]
Conversely, from a suitable map \(f\) one recovers the predicate by
\[
f\mapsto (!(+!))\circ f:A\to 2\cong[0,1].
\]
The paper identifies this predicate–instrument correspondence as the key aspect distinguishing the probabilistic type theory from quantum type theory, and it uses that correspondence to derive computation rules for conditioning and related probabilistic calculations [1511.09230].

The summary given for the finite set-based account states that these constructions are internalized in the COMET type theory via the instrument/assert maps, the partial sum, and the normalization operators, with the bijection between predicates and side-effect-free asserts guaranteeing that “assert-then-normalize” is the correct formal realization of Bayesian conditioning. This suggests that the operational content of conditioning is built into the calculus rather than imposed as an external meta-level rule.

## 3. Conditioning as normalization of assertion

For a state \(\omega:D(A)\) and a predicate \(p:A\to[0,1]\) with total weight
\[
w=\sum_a p(a)\omega(a)>0,
\]
the conditioned state is defined by
\[
\omega|_p \;:=\; \operatorname{norm}(\operatorname{assert}_p\,\omega).
\]
Pointwise,
\[
(\omega|_p)(a)=\frac{p(a)\omega(a)}{\sum_b p(b)\omega(b)}.
\]
In type-theoretic notation,
\[
\omega|_p=\operatorname{norm}(\operatorname{assert}_{\lambda x.p(x)}(\omega)).
\]

Bayes’ rule follows immediately from this definition. If \(A\) is a finite set, \(\omega\) is a prior on \(A\), and \(B\) is a binary observation event represented by the predicate
\[
p_B(a)=P(B\mid A=a),
\]
then the asserted substate is
\[
\alpha(a)=p_B(a)\cdot\omega(a).
\]
After normalization,
\[
(\omega|_B)(a)=\frac{p_B(a)\omega(a)}{\sum_b p_B(b)\omega(b)}.
\]
Writing \(\omega(a)=P(a)\), \(p_B(a)=P(B\mid a)\), and \(\sum_b p_B(b)\omega(b)=P(B)\), one obtains
\[
P(a\mid B)=\frac{P(B\mid a)P(a)}{P(B)}.
\]
In this formulation, the classical Bayesian posterior is exactly the normalized assert state [1511.09230].

One common misconception is to treat conditioning in such systems as merely a notation for posterior probabilities already defined elsewhere. In the finite-type treatment, conditioning is instead a derived operation on states and predicates, and Bayes’ rule appears as a theorem-level consequence of that operation.

## 4. Worked two-variable Boolean example

A fully explicit example is given for two Boolean variables \(A,C\in\{t,f\}\). The prior on \((A,C)\) is assumed to be a product prior,
\[
\omega(a,c)=\omega_A(a)\cdot\omega_C(c),
\]
with
\[
\omega_A(t)=0.3,\quad \omega_A(f)=0.7,\quad
\omega_C(t)=0.4,\quad \omega_C(f)=0.6.
\]

A test \(T\) is observed with likelihood factorization
\[
P(T\mid A,C)=p(a)\cdot q(c),
\]
where
\[
p(t)=0.8,\quad p(f)=0.1,\quad q(t)=0.9,\quad q(f)=0.2.
\]
The test is treated as a predicate on \(A\times C\):
\[
P_T(a,c)=p(a)\cdot q(c).
\]

The joint substate after asserting \(T\) is
\[
\alpha(a,c)=P_T(a,c)\cdot\omega(a,c)
=[p(a)q(c)]\cdot[\omega_A(a)\omega_C(c)].
\]
Its total weight is
\[
W=\sum_{a,c}p(a)q(c)\cdot\omega_A(a)\omega_C(c).
\]
The normalized posterior on \((A,C)\) is then
\[
(\omega|_T)(a,c)=\frac{p(a)q(c)\cdot\omega_A(a)\omega_C(c)}{W}.
\]

Marginalizing over \(C\) gives
\[
P(A=a\mid T)=\sum_c(\omega|_T)(a,c)
=\frac{\omega_A(a)p(a)\sum_c\omega_C(c)q(c)}{W}.
\]
The expectation over \(C\) is
\[
E_c[q(c)]=0.4\cdot0.9+0.6\cdot0.2=0.48.
\]
Hence
\[
W=\sum_a \omega_A(a)p(a)\cdot 0.48
=0.3\cdot0.8\cdot0.48+0.7\cdot0.1\cdot0.48
=0.1152+0.0336=0.1488.
\]
Therefore,
\[
P(A=t\mid T)=0.1152/0.1488\approx 0.7742,
\qquad
P(A=f\mid T)\approx 0.2258.
\]
The example exhibits the full finite-type workflow: prior factorization, likelihood as predicate, assert, normalization, and optional marginalization [1511.09230].

## 5. Formalisation and algebraic extensions

A later Cubical Agda formalisation develops finite-type Bayesian conditioning for finitely supported distributions as a higher inductive type \(FDist\,A\) with point-constructors
\[
\operatorname{pure}:A\to FDist\,A,\qquad
\operatorname{mix}:\operatorname{Weight}\to FDist\,A\to FDist\,A\to FDist\,A,
\]
together with six path-constructors imposing the usual convex-algebra laws, including \(\operatorname{mix}\)-idem, \(\operatorname{mix}\)-comm, two boundary laws, \(\operatorname{mix}\)-interchange, and \(\operatorname{mix}\)-assoc [2606.20351].

That work states that the standard convex-algebra interchange axiom, common to probability-monad formalisations since Stone, is provably too weak to support full Bayesian conditioning. The obstruction appears when conditioning is lifted through the \(\operatorname{mix}\)-interchange path: after conditioning, the two inner probabilities become
\[
q_1'=\operatorname{BayesW}(q;m_a,m_c),\qquad
q_2'=\operatorname{BayesW}(q;m_b,m_d),
\]
where the event marginals \(m_a,m_b,m_c,m_d\) are expectations of the likelihood under the corresponding branches. In general \(q_1'\neq q_2'\), so the standard interchange law cannot be applied.

On a full-support syntactic fragment \(FDist\text{-}syn\,A\), recursive conditioning is defined using
\[
\operatorname{BayesW}(p;m_1,m_2)=\frac{p\,m_1}{p\,m_1+(1-p)\,m_2},
\]
and a recursive \(\operatorname{bayes\text{-}cond}\) operator that computes expectations \(E_{syn}\,d\,lik\) on subtrees and reweights each \(\operatorname{mixS}\) node accordingly. To make HIT-lifting possible, the formalisation adds one new path-constructor, \(\operatorname{mix\text{-}bayes\text{-}interchange}\), which generalises the ordinary interchange law and specialises back to it when \(q_1=q_2=q\). The paper proves that the standard form is the degenerate case where the two inner weights coincide.

For a finite carrier \(\operatorname{Fin}\,n\), the same work defines a conditioning operation by
\[
\operatorname{mass}_{cond}(x)=
\frac{\operatorname{mass}_d(x)\,lik(x)}{\sum_y \operatorname{mass}_d(y)\,lik(y)},
\]
and states that this extends uniquely to a total Agda function \(\operatorname{cond\_FinEvent}\,d\,lik:FDist(\operatorname{Fin}\,n)\) satisfying Bayes’ rule at the mass level. It also packages a chain \(X\to Y\to Z\) into an \(SCM\) record and computes \(P(X\mid Y=y)\) via a conditioning operation \(\operatorname{cond\text{-}fst}\) on the joint distribution [2606.20351].

## 6. Related finite-constraint perspectives and scope

Finite-type Bayesian conditioning also appears in more asymptotic or constraint-based forms. In one line of work, an exchangeable sequence on a finite alphabet is conditioned on empirical moment constraints through a “Lanford window”
\[
E(\varepsilon_n)=\{Q\in\Delta_k:\|Q-\mu\|_1\le \varepsilon_n\},
\qquad
\varepsilon_n\downarrow 0,\;\; n\varepsilon_n^2\to\infty,
\]
under assumptions including finite alphabet, strictly positive baseline \(\Pi\)-density, convex and closed constraint set, and unique \(I\)-projection. The resulting theorem states that for every fixed block size \(m\),
\[
\Pr(X_{1:m}=x_{1:m}\mid P_n\in E(\varepsilon_n))
\to \prod_{i=1}^m P^*(x_i),
\]
where
\[
P^*=\arg\min_{Q\in E}D(Q\|P),
\]
and gives the finite-sample bound
\[
\Bigl\|L(X_{1:m}\mid P_n\in E(\varepsilon_n))-(P^*)^{\otimes m}\Bigr\|_{\mathrm{TV}}
=O\!\Bigl(\tfrac{m}{n^{1/3}}+\tfrac{m^2}{n}\Bigr)
\]
so that for fixed \(m\) the leading rate is \(O(n^{-1/3})\) [2509.13283]. This suggests a broader finite-type picture in which posterior prediction under constraints is governed by \(I\)-projection and exponential tilting rather than by elementary event indicators alone.

A related framework studies finite sample spaces \(\mathcal X=\{1,\dots,k\}\) with a reference pmf \(Q\), a moment map \(h:\mathcal X\to\mathbb R^d\), and a constraint manifold
\[
E=\{P\in\Delta_k^\circ:A\,P=\alpha\}.
\]
There the constrained predictive law for future draws is represented as a mixture over feasible empirical types, and around the information projection
\[
P^*=\arg\min_{P\in E}D_{KL}(P\|Q)
\]
the predictor admits a discrete–Gaussian mixture representation involving the projected Hessian
\[
H^*=V^\top[\operatorname{diag}(1/P^*)]V.
\]
The smallest eigenvalue \(\lambda_{\min}(H^*)\) measures local curvature, and the total-variation contraction bound depends explicitly on \(\lambda_{\min}(H^*)\) and \(p_{\min}^*=\min_x P^*(x)\) [2510.20742]. The same paper relates this geometry to empirical likelihood, Bayesian exponentially-tilted empirical likelihood, generalized method of moments, and generalized estimating equations.

The scope of finite-type conditioning is clarified by results on brittleness in continuous settings. For Bayesian models on a Polish space \(\mathcal X\), specified only through finitely many marginals or moment constraints, posterior lower and upper bounds after conditioning on finite-precision data can still attain the full deterministic range of a quantity of interest \(\Phi\). The same work shows that arbitrarily small Prokhorov or total-variation perturbations of the model may produce arbitrarily large posterior shifts after conditioning [1304.6772]. This does not negate the finite set-based theory; rather, it delineates a boundary. A plausible implication is that the algebraic clarity of finite-type Bayesian conditioning does not by itself supply robustness once the setting moves to continuous model classes under finite information.

In that sense, finite-type Bayesian conditioning occupies two roles. First, it is an exact formal account of Bayesian updating on finite carriers via states, predicates, assert maps, and normalization. Second, it functions as a reference model against which later formalisations, asymptotic constraint-based updates, and robustness analyses can be compared.

Source: https://www.emergentmind.com/topics/finite-type-bayesian-conditioning