---
title: 'Relative Bisimulation: A Unified Perspective'
url: https://www.emergentmind.com/topics/relative-bisimulation
type: topic
---

# Relative Bisimulation: A Unified Perspective

Relative bisimulation is a family of parameterized behavioral equivalences or preorders in which the usual bisimulation condition is relativized to an external parameter. In the literature covered here, that parameter is a stationary policy in discounted Markov decision processes, a distinguished subset of actions in labeled transition systems, a logical fragment in the calculus of relations, or a chosen relation lifting or relator in coalgebraic semantics [2202.02881] [1207.2462] [1210.2688] [1101.4223] [2502.01790]. The shared theme is not a single canonical definition but a controlled weakening or specialization of back-and-forth matching that preserves the observables relevant to the ambient theory.

## 1. Scope and General Form

The term has several established uses, each tied to a different semantic setting. The parameter controls which transitions, observations, or modal resources must be matched symmetrically, and which may be matched only in a weaker or more localized sense.

| Context | Relativizing parameter | Canonical effect |
|---|---|---|
| Discounted MDPs | stationary policy $\pi$ | replace $\max_{a\in A}$ by expectations under $\pi$ |
| Labeled transition systems | action subset $B\subseteq \mathrm{Act}$ | actions in $B$ are bisimulated; others are only simulated |
| Calculus of relations | fragment $F$ and degree $k$ | clauses quantify only over $\mathrm{paths}_k^F$ and fragment-specific operators |
| Coalgebra/relators | relation lifting or relator | step condition is defined relative to the chosen lifting |

This variation matters because different communities use “relative bisimulation” for different technical objects. In discounted control, the standard term is $\pi$-bisimulation or policy-relative bisimulation [2202.02881]. In concurrency theory, “partial bisimulation,” “relative bisimulation,” and “conditional bisimulation” are used synonymously for relations parameterized by a bisimulated action subset $B$ [1207.2462]. In finite-model theory and database semantics, relative bisimulation is fragment-relative: the back-and-forth clauses are tailored to the operators available in a fragment of the calculus of relations [1210.2688]. In coalgebra, relative bisimulation typically means bisimulation defined relative to a relation lifting $\overline{B}$ or, more generally, a relator or lax extension [1101.4223] [2502.01790].

A recurring misconception is to conflate these notions with weak or branching bisimulation. In the action-set-parametric setting, partial bisimulation is explicitly strong and stepwise, but restricted by $B$; it is distinct from weak or branching bisimulation, which abstract from silent steps and use path-based matching [1207.2462].

## 2. Policy-Relative Bisimulation in Discounted Markov Decision Processes

In discounted MDPs $(S,A,P,R,\gamma)$ with compact state space $S$, bounded reward $R:S\times A\to[0,1]$, and stationary policy $\pi$, policy-relative bisimulation is defined from the policy-averaged reward and transition kernel
$$
R_\pi(s)=\mathbb{E}_{a\sim\pi(\cdot\mid s)}[R(s,a)],\qquad
P_\pi(\cdot\mid s)=\mathbb{E}_{a\sim\pi(\cdot\mid s)}[P(\cdot\mid s,a)].
$$
The $\pi$-bisimulation metric $d^\sim_\pi$ is the unique fixed point of
$$
d^\sim_\pi(s_i,s_j)=c_R |R_\pi(s_i)-R_\pi(s_j)| + c_T W_1(d^\sim_\pi)\big(P_\pi(\cdot\mid s_i),P_\pi(\cdot\mid s_j)\big),
$$
with $c_R\in[0,\infty)$ and $c_T\in(0,1)$ [2202.02881].

This construction parallels the standard bisimulation metric
$$
d^\sim(s_i,s_j)=\max_{a\in A} c_R |R(s_i,a)-R(s_j,a)| + c_T W_1(d^\sim)\big(P(\cdot\mid s_i,a),P(\cdot\mid s_j,a)\big),
$$
but replaces the maximization over actions by expectations under $\pi$. The paper shows that both bisimulation and $\pi$-bisimulation can be generalized through $p$-Wasserstein and Sinkhorn distances. For $p\ge 1$ and $\zeta\ge 0$, the generalized operator uses $W_p^\zeta(d)$, and the same value-function-approximation guarantees hold:
$$
\|V^*-\widetilde V^*_\Phi\|_\infty \le \frac{2\epsilon}{c_R(1-\gamma)},\qquad
\|V^\pi-\widetilde V^\pi_\Phi\|_\infty \le \frac{2\epsilon}{c_R(1-\gamma)}
$$
for any $\epsilon$-aggregation $\Phi$, provided $c_T\ge \gamma$ [2202.02881].

A central technical point is that policy-relative bisimulation is smooth with respect to policy change. For $p\ge 1$ and $\lambda=0$,
$$
\|d^\sim_\pi-d^\sim_{\pi'}\|_\infty \le \frac{2c_R}{(1-c_T)^2}\,[D^\infty_{TV}(\pi,\pi')]^{1/p},
$$
where $D^\infty_{TV}(\pi,\pi')=\sup_{s\in S}D_{TV}(\pi(\cdot\mid s),\pi'(\cdot\mid s))$. Small policy updates therefore induce small changes in the metric. This is the basis for the paper’s conservative API$(\alpha)$ procedure, which updates
$$
\pi_{k+1}=(1-\alpha)\pi_k+\alpha \pi_g
$$
and obtains a better asymptotic bound than naive API with hard greedy replacement. The same work maps these ideas to actor-critic practice through representation learning objectives that approximate $d^\sim_\pi$, including the DBC loss with $W_2$ and Gaussian latent dynamics [2202.02881].

The policy-relative construction is therefore “relative” in a literal sense: state similarity is evaluated relative to the behavior induced by the current policy through $R_\pi$ and $P_\pi$. This avoids the pessimism of $\max_{a\in A}$ and is computationally attractive in large action spaces, while retaining uniform approximation guarantees for $V^\pi$.

## 3. Partial Bisimulation on Labeled Transition Systems

For a labeled transition system $L=(S,\mathrm{Act},\to,s_0)$, relative bisimulation is commonly defined by fixing a subset $B\subseteq \mathrm{Act}$ of bisimulated actions. A relation $R_B\subseteq S\times S$ is a partial bisimulation with respect to $B$ if, for all $(p,q)\in R_B$, actions in $B$ satisfy both forward and backward matching, while actions in $\mathrm{Act}\setminus B$ satisfy forward simulation only. If a termination predicate is present, one additionally requires termination monotonicity $p\!\downarrow \Rightarrow q\!\downarrow$ [1207.2462].

The induced preorder and equivalence are
$$
p\preceq_B q \iff \exists R_B\ \text{with}\ (p,q)\in R_B,\qquad
p\approx_B q \iff p\preceq_B q\ \text{and}\ q\preceq_B p.
$$
The two extreme choices recover familiar notions: $B=\emptyset$ yields simulation preorder and simulation equivalence, while $B=\mathrm{Act}$ yields full bisimulation [1207.2462].

The quotient construction is more delicate than for ordinary bisimulation because simulation-style minimization must track “little brothers.” These are class-level ordering relations $C\le D$ expressing that $D$ simulates $C$. In quotienting and refinement, one must preserve upward closure for simulated actions and additional back-matching constraints for actions in $B$. The paper emphasizes that this extra structure is what makes simulation-equivalence minimization more expensive than bisimulation minimization [1207.2462].

The algorithmic contribution is a partition-refinement method that maintains a partition–relation pair $(\Pi,\leq)$ and alternates two phases: partition refinement in Paige–Tarjan style and little-brother updates. Stability requires uniform termination on each block, forward simulation conditions for all labels, and back-matching on bisimulated labels. The paper proves that stable pairs form an upper lattice with a greatest stable pair, and that iterating the refinement operator converges to the coarsest stable pair, hence to the greatest $\preceq_B$ and $\approx_B$ [1207.2462].

The worst-case complexity is
$$
O(|\to|\log |S| + |\mathrm{Act}|\cdot |\Pi|\cdot |\leq|)
$$
time and
$$
O(|\mathrm{Act}|\cdot |S| \log |\Pi| + |\mathrm{Act}|\cdot |\Pi|^2 \log |\Pi|)
$$
space. These bounds scale with the bisimulated subset because only labels in $B$ require the more expensive symmetric treatment. The paper’s intended application is supervisory control in discrete-event systems, where $B$ is chosen as the set of uncontrollable actions: partial bisimulation then enforces bisimulation on uncontrollables and only simulation on controllables [1207.2462].

In this tradition, “relative” means relative to a designated action interface. The relation lies strictly between simulation and bisimulation, and its significance is tied to property preservation and scalable quotienting rather than to metric geometry.

## 4. Fragment-Relative Bisimulation in the Calculus of Relations

In the calculus of binary relations, relative bisimulation is parameterized by a fragment $F$ of the language and, in the degree-bounded setting, by a degree $k$. The semantics are given over relational structures $\mathcal A=(A,(R_i^\mathcal A)_{i\in I})$, and the key auxiliary object is the fragment-relative path predicate $\mathrm{paths}_k^F(\mathcal A)$, which captures the pairs reachable by expressions of degree at most $k$ [1210.2688].

Marked structures are triples $(\mathcal A,a,b)$, and indistinguishability is defined by type inclusion:
$$
(\mathcal A_1,a_1,b_1)\preccurlyeq_k^F(\mathcal A_2,a_2,b_2)
\iff
\mathrm{tp}_k^F(\mathcal A_1,a_1,b_1)\subseteq \mathrm{tp}_k^F(\mathcal A_2,a_2,b_2).
$$
When $F$ contains complement or difference, one-sided indistinguishability collapses to two-sided indistinguishability except for trivial outside-path cases, and the appropriate notion is an $(F,k)$-bisimulation: a decreasing sequence $\bar Z=(Z_0,\dots,Z_k)\subseteq A_1^2\times A_2^2$ satisfying Atoms Forth/Back together with fragment-specific back-and-forth clauses for composition, projection, and residuals [1210.2688].

The composition clause is representative. At degree $i\ge 1$, if $(a_1,c_1)$ and $(c_1,b_1)$ lie in $\mathrm{paths}_{i-1}^F(\mathcal A_1)$, then there must exist $c_2$ such that $(a_1,c_1,a_2,c_2)\in Z_{i-1}$ and $(c_1,b_1,c_2,b_2)\in Z_{i-1}$; the back direction is symmetric. Projection and residuals introduce additional node-observational and universal/conditional clauses, and all quantification is explicitly restricted to $\mathrm{paths}_{i-1}^F$ [1210.2688].

For positive fragments, where neither complement nor difference is available, the paper replaces bisimulation by a two-relations simulation $(\bar Z,\bar W)$. This is needed because coprojection and residuals are nonmonotonic in the absence of complement. The adequacy theorem states that, for fragments with complement or difference,
$$
(\mathcal A_1,a_1,b_1)\equiv_k^F(\mathcal A_2,a_2,b_2)
\iff
(\mathcal A_1,a_1,b_1)\sim_k^F(\mathcal A_2,a_2,b_2),
$$
while for positive fragments, one-sided indistinguishability is characterized by the corresponding $(F,k)$-simulation [1210.2688].

For finite structures, the degree-bounded refinement stabilizes, yielding Hennessy–Milner-style characterizations for the full fragment. The paper also gives polynomial-time decidability for indistinguishability of finite marked structures in fixed fragments. Here, “relative” is tied to expressivity: the bisimulation clauses are exactly strong enough to preserve the operators admitted by the chosen fragment.

## 5. Coalgebraic Relative Bisimulation and Relators

In coalgebraic semantics, relative bisimulation is the relation-lifting-based notion associated with a functor. For a functor $B:C\to C$, coalgebras $(X,h)$ and $(Y,k)$, and a relation $R\subseteq X\times Y$, the Hermida–Jacobs condition is
$$
R \le (h\times k)^{-1}(\overline{B}(R)),
$$
equivalently: if $(x,y)\in R$ then $(h(x),k(y))\in \overline{B}(R)$. The paper “Relating coalgebraic notions of bisimulation” identifies this as the notion most commonly called relative bisimulation and denotes it as HJ-bisimulation [1101.4223].

That paper studies four coalgebraic generalizations: Aczel–Mendler bisimulation, HJ-bisimulation, AM-precongruence, and kernel bisimulation. It proves the implication chain
$$
\text{AM-bisimulation} \Rightarrow \text{HJ-bisimulation} \Rightarrow \text{AM-precongruence},
$$
and then provides structural conditions under which the notions coincide. In particular, if $B$ preserves weak pullbacks, every kernel bisimulation is an AM-bisimulation; under the standard accompanying hypotheses, the four notions coincide with behavioral equivalence, and the greatest relative bisimulation can be obtained by transfinite refinement
$$
R_{\alpha+1}=\Phi_{HJ}(R_\alpha),\qquad
R_\lambda=\bigcap_{\beta<\lambda} R_\beta
$$
starting from $R_0=X\times Y$ [1101.4223].

A later generalization replaces relation liftings by relators or lax extensions. For a set endofunctor $F$ and an $F$-relator $R$, a relation $r:X\rightsquigarrow Y$ between coalgebras $a:X\to FX$ and $\beta:Y\to FY$ is an $R$-simulation iff
$$
r \subseteq \beta^\circ \cdot Rr \cdot a,
$$
that is, $x\,r\,y$ implies $a(x)\,Rr\,\beta(y)$. When $R$ is symmetric, the resulting greatest fixed point is an $R$-bisimilarity [2502.01790].

Within this framework, soundness and completeness become properties of the chosen relator. The coBarr relator $E$ is sound and complete for behavioral equivalence when the functor preserves $1/4$-iso pullbacks. The same work shows that the expected closure properties of simulations and bisimulations characterize relator axioms such as extension of functions, laxity, symmetry, and normality, and that for functors preserving inverse images there exists a greatest normal lax extension $L_{\max}$ [2502.01790]. In this sense, coalgebraic relative bisimulation is literally bisimulation relative to a chosen lifting discipline.

## 6. Distribution-Based and Probabilistic Variants

For finite, image-finite probabilistic automata
$$
A=(S,\mathrm{Act},\to,L,\alpha),
$$
the paper on probabilistic automata introduces a distribution-based bisimulation directly on $\mathrm{Dist}(S)$. For input-enabled automata, a symmetric relation $R\subseteq \mathrm{Dist}(S)\times \mathrm{Dist}(S)$ is a bisimulation if, whenever $\mu R \nu$, two conditions hold: first, label preservation,
$$
\forall A\subseteq AP,\qquad \mu(A)=\nu(A),
$$
and second, step matching,
$$
\forall a\in \mathrm{Act},\qquad
\mu \xrightarrow{a} \mu' \Rightarrow \exists \nu'\ \text{with}\ \nu\xrightarrow{a}\nu'\ \text{and}\ \mu' R \nu'.
$$
For non-input-enabled automata, the definition is given via the input-enabled extension $A_\bot$ [1311.3396].

This notion is weaker than lifted state-based probabilistic bisimulations because it is defined directly on distributions rather than as a lifting of a state relation. The paper states that the bisimilarity relation is linear and continuous, but not left-decomposable in general. That failure of left-decomposability is exactly what allows the relation to bridge equivalence and bisimulation in Rabin’s reactive automata [1311.3396].

For reactive automata with the same action alphabet, the paper restates the Doyen–Henzinger–Raskin theorem:
$$
A_1 \text{ and } A_2 \text{ are equivalent } \iff \alpha_1 \sim_d \alpha_2,
$$
and shows that, in the direct sum automaton, its own distribution-based bisimulation coincides with $\sim_d$ on initial distributions. Thus the probabilistic relation captures Rabin’s language equivalence exactly [1311.3396].

The same work develops a discounted approximate bisimulation family $\{R_\varepsilon\}_{\varepsilon\ge 0}$ and the induced bisimulation distance
$$
D_b(\mu,\nu)=\inf\{\varepsilon\ge 0\mid \mu\sim_\varepsilon \nu\}.
$$
It proves that $D_b$ is a pseudometric, that $D_b=0$ iff $\mu\sim\nu$, and that $D_b$ coincides both with a Hennessy–Milner-style logical distance $D_l$ and with the least fixed point $D_f$ of a monotone functional on pseudometrics. The distribution-based metric is bounded above by the Kantorovich lifting of the state-based game bisimulation metric, so it is at least as coarse as the lifted state-based metric [1311.3396].

Although the paper does not define its relation under the label “relative bisimulation,” it explicitly presents the construction through that lens. The relation is relative to the observable interface given by labels and actions and, in reactive automata, to acceptance semantics.

## 7. Relational Dualities, Modal Invariance, and Conceptual Scope

A recent categorical development reconstructs bisimulation through relational extensions of Tarski and Thomason dualities. For a relation $S\subseteq X\times Y$, the lower lifting is
$$
A \Lower{S} B \Longleftrightarrow \forall x\in A.\ \exists y\in B.\ xSy,
$$
with dual upper lifting obtained from the converse. On Kripke frames $(W,R)$ and $(W',R')$, a bisimulation $Z\subseteq W\times W'$ is characterized by the relational inclusions
$$
Z\circ R' \subseteq R\circ Z,
\qquad
Z^\top \circ R \subseteq R' \circ Z^\top.
$$
These are exactly the usual forth and back conditions, written diagrammatically [2605.06533].

The algebraic side is modal: for $\Diamond_R(A)=R[A]$ and $\Box_R(A)=\{w\in W\mid R[w]\subseteq A\}$, the induced predicate transformers satisfy modal commutation laws along bisimulations. The paper constructs categories $\mathbf{FRMSIM}$ and $\mathbf{FRMBISIM}$ of frames with simulations and bisimulations, together with algebraic categories $\mathbf{CABAOSIM}$ and $\mathbf{CABAOBISIM}$, and proves the relational Thomason duality
$$
\mathbf{FRMBISIM}^{\mathrm{op}} \simeq \mathbf{CABAOBISIM}
$$
via the lower lifting [2605.06533].

The logical consequence is formula invariance: if $Z$ is a bisimulation and atomic valuations are preserved along $Z$, then for every modal formula $\varphi$,
$$
(w,w')\in Z \Longrightarrow \bigl(w\models \varphi \iff w'\models \varphi\bigr).
$$
The paper also presents a proof-theoretic reading through judgments expressing that one predicate simulates another across a relation, together with modal transport rules induced by simulations, cosimulations, and bisimulations [2605.06533].

This duality-based account sharpens the conceptual scope of relative bisimulation. In some literatures the relativity is to policies, action subsets, logical fragments, or relators; here it is to the relation induced between predicate algebras by the lower lifting. This suggests a broad unifying schema: relative bisimulation is not a single equivalence, but a method for tailoring back-and-forth reasoning to a specified semantic interface while preserving the invariants native to that interface.

Source: https://www.emergentmind.com/topics/relative-bisimulation