--- title: Invariant Domain Preservation url: https://www.emergentmind.com/topics/invariant-domain-preservation type: topic --- # Invariant Domain Preservation Invariant domain preservation denotes the requirement that an update, projection, synchronization rule, or representation map remain inside a prescribed admissible set while retaining the structural information that defines that set. Across recent literature, the phrase is used in several non-equivalent but mathematically related senses: preserving convex admissible states for hyperbolic conservation laws and stochastic differential equations; preserving regulatory state transitions across multiple synchronized domains; preserving invariant sets in Koopman-based approximations; and preserving task-relevant, causal, or anatomical content under domain adaptation and harmonization [2507.18717] [2503.13094] [2604.03844] [2312.08278] [2409.00807]. In each case, the central question is not only whether a map is accurate, but whether it respects the domain on which the underlying model or semantics remains valid. ## 1. Formal scope and recurring mathematical structure A standard numerical formulation appears for hyperbolic conservation laws \[ \partial_t \boldsymbol{u} + \nabla \cdot \boldsymbol{f}(\boldsymbol{u}) = \boldsymbol{0}, \] with a convex admissible set \[ \mathcal{A}\coloneqq\{\boldsymbol{u}\in\mathbb{R}^m:\Psi^l(\boldsymbol{u})>0,\;l=1,\dots,k\}, \] and an operator \(T\) is called invariant-domain-preserving if \(\boldsymbol{u}_h^n|_K\in\mathcal{A}\Rightarrow T(\boldsymbol{u}_h^n)|_K\in\mathcal{A}\), together with conservation of element-wise and global integrals. In recent finite-element AMR work, the admissible sets include \(\mathcal{G}_{\mathrm{Euler}}=\{\rho>0,\;p>0\}\) and \(\mathcal{G}_{\mathrm{SW}}=\{h>0\}\) [2507.18717]. For one-dimensional PAMPA schemes, the same idea is expressed through an invariant domain \(G\subset\mathbb{R}^m\), with discrete IDP inherited by SSP time integrators because SSP methods are convex combinations of forward Euler steps and \(G\) is convex [2412.03423]. A second formulation arises for bounded stochastic dynamics. For SDEs on the open hypercube \[ D := (L_1,R_1)\times \dots \times (L_d,R_d), \] the exact solution remains in \(D\) when the drift points inward at the boundary and the diffusion vanishes on \(\partial D\). Numerical invariant domain preservation is then built by explicit updates whose componentwise flows preserve left and right bounds and are combined by convex weights [2503.13094]. A third formulation is categorical in spirit. In cross-domain state synchronization, each domain is an abstract deterministic partial state machine \(\delta:S\times A\to S_\perp\), and preservation is encoded by structure-preserving maps satisfying naturality: \[ \forall s \in S_s,\; a \in A_s,\; \text{if } transition_s\, s\, a = Some\, s' \text{ then } transition_t(state\_map\, s, action\_map\, a)=Some(state\_map\, s'). \] Here the invariant object is not a positivity set but the regulatory state-transition structure itself [2604.03844]. In Koopman-based model reduction, invariant domain preservation appears through \(\lambda=1\) eigenfunctions. If \(\phi(F(x))=\phi(x)\), then the level sets \[ A_c := \{x \in X : \phi(x)=c\} \] are forward-invariant, so preserving these eigenfunctions preserves invariant domains of the dynamics [2312.08278]. ## 2. Cross-domain state synchronization and mechanized safety–liveness proofs A fully formal treatment is given for cross-domain state preservation under Byzantine faults. The development models a finite set of domains \(D\), each instantiating the locale `state_machine` with finite state set \(S\), finite action set \(A\), deterministic partial transition function \(\delta:S\times A\to S_\perp\), and terminal set \(T\subseteq S\). The assumptions include `terminal_absorbing`, `transition_closed`, and `transition_domain`. Unidirectional preservation is formalized by `state_preservation`, bidirectional roundtrip by `symmetric_state_preservation`, and \(N\)-domain consistency by `multi_domain_preservation` [2604.03844]. The core safety theorems are single-step and sequential. Sequential Preservation states that if \[ source.apply\_actions\; s\; as = Some\; s', \] then \[ target.apply\_actions\; (state\_map\; s)\; (map\; action\_map\; as) = Some\; (state\_map\; s'). \] Roundtrip guarantees are encoded as \[ \forall s \in states_s.\; state\_map\_inv(state\_map\, s)=s,\qquad \forall t \in states_t.\; state\_map(state\_map\_inv\, t)=t, \] from which injectivity of `state_map` is derived. At the multi-domain level, Cross-Domain Consistency proves that if `sync_all` succeeds and `transition s action = Some s'`, then every connected domain stores `Some s'` for that asset, while Sync Isolation proves that synchronization on asset `aid` leaves every `aid' \neq aid` unchanged [2604.03844]. The regulatory instance uses \[ reg\_state = \{ACTIVE, FROZEN, SEIZED, CONFISCATED, RESTRICTED\}, \] \[ reg\_action = \{FREEZE, SEIZE, CONFISCATE, RESTRICT, UNFREEZE, UNRESTRICT, RELEASE\}, \] with `reg_transition` defining 12 valid transitions. The global validity predicate is \[ valid\_state\; gs \equiv consistent\_state\; gs \wedge no\_locked\_without\_reason\; gs. \] Within this instance, CONFISCATED is absorbing, FREEZE propagates \(ACTIVE\to FROZEN\) across all connected chains, and `valid_state_preservation` proves that successful synchronization preserves both cross-domain consistency and lock discipline [2604.03844]. The liveness layer introduces `priority_system`, `deadlock_free_locking`, and `fair_leader_system` under the threshold \(n \ge 3f + 1\), hence \(f 0`, Starvation Bound under bounded fair-leader occurrence, and Eventual Completion by well-founded induction on `pending`. The paper’s central strengthening is that liveness discharges the honest-node assumption used by safety: deterministic conflict resolution, deadlock freedom, and starvation freedom guarantee the conditions under which the safety theorems apply, thereby promoting conditional safety to an unconditional guarantee under Byzantine faults [2604.03844]. ## 3. Hyperbolic conservation laws, AMR transfer, and high-order limiting For adaptive finite-element discretizations of hyperbolic systems, invariant-domain preservation is formulated as conservative transfer between hierarchical spaces. A three-stage projection \[ \mathcal{A}(\Omega)\xrightarrow{P_h^\sharp}\mathcal{Q}_p^\sharp(\Pi_h)^m\xrightarrow{P_h^{\mathrm{avg}}}\tilde{\mathcal{Q}}_p(\Pi_h)^m\xrightarrow{P_h^{\mathrm{red}}}\mathcal{Q}_p(\Pi_h)^m \] combines element-wise mass projection, nodal averaging, and mass redistribution with hanging-node constraints. The element-wise limited update \[ \boldsymbol{U}^{\sharp}_{i,K}=\boldsymbol{U}^{\sharp,L}_{i,K}+\sum_j \kappa\, l_{ij}^K\, \boldsymbol{P}_{ij}^K \] uses symmetric limiter coefficients \(l_{ij}^K\in[0,1]\) chosen from local convex constraints so that the result remains in \(\mathrm{conv}_{\boldsymbol{x}\in K}(\boldsymbol{u}(\boldsymbol{x}))\subset\mathcal{A}\). The resulting theorems establish conservative IDP element-wise projection, conservative IDP nodal averaging, and conservative IDP mass redistribution [2507.18717]. The method is explicit about physically relevant invariant sets. For compressible Euler, \[ \mathcal{G}_{\mathrm{Euler}}=\{\boldsymbol{U}:\rho>0,\;p>0\}, \] with \[ p(\boldsymbol{U})=(\gamma-1)\left(E-\frac{\|\boldsymbol{m}\|^2}{2\rho}\right), \] and for shallow water, \[ \mathcal{G}_{\mathrm{SW}}=\{\boldsymbol{U}:h>0\}. \] The practical significance is illustrated by benchmarks: in a dam-break problem with wetting and drying, a conservative but non-IDP projection causes the time step to collapse to \(\Delta t\sim 10^{-10}\), whereas the conservative IDP projection maintains \(\Delta t\sim 10^{-2}\); in a Sedov-like blast with JWL EOS, uniform finest level \(l=9\) requires \(114\) s on \(8\) cores, while AMR finishes in \(34.6\) s with an overall speedup factor \(\approx 3.30\) [2507.18717]. A distinct one-dimensional line of work studies PAMPA schemes. There, the decisive identity is the cell-average decomposition \[ \overline{\mathbf{U}}_{j+\frac12}^n=\frac16 \mathbf{U}_j^n+\frac46 \mathbf{U}_{j+\frac12}^n+\frac16 \mathbf{U}_{j+1}^n. \] The analysis shows that if the midpoint value leaves the invariant domain, then no uniform CFL number ensures updated cell averages remain in \(G\) for all configurations. The remedy is a local scaling limiter that moves midpoint and endpoint values toward the cell average while preserving the decomposition exactly. For cell averages, the IDP proof requires an IDP numerical flux and the CFL bound \[ \lambda_{\max}\frac{\Delta t^n}{\Delta x_{j+\frac12}}\le \frac16. \] For point values, the paper proposes an automatic limiter-free reformulation inspired by Softplus and Clipped ReLU. In the Euler case, one sets \[ \rho=\rho_{\rm ref}\ln(1+e^q)>0,\qquad p=\rho^\gamma e^s>0, \] so that any point update in \((q,v,s)\)-variables maps back into the positivity set [2412.03423]. A more general 2026 framework treats high-order FV and DG discretizations under explicit and implicit time integration. It limits antidiffusive fluxes around a low-order solution known to preserve all invariant domains and defines coefficients so that the limited solution is a convex combination of invariant-domain-preserving quantities. The construction generalizes flux-corrected transport to systems of conservation laws, supports explicit or implicit Runge–Kutta and time DG integration, and can be iterated to refine the limited solution toward the high-order one while preserving invariant domains [2605.08038]. ## 4. Stochastic differential equations and compressible Navier–Stokes For SDEs with diagonal diffusion on a bounded hypercube, invariant-domain preservation begins at the continuous level. The exact system \[ dX_i(t)=f_i(X(t))\,dt + G_i(X(t))\,dW_i(t),\qquad G_i(y)=g_i(y)(y_i-L_i)(R_i-y_i), \] has a unique strong solution satisfying \[ \mathbb{P}\big(X_i(t)\in(L_i,R_i),\ \forall t\ge 0\big)=1 \] when \(f_i(\mathrm{Proj}_i^{L_i}(y))\ge 0\), \(f_i(\mathrm{Proj}_i^{R_i}(y))\le 0\), and \(f,g\in C^1(\bar D)\). The proof uses the Lyapunov function \[ \mathcal{V}_i(y)=\frac{1}{y_i-L_i}+\frac{1}{R_i-y_i}. \] The numerical construction then builds two positivity-preserving flows per component, one guaranteeing \(Y_i^L(t_{n+1})>L_i\) and one guaranteeing \(Y_i^R(t_{n+1})0,\ e(U)>0\}, \] and for the hyperbolic substep one refines this to \[ C(U_0):=\{U:\rho>0,\ e>0,\ s(\rho,e)\ge s_{\min}\}, \] whereas for the parabolic substep one uses \[ D(U_0):=\{U:\rho>0,\ e\ge e_{\min}\}. \] The fully discrete method is second-order accurate in time and space, semi-implicit, and guaranteed to be invariant domain preserving under the standard hyperbolic CFL condition \(\tau\lesssim \mathcal{O}(h)/V\) [2009.06022]. The hyperbolic half-steps are explicit and use graph viscosity, auxiliary bar states, and convex limiting to preserve density positivity and an entropy lower bound. The parabolic full step freezes density, advances velocity by Crank–Nicolson, and updates internal energy by a backward-Euler low-order solve together with a Crank–Nicolson high-order correction limited by FCT. The discrete minimum principle gives \[ \min_i e_i^{n+1}\ge \min_i e_i^n, \] and the total-energy update \[ E_i^{n+1}=\rho_i^{n+1} e_i^{n+1}+\frac12 \rho_i^n\|V_i^{n+1}\|^2 \] satisfies a discrete source-work identity. The key distinction from explicit positivity-preserving Navier–Stokes schemes is that no parabolic restriction \(\Delta t\lesssim \mathcal{O}(h^2)/\mu\) is imposed [2009.06022]. ## 5. Koopman approximations and invariant sets in data-driven dynamics In Dynamic Mode Decomposition and EDMD, the central preserved property is usually linearity of the Koopman operator. “Invariant Consistent Dynamic Mode Decomposition” extends this by preserving functional relationships among observables and consistency along geometric invariants. For a deterministic autonomous system \(x_{t+1}=F(x_t)\), Koopman eigenfunctions satisfy \[ \mathcal{K}\phi=\lambda \phi,\qquad \phi(F(x))=\lambda \phi(x). \] When \(\lambda=1\), \(\phi\) is invariant along trajectories, and the level sets \[ A_c=\{x\in X:\phi(x)=c\} \] are forward-invariant [2312.08278]. The constrained regression imposes \[ A D = \bar D,\qquad E^H A = \bar E^H, \] together with linearized functional constraints such as \[ LAX=0. \] Under compatibility and rank assumptions, the feasible set admits the explicit parametrization \[ \mathcal{A}=\{A_0 + E^\perp \tilde A (D^\perp)^H\}, \] so the constrained least-squares problem reduces to a smaller problem in the nullspaces. The computational overhead is described as minimal and primarily due to the linearity of constraints [2312.08278]. The payoff is an exact or approximate enforcement of \(\lambda=1\) eigen-relations on selected invariant samples. If \(\bar D=\lambda D V\), then \[ A_{IC} D V = \lambda D V, \] and left eigenvectors \(W^H\) satisfy \[ W^H A_{IC}=\lambda W^H,\qquad W^H D V=I. \] For \(\lambda=1\), the rows of \(W^H\) approximate invariant observables whose level sets delineate invariant domains. The framework also subsumes Affine DMD, by preserving the constant eigenfunction, and Higher-order DMD, by preserving delay-shift relationships. Numerical evidence is given on one-dimensional multistable systems, a Duffing oscillator, and competing limit cycles, where IC-DMD improves constancy of the induced \(\lambda=1\) eigenfunctions on invariant sets relative to vanilla EDMD [2312.08278]. ## 6. Domain-invariant representations, harmonization, and factor preservation In multi-domain neuroimaging harmonization, invariant domain preservation means removing scanner- or site-specific variability while preserving biological and anatomical content. A diffusion-based framework does this by learning a domain-invariant anatomical condition \(Y=C(X_0,Z_{\mathrm{source}})\) and combining it with domain embeddings \(Z\) through AdaIN-modulated layers in a conditional DDPM. The losses are \[ L_{\mathrm{noise}} = |\tilde\epsilon_t-\epsilon_t|,\qquad L_{\mathrm{recon}} = |\tilde X_0-X_0|,\qquad L_{\mathrm{cond}} = |Y-canny\_edge|, \] with \(L_{\mathrm{total}}=L_{\mathrm{noise}}+L_{\mathrm{recon}}+L_{\mathrm{cond}}\). The model uses a fixed \(T=100\)-step schedule, and the proposed “skip sampling” re-noises a target-style sample to \(t=20\) before standard reverse sampling [2409.00807]. Empirically, the method is evaluated on ADNI 1 and ABIDE II. On ABIDE II, the learned-condition model improves FID relative to GAN baselines in several harmonizations; for Others\(\to\)GU, the reported scores are CycleGAN \(=18.4\), Seg-Renorm \(=15.2\), Ours (edge map) \(=30.6\), and Ours (learned) \(=12.1\). On ADNI 1, downstream PVS count ratio distributions become consistent across all scanners after harmonization to a common scanner style, and t-SNE plots of the domain embeddings collapse from three separated clusters to a single cluster after harmonization [2409.00807]. In multi-source domain adaptation, “preservation” can mean preserving selected task-relevant domain factors rather than erasing them. Factor-Preserving Domain Adaptation modifies adversarial training by masking the domain loss so that competition is restricted to domains sharing a chosen factor value. On CORe50, the selected factor is “hand side,” identified from PCA on one-to-one transfer matrices. With unsupervised target data, FP-DA reports average accuracy \(91.83\%\) and minimum accuracy \(86.8\%\), compared with \(89.87\%\) and \(85.7\%\) for standard adversarial DA with target data, and \(89.78\%\) and \(75.3\%\) for no DA. The paper’s interpretation is that removing all domain factors can cause negative transfer when a domain factor is simultaneously task-informative or visually close to the object [2010.07783]. These practical systems share a direct design principle: the invariant component is represented explicitly and is not inferred solely by global domain confusion. In neuroimaging it is the learned anatomical condition \(Y\); in FP-DA it is a factor-consistent grouping that switches off adversarial competition across selected domains [2409.00807] [2010.07783]. ## 7. Theoretical critiques, causal structure, and preserver problems Recent theory makes clear that invariant domain preservation in representation learning is not equivalent to indiscriminate domain invariance. “Support and Invertibility in Domain-Invariant Representations” shows that classical discrepancy bounds do not account for information lost in non-invertible representations and that strict domain invariance can be too strong. The paper introduces a support sufficiency divergence \[ d^\epsilon_{\mathrm{supp}(p,q)} \] and an explicit non-invertibility cost \[ \eta^\ell_\phi(f,Y), \] leading to the bound \[ R_t(f\circ\phi)\le \mathbb{E}_{p_s}\!\left[w_{p_s,p_t}^\epsilon(z)\,\ell(f(z),y)\right] + M\, d^\epsilon_{\mathrm{supp}(p_s(z),p_t(z))} + \eta^\ell_\phi(f,Y). \] The central claim is that penalizing distance between densities is often wasteful, whereas support coverage and information retention are the relevant control quantities [1903.03448]. A causal reformulation reaches a related conclusion. Under the CISA model, invariant structure is the counterfactually invariant part \(X^\perp_z\) of the features, and the correct observable invariance depends on the causal subtype: anti-causal problems support \(\phi(X)\perp E\mid Y\), confounded-outcome problems support \(\phi(X)\perp E\), and confounded-descendant problems support \(Y\perp E\mid \phi(X)\). The paper argues that using the wrong invariance notion can contradict the true invariant structure, and that IRM is justified only in confounded-descendant settings, while anti-causal settings require generalized IRM with label-prior reweighting [2208.06987]. A separate analytical line recasts invariant risk minimization itself. “Invariant Risk Minimization Is A Total Variation Model” proves that the standard IRM surrogate is a TV-\(\ell_2\) model on the learning risk as a function of the classifier variable \(w\), \[ \min_\phi\ \mathbb{E}_w\!\Big[R(w\circ\phi)+\lambda |\nabla_w R(w\circ\phi)|^2\Big], \] and proposes a TV-\(\ell_1\) variant whose coarea geometry promotes piecewise-constant dependence of the risk across environments. The paper states that TV-\(\ell_1\) has robust performance in denoising and invariant feature preservation, and its synthetic ablations report a larger fraction of total weight assigned to invariant features than TV-\(\ell_2\) [2405.01389]. In copula theory, the preserver problem is sharper: the copula of a continuous random vector is preserved unchanged under strictly increasing marginal transformations, whereas decreasing transformations generally produce reflected or survival copulas, and direct argument transformations \(C\circ T\) preserve 2-increasingness but typically destroy uniform marginals unless \(T\) is the identity. The paper’s formulation is that copula property is preserved uniquely under increasing transformations, which places invariant domain preservation in the older tradition of preserver problems rather than only in numerical analysis or machine learning [1908.10181]. Taken together, these results rule out a common misconception: preservation is not synonymous with maximal invariance. In numerical analysis, the admissible set is usually convex and explicit; in synchronization, the preserved object is a transition structure; in operator learning, it is an invariant set encoded by \(\lambda=1\) eigenfunctions; in representation learning, preservation may require support sufficiency, invertibility, causal alignment, or explicit factor retention rather than complete domain erasure [1903.03448] [2208.06987] [2405.01389] [1908.10181]. Source: https://www.emergentmind.com/topics/invariant-domain-preservation