---
title: 'State-Preserving Growth: Invariants in Expansion'
url: https://www.emergentmind.com/topics/state-preserving-growth
type: topic
---

# State-Preserving Growth: Invariants in Expansion

State-preserving growth denotes a mode of expansion in which a system grows, scales, or evolves while retaining the structural properties that define an admissible state. In recent arXiv usage, the preserved object varies sharply by field: conserved mass and dissipative energy laws in diffuse-interface tumour models, learned inter-module interfaces in sparse mixture-of-experts language models, invariant firm-size tails on balanced growth paths, and compact authenticated summaries that prevent linear on-chain state blow-up in automated market makers [2509.14486] [2606.07404] [1012.0199] [2406.17094].

## 1. Semantic range and unifying idea

The term has no single canonical definition across disciplines. In tumour-growth numerics, it refers to exact preservation of mass conservation and energy dissipation, together with boundedness or maximum-bound principles for state variables. In large-model systems, it means preserving learned interfaces during architectural expansion. In economics and spatial demography, it denotes growth paths that keep a distributional state invariant or pull it back toward balance. In transaction systems and graph processes, it refers to scaling while preventing uncontrolled state-size growth or while leaving prescribed combinatorial invariants unchanged [2509.14486] [2606.07404] [1012.0199] [2601.10444] [2406.17094] [2204.07423].

| Domain | Preserved state | Growth mechanism |
|---|---|---|
| Diffuse-interface tumour models | Mass conservation, energy dissipation, bounds or \(L^\infty\) control | Aggregation, chemotaxis, tumour evolution |
| Sparse MoE language models | Learned interfaces, routing health, activation-memory flatness, bounded optimizer state | Dense\(\rightarrow\)MoE, shallow\(\rightarrow\)deep, few\(\rightarrow\)many experts |
| Firm-size and population growth | Invariant tail law or balanced cross-state distribution | Balanced growth, conditional convergence, spillovers |
| AMMs and graph growth | Controlled ledger state or preserved existing degrees | Traffic scaling, DPG vertex insertion |

This suggests a unifying template: growth is permitted provided invariants, interface contracts, or feasibility constraints are preserved. What changes across fields is the ontology of the preserved state. In PDEs it is thermodynamic or invariant-region structure; in ML systems it is the functional contract between modules; in economics it is the shape of a distribution or a balanced allocation rule; in discrete systems it is a ledger or degree sequence.

## 2. Thermodynamic and bounded-state growth in tumour models

In diffuse-interface tumour-growth models, state-preserving growth is formulated most explicitly as exact compatibility between the continuous PDE structure and the fully discrete solver. A representative system couples a Cahn–Hilliard-type equation for tumour cell volume fraction \(u\) with a nonlinear reaction-diffusion equation for nutrient concentration \(n\), with chemical potentials
\[
\mu = -\epsilon^2 \Delta u + \lambda u - \chi_0 n + f'(u), \qquad
\sigma = \delta^{-1} n - \chi_0 u,
\]
and free energy
\[
\mathcal{E}[u,n]
:= \int_{\Omega} \left( \frac{\epsilon^2}{2}|\nabla u|^2 + \frac{\lambda}{2}u^2 + f(u) + \frac{1}{2\delta}n^2 - \chi_0\,u\,n \right)\,dx .
\]
The continuous system satisfies
\[
\frac{d}{dt}\,\mathcal{E}[u,n]
= -\|\nabla \mu\|_{L^2(\Omega)}^2 - \|\nabla \sigma\|_{L^2(\Omega)}^2 - \| \sqrt{P(u)}(\sigma-\mu)\|_{L^2(\Omega)}^2 \le 0,
\]
together with conservation of \(\int_\Omega (u+n)\,dx\). The fully discrete SAV-based finite-element scheme is linear, unconditionally energy-stable, mass-preserving, and first-order accurate in time with optimal-order accuracy in space; under suitable regularity assumptions it satisfies
\[
\|u_h^k-u(t_k)\|_{H^s} + \|\mu_h^k-\mu(t_k)\|_{H^s}
+ \|n_h^k-n(t_k)\|_{H^s} + |r_h^k-r(t_k)|
\le C(h^{q+1-s}+\tau), \quad s\in\{0,1\},
\]
and also derives \(L^\infty\) estimates that control nonlinear growth dynamics [2509.14486].

A second formulation incorporates surrounding fluid through Darcy’s law,
\[
\boldsymbol{v} = -K\left(\nabla p + u\,\nabla \mu_u + n\,\nabla \mu_n\right), \qquad \nabla\cdot \boldsymbol{v}=0,
\]
and couples advection, degenerate mobilities, chemotaxis, and reaction terms. Its continuous energy law contains the additional dissipation \(\frac{1}{K}\int_\Omega |\boldsymbol{v}|^2\), while the discrete upwind DG plus convex-splitting scheme inherits mass conservation, pointwise bounds \(0\le u,n\le 1\), and a discrete energy inequality. The paper emphasizes that these properties are not incidental numerical side effects but the organizing principle of the discretization: local incompressibility, monotone upwind fluxes, and special mobility splittings are chosen precisely so that the discrete dynamics remains within the physically admissible state set [2605.21716].

A related phase-field model with extracellular matrix degradation generalizes the preserved state further. There the evolving variables are tumour fraction \(\phi_T\), necrotic fraction \(\phi_N\), nutrient \(c\), MDE \(m\), and ECM density \(e\). The numerical objective is to preserve the maximum bound principle for \(c\) and \(m\), preserve bounds for \(e\), \(\phi_T\), and \(\phi_N\), and keep \(\phi_V=C(\phi_T)-\phi_N\) in \([0,1]\). The ETDRK construction uses stabilizing linear operators for the PDE components, trapezoidal updates for the ODE components, and a single cut-off \(C(\phi_T)=\max(0,\min(1,\phi_T))\) after each ETD stage. Under the stated parameter conditions, it yields unconditional discrete MBP for nutrient and MDE, while \(e\) and \(\phi_N\) remain bounded under the stated time-step restrictions [2503.18699].

Taken together, these works define state-preserving growth in tumour modelling as growth under thermodynamic consistency, invariant-region control, and discretization-induced nonphysical-state exclusion. This suggests that, in this literature, the phrase is less about monotone increase in tumour size than about preserving admissible evolution during aggregation, chemotaxis, necrosis, and fluid-mediated transport.

## 3. Interface-preserving scaling in sparse mixture-of-experts models

In large-scale language-model systems, the term is used in a fundamentally different but equally technical sense. “State-preserving growth” is defined as “the preservation of learned interfaces” across model expansions: a larger model should begin from a state that already functions, rather than relearning what the smaller model knew. The preserved state includes learned functions and weights, routing distributions and router state, optimizer state where applicable, and layer-local or recurrent state. LightningLM 0.1V implements this principle in a four-stage lineage: a 2B dense seed, a 5B MoE, a 9B MoE, and a 120B MoE with 460 routed experts plus 1 shared expert under top-12 routing. Verified counts rise from 1.78B active and stored parameters at the dense seed to 5.93B active per token and 118.67B stored parameters at 120B; the released 120B checkpoint reports trailing-100 training loss \(1.78\) at step \(5161\) on a single 8-GPU node [2606.07404].

The preservation rules are concrete. For dense\(\rightarrow\)MoE conversion, the trained dense FFN is copied exactly into an always-active shared expert, while routed experts are initialized by overlapping random partitions of the dense intermediate neurons. For shallow\(\rightarrow\)deep expansion, the 8\(\rightarrow\)20 layer mapping “1–8, 1–4, 1–8” is selected so that the deeper stack still terminates on the original terminal layer \(L7\), preserving the hidden-state distribution expected by the LM head. For few\(\rightarrow\)many experts, each of the 20 source experts is cloned into 23 variants, with “drop-upcycling” reinitializing half of intermediate positions while reusing the same mask across gate/up/down weights. Routing symmetry is then broken by router tiling plus small bias noise \(\sigma=0.05\), together with probabilistic early selection so that near-duplicate clones receive gradients before hard top-\(k\) routing collapses onto a single winner [2606.07404].

The paper also treats state preservation as a systems constraint. Reversibility keeps activation memory approximately flat with depth through the midpoint update
\[
x_{l+1} = x_l + \delta_l\!\left( x_l + \tfrac12\,\delta_l(x_l) \right),
\]
with backward reconstruction instead of stored activations. TQP bounds optimizer-state growth through
\[
W \approx Q(W) + U V^\top,\qquad r=16,
\]
so that Adam moments are carried only on adapters. Since experts alone exceed 100B parameters, naive Adam would require approximately \(800\) GB for expert moments, whereas the adapter-only optimizer state is approximately \(18\) GB, a reduction of about \(45\times\) [2606.07404].

A notable feature of this usage is its emphasis on silent failure. Spectral or SVD upcycling destroys the dense function and yields “near-random cold loss” at step 1; non-strict checkpoint loading can leave target parameters random while cheap checks still pass; hard top-\(k\) routing over near-duplicate clones produces dead experts and clone-family collapse. The corrective actions—strict target-keyspace loading, function-preserving initialization, router retuning, and probabilistic early selection—are presented as state-preserving requirements rather than optional heuristics. Here growth is architectural and parametric, but what is preserved is the operational contract among modules.

## 4. Distribution-preserving and convergence-preserving growth in economics and demography

In stochastic growth theory, state-preserving growth is explicitly distributional. In a reduced-form model of firm dynamics, firms are born according to \(\nu(t)=\nu_0 e^{dt}\), entrants arrive with initial size \(s_0^i=s_{0,i}e^{c_0 t_i}\), incumbents follow geometric Brownian motion,
\[
dS_i(t)=S_i(t)(\mu\,dt+\sigma\,dW_i(t)),
\]
and exit occurs either at an efficiency threshold or by size-independent hazard \(h\). The upper tail of the firm-size distribution is asymptotically Pareto with exponent
\[
m := \frac12 \left[ \left(1 - \frac{2(\mu - c_0)}{\sigma^2}\right) + \sqrt{ \left(1 - \frac{2(\mu - c_0)}{\sigma^2}\right)^2 + \frac{8(d + h)}{\sigma^2} } \right].
\]
Zipf’s law, \(m=1\), holds if and only if
\[
\mu - h = d + c_0 .
\]
That equality is the balance condition equating the effective growth of incumbents and the growth of investment into entrants, and it is also the condition for maximum sustainable growth of aggregate size. In this setting, state-preserving growth means that the economy scales while preserving the cross-sectional shape of the firm-size distribution [1012.0199].

A different mechanism appears in the human-capital redistribution model. Individual human capital evolves by a stochastic multiplicative process; when \(\mathbb{E}[\ln \eta]<0\), individual human capital is destroyed in the long run. Taxation at rate \(\tau\) with administrative loss rate \(\kappa\) pools risk through equal redistribution of the surviving public good. The aggregate law is
\[
Y(t+1)=\big(1-\kappa\,\tau\big)\sum_{i=1}^N \eta_i(t)\,y_i(t),
\]
and the paper interprets the resulting improvement in long-run growth as a portfolio effect. Progressive taxation yields the highest growth-maximizing \(g_{\max}(\kappa)\), proportional taxation is second, and regressive taxation is last; by contrast, a government maximizing revenue under the model may prefer regressive taxation because it supports a higher growth-optimal tax rate, even though it delivers lower growth [1210.3716].

Spatial demography uses the term in yet another way. In a dynamic spatial panel for 49 U.S. states over 1965–2017, with data-inferred network \(\widehat{\mathbf W}\), heterogeneous slopes, IV estimation, and interactive fixed effects, state-preserving growth refers to growth dynamics that pull the cross-state population distribution back toward balanced levels. The paper reports that \(73.5\%\) of states have \(\delta_i<0\) in \(\Delta \ln Pop_{it} = \delta_i \ln Pop_{i,t-1} + \cdots\), while a smaller cluster mildly diverges. Under MGIV with \(\widehat{\mathbf W}\), the mean convergence coefficient is \(\delta \approx -0.051\) with implied half-life approximately \(13.3\) years, and indirect spillover effects are roughly one-third of total impacts. The preferred network is sparse, about \(0.66\%\) dense, but diffusion reaches beyond contiguous neighbors through higher powers of \(\mathbf W\) [2601.10444].

Across these economic and demographic uses, the preserved state is not a conserved scalar but a balanced distributional configuration. This suggests that state-preserving growth, in these settings, is a doctrine of scale without distributional destabilization.

## 5. State-size control and combinatorial invariants in discrete systems

In automated market makers, state-preserving growth is tied to ledger scalability. ammBoost splits functionality between a minimal L1 TokenBank contract and a purpose-built sidechain. Swaps, mints, burns, and collects are executed on the sidechain and summarized at fixed epochs into concise per-user and per-position aggregates; the summary is then authenticated to L1 through a threshold BLS signature. If \(N_{\text{ops}}\) is the number of sidechain operations in an epoch, \(U\) the number of active users, and \(P\) the number of positions touched, the reduction in L1 writes is from \(O(N_{\text{ops}})\) to \(O(U+P)\), with compression ratio
\[
CR=\frac{N_{\text{ops}}}{U+P}.
\]
After Sync is confirmed on L1, the sidechain prunes temporary meta-blocks and retains only permanent summary-blocks. In the reported evaluation, throughput rises to \(242.35\) tx/s at \(25M\) daily volume, approximately \(500\times\) Uniswap daily traffic; for \(V_D=500K\), gas cost reduction versus Uniswap on Sepolia is \(94.53\%\), and mainchain state growth reduction is \(80.25\%\) versus Sepolia and \(92.80\%\) versus Uniswap on production Ethereum. The paper formalizes this as preserving AMM safety and liveness while preventing state growth proportional to transaction count [2406.17094].

Graph theory supplies a purely combinatorial analogue. In Degree-Preserving Growth, a new vertex is inserted into a simple graph by choosing a \(k\)-matching \(M\), deleting the \(k\) matched edges, and connecting the new vertex to all \(2k\) endpoints. The new vertex has degree \(2k\), while every existing vertex preserves its degree because it loses one incident edge and gains one edge to the new vertex. In degree-sequence language, if \(\pi\) is a non-increasing graphic sequence and \(\delta\in\mathbb N\) with \(1\le \delta\le n/2\), then \(\pi\cup\{2\delta\}\) is graphic if and only if some realization of \(\pi\) has a matching of size \(\delta\). The paper further identifies the potential matching number \(\nu^\ast(d)\) and forcible matching number \(F(d)\) as sequence-level capacities for such insertions [2204.07423].

These two uses sit at different levels of abstraction but share a common logic. ammBoost preserves operational correctness while changing the storage geometry of transaction execution; DPG preserves the entire degree profile of existing vertices while adding a new one. In both cases, growth is feasible only because the update rule is engineered to leave designated state variables invariant.

## 6. Mathematical extensions, misconceptions, and open directions

The phrase should not be read as implying static behavior. In conservative surface dynamics, area preservation can coexist with arbitrarily fast growth of periodic-point counts. For open subsets of real-analytic Hamiltonian diffeomorphisms of \(T^2\), maps with
\[
\limsup_{n\to\infty}\,\frac{\min\{\#\mathrm{Per}_h(f,n),\#\mathrm{Per}_e(f,n)\}}{\gamma_n}=\infty
\]
are dense for any given sequence \((\gamma_n)\); in smooth area-preserving dynamics on closed surfaces, the analogous fast growth is \(C^\infty\)-typical in an open set [1603.08639]. Preservation of measure or symplectic structure therefore does not suppress combinatorial or orbit-complexity growth.

A second misconception is that state preservation must always be exact positivity or exact boundedness. The tumour-model literature distinguishes several levels: exact conservation of \(\int_\Omega (u+n)\,dx\), discrete energy decay, pointwise bounds \(0\le u,n\le 1\), continuous MBP for transformed variables, and \(L^\infty\) bounds derived by analysis rather than by hard constraints [2509.14486] [2605.21716] [2503.18699]. The preserved state is therefore model-dependent: exact invariant, invariant region, modified-energy law, or boundedness estimate.

More abstractly, geometry offers a threshold formulation. For a complete Riemannian manifold \((M,g)\) and conformal change \(\tilde g=\phi^2 g\), completeness is preserved if and only if \(\phi\) is not \(L^1\) on any \(g\)-divergent curve. In radial terms, decay like \(1/r\) is critical: \(\phi(r)\approx 1/r\) still preserves completeness, whereas \(\phi(r)\approx 1/r^{1+\varepsilon}\) or \(\phi(r)\approx e^{-r}\) yields incompleteness and even finite \(\tilde g\)-diameter [1202.5437]. This provides a mathematically sharp example of state-preserving growth or decay controlled by an integral threshold rather than a conservation law.

Open directions in the current literature are correspondingly domain-specific. In tumour numerics, proposed extensions include higher-order time stepping such as BDF2-SAV and Crank–Nicolson-SAV, adaptive meshes, logarithmic potentials, and multi-species couplings such as Cahn–Hilliard–Brinkman, Navier–Stokes, or Keller–Segel variants [2509.14486]. In Darcy-coupled DG schemes, the stated limitations include lowest-order scalar spaces, mesh orthogonality assumptions, and the absence of an error analysis, with anisotropic media, 3D simulations, and richer couplings listed as extensions [2605.21716]. In large-model systems, open questions include formal capacity control at very high expert counts, mechanistic conditions under which periodic merge-and-reset succeeds or diverges at scale, and generalization of DroPE in recurrence-backbone hybrids [2606.07404]. In spatial growth econometrics, external validity beyond 1965–2017 U.S. data requires replicating data-driven network recovery and IV with interactive fixed effects [2601.10444].

State-preserving growth is therefore best understood not as a single theory but as a recurrent research pattern: permit expansion only through update rules that preserve the state variables, invariants, or interface contracts deemed structurally essential. Across PDEs, ML systems, economics, spatial panels, blockchains, graphs, dynamics, and geometry, the phrase marks the same methodological ambition: scaling without loss of the laws that make the evolving state interpretable.

Source: https://www.emergentmind.com/topics/state-preserving-growth