---
title: Capacity-Stability Trade-off
url: https://www.emergentmind.com/topics/capacity-stability-trade-off
type: topic
---

# Capacity-Stability Trade-off

In recent literature, the capacity–stability trade-off denotes a family of constraints in which greater storage density, memory depth, representational flexibility, throughput, or information-integration ability is obtained at the price of weaker retention, robustness, contraction, or recoverability. The precise meanings of *capacity* and *stability* are domain-specific, but the recurring structure is that useful information-carrying degrees of freedom compete with mechanisms that suppress drift, perturbation growth, or failure accumulation [2508.16236, 2507.18467, 2312.02372, 1610.03541, 2512.24245].

## 1. Formal meanings of capacity and stability

Across the cited works, capacity is operationalized in several non-equivalent but structurally related ways. In Self-Directed Channel memristors, capacity is the mutual information of a delay-dependent storage channel under an average programming-energy constraint,
\[
C_E(d)=\max_{P(R)\in\Gamma_B} I(R;\hat R),
\]
where the input is a programmed resistance state \(R\), the output is the delayed readout \(\hat R\), and \(\Gamma_B\) enforces the energy budget [2508.16236]. In Echo-State Networks, capacity is the delay-resolved memory capacity
\[
C(\tau)=1-\frac{E^{(\tau)}}{\sigma^2},
\qquad
\mathrm{MC}_{\text{tot}}=\sum_{\tau=1}^{\infty} C(\tau)\le n,
\]
where \(n\) is reservoir dimension; stability is formalized by the Echo-State Property and the Fading-Memory Property [2507.18467]. In graph neural networks, representational capacity is proxied by degrees of freedom in the parameter space, whereas stability is a Lipschitz-type robustness of the output map \(\Phi_\Theta(S,x)\) to topological perturbations of the graph shift operator \(S\) [2312.02372]. In distributed storage, capacity is the amount of source data that remains recoverable for long durations under continual failures and repairs, asymptotically bounded by
\[
C_{\text{source}} \approx \left(1-\frac{E}{2R}\right)Nc,
\]
with \(E\) the erasure rate and \(R\) the repair read rate [1610.03541, 2101.05223]. In optical quantum memory, capacity is linked to the maximal photon-number variance supported by the memory and is approximated by
\[
\mathcal{C}\simeq \ln\!\left\{ \big(4 \langle\Delta n^2\rangle_{\max}\big)^{1/2} + 1 \right\},
\]
while stability is high-fidelity state preservation over storage and driving times [2512.24245].

The stability side is equally heterogeneous. In dynamical systems it appears as contraction, negative Lyapunov exponents, or monotone decay of a Lyapunov functional [2507.18467, 1908.09446]. In storage devices it appears as retention against drift toward equilibrium [2508.16236]. In communication and infrastructure it appears as recoverability under node failures, robustness of a min-cut under variable link capacities, or protection of a primary user under interference constraints [1610.03541, 2507.14852, 1810.08251]. This suggests a unifying pattern: capacity is always computed under an explicit channel, dynamical, or recoverability constraint, and stability determines how sharply that feasible set contracts.

## 2. Physical memories and retention-limited storage

In SDC memristors, the trade-off is formulated as a capacity–stability–energy triangle. The memristive state is a resistance-like variable \(R\), and retention is modeled as a delay-dependent noisy channel
\[
\hat R \sim P(\hat R\mid R,D),
\]
with all states drifting toward an equilibrium resistance \(R_{\text{eq}}\approx 7.1853\times 10^6\,\Omega\). The programming cost from equilibrium is fit by
\[
\mathcal{E}(R)=\left|A\ln\left|\frac{B}{R}\right|\right|,
\]
with fitted parameters \(A=2.39506\times 10^{-4}\) and \(B=7.1853\times 10^{6}\,\Omega\). Using cGAN-generated channel estimates and cost-constrained Blahut–Arimoto optimization over \(q=100\) input and output bins, the work reports concave energy–capacity curves for 10, 50, and 100 minute delays, with \(C_E(10)>C_E(50)>C_E(100)\) at any given energy, and with capacity saturating smoothly rather than abruptly at high energy [2508.16236]. The factual implication is that stronger retention requirements collapse distinguishable levels over time even when more programming energy is available.

The optical quantum-memory setting yields a sharper analytical statement. In an EIT-based ensemble memory with disordered detuning \(\Delta_j\sim \mathcal{N}(\Delta,\delta\Delta^2)\) and disordered coupling \(g_j\sim \mathcal{N}(g,\delta g^2)\), the stored state acquires a number-dependent Berry phase. The paper shows that disordered coupling contributes to decoherence only through its correlation with detuning, not as an isolated imperfection. Averaging over disorder gives the fidelity lower bound
\[
\mathcal{F}(\tau)\ge \exp\!\left[-\frac{\Gamma_{\boldsymbol\xi_0}(\tau)}{N}\,\langle\Delta n^2\rangle\right],
\]
and, after relating \(\langle\Delta n^2\rangle_{\max}\) to the LSD capacity \(\mathcal C\), the high-reliability regime obeys
\[
1-\mathcal{F}_0 \simeq
\left(
\delta\Delta^2\, \tau_s^2
+\Delta^2 \delta g^2\, \zeta_\theta^2 \frac{\tau_d^2}{g^2}
\right)
\frac{(\exp\mathcal{C}-1)^2}{4N}.
\]
Here \(\tau_s\) is storage time, \(\tau_d\) is driving time, and \(\zeta_\theta\) depends only on the pulse shape. The result makes the trade-off explicit: at fixed disorder and atom number, raising capacity forces shorter storage or driving times if fidelity is to remain high [2512.24245].

A common misconception is that all physical imperfections contribute independently. The quantum-memory analysis rejects that view: coupling disorder alone does not decohere the dark-state protocol when \(\Delta=0\); the harmful term is the correlated \(g_j^2\Delta_j\) contribution to the random Berry phase [2512.24245]. In memristors, similarly, the limiting factor is not only programming noise but the convergence of delay-dependent output distributions toward a common equilibrium distribution [2508.16236].

## 3. Dynamical computation and machine learning

In Echo-State Networks, the trade-off is stated in dynamical-systems language. Stability is formalized by the Echo-State Property, which requires wash-out of initial conditions, and by the Fading-Memory Property, which requires geometric forgetting of remote inputs. A sufficient contraction condition is
\[
L_\varphi \|W\|_2 < 1,
\]
where \(L_\varphi\) is the activation Lipschitz constant and \(W\) is the reservoir matrix. Capacity is quantified by the memory-capacity spectrum \(C(\tau)\) and the total bound \(\mathrm{MC}_{\text{tot}}\le n\). The paper identifies three regimes: too contractive (\(\|W\|_2L_\varphi\ll 1\)), where memory is shallow and concentrated at short delays; too expansive, where ESP can fail and positive Lyapunov exponents make memory irreproducible; and a near-critical regime with \(\lambda_{\max}\to 0^{-}\), where ESP and FMP still hold but forgetting is slow enough to spread capacity over longer delays [2507.18467]. The trade-off is therefore not between stability and instability in the abstract, but between useful long-range memory and the contraction margin required for reproducible computation.

Continual learning gives a parameter-space version of the same dilemma. Auxiliary Network Continual Learning introduces a frozen old network \(\theta_{1:t-1}^*\), a plastic auxiliary network \(\theta_t^*\) trained only on the current task, and a main network trained with
\[
\mathcal{L}_{\text{ANCL}}
=
\mathcal{L}_t(\theta)
+
\Omega(\theta;\theta_{1:t-1}^*,\lambda)
+
\Omega(\theta;\theta_t^*,\lambda_a).
\]
For EWC- and MAS-type regularizers, the resulting optimum is an interpolated parameter target between old and auxiliary solutions, weighted by \(\alpha=\eta\lambda F_{1:t-1,i}\) and \(\beta=\eta\lambda_a F_{t,i}\). For LFL and LwF, the interpolation appears in feature or logit space. The paper’s analyses with weight distance and CKA show that tuning \(\lambda_a\) moves the main solution continuously between stability and plasticity, and that the best-performing solutions are those whose representations are closest to the multitask solution rather than to either extreme. On the reported benchmarks, ANCL improves strong baselines by roughly \(1\%\)–\(3\%\) absolute in both task-incremental and class-incremental settings [2303.09483].

These two cases expose complementary mechanisms. In ESNs, stronger stability consumes dynamical degrees of freedom by enforcing contraction [2507.18467]. In continual learning, stronger stability consumes parameter degrees of freedom by preventing reuse of weights needed for new tasks [2303.09483]. In both, the highest utility lies neither at maximal rigidity nor at unconstrained plasticity.

## 4. Graph structure, higher-order organization, and criticality

For graph neural networks, the trade-off is formulated between representational capacity and robustness to graph perturbations. The EdgeNet framework unifies more than twenty architectures, including convolutional, attention-based, graph isomorphism, and hybrid models. Capacity is proxied by parameter-space degrees of freedom: classical graph convolutions use one scalar per shift, node-varying models use one parameter per node per hop, and fully edge-varying models use one parameter per edge per hop. Stability is expressed through bounds of the form
\[
\|\Phi_\Theta(S,x)-\Phi_\Theta(\tilde S,x)\|_2
\le
C_{\text{net}}(\Theta,S)\,\|E\|_2\,\|x\|_2 + \mathcal O(\|E\|_2^2),
\]
for relative topological perturbations \(\tilde S = S + ES + SE\). The key mechanism is eigenvector misalignment between parameter matrices and the graph shift operator. The stability constants obey
\[
C_{\text{SI}} = 2\sqrt{n}C_L
<
C_{\text{ES}} = 2\sqrt{n}(1+n\varepsilon)C_L
<
C_{\text{Edge}} = 2\sqrt{n}(1+2n\varepsilon)C_L,
\]
so more flexible and less spectrally aligned architectures are less stable. This makes the trade-off quantitative: greater representational freedom enlarges the space of realizable graph operators but worsens transferability under topology change [2312.02372].

A different but related formulation appears in evolved Boolean networks. There, the paper contrasts redundancy-dominated, synergy-dominated, and Tononi–Sporns–Edelman-complex networks. Capacity is the integrated-information quantity \(\Phi^R\), while stability is measured through attractor counts, transient lengths, and the Derrida coefficient \(D\). High-synergy systems are reported as unstable and chaotic, with \(D = 2.155 \pm 0.108\) and \(\Phi^R \approx 3.67 \pm 1.45\) bits; redundant systems are extremely stable, with \(D = 1.027 \pm 0.156\) and \(\Phi^R \approx 0.16 \pm 0.31\) bits; TSE-complex systems lie in between, with \(D \approx 1.428 \pm 0.103\) and \(\Phi^R \approx 1.08 \pm 0.54\) bits [2401.14347]. The paper’s claim is direct: high-synergy systems are unstable and chaotic but have high information-integration capacity, whereas redundant systems are very stable but computationally impoverished.

A plausible implication is that several “edge-of-chaos” narratives in machine learning and complex systems are specific instances of the same structural pattern. The ESN result ties useful memory to \(\lambda_{\max}\approx 0^{-}\) [2507.18467], while the Boolean-network study places TSE-complex systems between redundant order and synergistic chaos [2401.14347]. The common theme is not maximal instability, but marginal stability that preserves distinguishability without collapsing trajectories too quickly.

## 5. Communication, storage infrastructure, and network control

Distributed storage systems make the trade-off fully operational. With \(N\) unreliable nodes of capacity \(c\), erasure rate \(E\), and repair read rate \(R\), the asymptotic source-data capacity is
\[
C_{\text{source}} \approx \left(1-\frac{E}{2R}\right)Nc.
\]
The converse states that asymptotically no system can exceed this amount, and the liquid and advanced liquid repairers asymptotically achieve it. The threshold interpretation is sharp: if \(R < E/2\), asymptotic capacity collapses to zero; increasing \(R\) raises the storable fraction of \(Nc\) by reducing the redundancy needed for long-term recoverability [1610.03541, 2101.05223]. Here, stability means continued recoverability under random failures, and capacity is exactly the usable payload that survives those failures.

In a stochastic fold model of traffic flow, the same phrase refers to a different mechanism. Capacity is the maximum stationary flow in the fundamental diagram, while stability is the asymptotic stability of free-flow and congested regimes. A deterministic fold model yields a continuous two-phase diagram without capacity drop. Introducing multiplicative stochastic noise in a single transition coefficient produces two opposing effects: it extends the stochastic stability region of the free-flow state beyond the deterministic fold point, but it also induces large variance in the congested regime and generates an inverse-\(\lambda\) capacity drop. The analysis identifies an effective stochastic fold \(N_c' > N_c\) and derives stationary mean and variance for the slow-state population when \(R_0^s>1\) [2503.15717]. This case is important because it reverses a common intuition: noise can increase free-flow stability while lowering effective congested capacity.

Cognitive radio systems express the trade-off between sensing quality and secondary throughput. In the model with steerable directional antennas, the secondary transmitter senses for \(\tau\) seconds and then transmits during the remaining fraction \(D(\tau)=(T-\tau)/T\) if the channel is sensed idle. The sensing probabilities
\[
P_f(\phi_t,\tau)
=
Q\!\left(\left(\frac{\xi}{\sigma_n^2}-1\right)\sqrt{\tau f_s}\right),
\qquad
P_d(\phi_t,\tau)
=
Q\!\left(\left(\frac{\xi}{\sigma_n^2}-\gamma-1\right)\sqrt{\frac{\tau f_s}{2\gamma+1}}\right)
\]
improve with longer sensing time and with antenna orientation toward the primary transmitter, but both choices reduce secondary data rate or desired-link gain. The optimal transmit power is the minimum of a peak-power cap and an interference-outage cap,
\[
P^{\text{opt}}
=
\min\!\left\{
\frac{P_{\text{pk}}}{D\widehat{\pi}_0},
\;
\frac{-I_{\text{pk}}}{D\bar b_0\ln\varepsilon}
\right\},
\]
and the paper shows that the capacity curve in \(\tau\) has an interior maximizer \(\tau^*\in(0,T)\) [1810.08251]. In this formulation, stability is the protected operating condition of the primary user, enforced through an outage interference constraint.

Finite-regime network flow extends the idea to variable min-cuts. With link-rate intervals \([r_i^{\min},r_i^{\max}]\), network throughput is bounded by
\[
\eta^{\max}=\min_C w^{\max}(C),\qquad
\eta^{\min}=\min_C w^{\min}(C),\qquad
\eta^{\mathrm{mean}}=\min_C w^{\mathrm{mean}}(C).
\]
The paper defines stability as invariance of the min-cut set across all realizations. An unstable graph can have up to \(O(2^{|E|})\) distinct min-cut sets. At the same time, increasing the number of links on a cut reduces throughput variability substantially; the reported example shows nearly \(90\%\) reduction. To enforce stability, the paper proposes an algorithm of complexity \(O(|E|^2+|V|)\) that shrinks uncertainty intervals so a single min-cut remains active, with the worst-case effect \(\eta^{\max}\to\eta^{\mathrm{mean}}\) [2507.14852]. The trade-off is therefore explicit: structural stability can be purchased by sacrificing best-case variability slack while preserving mean rates.

## 6. Electronic, thermodynamic, and adjacent formulations

At the device level, h-BN encapsulated GFETs exhibit the trade-off between RF capability and circuit stability. Capacity is the effective RF performance, measured by \(f_T\), \(f_{\max}\), and power gain. With channel scaling to \(30\)–\(100\) nm, the projected extrinsic cutoff frequency approaches \(5\) THz, and for \(L=30\) nm the projected \(f_{\max}\) reaches about \(10\) THz with \(R_G = 2\,\text{k}\Omega\cdot\mu\text{m}\). Yet the same short-channel, high-gain regime expands negative-differential-resistance regions in which the Rollett factor can satisfy \(K<-1\), making the device unstable at high frequency. Lower gate resistance simultaneously improves stability and raises \(f_{\max}\), and the paper notes that high power gain and stability remain feasible even far from current saturation [1805.07138]. The resulting trade-off is not between low and high gain alone, but between operating near the most aggressive NDR-enhanced gain region and maintaining a usable stability margin.

Information geometry provides a thermodynamic version of the concept. For a probability distribution \(\boldsymbol p(t)\), the intrinsic speed is
\[
\left(\frac{ds(\boldsymbol p)}{dt}\right)^2
=
\sum_i \frac{1}{p_i}\left(\frac{dp_i}{dt}\right)^2,
\]
and the paper proposes monotone decay of this quantity as a generalized stability criterion. It also derives the Cramér–Rao-type trade-off
\[
\left(\frac{d}{dt}\mathbb E_{\boldsymbol p}[R]\right)^2
\le
\mathrm{Var}_{\boldsymbol p}[R]\,
\left(\frac{ds(\boldsymbol p)}{dt}\right)^2,
\]
together with bounds linking excess entropy production to intrinsic speed. In this language, stability means decay of intrinsic speed near a steady state, while the capacity for rapid, precise observable change is bounded by available fluctuations and dissipation [1908.09446]. The paper thereby interprets stability as an upper bound on local information-processing speed.

A related but not identical usage appears in other systems. In bosonic communication, trade-off coding allocates photons among classical, quantum, and entanglement resources, or among public, private, and secret-key resources; under high mean photon number the paper derives a rule of thumb \(\lambda \propto 1/N_S\), meaning that only an \(O(1)\) number of photons need be devoted to quantum resources to operate near quantum capacity while the remaining power supports classical throughput [1105.0119]. In CLR-DRAM, the configurable constraint is capacity versus latency rather than dynamical stability: high-performance mode halves row capacity but reduces \(t_{RCD}\) by 60.1%, \(t_{RAS}\) by 64.2%, \(t_{RP}\) by 46.4%, and \(t_{WR}\) by 35.2%, exposing a runtime, row-granular capacity–latency control rather than a fixed design-time point [2005.12775].

Taken together, these results indicate that the capacity–stability trade-off is not a single theorem but a recurring structural motif. In some domains it is governed by contraction versus memory depth, in others by eigenvector misalignment, repair bandwidth, delay-dependent drift, disorder-induced phase diffusion, or interference protection. What remains invariant is the underlying logic: preserving reliable operation requires constraints that consume usable degrees of freedom, and relaxing those constraints expands capacity only by accepting greater sensitivity, shorter horizons, larger energy or repair costs, or a smaller robustness margin.

Source: https://www.emergentmind.com/topics/capacity-stability-trade-off