Small-Covariance Noise-to-State Stability (scNSS)

• scNSS is a stochastic stability concept that ensures a system’s state remains within a covariance-dependent neighborhood of equilibrium when noise is sufficiently small.
• It utilizes Lyapunov-based inequalities with bounded covariance gains to distinguish between global NSS, local scNSS, and integral NSS frameworks.
• Key applications include stochastic gradient dynamics, LQR, and logistic regression, where controlling noise covariance is critical for desired stability.

Small-covariance noise-to-state stability (scNSS) is a stochastic stability notion for systems whose state remains, with high probability, in a covariance-dependent neighborhood of an equilibrium, but only when the driving noise covariance is sufficiently small. In the formulation introduced for stochastic gradient dynamics, scNSS preserves the standard NSS template

$$\mathbb P\!\left\{ \mathcal V(\chi(t))\le \beta(\mathcal V(\chi(0)),t)+\gamma(\Sigma\Sigma^\top) \right\}\ge 1-\epsilon,$$

while restricting the admissible covariance magnitude to

$\|\Sigma\Sigma^\top\|_\infty<d,$

with $\gamma\in\mathcal K_{[0,d)}$ rather than $\gamma\in\mathcal K$. The concept was introduced to capture robustness regimes in which stability is available only for sufficiently small covariance, especially in stochastic optimization and Langevin-type dynamics (Cui et al., 29 Sep 2025).

1. Formal definition and state-space setting

The scNSS framework is posed for stochastic systems of the form

$$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$

where $\chi(t)\in\mathcal S\subset\mathbb R^n$, $\mathcal S$ is open and diffeomorphic to $\mathbb R^n$, $B(t)$ is an $m$-dimensional standard Brownian motion, $\|\Sigma\Sigma^\top\|_\infty<d,$0 and $\|\Sigma\Sigma^\top\|_\infty<d,$1 are locally bounded and locally Lipschitz, $\|\Sigma\Sigma^\top\|_\infty<d,$2 at an equilibrium $\|\Sigma\Sigma^\top\|_\infty<d,$3, and $\|\Sigma\Sigma^\top\|_\infty<d,$4 is Borel measurable and locally essentially bounded. The instantaneous noise covariance is $\|\Sigma\Sigma^\top\|_\infty<d,$5 (Cui et al., 29 Sep 2025).

A size function $\|\Sigma\Sigma^\top\|_\infty<d,$6 is twice continuously differentiable, positive definite with respect to $\|\Sigma\Sigma^\top\|_\infty<d,$7, and coercive in the sense that

$\|\Sigma\Sigma^\top\|_\infty<d,$8

This function supplies the state-energy variable in the stability estimate.

The distinction between NSS and scNSS is entirely in the disturbance channel. Standard NSS in probability requires the bound

$\|\Sigma\Sigma^\top\|_\infty<d,$9

for some $\gamma\in\mathcal K_{[0,d)}$0, $\gamma\in\mathcal K_{[0,d)}$1, all $\gamma\in\mathcal K_{[0,d)}$2, all initial conditions, and all $\gamma\in\mathcal K_{[0,d)}$3. By contrast, scNSS in probability uses the same probabilistic form but only for sufficiently small covariance, with $\gamma\in\mathcal K_{[0,d)}$4 and the side condition $\gamma\in\mathcal K_{[0,d)}$5. The definition therefore encodes a local-in-covariance robustness property rather than a global-in-covariance one. The same source also recalls integral NSS (iNSS),

$\gamma\in\mathcal K_{[0,d)}$6

which weakens the disturbance channel further by allowing an accumulated energy term instead of an instantaneous covariance gain.

2. Lyapunov characterization and hierarchy of stochastic robustness

The central Lyapunov inequalities separate NSS, scNSS, and iNSS by the admissible comparison function class in the dissipation term. An NSS-Lyapunov function satisfies

$\gamma\in\mathcal K_{[0,d)}$7

for $\gamma\in\mathcal K_{[0,d)}$8, $\gamma\in\mathcal K_{[0,d)}$9, all $\gamma\in\mathcal K$0, and all $\gamma\in\mathcal K$1. An scNSS-Lyapunov function satisfies the same inequality with $\gamma\in\mathcal K$2, $\gamma\in\mathcal K$3, and only for $\gamma\in\mathcal K$4. An iNSS-Lyapunov function weakens dissipation further to $\gamma\in\mathcal K$5, $\gamma\in\mathcal K$6 (Cui et al., 29 Sep 2025).

The corresponding implication results are direct: existence of an scNSS-Lyapunov function implies scNSS, existence of an NSS-Lyapunov function implies NSS, and existence of an iNSS-Lyapunov function implies iNSS. In the scNSS proof, stopping times and supermartingale arguments are used to show that trajectories enter and remain in a neighborhood

$\gamma\in\mathcal K$7

whose size is controlled by the covariance. A representative estimate is

$\gamma\in\mathcal K$8

valid when $\gamma\in\mathcal K$9 is below a small-covariance threshold $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$0.

Within this framework, NSS is the strongest notion, scNSS is weaker because it only covers $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$1, and iNSS is weaker still because it only requires positive-definite dissipation and admits an integral disturbance term. The same hierarchy appears at the level of optimization geometry: $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$2 A common misconception is to treat scNSS as merely NSS with smaller constants. The formal difference is sharper: the gain itself is only defined on a bounded covariance interval, so the guarantee is structurally local in covariance magnitude.

3. Gradient dynamics and generalized Polyak–Łojasiewicz structure

The principal application domain for scNSS is stochastic gradient dynamics of the overdamped Langevin type,

$$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$3

The standing assumptions are that $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$4, $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$5 is bounded below and coercive, and $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$6 is locally Lipschitz and locally bounded. When $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$7 is globally $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$8-Lipschitz and $$d\chi(t)=f(\chi(t))\,dt+g(\chi(t))\,\Sigma(t)\,dB(t),$$9 is globally bounded by $\chi(t)\in\mathcal S\subset\mathbb R^n$0, the Lyapunov candidate

$\chi(t)\in\mathcal S\subset\mathbb R^n$1

satisfies

$\chi(t)\in\mathcal S\subset\mathbb R^n$2

This makes the generalized Polyak–Łojasiewicz condition the decisive geometric hypothesis (Cui et al., 29 Sep 2025).

The paper distinguishes three variants: $\chi(t)\in\mathcal S\subset\mathbb R^n$3 with $\chi(t)\in\mathcal S\subset\mathbb R^n$4 for $\chi(t)\in\mathcal S\subset\mathbb R^n$5-PL, $\chi(t)\in\mathcal S\subset\mathbb R^n$6 for $\chi(t)\in\mathcal S\subset\mathbb R^n$7-PL, and $\chi(t)\in\mathcal S\subset\mathbb R^n$8 for positive-definite-PL. Under global Lipschitzness and bounded noise gain, the theorem for overdamped diffusion states that $\chi(t)\in\mathcal S\subset\mathbb R^n$9-PL implies NSS, $\mathcal S$0-PL implies scNSS and iNSS, and $\mathcal S$1-PL implies iNSS. The neighborhood size around the optimum is determined by the covariance term in the Lyapunov inequality; smaller covariance produces a smaller ultimate region.

The same trichotomy extends to underdamped Langevin diffusion, or stochastic heavy-ball dynamics,

$\mathcal S$2

Here the analysis uses the mixed Lyapunov function

$\mathcal S$3

and obtains an estimate of the form

$\mathcal S$4

Under global Lipschitz gradient and bounded $\mathcal S$5, the same three-way conclusion holds: $\mathcal S$6-PL yields NSS, $\mathcal S$7-PL yields scNSS and iNSS, and $\mathcal S$8-PL yields iNSS.

4. Non-globally-Lipschitz objectives and step-size tuning

When $\mathcal S$9 is not globally Lipschitz, the fixed-drift overdamped model is replaced by a state-dependent step-size dynamics,

$\mathbb R^n$0

The analysis is organized through sublevel sets

$\mathbb R^n$1

and curvature envelopes

$\mathbb R^n$2

Under the $\mathbb R^n$3-PL condition, the ratio

$\mathbb R^n$4

determines whether the system is merely small-covariance stable or globally NSS (Cui et al., 29 Sep 2025).

The resulting dichotomy is explicit. If

$\mathbb R^n$5

then the dynamics are scNSS. If instead

$\mathbb R^n$6

the dynamics are NSS. The interpretation given is that the learning rate $\mathbb R^n$7 must dominate the local curvature growth $\mathbb R^n$8 relative to the PL gain. Two concrete examples are provided: $\mathbb R^n$9 gives scNSS, whereas $B(t)$0 gives NSS.

For the underdamped non-globally-Lipschitz case, a different Lyapunov construction is used,

$B(t)$1

where $B(t)$2 is obtained by smoothing a $B(t)$3 bound on the gradient via local curvature. Under suitable tuning of $B(t)$4 and $B(t)$5, the same $B(t)$6 trichotomy again yields NSS, scNSS, and iNSS. This suggests that scNSS is not tied to global smoothness, but rather to the balance among curvature growth, dissipation, and covariance magnitude.

5. Canonical applications: LQR and logistic regression

For continuous-time linear quadratic regulator policy optimization, the objective is

$B(t)$7

where $B(t)$8 solves

$B(t)$9

and the gradient is

$m$0

with $m$1 solving

$m$2

The objective $m$3 is coercive and analytic, $m$4 is only locally Lipschitz, and $m$5 satisfies the $m$6-PL condition

$m$7

For the overdamped stochastic policy dynamics,

$m$8

the criterion is

$m$9

while

$\|\Sigma\Sigma^\top\|_\infty<d,$00

For underdamped or heavy-ball LQR policy dynamics, the same general underdamped theorem and the $\|\Sigma\Sigma^\top\|_\infty<d,$01-PL property yield scNSS.

For logistic regression, the loss is

$\|\Sigma\Sigma^\top\|_\infty<d,$02

Under the assumptions that the data matrix $\|\Sigma\Sigma^\top\|_\infty<d,$03 has full row rank and the data are nonseparable, $\|\Sigma\Sigma^\top\|_\infty<d,$04 is coercive, strictly convex, and has globally Lipschitz gradient with constant

$\|\Sigma\Sigma^\top\|_\infty<d,$05

It also satisfies a $\|\Sigma\Sigma^\top\|_\infty<d,$06-PL condition

$\|\Sigma\Sigma^\top\|_\infty<d,$07

for some $\|\Sigma\Sigma^\top\|_\infty<d,$08-function $\|\Sigma\Sigma^\top\|_\infty<d,$09, but it does not satisfy the $\|\Sigma\Sigma^\top\|_\infty<d,$10-PL condition because $\|\Sigma\Sigma^\top\|_\infty<d,$11 is uniformly bounded while $\|\Sigma\Sigma^\top\|_\infty<d,$12 as $\|\Sigma\Sigma^\top\|_\infty<d,$13. Consequently, both the overdamped diffusion

$\|\Sigma\Sigma^\top\|_\infty<d,$14

and the underdamped dynamics

$\|\Sigma\Sigma^\top\|_\infty<d,$15

are concluded to be scNSS rather than NSS. The operational interpretation is that the stochastic training trajectory remains, with high probability, in a covariance-dependent neighborhood of the logistic optimum, and that neighborhood shrinks as the covariance decreases (Cui et al., 29 Sep 2025).

6. Relation to earlier NSS theory and adjacent extensions

scNSS sits within a broader NSS lineage for stochastic systems with persistent or state-dependent noise. Earlier NSS theory for SDEs with persistent noise already expressed state bounds in terms of the maximum covariance magnitude through $\|\Sigma\Sigma^\top\|_\infty<d,$16, using NSS in probability and $\|\Sigma\Sigma^\top\|_\infty<d,$17th-moment NSS with Lyapunov conditions of the form

$\|\Sigma\Sigma^\top\|_\infty<d,$18

That framework did not isolate a separate small-covariance notion, but it already encoded the principle that smaller covariance implies a smaller disturbance-dependent state bound (Mateos-Núñez et al., 2015).

A different precursor is the time-domain analysis of noise-to-state exponentially stable systems. For SDEs

$\|\Sigma\Sigma^\top\|_\infty<d,$19

the resident-time ratio

$\|\Sigma\Sigma^\top\|_\infty<d,$20

was introduced to quantify the fraction of time a trajectory spends in a bounded region. The resulting almost-sure lower bound improves as the noise intensity decreases and tends to $\|\Sigma\Sigma^\top\|_\infty<d,$21 as the noise vanishes. That work does not study a small-covariance regime in the perturbative sense, but it provides a time-average small-noise enhancement of NSS-type behavior and complements fixed-time probabilistic boundedness by a long-run residence guarantee (Fang et al., 2016).

More recent neighboring developments broaden the same theme rather than replacing it. Stochastic contraction results give incremental noise- and input-to-state stability in weighted $\|\Sigma\Sigma^\top\|_\infty<d,$22-norms, with asymptotic mean-square errors scaling linearly with diffusion magnitude, such as terms of order $\|\Sigma\Sigma^\top\|_\infty<d,$23 and $\|\Sigma\Sigma^\top\|_\infty<d,$24; this is closely aligned with the intuition behind small-covariance robustness (Kawano et al., 20 Feb 2026). In Wasserstein space, distributional ISS has been proposed for measure-valued dynamics, with the claim that on compact domains it recovers particle-level ISS and NSS, including stochastic particle systems whose disturbance magnitude is $\|\Sigma\Sigma^\top\|_\infty<d,$25 (Pascual et al., 30 Mar 2026). For discrete-time linear systems, risk-aware stability introduces NSS-type offsets measured through coherent risk functionals or a mean-conditional-variance functional, so that covariance and higher-order centered noise statistics affect the residual state-risk bound (Chapman et al., 2022). In randomly switching linear systems with additive Gaussian noise, lifted covariance dynamics and invariant ellipsoids yield computable bounds on state covariance trajectories; this has been interpreted as a small-covariance NSS-type property because smaller mode-dependent covariances $\|\Sigma\Sigma^\top\|_\infty<d,$26 lead to tighter covariance confinement (Yoon et al., 2019).

Taken together, these results delimit the scope of scNSS. It is neither an exact stationary-distribution theory nor a generic ergodic theorem, and it is distinct from fixed-time NSS, time-average residence bounds, distributional Wasserstein robustness, and risk-aware formulations. Its specific role is to formalize the regime in which covariance-dependent ultimate boundedness is valid only below a noise threshold, a setting that arises naturally in stochastic gradient systems and related control and optimization dynamics.