Papers
Topics
Authors
Recent
Search
2000 character limit reached

Finite-Horizon Stochastic BRL

Updated 16 January 2026
  • Finite-Horizon Stochastic BRL is a framework that establishes necessary and sufficient conditions for disturbance attenuation in stochastic linear systems using Riccati recursions or LMIs.
  • It generalizes classical H∞ control by incorporating stochastic inputs, mean-field effects, and distributional uncertainties through anisotropic and induced norm measures.
  • Practical implementation involves numerical backward recursions and LMIs to certify performance bounds, aiding robust filtering, controller synthesis, and uncertainty quantification.

The finite-horizon stochastic bounded real lemma provides necessary and sufficient conditions for the disturbance attenuation (in the sense of an induced norm) of discrete- or continuous-time linear systems subject to stochastic inputs, disturbances, and model uncertainties. It extends the classic bounded real lemma (BRL) from deterministic H\mathcal{H}_\infty control theory to finite-horizon, stochastic, and possibly mean-field and distributionally uncertain settings. The lemma formalizes the relationship between system parameters, Riccati recursions or LMIs, and norm bounds for worst-case output amplification in the presence of general stochastic uncertainties.

1. System Classes and Stochastic Uncertainty Modeling

Finite-horizon stochastic BRL results apply to a broad class of disturbed systems:

  • Linear Discrete-Time Varying (LDTV):

xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k, zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k, x0=0x_0 = 0 (Maximov et al., 2012).

  • Stochastic Difference in Hilbert Spaces:

x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k), z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k), x(0)=0x(0)=0 (Li et al., 9 Jan 2026).

  • Systems with Mean-Field and Noise:

x(k+1)=A(k)x(k)+Aˉ(k)E[x(k)]+x(k+1)=A(k)x(k)+\bar A(k)\mathbb{E}[x(k)] + \cdots (mean-field terms and multiplicative noise) (Weihai et al., 2016).

  • Continuous-Time Mean-Field Stochastic Systems:

dX(s)=dX(s) = \cdots (Itô equations with mean-field coupling and affine terms) (Fang et al., 26 Jul 2025).

  • General Linear-Quadratic Framework:

Covers systems with state, control, and disturbance covariance formulations, including stochastic models as special cases (Bamieh, 2024).

Stochastic uncertainty is modeled either by:

  • Color and correlation structure of noise (white, colored, or with imprecisely known distributions).
  • Anisotropy of noise—a parameter measuring entropy-theoretic deviation from white Gaussian law (Maximov et al., 2012).
  • Distributional ambiguity (admissible input distributions constrained by relative entropy or second-order moments).

2. Norms and Performance Objectives

The framework is built around induced norms quantifying the maximal amplification from disturbance to output in mean-square sense, over the considered time horizon:

  • RMS-gain (for operator FF and random xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k0):

xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k1

  • xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k2-anisotropic norm: Maximal RMS-gain over all inputs xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k3 of anisotropy up to xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k4:

xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k5

where xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k6 is the set of input random vectors of anisotropy xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k7 (Maximov et al., 2012).

  • xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k8 norm: For general stochastic or mean-field models, the induced norm is:

xk+1=Akxk+Bkwkx_{k+1} = A_k x_k + B_k w_k9

and the performance objective is zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k0 for all admissible disturbances (Weihai et al., 2016).

As constraints on the noise law are relaxed (e.g., zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k1), the anisotropic norm reduces to the classical zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k2 norm.

3. Finite-Horizon Stochastic Bounded Real Lemma: Main Results

The lemma gives a test for the norm bound in terms of the feasibility of recursion relations (Ricatti equations) or LMIs:

For an LDTV system with output operator zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k3, the ANBRL states:

  • For prescribed zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k4, anisotropy bound zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k5, zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k6 iff there exists zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k7 such that:

    • Forward Riccati recursion

    zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k8

    with zk=Ckxk+Dkwkz_k = C_k x_k + D_k w_k9 for all x0=0x_0 = 00. - Determinant inequality:

    x0=0x_0 = 01

  • As x0=0x_0 = 02, the determinant constraint becomes redundant and the result reduces to standard x0=0x_0 = 03-BRL.

For systems in separable Hilbert spaces with additive and multiplicative noise, x0=0x_0 = 04 if and only if there exists a sequence of self-adjoint operators x0=0x_0 = 05 with x0=0x_0 = 06 such that:

  • Backward Riccati recursion:

x0=0x_0 = 07

  • For all x0=0x_0 = 08, the “denominator” x0=0x_0 = 09.

In mean-field discrete-time settings, two coupled backward Riccati recursions for x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)0 and x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)1 (with x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)2) and LMI positivity conditions are required for BRL feasibility. In continuous-time mean-field Itô systems, the lemma relies on the existence, uniqueness, and positive definiteness of solutions to coupled Riccati differential equations (CDREs) over the finite time horizon, along with solvability of auxiliary backward SDEs and deterministic ODEs capturing affine input effects.

Within the linear-conic duality framework, the stochastic finite-horizon x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)3 analysis is cast as a semidefinite program (SDP) over joint state-input-noise covariances, with dual LMIs and equivalence to Riccati recursions. Specifically, the dual problem yields for each x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)4: x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)5 with backward Riccati recursion for x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)6.

4. Theoretical Derivation and Underlying Methods

  • Maximum Entropy and Duality: The worst-case disturbance is often attained at a Gaussian law with covariance derived via Kullback-Leibler duality and entropy maximization over input distributions (Maximov et al., 2012).
  • Riccati Equations: The completion of squares and optimal state feedback structure in the performance index require solvability of Riccati difference or differential equations. In mean-field cases, these are coupled systems tracking both mean and fluctuation contributions (Weihai et al., 2016, Fang et al., 26 Jul 2025).
  • LMI Formulation: In the covariance representation approach, the stochastic BRL emerges as the dual feasibility of a family of finite-horizon LMIs, connecting state-input covariance constraints to performance bounds (Bamieh, 2024).
  • Auxiliary Equations: The presence of affine or mean-field terms introduces auxiliary backward SDEs or ODEs whose solvability is required for the disturbance attenuation certificate (Fang et al., 26 Jul 2025).

5. Comparison to the Classical Deterministic Bounded Real Lemma

The finite-horizon stochastic BRL generalizes the traditional deterministic BRL along several axes:

  • Distributional Robustness: Stochastic versions quantify robustness to unknown noise distributions via entropy or anisotropy constraints (Maximov et al., 2012).
  • Statistical Uncertainty: The Riccati recursions and determinant/global constraints (e.g., x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)7) encode the effect of statistical uncertainty, not present in deterministic BRL.
  • Inheritance: As the constraint on statistical uncertainty is relaxed or disappears (e.g., x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)8 in the anisotropic norm, noise law becomes completely unknown), the stochastic BRL reduces to the classical x(k+1)=Akx(k)+Bkw(k)+[Ckx(k)+Dkw(k)]ω(k)x(k+1) = A_k x(k) + B_k w(k) + [C_k x(k) + D_k w(k)]\, \omega(k)9 BRL as a special case (Maximov et al., 2012).
Lemma Flavor Key Riccati Type / Constraint Noise Model Extra Condition
Deterministic z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)0 Riccati with z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)1 Deterministic/worst-case None
Anisotropic/Robust BRL Riccati with z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)2 Uncertain law, bound z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)3 Determinant-inequality
Mean-field/BSDE variants Coupled Riccati or CDRE, Aux. SDE/ODE Mean-field/multiplicative Invertibility (gain)

6. Practical Implementation and Applications

In practical terms, verification and controller synthesis via the finite-horizon stochastic BRL proceeds as follows:

  • Specify system dynamics (possibly with mean-field or multiplicative noise).
  • Formulate RMS or z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)4-induced norm-based performance requirements.
  • Solve the relevant Riccati difference/differential equations or check LMI feasibility (with determinant/invertibility constraints if anisotropy or mean-field structure is present).
  • Verify positive-definiteness of key block or denominator terms at each recursion step.
  • Compute worst-case disturbance and, if required, feedback gains for optimal attenuation.
  • Use numerical backward recursions and matrix computations to determine critical norm thresholds and establish explicit performance bounds (Maximov et al., 2012, Li et al., 9 Jan 2026, Fang et al., 26 Jul 2025).

Applications span robust filtering, z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)5 mixed control, mean-field games, and stochastic optimization for uncertain environments in engineering systems.

  • The framework naturally extends to continuous-time, infinite-dimensional, and operator-theoretic systems (e.g., Hilbert-space setups) (Li et al., 9 Jan 2026).
  • The mean-field stochastic BRL is the analytical engine underlying finite-horizon z(k)=Ckzx(k)+Dkzw(k)z(k) = C^z_k x(k) + D^z_k w(k)6 control with mean-field and affine effects (Fang et al., 26 Jul 2025), and mean-field mixed stochastic systems (Weihai et al., 2016).
  • The anisotropic norm approach provides a refined interpolation between purely stochastic norm bounds and the deterministic robust setting, quantifying probabilistic uncertainty via entropy (Maximov et al., 2012).

The finite-horizon stochastic bounded real lemma thus represents a comprehensive unification of performance analysis, uncertainty modeling, LQ theory, and duality-based optimization in stochastic control and robust system theory.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Finite-Horizon Stochastic Bounded Real Lemma.