---
title: 'EF-ZRLS: Recursive Zonotopic Estimation'
url: https://www.emergentmind.com/topics/exponentially-forgetting-zonotopic-recursive-least-squares-ef-zrls-e0df9274-8859-419d-9f2c-e8276d09eb9f
type: topic
---

# EF-ZRLS: Recursive Zonotopic Estimation

Exponentially Forgetting Zonotopic Recursive Least Squares (EF-ZRLS) is a set-membership estimation algorithm designed for online identification of time-varying system parameters and robust data-driven reachability analysis in dynamic systems, particularly under bounded noise and uncertain parameter drift. EF-ZRLS recursively computes over-approximating zonotopic sets that provably contain the true, slowly-varying system parameters, offering provable guarantees of containment and exponential adaptation under persistent excitation. The estimator provides an effective tool for safety-critical reachability analysis and verification when only streaming data is available and no accurate offline model identification can be assumed [2509.17058].

## 1. Mathematical Framework

The EF-ZRLS estimator addresses the linear regression model with multiple outputs, time-varying parameters, and bounded additive noise, formulated as
\[
y_k = \varphi_k \theta_{\mathrm{tr},k} + v_k, \qquad \theta_{\mathrm{tr},k} = \theta_{\mathrm{tr},k-1} + \delta\theta_{k-1},
\]
where
- \( y_k \in \mathbb{R}^{p \times m} \) is the observed output,
- \( \varphi_k \in \mathbb{R}^{p \times n} \) is the regressor,
- \( \theta_{\mathrm{tr},k} \in \mathbb{R}^{n \times m} \) is the unknown time-varying parameter matrix,
- \( v_k \) is noise, \( \|v_k\|_{\max} \leq \sigma_v \),
- \( \delta\theta_{k-1} \) models parameter drift, \( \|\delta\theta_{k-1}\|_{\max} \leq \sigma_\theta \).

At each time \( k \), EF-ZRLS maintains a zonotope (set of parameter matrices) given by
\[
\mathcal{M}_k = \left\langle C_k, G_k \right\rangle = \left\{ \Theta \in \mathbb{R}^{n \times m} \mid \Theta = C_k + G_k \beta,\, \|\beta\|_\infty \le 1 \right\},
\]
with center \( C_k \in \mathbb{R}^{n \times m} \) and generator stack \( G_k \in \mathbb{R}^{n \times m \times r} \) for some number of generators \( r \).

## 2. Recursive Update Laws

The EF-ZRLS algorithm utilizes an exponential forgetting factor \( \lambda \in (0,1] \) and a gain matrix \( K_k \in \mathbb{R}^{n \times p} \) to enable adaptation to parameter drift and noise:

- **Center Update:**
  \[
  C_{k+1} = (I_n - K_k \varphi_k) C_k + K_k y_k.
  \]

- **Generator Update:**
  \[
  G_{k+1} = \left[
    \lambda^{-1/2} (I_n - K_k \varphi_k) G_k^{(1)},
    \ldots,
    \lambda^{-1/2} (I_n - K_k \varphi_k) G_k^{(r)},
    -K_k Q_v^{(1)},
    \ldots,
    -K_k Q_v^{(pm)}
  \right],
  \]
  where \( Q_v^{(j)} \) are noise-generator matrices covering the admissible noise.

- **Gain and Covariance Updates:**
  \[
  K_k = P_k \varphi_k^\top (\varphi_k P_k \varphi_k^\top + \lambda Q)^{-1},
  \]
  \[
  P_{k+1} = \lambda^{-1} (I - K_k \varphi_k) P_k,
  \]
  with \( Q = m \sigma_v^2 I_p \), \( P_0 \succ 0 \) initialized as a scaled identity.

The generator scaling by \( \lambda^{-1/2} \) ensures the zonotope can expand to encompass drift over time.

## 3. Initialization and Parameter Selection

- **Center \( C_0 \):** Chosen as zero or, if possible, as the batch least-squares solution from an initial dataset.
- **Covariance \( P_0 \):** Large multiple of the identity to ensure initial uncertainty covering the true parameter.
- **Generators \( G_0^{(i)} \):** Chosen to be large enough so that the initial parameter is guaranteed in the zonotope, a typical choice is one per unknown entry, each set to \( \sigma_\theta \).
- **Forgetting Factor \( \lambda \):** Selected in \((0.95,1]\) to trade off between rapid adaptation (\( \lambda \) small) and reduced noise sensitivity (\( \lambda \) large).

## 4. Algorithmic Workflow

The principal algorithm proceeds as follows (summarized from the cited pseudocode):

1. **Innovation:** \( e \leftarrow y_k - \varphi_k C \)
2. **Compute \( \Lambda \):** \( \Lambda \leftarrow \varphi_k P \varphi_k^\top + \lambda (m \sigma_v^2 I_p) \)
3. **Gain:** \( K \leftarrow P \varphi_k^\top \Lambda^{-1} \)
4. **Update Center:** \( C \leftarrow (I - K \varphi_k) C + K y_k \)
5. **Update Covariance:** \( P \leftarrow \lambda^{-1} (I - K \varphi_k) P \)
6. **Update Generators:**
   - Scale old: \( G_{\text{old,scaled}} \leftarrow \lambda^{-1/2}(I - K \varphi_k) G \)
   - Add noise generators: \( G_{\text{noise}} \leftarrow [-K Q_v^{(1)}, \ldots, -K Q_v^{(pm)}] \)
   - Concatenate: \( G \leftarrow [G_{\text{old,scaled}}, G_{\text{noise}}] \)
7. **(Optional) Zonotope Reduction:** Apply a generator-reduction operator \( \downarrow_q \) to control computational growth.
8. **Output parameter set:** \( \mathcal{M}_k = \langle C, G \rangle \).

## 5. Theoretical Guarantees

- **Containment:** For all \( k \), the true parameter \( \theta_{\mathrm{tr},k} \in \mathcal{M}_k \) by construction (Proposition 1).
- **Optimality:** The gain \( K_k \) minimizes \( \operatorname{Tr}(W P_{k+1}) \) for any positive semidefinite weighting matrix \( W \) (Theorem 1).
- **Adaptation:** Under persistent excitation (PE) of \( \varphi_k \), the zonotope center \( C_k \) converges exponentially in mean-square to \( \theta_{\mathrm{tr},k} \), and the zonotopic RLS error remains bounded even when drift \( \delta\theta_k \neq 0 \).
- **Forgetting Factor Role:** The scaling of generators by \( \lambda^{-1/2} \) ensures comprehensive tracking of parameter drift. Taking \( \lambda \to 1 \) increases reliance on historical data (reducing sensitivity to noise, but slowing dynamic adaptation), while \( \lambda \) closer to 0.95 boosts responsiveness to parameter changes at the cost of larger zonotope inflation.

## 6. Computational Complexity and Zonotope Reduction

At each iteration, operations scale as follows:

| Computation Stage      | Complexity        | Notes                           |
|-----------------------|-------------------|----------------------------------|
| Gain computation      | \(O(n^2p + p^3)\) |                                 |
| Center/covariance     | \(O(n^2)\)        |                                 |
| Generator scaling     | \(O(n^2mr)\)      | \(r\): number of generators     |
| Noise generator add   | \(pm\) blocks     |                                 |
| **Total per step**    | \(O(n^2mr + n^2p + p^3)\) |                               |

Without generator reduction, the number of generators grows at each update, making zonotope reduction essential for long-term computational tractability. The reduction operator \( \downarrow_q \) merges/prunes generators while preserving containment \( \langle C, G \rangle \subseteq \langle C, \downarrow_q(G) \rangle \).

## 7. Illustrative Example

For the scalar case (\( n=m=p=1 \)):
\[
y_k = \theta_k x_k + v_k,\quad |v_k|\leq0.1, \quad \theta_k = \theta_{k-1} + \delta_k,\;|\delta_k|\leq0.01.
\]
Initialization: \( C_0=0,\, P_0=100,\, G_0=[0.05],\, \lambda=0.98 \).
Suppose measurements \( (x_0, y_0)=(1,1.05) \), \( (x_1, y_1)=(2, 2.08) \). After two updates, the center evolves to approximately 1.028 and the zonotope parameters shrink, while always containing all parameter trajectories satisfying the drift and noise bounds. This demonstrates the estimator's ability to rapidly adapt and contract uncertainty, while ensuring containment of the true parameter [2509.17058].

## 8. Applications and Significance

EF-ZRLS enables rigorous online reachability analysis for discrete-time linear time-varying and nonlinear Lipschitz systems, supporting safety verification under measurement noise and uncertain parameters. By explicitly characterizing bounded uncertainty in parameters and inputs with zonotopic over-approximations, the method offers less conservative reachability sets compared to classical interval or ellipsoidal approaches. It operates exclusively on real-time streaming data, obviating the need for pre-recorded offline experiments and is robust to slowly varying model dynamics. Empirical performance is validated through numerical simulations and real-world applications, highlighting its relevance for safety-critical cyber-physical systems in environments where accurate prior models are not available [2509.17058].

Source: https://www.emergentmind.com/topics/exponentially-forgetting-zonotopic-recursive-least-squares-ef-zrls-e0df9274-8859-419d-9f2c-e8276d09eb9f