Dedicated-IO: Robust Kalman Filtering

• Dedicated-IO is a robust filtering methodology designed to counteract innovation outliers in discrete-time linear state-space models.
• The rLS.IO filter integrates a Huber-type clipping mechanism within the Kalman update to manage gross deviations in process noise effectively.
• Its optimal threshold calibration and minimax-MSE framework provide superior tracking of endogenous regime shifts compared to classical and AO-robust filters.

Dedicated-IO refers to a dedicated innovation-outlier (IO)-robust Kalman filtering methodology, specifically formulated to address gross deviations in process noise—so-called innovation outliers—in discrete-time linear state-space models. The rLS.IO filter is the canonical dedicated-IO robust Kalman filter, constructed to achieve minimax mean-squared error (MSE) optimality within contamination neighborhoods for process noise, thus ensuring rapid tracking of endogenous regime shifts in the latent state without excessive attenuation, in contrast to classical or AO (additive outlier)-robust approaches (Ruckdeschel, 2010).

1. Linear State-Space Setup and Classical Kalman Filter

The baseline is the ideal linear–Gaussian discrete-time state-space model:

• State equation:

$X_t = F_t X_{t-1} + v_t$

with $X_t \in \mathbb{R}^p$, transition matrix $F_t$, and $v_t \sim N_p(0, Q_t)$ i.i.d.

• Observation equation:

$Y_t = Z_t X_t + \varepsilon_t$

where $Y_t \in \mathbb{R}^q$, observation matrix $Z_t$, and $\varepsilon_t \sim N_q(0, V_t)$ i.i.d.

Initial conditions are $X_{0|0} = a_0$, $\Sigma_{0|0} = Q_0$, and all noises and initial state are mutually independent.

Classical Kalman recursion at each $t$:

• Prediction:

$$\hat X_{t|t-1} = F_t \hat X_{t-1|t-1},\quad \Sigma_{t|t-1} = F_t \Sigma_{t-1|t-1} F_t^\top + Q_t$$

• Innovation:

$\Delta Y_t = Y_t - Z_t \hat X_{t|t-1}$

• Correction:

$$M^0_t = \Sigma_{t|t-1} Z_t^\top (Z_t \Sigma_{t|t-1} Z_t^\top + V_t)^{-1}$$

$\hat X_{t|t} = \hat X_{t|t-1} + M^0_t \Delta Y_t$

$\Sigma_{t|t} = (I_p - M^0_t Z_t) \Sigma_{t|t-1}$

2. IO-Contamination Model and Minimax Criterion

Innovation outliers are modeled as gross deviations affecting the process noise $v_t$. Formally, for each $t$, the conditional law of $X_t|X_{t-1}$ is a mixture: with probability $1-r$, $v_t$ is Gaussian, and with probability $r$, it follows an arbitrary distribution. The contamination neighborhood is:

$$\mathcal U^{\rm IO}(r) = \left\{ \text{mixtures of } N(F_t X_{t-1}, Q_t) \text{ and arbitrary law, mass } r \right\}$$

The robust estimation objective is minimax-MSE:

$$\hat X_{t|t} = \arg\min_f \sup_{P \in \mathcal U^{\rm IO}(r)} \mathbb{E}_P\left\| X_t - f(Y_{1:t}) \right\|^2$$

3. Derivation and Algorithm of the Dedicated IO-Robust Filter (rLS.IO)

The derivation centers on the estimation of the one-step state innovation $\Delta X_t := X_t - \hat X_{t|t-1}$ from the pre-whitened innovation $\Delta Y_t = Z_t \Delta X_t + \varepsilon_t$.

Under the ideal model:

• $\Delta X_t \sim N(0, \Sigma_{t|t-1})$
• $\varepsilon_t \sim N(0, V_t)$

Classical (non-robust) estimator:

$\hat{\Delta X}_t^{\rm lin} = M^0_t \Delta Y_t$

To prevent treating all large innovations as measurement noise in presence of IO-contamination, the rLS.IO filter applies Huber-type clipping to the linearized measurement noise residual:

• Residual-for-noise: $r_t = (I_q - Z_t M^0_t) \Delta Y_t$
• Huber function: $H_b(u) = u \min(1, b/\|u\|)$ for $u \in \mathbb{R}^q$

The IO-robust correction is constructed as follows:

Step	Operation	Purpose
1	Compute $$\hat X_{t|t-1},\, \Sigma_{t|t-1},\, M^0_t,\, \Delta Y_t$$	Classical prediction and innovation
2	$r_t = (I_q - Z_t M^0_t)\Delta Y_t$	Linearization of measurement error
3	$r_t^c = H_b(r_t)$	Huber clipping of residual-for-noise
4	$$\widehat{\Delta X}_t^{\rm IO} = Z_t^{-1}(\Delta Y_t - r_t^c)$$	Unclipped innovation attributed to state
5	$$\hat X_{t|t} = \hat X_{t|t-1} + Z_t^{-1}\bigl[\Delta Y_t - H_b\bigl((I_q - Z_t M^0_t)\Delta Y_t\bigr)\bigr]$$	Final IO-robust state update

The resulting map is piecewise linear in $\Delta Y_t$, with a state-dependent correction gain.

If $Z_t$ is not invertible (i.e., $q < p$), a suitable generalized inverse is used, or the method is embedded in a robust smoother.

4. Clipping Threshold Calibration and Implementation

The minimax optimal Huber threshold $b=b(r)$ is determined by the contamination radius $r$ and solves:

$(1-r)\mathbb{E}_{\rm id}[\|r_t\| - b]_+ = r b$

where $[x]_+ = \max\{x,0\}$, $r_t$ is distributed as $(I_q - Z_t M^0_t)\Delta Y_t$ under the nominal model.

Alternatively, an efficiency-tuned threshold is based on allowing a premium $\delta>0$ on the ideal MSE:

$$\mathbb{E}_{\rm id}\left\| Z_t^{-1}H_b((I - Z_t M^0_t)\Delta Y) - Z_t^{-1}(I - Z_t M^0_t)\Delta Y \right\|^2 = (1+\delta)\mathbb{E}_{\rm id}\left\| Z_t^{-1}(I - Z_t M^0_t)\Delta Y \right\|^2$$

In practice, $b$ (or $b(r)$) is precomputed offline. The online computational overhead per step is minimal, requiring (in addition to the classical Kalman steps) a matrix–vector multiplication, norm and scalar evaluation, and Huber clipping.

5. Theoretical Properties and Performance Comparison

The rLS.IO filter achieves one-step minimax-MSE optimality with respect to IO-contamination. Specifically:

• It attains the saddle point of $$\min_f \max_{P \in \mathcal U^{\rm IO}(r)} \mathbb{E}_P\|X-f(Y)\|^2$$ at each step.
• Under mild regularity, this one-step argument applies recursively, making rLS.IO optimally robust to single-step IOs in time series contexts.

Comparison to alternatives:

• Classical Kalman filter: rLS.IO more effectively tracks sudden structural changes (level shifts or regime changes) because it does not absorb large innovations as measurement noise.
• AO-robust filter (rLS.AO): While rLS.AO applies Huberization to $M^0_t\Delta Y_t$, thus damping exogenous measurement outliers, rLS.IO specifically tracks endogenous state changes driven by process noise.
• Hybrid (rLS.IOAO): In environments with both IOs and AOs, rLS.AO and rLS.IO can be operated in parallel, with switch-over based on runs of large innovations, forming a hybrid filter that addresses both outlier types at the cost of a small delay.

6. Context, Significance, and Connections

Robust filtering under model misspecification is essential in applications where latent state transitions are intermittently subjected to large, unpredictable shifts. Dedicated-IO filtering, as formalized in rLS.IO, enables accurate state estimation in the presence of endogenous non-Gaussian disturbances, addressing a gap left by AO-focused robustification and the baseline Kalman approach.

The development of separate optimally robust (in the minimax sense) procedures for AO and IO regimes, their hybridization, and explicit comparison to classical ACM and repeated-median-based filters is detailed in (Ruckdeschel, 2010). A plausible implication is an expanded toolkit for robust state-space estimation in domains such as econometrics, navigation, and signal processing, where distinguishing between system-intrinsic and exogenous disruptions is critical.