---
title: Koopman Invariant Subspace Learning
url: https://www.emergentmind.com/topics/koopman-invariant-subspace-learning
type: topic
---

# Koopman Invariant Subspace Learning

Koopman invariant subspace learning is the theoretical and algorithmic endeavor of identifying finite- or low-dimensional subspaces of observables that are (exactly or approximately) invariant under the action of the Koopman operator for a dynamical system. The construction and characterization of such subspaces are central to leveraging the linearity of the Koopman operator in the analysis, prediction, and control of nonlinear dynamical systems. The field is distinguished by precise definitions of subspace invariance, algorithmic strategies for discovering invariant subspaces from data, error analysis grounded in functional analysis and geometry, and extensive applications in model reduction, system identification, and control.

## 1. Koopman Operator and Subspace Invariance

Let \( X \subset \mathbb{R}^n \) be the state space of a discrete or continuous dynamical system and \( F \) a (possibly infinite-dimensional) inner-product space of observables (functions \( f: X \to \mathbb{C} \)). The (discrete-time) Koopman operator \( K: F \to F \) is defined by \( (Kf)(x) = f(T(x)) \), where \( T: X \to X \) is the state-transition map. A subspace \( V \subset F \) is Koopman-invariant if \( K V \subset V \), i.e., for every \( f \in V \), \( Kf \in V \).

**Finite-dimensional Koopman-invariant subspaces** provide a setting in which the nonlinear dynamics, when observed through suitable nonlinear observables, evolve linearly in time. If \( V \) has basis \( \{\psi_1, ..., \psi_m\} \), then
\[
K \psi_j = \sum_{i=1}^m K_{ij} \psi_i,
\]
with \( K \) an \( m \times m \) matrix, and the evolution in the lifted coordinates \( z_k = (\psi_1(x_k), ..., \psi_m(x_k)) \) is given by \( z_{k+1} = K z_k \). This enables spectral analysis, stable approximation, prediction, and Koopman-based model reduction for otherwise nonlinear systems [1510.03007], [1909.01419].

**Approximate invariance** is typically necessary in nonlinear and finite-dimensional settings. Subspace \( V \) exhibits uniform finite approximate closure if the closure error
\[
\epsilon_N = \sup_{f \in V, \|f\|=1} \| K f - P_V K f \|
\]
is uniformly small, where \( P_V \) denotes orthogonal projection onto \( V \) [2212.07358], [2311.13033].

## 2. Quantifying and Certifying Invariance: Invariance Proximity

A central quantitative notion is the **invariance proximity** \( \delta(V) \), providing a tight, worst-case upper bound on the relative one-step prediction error incurred by projecting the Koopman operator onto \( V \) [2311.13033], [2307.15368]. Formally,
\[
\delta(V) = \sup_{f \in V, \|Kf\| \neq 0} \frac{\| Kf - P_V Kf \|}{\|Kf\|}.
\]
This leads to the error-bound property:
\[
\| Kf - K_{\rm approx} f \| \le \delta(V) \| Kf \|, \quad K_{\rm approx} = P_V K,
\]
and no tighter uniform bound holds.

A key theoretical advance is a **closed-form formula for \(\delta(V)\)** via principal angles between \( V \) and its image \( K(V) \). Let \( \theta_{m_2} \) be the largest principal angle (Jordan angle) between \( V \) and \( K(V) \). Then
\[
\delta(V) = \sin\bigl( \theta_{m_2} \bigr )
\]
which reduces computation to standard singular value decomposition (SVD) routines via
\[
\delta(V) = \sqrt{1 - \sigma_{m_2}^2},
\]
with \( \sigma_{m_2} \) the minimal singular value of the matrix of inner products between orthonormal bases for \( V \) and \( K(V) \). This enables efficient certification and optimization of subspace invariance in practical computations [2311.13033].

## 3. Data-Driven Algorithms for Invariant Subspace Discovery

### 3.1 Symmetric Subspace Decomposition (SSD)

SSD is an iterative algorithm guaranteeing (under mild conditions) convergence to the maximal Koopman-invariant subspace in the span of a user-supplied dictionary. The method tests for range correspondence between the dictionary at current and next time-steps (forward and backward), systematically pruning directions that fail the invariance symmetry condition. The result is a reduced dictionary with basis functions spanning the maximal invariant subspace represented in the data [1909.01419], [2005.06138]. Extensions include:

- Approximated-SSD, which relaxes to approximate invariance via truncated SVD.
- Streaming SSD (SSSD), supporting online data assimilation with fixed memory.

### 3.2 Grassmannian Optimization

Invariance proximity \( \delta(V) \) is minimized directly as a **cost function on the Grassmann manifold**. Optimization is over the set of subspaces of fixed dimension, using gradient or conjugate-gradient methods that leverage the geometry of the Grassmannian and efficient SVD-based computation of principial angles. This approach enables systematic refinement (or augmentation) of dictionaries towards maximally invariant subspaces [2511.07234], [2311.13033].

### 3.3 Deep Learning and Dictionary Learning Frameworks

Neural networks can parameterize the dictionary \( \psi_\theta \) and, jointly with the projected Koopman operator, can be trained using various loss functions enforcing approximate invariance. Notably, the **Koopman auto-encoding loss** combines prediction and reconstruction terms, and recent works incorporate multistep prediction consistency and information-theoretic regularization to mitigate overfitting and ensure expressivity [2511.12760], [2510.13025], [2306.17396]. 

State-inclusive logistic lifting (SILL), augmented with conjunctive logistic and RBF-like functions, provides analytic control of approximate subspace invariance, and neural learning approaches such as deepDMD and FlowDMD are empirically observed to recover nearly invariant subspaces of minimal required dimension [2212.07358], [2212.07365], [2306.17396].

## 4. Error Bounds, Theoretical Guarantees, and Structural Limitations

Theoretical analysis centers on uniform finite approximate closure—guaranteeing that subspace projection of the Koopman generator yields arbitrarily small error as dictionary parameters (e.g., steepness in SILL, dictionary size) increase. For heterogeneous dictionaries (e.g., "augSILL"), closure errors decay exponentially in parameter and measurement dimensions, explaining the empirical success and efficiency of deep-learning-derived dictionaries [2212.07365], [2206.13585]. 

Principal-angle based invariance proximity provides a **tight, computable certificate** for the worst-case relative error, but is conservative with respect to average prediction error. The analytic inclusion of the state variable in the finite-dimensional invariant subspace is only possible for systems topologically conjugate to a single fixed point, ruling out global finite-dimensional Koopman representations for systems with richer attractor structures [1510.03007].

## 5. Algorithmic and Computational Considerations

Key computational elements include:

- SVD-based computation of principal angles for invariance proximity and subspace augmentation.
- Nullspace and range calculations for SSD and P-SSD (parallel distributed SSD) supporting scaling to large dictionaries and distributed datasets [2005.06138].
- Learning routines combining batch and streaming data acquisition, regularized regression (elastic net or group-LASSO) to achieve parsimonious representations, and stochastic optimization (Adam, SGD) for deep learning settings.

Empirical studies demonstrate the impact of dictionary construction, size, and mixing on predictive accuracy, parameter efficiency, and interpretability, with deep or heterogeneous dictionaries providing state-of-the-art performance at a fraction of the complexity of traditional monomial or kernel approaches [2212.07365], [2511.07234].

## 6. Applications, Extensions, and Current Research Directions

Koopman-invariant subspaces underpin a variety of operator-theoretic model reduction techniques, spectral analysis, forecasting, and nonlinear control design—including pole placement via Koopman lifting, with closed-loop eigenvalue assignment [2208.08883], [2310.01124]. Extensions to systems with parameters, stochastic dynamics, and control inputs have led to architectures capable of learning parameter-indexed operator families and leveraging invariance proximity for consistent model quality guarantees [2310.01124], [2307.15368].

Recent advances incorporate information-theoretic controls on latent representation—balancing compression and expressiveness through mutual information and entropy-based regularization [2510.13025], multistep prediction losses [2511.12760], and invertible neural architectures for simultaneous reconstruction and invariant basis discovery [2306.17396].

Open problems and active areas include:

- Quantitative sharpness of invariance proximity for multi-step, average-case, or system-specific error metrics.
- Scalable, efficient algorithms for very high-dimensional systems and data streams.
- Integration of symmetry, control, and heterogeneity in learned dictionaries.
- Provable continual learning (online adaptation) with finite regret and stability guarantees [2511.12760].

## 7. Summary Table: Core Methods for Koopman Invariant Subspace Learning

| Approach                       | Core Principle                                  | Primary Reference(s)        |
|------------------------------- |-------------------------------------------------|-----------------------------|
| SSD/SSSD/(P-)SSD               | Nullspace/range symmetry in data-lifted space   | [1909.01419], [2005.06138]  |
| Grassmann Optimization         | Subspace selection via geometric cost (principal angle) | [2511.07234], [2311.13033]  |
| Deep Dictionary Learning       | Joint NN-based learning of observables/invariance| [2510.13025], [2306.17396]  |
| SILL/augSILL (analytic)        | Parameterized homogeneous/heterogeneous closure  | [2212.07358], [2212.07365]  |
| RKHS-based Kernel Regression   | Operator regression in kernel feature space      | [2205.14027], [2505.05085]  |
| Sparsity-promoting Selection   | Pruning of non-invariant or spurious components  | [2002.10637]                |

These approaches collectively underpin modern Koopman invariant subspace learning, providing a mathematically rigorous foundation for extracting linear models underlying high-dimensional, nonlinear dynamical systems. The advances in quantifying invariance, certifying model error, and developing scalable learning algorithms have cemented Koopman subspace learning as a paradigmatic tool in data-driven dynamical systems, with ongoing research focusing on robustness, adaptivity, and interpretability across scientific and engineering domains.

Source: https://www.emergentmind.com/topics/koopman-invariant-subspace-learning