---
title: Neural Koopman Embeddings
url: https://www.emergentmind.com/topics/neural-koopman-embeddings
type: topic
---

# Neural Koopman Embeddings

Neural Koopman Embeddings

Neural Koopman embeddings constitute a framework for learning finite-dimensional, often deep neural, coordinate transformations in which nonlinear dynamical systems evolve linearly (or nearly linearly) in latent space. This paradigm leverages Koopman operator theory—in which a nonlinear system is globally linearized by lifting the dynamics to an appropriate space of observables—while employing modern neural architectures to flexibly parameterize the requisite embeddings, operators, and their composition with additional domain constraints. The resulting pipeline endows nonlinear system identification, prediction, control, and scientific inference with the computational tractability and analysis tools native to linear systems, while retaining the powerful representation learning capabilities of neural networks.

## 1. Koopman Operator Theory and Neural Parameterization

Koopman operator theory asserts that nonlinear dynamical systems admit an (infinite-dimensional) linear representation: for a discrete-time system $x_{k+1} = f(x_k)$, the Koopman operator $\mathcal{K}$ acts on observables $g$ by $(\mathcal{K}g)(x) = g(f(x))$. If a finite dictionary $\{\phi_i(x)\}$ spans a Koopman-invariant subspace, then the evolution in the lifted space $z_k = \phi(x_k)$ obeys $z_{k+1} = K z_k$ for a finite matrix $K$.

Neural Koopman embeddings replace the fixed dictionary with a neural encoder $\phi_\theta$, possibly concatenated with the identity on $x$, and jointly learn both the embedding and a finite $K$. Autoencoders ($x \leftrightarrow z$) are often employed for invertibility, and the linearity constraint is enforced by multi-step prediction losses, with additional regularization and inductive bias tailored to system class (e.g., stability, symplecticity, compositional structure).

Notably, recent architectures generalize $K$ to depend on conditioning variables, auxiliary tasks, or nonlinear maps (e.g., $U_\psi$ in operator-driven fusion), while maintaining the defining property that the latent evolution is, to varying approximation, governed by a Koopman-type operator [2508.16414, 2309.05317, 2401.08153].

## 2. Neural Koopman Embedding Architectures

### 2.1 Classical and Autoencoder Approaches

Early neural Koopman embeddings employ autoencoder architectures with encoders (MLPs or convolutional nets) $\phi_\theta : x \to z$, decoders $\psi_\eta: z \to x$, and a learned matrix or operator $K$ such that $z_{k+1} \approx K z_k$ and $x_{k+1} \approx \psi(K^t \phi(x_0))$ for long-horizon prediction [2309.05317, 2209.08637, 2409.01308]. Reconstruction and latent linearity/prediction losses jointly tune these components.

### 2.2 Graph Neural, Attention, and Multimodal Extensions

Neural Koopman embeddings have been applied to compositional physical systems, graph-structured data, and multimodal biological settings. For example, "NeuroKoop" [2508.16414] fuses structural and functional connectome graphs via two GCN encoders, bi-directional cross-modal attention, and a neural Koopman operator $U_\psi$, unrolling the latent state for several steps, with domain-specific modulation (working memory scores) and adversarial alignment regularizers. Message-passing architectures (KMPNN [2305.09060]) lift node and edge features via deep GNNs, followed by a diagonal or block-structured linear Koopman operator and a GNN decoder, optimizing for multi-step prediction and invariant subspace learning.

### 2.3 Data-Driven Dictionary and Time-Delay Embeddings

Dynamic Mode Decomposition (DMD) and its neural extensions (e.g., DMD-residual autoencoders [1906.03663], hybrid SDP-initialized AEs [2504.18676]) use explicit or learned dictionaries of observables, with options to augment via time-delayed (Hankel) coordinates to ensure approximate closure and improve the accuracy of finite-dimensional projections, especially for systems exhibiting memory [2409.01308, 2306.05224].

### 2.4 Structure-Preserving and Conditioning Variants

Certain formulations explicitly enforce physical structure (symplecticity in Hamiltonian systems [2308.13835]) and stability (Schur-stable or contraction-based parameterizations [2401.08153], Lyapunov-certified bilinear systems [2201.05098]). Extensions to control incorporate bilinear or state-dependent control terms, often via auxiliary networks (Deep Koopman with nonlinear control [2202.08004]), and can yield theoretical stabilizability guarantees.

### Representative Architectures Table

| Architecture Example         | Encoder Type                  | Latent Dynamics    | Key Constraints              |
|-----------------------------|-------------------------------|--------------------|------------------------------|
| NeuroKoop [2508.16414]      | GCN (structural/functional)   | MLP Koopman $U_\psi$ + modulation | Cross-modal attention, adversarial, cognitive covariates |
| KMPNN [2305.09060]          | MPNN (graph message passing)  | Diagonal/complex $K$ | Reconstruction, linearity, prediction loss |
| Hybrid SDP-AE [2504.18676]  | MLP, Hankel input (SDP order) | Linear $K$ (HAVOK) | SDP-based selection, eigenvalue nets        |
| Symplectic AE [2308.13835]  | MLP (with symplectic penalty) | Linear or cubic Hamiltonian | Symplecticity, bounded stability          |

## 3. Training Objectives and Loss Functions

Neural Koopman embedding training objectives combine:

- **Reconstruction loss:** $\mathcal{L}_{rec} = \|x - \psi(\phi(x))\|^2$, ensuring invertibility and manifold preservation [2309.05317, 2504.18676].
- **Latent linearity and multi-step prediction loss:** $\mathcal{L}_{lin} = \| \phi(x_{t+1}) - K \phi(x_t) \|^2$ and its multi-horizon or forward-decoding variants.
- **Adversarial regularization:** e.g., to align fused and real embeddings in multimodal settings [2508.16414].
- **Physical structure and stability constraints:** e.g., symplectic loss for Hamiltonian systems [2308.13835], contraction/stability via parametric $K$ [2401.08153], Lyapunov constraints [2201.05098].
- **Task losses:** classification (e.g., prenatal exposure [2508.16414]), control-tracking [2209.08637], or variational data assimilation [2309.05317].

Optimization employs Adam-type solvers, sometimes in staged protocols (SDP-initialized, pre-training, or alternating projections), with hyperparameters determined by validation (embedding dimension, memory/window size, regularization weights).

## 4. Empirical Performance, Guarantees, and Ablations

Neural Koopman embeddings exhibit state-of-the-art accuracy for nonlinear prediction and control across physical, biological, and engineering domains:

- **Classification**: NeuroKoop achieves $82.33 \pm 0.02 \%$ accuracy in fusing adolescent connectomes, a 5% absolute gain over the best baseline. Koopman layer ablation shows a dramatic accuracy drop [2508.16414].
- **Prediction**: Hybrid SDP-AE methods outperform pure neural autoencoders by order-of-magnitude improvements in 1-step MSE and accelerate convergence [2504.18676]. Message-passing implementations achieve $10^2$–$10^4\times$ lower network-dynamics error than classical or generic autoencoder baselines [2305.09060].
- **Control**: Model predictive and LQR-based policies trained on Koopman embeddings provide robust and sample-efficient tracking even under strong parametric uncertainty and disturbances, with performance gains of $>87\%$ RMSE reduction demonstrated in coupled-oscillator, manipulation, and robotic benchmarks [2405.09101, 2201.05098, 2209.08637].
- **Stability**: Explicitly stable or stabilizable parameterizations guarantee boundedness and/or contraction in the latent space, overcoming fragility of unconstrained deep Koopman approaches [2401.08153, 2308.13835, 2201.05098].

Ablation studies consistently show cross-modal attention, dynamic latent evolution, and physically congruent regularization as critical design elements [2508.16414, 2504.18676].

## 5. Applications: Multimodal Fusion, Scientific Inference, and Control

Neural Koopman embeddings have enabled a range of advanced scientific and engineering tasks:

- **Multimodal data fusion:** Integration of structural and functional brain connectivity via cross-modal attention and Koopman latent flow, enabling classification and mechanistic insight into neurodevelopmental effects [2508.16414].
- **Reduced-order modeling:** Hybrid frameworks produce compact, data-driven surrogates for high-dimensional physical and biological systems, with precise modal decomposition and uncertainty quantification via variational inference [2504.18676, 1906.03663].
- **Nonlinear control and robotics:** Bilinear or adaptive neural Koopman controllers extend efficient linear control synthesis (MPC, LQR) to complex nonlinear plants, tracking targets under model mismatch and online disturbances [2405.09101, 2202.08004, 2201.05098].
- **Scientific discovery and interpretability:** Structure-preserving embeddings (e.g., symplectic, Hamiltonian) yield interpretable latent models with guaranteed stability, supporting inverse design and principled prediction in domains such as fluid dynamics or neural development [2308.13835, 2309.05317].

## 6. Limitations, Extensions, and Open Challenges

While neural Koopman embeddings advance the data-driven identification and control of nonlinear systems, several theoretical and practical challenges remain:

- **Finite-dimensional closure:** Many dynamical systems (multi-attractor, chaotic) lack exact invariant finite-dimensional Koopman subspaces, requiring approximate or time-delay-augmented embeddings [2409.01308].
- **Curse of dimensionality:** Choice of embedding dimension and memory/order must balance fidelity and computational tractability; overparameterization may yield intractable SVDs or spurious modes [2504.18676].
- **Stability and generalization:** Without explicit structural constraints, neural embeddings may fail outside training distribution or destabilize under feedback [2401.08153, 2209.08637]. Control-aware training and regularization mitigate but do not eliminate this issue.
- **Interpretability:** While latent flows may align with Koopman modes, true diagonalization and eigenfunction extraction is limited except in special cases; direct physical meaning of neural coordinates is often elusive [2508.16414, 2306.05224].
- **Extension to complex architectures:** Generalization to convolutional, recurrent, or spatio-temporal graph networks is an active area, with block-Toeplitz or delay-embedding techniques proposed but not universally validated [2409.01308].
- **Online and adaptive learning:** Recent conformal and adaptive schemes selectively update embeddings and operators in response to model error or system drift, balancing tracking accuracy with avoidance of catastrophic forgetting [2511.12760, 2405.09101].

## 7. Outlook

Neural Koopman embeddings synthesize the analytic tractability of operator-theoretic methods with the representational power of deep learning, forming a foundation for interpretable, robust, and generalizable nonlinear system identification, prediction, data assimilation, and control. Principal directions for ongoing research include principled basis selection, scalable training for high-dimensional and multi-modal datasets, rigorous uncertainty quantification, and integration of strong priors and structure—physical, causal, or cognitive—directly into the neural-encoded Koopman framework.

**References**: [2508.16414], [2209.08637], [2409.01308], [2504.18676], [1906.03663], [2405.09101], [2306.05224], [2309.05317], [2511.12760], [2304.11925], [2308.13835], [1910.08264], [2308.13051], [2401.08153], [2305.09060], [2201.05098], [2202.08004].

Source: https://www.emergentmind.com/topics/neural-koopman-embeddings