---
title: Discrete-Time Conditional Gaussian Koopman Network
url: https://www.emergentmind.com/topics/discrete-time-conditional-gaussian-koopman-network-cgkn
type: topic
---

# Discrete-Time Conditional Gaussian Koopman Network

Discrete-Time Conditional Gaussian Koopman Network (CGKN) denotes a class of learned surrogate models for partially observed nonlinear dynamical systems in which the unobserved state is mapped to a latent Koopman-style representation whose evolution is linear conditional on the observed variables. The resulting joint model is a conditional Gaussian nonlinear system, so the latent posterior remains Gaussian and can be updated analytically for data assimilation (DA). In the literature, CGKN first appears as a continuous-time framework based on neural differential equations and is then specialized to a directly discrete-time formulation that learns the coarse time-\(\Delta t\) solution map itself rather than relying on internal time integration [2410.20072][2507.08749].

## 1. Emergence and scope

The defining motivation of CGKN is the joint treatment of forecasting and DA within one trainable model. Conventional deep surrogates can approximate nonlinear dynamics well, but their black-box structure makes DA expensive and typically forces the use of ensemble-based methods with sampling error and empirical tuning. CGKN addresses this by retaining enough nonlinear structure to model complex dynamics while enforcing a conditional Gaussian latent architecture that yields analytic filtering formulae [2410.20072].

The transition from the 2024 formulation to the discrete-time version is not merely a change of notation. The continuous-time model is written as a conditional Gaussian neural SDE/ODE, whereas the discrete-time model learns the time-\(\Delta t\) map directly at the temporal resolution of the data. This shift is especially important for PDE surrogates trained on coarse output intervals, because it removes the need for expensive numerical integration inside the learned model [2507.08749].

| Formulation | Core latent structure | Main emphasis |
|---|---|---|
| Continuous-time CGKN | \(\frac{d\mathbf{v}}{dt}=\mathbf{f}_2(\mathbf{u}_1)+\mathbf{g}_2(\mathbf{u}_1)\mathbf{v}+\boldsymbol{\sigma}_2\dot{\mathbf{W}}_2\) | Forecasting and analytic DA in neural differential equations |
| Discrete-time CGKN | \(\mathbf{v}^{n+1}=\mathbf{F}_2(\mathbf{u}_1^n)+\mathbf{G}_2(\mathbf{u}_1^n)\mathbf{v}^n+\boldsymbol{\sigma}_2\boldsymbol{\epsilon}_2^n\) | Direct learning of the coarse solution map |
| Lagrangian CGKN | Same conditional Gaussian latent form, with tracer-specific observation structure | DA and prediction from Lagrangian observations |

A central conceptual point is that CGKN is Koopman-inspired rather than fully Koopman-linear. Standard Koopman learning typically seeks a lifted state with globally linear dynamics. CGKN instead learns a latent embedding of the hidden state and only requires linearity in that latent state conditional on the observed variables. This substantially enlarges the admissible model class while preserving tractable posterior inference [2410.20072][2507.08749].

## 2. Discrete-time state-space formulation

The discrete-time setting begins with a partially observed nonlinear dynamical system
\[
\mathbf{u}^{n+1}=\mathcal{G}(\mathbf{u}^n), \qquad \mathbf{u}^n=(\mathbf{u}_1^n,\mathbf{u}_2^n),
\]
where \(\mathbf{u}_1^n\) denotes observed variables and \(\mathbf{u}_2^n\) denotes unobserved variables. In general,
\[
\mathbf{u}_1^{n+1}=\mathcal{G}_1(\mathbf{u}_1^n,\mathbf{u}_2^n), \qquad
\mathbf{u}_2^{n+1}=\mathcal{G}_2(\mathbf{u}_1^n,\mathbf{u}_2^n).
\]
CGKN replaces this with a surrogate in which the hidden component is encoded into a latent variable \(\mathbf{v}^n\) through an autoencoder:
\[
\mathbf{v}=\boldsymbol{\varphi}(\mathbf{u}_2), \qquad \mathbf{u}_2=\boldsymbol{\psi}(\mathbf{v}).
\]
The learned surrogate is
\[
\begin{aligned}
\mathbf{u}_1^{n+1} &= \mathbf{F}_1(\mathbf{u}_1^n)
+ \mathbf{G}_1(\mathbf{u}_1^n)\mathbf{v}^n
+ \boldsymbol{\sigma}_1\boldsymbol{\epsilon}_1^n,\\
\mathbf{v}^{n+1} &= \mathbf{F}_2(\mathbf{u}_1^n)
+ \mathbf{G}_2(\mathbf{u}_1^n)\mathbf{v}^n
+ \boldsymbol{\sigma}_2\boldsymbol{\epsilon}_2^n,
\end{aligned}
\]
with independent standard Gaussian noises \(\boldsymbol{\epsilon}_1^n,\boldsymbol{\epsilon}_2^n\) [2507.08749].

This model is nonlinear in the full state because \(\mathbf{F}_1,\mathbf{F}_2,\mathbf{G}_1,\mathbf{G}_2\) depend nonlinearly on \(\mathbf{u}_1^n\). Yet for fixed \(\mathbf{u}_1^n\), the update is affine in \(\mathbf{v}^n\). That is the precise sense in which the model is conditional Gaussian. It is also the sense in which the latent representation is “Koopman”: the latent dynamics are simple—linear in \(\mathbf{v}\)—once conditioned on the observed coordinates [2507.08749].

The continuous-time predecessor uses the analogous structure
\[
\frac{d \mathbf{u}_1}{dt}=\mathbf{f}_1(\mathbf{u}_1)+\mathbf{g}_1(\mathbf{u}_1)\mathbf{v}+\boldsymbol{\sigma}_1\dot{\mathbf{W}}_1,\qquad
\frac{d \mathbf{v}}{dt}=\mathbf{f}_2(\mathbf{u}_1)+\mathbf{g}_2(\mathbf{u}_1)\mathbf{v}+\boldsymbol{\sigma}_2\dot{\mathbf{W}}_2,
\]
and the discrete-time model can be viewed as learning the corresponding time-discretized solution operator directly [2410.20072].

## 3. Conditional Gaussian inference and analytic data assimilation

Because the latent dynamics are linear-Gaussian once the observed trajectory is fixed, the posterior
\[
p(\mathbf{v}^n \mid \{\mathbf{u}_1^i\}_{i=0}^n)
\]
is Gaussian. Writing
\[
\boldsymbol{\mu}_{\mathbf{v}^n}=\mathbb{E}\!\left[\mathbf{v}^n\mid \{\mathbf{u}_1^i\}_{i=0}^n\right], \qquad
\boldsymbol{\Sigma}_{\mathbf{v}^n}=\operatorname{Cov}\!\left(\mathbf{v}^n\mid \{\mathbf{u}_1^i\}_{i=0}^n\right),
\]
the discrete-time conditional Gaussian filter is
\[
\begin{aligned}
\boldsymbol{\mu}_{\mathbf{v}^{n+1}}
&= \mathbf{F}_2 + \mathbf{G}_2\,\boldsymbol{\mu}_{\mathbf{v}^{n}}
+ \mathbf{K}^n \Big(\mathbf{u}_1^{n+1} - \mathbf{F}_1 - \mathbf{G}_1\,\boldsymbol{\mu}_{\mathbf{v}^{n}}\Big),\\
\boldsymbol{\Sigma}_{\mathbf{v}^{n+1}}
&= \mathbf{G}_2\,\boldsymbol{\Sigma}_{\mathbf{v}^{n}}\,\mathbf{G}_2^\top
+ \boldsymbol{\sigma}_2\boldsymbol{\sigma}_2^\top
- \mathbf{K}^n \mathbf{G}_1 \boldsymbol{\Sigma}_{\mathbf{v}^{n}} \mathbf{G}_2^\top,
\end{aligned}
\]
with
\[
\mathbf{K}^{n} = \mathbf{G}_2 \boldsymbol{\Sigma}_{\mathbf{v}^{n}} \mathbf{G}_1^\top
\Big(
\boldsymbol{\sigma}_1\boldsymbol{\sigma}_1^\top
+ \mathbf{G}_1 \boldsymbol{\Sigma}_{\mathbf{v}^{n}} \mathbf{G}_1^\top
\Big)^{-1}.
\]
These recursions are Kalman-like but with coefficients depending on \(\mathbf{u}_1^n\) through the learned networks [2507.08749].

The physical hidden state is recovered through the decoder:
\[
\boldsymbol{\mu}^n=\boldsymbol{\psi}(\boldsymbol{\mu}_{\mathbf{v}^n}) \approx
\mathbb{E}\!\left[\mathbf{u}_2^n \mid \{\mathbf{u}_1^i\}_{i=0}^n\right].
\]
This approximation is exact only if the decoder is linear; with a nonlinear decoder, \(\boldsymbol{\psi}(\boldsymbol{\mu}_{\mathbf{v}^n})\) is used as a practical posterior mean surrogate and is explicitly optimized during training through the DA loss [2507.08749].

A major computational consequence is that DA no longer requires ensembles. In the discrete-time benchmarks, the latent filter is analytic and significantly cheaper than EnKF applied to the full PDE model. For viscous Burgers’, the reported DA cost per trajectory is \(0.02\) s for CGKN versus \(12\) s for EnKF; for Kuramoto–Sivashinsky it is about \(0.8\) s versus \(100\) s; for \(2\)-D Navier–Stokes it is about \(80\) s versus about \(25000\) s on the same hardware [2507.08749].

## 4. Learning objectives, noise estimation, and implementation

The discrete-time formulation trains four coupled components: an encoder \(\boldsymbol{\varphi}\), a decoder \(\boldsymbol{\psi}\), and a dynamics network producing \(\mathbf{F}_1,\mathbf{G}_1,\mathbf{F}_2,\mathbf{G}_2\) as functions of \(\mathbf{u}_1\). The total objective is
\[
L = \lambda_{\mathrm{AE}} L_{\mathrm{AE}}
+ \lambda_{\mathbf{u}} L_{\mathbf{u}}
+ \lambda_{\mathbf{v}} L_{\mathbf{v}}
+ \lambda_{\mathrm{DA}} L_{\mathrm{DA}}.
\]
The four terms are:
\[
L_{\mathrm{AE}}
= \mathbb{E}_{\mathbf{u}_2^\star}
\left\|
\mathbf{u}_2^\star-\boldsymbol{\psi}(\boldsymbol{\varphi}(\mathbf{u}_2^\star))
\right\|^2,
\]
\[
L_{\mathbf{u}}
= \mathbb{E}_{\mathbf{u}^{0\star}}
\frac{1}{N_s}\sum_{n=1}^{N_s}
\left\|\mathbf{u}^{n\star}-\mathbf{u}^{n}\right\|^2,
\]
\[
L_{\mathbf{v}}
= \mathbb{E}_{\mathbf{u}^{0\star}}
\frac{1}{N_s}\sum_{n=1}^{N_s}
\left\|\mathbf{v}^{n\star}-\mathbf{v}^{n}\right\|^2,
\qquad
\mathbf{v}^{n\star}=\boldsymbol{\varphi}(\mathbf{u}_2^{n\star}),
\]
and
\[
L_{\mathrm{DA}}
=
\mathbb{E}_{\mathbf{u}^{0\star}}
\frac{1}{N_l-N_b}\sum_{n=N_b+1}^{N_l}
\left\|
\mathbf{u}_2^{n\star}-\boldsymbol{\mu}^{n}
\right\|^2,
\qquad
\boldsymbol{\mu}^{n}=\boldsymbol{\psi}(\boldsymbol{\mu}_{\mathbf{v}^n}).
\]
Here \(N_b\) is a warm-up period for the filter [2507.08749].

Training is carried out in two stages. First, the model is fit without the DA term. Then the diagonal noise levels are estimated from one-step residuals:
\[
\mathrm{diag}(\boldsymbol{\sigma}_1)
=
\sqrt{
\frac{1}{N}\sum_{n=1}^{N}
(\mathbf{u}_1^{n\star}-\mathbf{u}_1^{n})
\odot
(\mathbf{u}_1^{n\star}-\mathbf{u}_1^{n})
},
\]
\[
\mathrm{diag}(\boldsymbol{\sigma}_2)
=
\sqrt{
\frac{1}{N}\sum_{n=1}^{N}
(\mathbf{v}^{n\star}-\mathbf{v}^{n})
\odot
(\mathbf{v}^{n\star}-\mathbf{v}^{n})
}.
\]
With \(\boldsymbol{\sigma}_1,\boldsymbol{\sigma}_2\) fixed, the model is retrained using the full objective including \(L_{\mathrm{DA}}\) [2507.08749].

The original CGKN implementation uses fully connected networks for the one-dimensional benchmark systems and a convolutional autoencoder for the \(2\)-D Navier–Stokes case. The continuous-time predecessor emphasizes that DA performance is not an afterthought placed on top of a black-box predictor; it is incorporated directly into the optimization of the model, so the learned latent space is shaped simultaneously by forecast fidelity and inferential tractability [2410.20072].

## 5. Relation to Koopman modeling, stochastic lifting, and control

CGKN occupies a specific position within the broader Koopman literature. Standard deep Koopman models seek a lifting \(\mathbf{z}=\Phi(\mathbf{x})\) such that \(\mathbf{z}_{k+1}\approx \mathbf{K}\mathbf{z}_k\), often with a decoder back to the observation space; this has been demonstrated for video data, discrete spectra, and mode extraction, with explicit latent linear evolution as the architectural constraint [2010.09245]. CGKN keeps the encoder–linear-latent–decoder pattern but relaxes global linearity to conditional linearity, replacing a fixed \(\mathbf{K}\) by state-dependent operators \(\mathbf{G}_1(\mathbf{u}_1)\) and \(\mathbf{G}_2(\mathbf{u}_1)\) acting on the latent state [2507.08749].

For nonlinear systems with inputs, exact discrete-time Koopman lifting generally does not preserve a constant LTI input matrix. Instead, the exact lifted form is
\[
\Phi(x_{k+1}) = A\Phi(x_k) + B(x_k,u_k)u_k,
\]
or, in scheduling form,
\[
z_{k+1}=A z_k + B_z(p_k)u_k, \qquad p_k=\mu(z_k,u_k),
\]
so the natural object is an LPV-like Koopman model rather than a purely LTI one [2207.12132]. For control-affine systems, a closely related lifted backbone is the bilinear model
\[
z_{t+1}=A z_t + u_t B z_t,
\]
for which controllability analysis and CLF/LMI-based stabilization have been developed in discrete time [2203.14114]. These results clarify that conditional or input-dependent Koopman operators are structurally natural rather than ad hoc.

Several neighboring probabilistic formulations illuminate CGKN from different directions. A discrete-time CGKN can be understood as a neural, conditional-Gaussian analogue of Koopman-Equivariant Gaussian Processes, which also place linear time evolution in Koopman features at the center and obtain closed-form multistep Gaussian trajectory distributions through linear propagation of uncertainty [2502.06645]. The Stochastic Adversarial Koopman model likewise uses Gaussian latent states, discrete-time Koopman evolution for mean and log-standard deviation, and parameter-conditioned Koopman matrices, but its emphasis is adversarial training and latent sequence prediction rather than analytic DA [2109.05095]. Physics-informed Koopman networks add generator-based or discrete residual constraints to learn Koopman eigenfunctions with fewer trajectories, suggesting a route to hybrid CGKN training when governing equations or operators are partially known [2211.09419].

A plausible implication is that control-theoretic Koopman tools such as observability and controllability Gramians, balancing, and balanced truncation can serve as principled latent-dimension diagnostics for CGKN-type models, since they quantify which lifted coordinates matter most for input-output behavior in discrete time [1709.08712]. At the operator-theoretic end, separate state and input liftings into RKHSs yield an exact bilinear representation
\[
\phi_{x^+}=M_1\phi_x+M_2\varphi_u+M_3(\phi_x\otimes\varphi_u),
\]
which suggests a rigorous foundation for conditional Gaussian control extensions of CGKN [2606.10344].

## 6. Structured variants, empirical performance, and limitations

The most substantial structured extension is the Lagrangian conditional Gaussian Koopman network (LaCGKN), developed for inferring Eulerian flow fields from moving tracer observations. In that setting, the observed variables are tracer positions and the hidden variables are Eulerian flow fields. LaCGKN preserves the conditional Gaussian latent form but modifies the observation model through tracer homogenization, Fourier positional encoding, and an SVD-inspired low-rank parameterization
\[
\mathbf{G}_2=\mathbf{U}\,\mathrm{diag}(\mathbf{s})\,\mathbf{V}^\top+\mathrm{diag}(\boldsymbol{\delta}),
\]
with \(r\ll d_z\), reducing parameter count from \(\mathcal{O}(d_z^2)\) to \(\mathcal{O}(d_z r)\) while maintaining an expressive latent transition operator [2603.14115].

In the two-layer quasi-geostrophic example of LaCGKN, the reported one-step flow RMSE is \(0.037\) for the high-capacity LaCGKN\(_{32}\), compared with \(0.070\) for a DNN(tracer)+CNN(flow) baseline and \(0.243\) for persistence. For posterior flow-field RMSE under DA, LaCGKN reports \(0.464\), compared with \(0.481\) for EnKF, \(0.710\) for optimal interpolation, and \(0.681\) for climatology; the method is also reported as about \(100\times\) faster than parallelized EnKF on the same CPU [2603.14115].

For the directly discrete-time PDE benchmarks, the reported CGKN errors are as follows [2507.08749]:

| System | CGKN forecast MSE | CGKN DA MSE |
|---|---:|---:|
| Viscous Burgers’ equation | \(7.57\times 10^{-4}\) | \(7.50\times 10^{-4}\) |
| Kuramoto–Sivashinsky equation | \(1.10\times 10^{-2}\) | \(2.49\times 10^{-2}\) |
| \(2\)-D Navier–Stokes equations | \(1.98\times 10^{1}\) | \(6.09\times 10^{1}\) |

These values are accompanied by strong comparisons against both pure forecast surrogates and model-based DA. In the same experiments, FNO attains forecast MSE \(3.97\times10^{-4}\), \(5.49\times10^{-3}\), and \(1.71\times10^{1}\) on the three systems, while EnKF attains DA MSE \(5.81\times10^{-4}\), \(2.49\times10^{-2}\), and \(6.90\times10^{1}\), respectively. The principal empirical conclusion is therefore not that CGKN dominates all forecast models, but that it attains forecast skill close to state-of-the-art SciML surrogates while simultaneously providing efficient, accurate DA within the same learned architecture [2507.08749].

The main limitations are structural. The model assumes additive Gaussian white noises in the latent-form surrogate, and it assumes that the hidden dynamics can be represented as conditionally linear in a suitable latent space. Training in current formulations requires offline full-state data for supervision of the hidden state or its encoding. Because \(\mathbf{u}_2=\boldsymbol{\psi}(\mathbf{v})\) is nonlinear, physical-space posterior covariance is not analytic and is commonly approximated through residual-based uncertainty networks rather than exact propagation. Finally, latent covariance updates scale cubically in latent dimension in the generic dense case, which motivates low-rank, sparse, or local parameterizations in high-dimensional settings [2410.20072][2507.08749].

In this sense, the discrete-time CGKN is best understood not as a generic replacement for deep sequence models, but as a structure-preserving compromise: it forgoes full black-box flexibility in exchange for conditional Gaussian tractability, analytic DA, and a Koopman-style latent organization that remains effective on shocks, spatiotemporal chaos, turbulence, and Lagrangian observation problems [2507.08749][2603.14115].

Source: https://www.emergentmind.com/topics/discrete-time-conditional-gaussian-koopman-network-cgkn