---
title: Weighted Dynamic Mode Decomposition (wtDMD)
url: https://www.emergentmind.com/topics/weighted-dynamic-mode-decomposition-wtdmd
type: topic
---

# Weighted Dynamic Mode Decomposition (wtDMD)

Weighted Dynamic Mode Decomposition (wtDMD) is a family of algorithms that extends Dynamic Mode Decomposition (DMD) by incorporating weightings on snapshots—either in the time domain, data domain, or inner product structure. These weightings are motivated by the need to accelerate convergence of ergodic averages, adapt to time-varying or nonstationary systems, control influence of noise or spatial inhomogeneity, or impose problem-specific structure (such as physical mass matrices or noise covariance). wtDMD has significant impact on data-driven modeling, prediction, and modal analysis for dynamical systems, especially those with limited, nonuniform, or rapidly evolving datasets.

## 1. Mathematical Foundations and Classical DMD

Classical DMD operates on a sequence of state vectors (snapshots) $\{X_n\}_{n=1}^{N+1}\subset\mathbb{R}^d$ associated with a dynamical system sampled at discrete, usually uniform, time intervals. The core data matrices are
\[
\mathbb{X} = [X_1, X_2, \dots, X_N]\in\mathbb{R}^{d\times N}, \qquad \mathbb{Y} = [X_2, X_3, \dots, X_{N+1}]\in\mathbb{R}^{d\times N}.
\]
DMD seeks the best-fit linear operator $A\in\mathbb{R}^{d\times d}$ in the least-squares sense:
\[
X_{n+1}\approx A\, X_n\,, \quad n=1,\ldots, N,
\]
yielding the solution $A = \mathbb{Y}\, \mathbb{X}^{\dagger}$, where $\mathbb{X}^{\dagger}$ is the Moore–Penrose pseudoinverse. The eigendecomposition of $A$, $A V = V \Lambda$, provides DMD modes ($v_j$) and associated spectral content ($\lambda_j$), corresponding to coherent spatial-temporal patterns and their dynamics [2511.17772].

## 2. Weighted Averages and Tapering

A critical limitation of classical DMD in practical scenarios is its reliance on equal-weighted, unwindowed averages, often leading to slow convergence, especially for ergodic or nearly periodic dynamics. Weighted Birkhoff averages replace uniform weights with a smooth taper $w:[0,1]\to\mathbb{R}_+$, subject to
\[
\int_0^1 w(s)\,\mathrm{d}s = 1, \quad w^{(m)}(0) = w^{(m)}(1) = 0\quad \forall m\geq 0.
\]
Weights $w_k = w(k/N)$ de-emphasize trajectory endpoints. The weighted average for an observable $g$ becomes
\[
WB_N(g)(x_0) = \frac{1}{\alpha_N} \sum_{k=0}^{N} w_k\, g(f^k(x_0)), \quad \alpha_N = \sum_{k=0}^N w_k.
\]
For smooth or periodic systems, this approach yields super-polynomial or exponential convergence in estimating statistical properties, outperforming uniform averaging, whereas in chaotic systems convergence is never worsened [2511.17772].

## 3. Weighted DMD Operator Formulation

wtDMD replaces uniform accumulation in the Gram-type (covariance) matrices with weighted accumulations:
\[
\frac{1}{\alpha_N} \mathbb{Y}_w \mathbb{X}_w^\top = \frac{1}{\alpha_N}\sum_{n=1}^N w((n-1)/N) X_{n+1} X_n^\top,
\]
where the weighted snapshots are defined as
\[
\mathbb{X}_w = \mathbb{X}\, W^{1/2}, \quad \mathbb{Y}_w = \mathbb{Y}\, W^{1/2},
\]
and $W = \operatorname{diag}(w_0, ..., w_N)$. The weighted DMD operator is obtained by
\[
A_w = \mathbb{Y}_w \, (\mathbb{X}_w)^\dagger = \Big(\frac{1}{\alpha_N} \mathbb{Y}_w\mathbb{X}_w^\top\Big) \, \Big(\frac{1}{\alpha_N} \mathbb{X}_w\mathbb{X}_w^\top\Big)^\dagger.
\]
Spectral decomposition of $A_w$,
\[
A_w V_w = V_w \Lambda_w,
\]
gives the weighted DMD modes and eigenvalues [2511.17772].

## 4. Extensions: High-Order, Online, and Inner-Product Weighting

wtDMD generalizes along several axes:

- **Exponential Forgetting for Time-Varying Systems:** Assigning weights $w_i = \rho^{d_i}$, where $d_i$ is the delay of snapshot $i$ and $\rho\in(0,1]$ the forgetting factor, supports adaptation to nonstationarity. The weighted cost
  \[
  \sum_{k=1}^T w_k \|f_k - A f_{k-1}\|_2^2
  \]
  is minimized by solving with appropriately weighted matrices, and can be updated online using recursive rank-1 updates [1707.02876, 2101.00466].

- **High-Order Autoregressive (AR) Extensions:** wtDMD naturally extends to systems with lagged and exogenous variables, stacking multiple time steps in the input matrix, and performing analogous weighted least-squares [2101.00466].

- **Weighted Inner Product Spaces:** DMD can be reformulated with a user-prescribed, Hermitian positive-definite weight $W$ defining the data space inner product, such as mass matrices from PDE discretization, noise covariance, or physically informed weights. The resulting Rayleigh–Ritz operator $C_W = (X^* W X)^{-1} (X^* W Y)$ generalizes DMD to arbitrary weighted geometries [1708.02685].

## 5. Algorithmic and Practical Implementation

The core procedural steps for non-online wtDMD are:

1. Formulate $\mathbb{X}, \mathbb{Y}$ from snapshots.
2. Construct the diagonal weight matrix $W$ using the taper or other domain-appropriate criteria.
3. Compute $\mathbb{X}_w$, $\mathbb{Y}_w$.
4. Obtain the weighted pseudoinverse, typically via SVD.
5. Form $A_w = \mathbb{Y}_w (\mathbb{X}_w)^\dagger$.
6. Extract modes and eigenvalues via eigendecomposition of $A_w$.

For streaming/online data, rank-reduced projections are updated in closed form with key “core” matrices (e.g., $P$, $Q_X$, $Q_Y$) updated recursively, and bases augmented as required to maintain representation of new dynamical directions [2101.00466]. For models with exponential forgetting or in online settings, weighted covariance matrices can be recursively updated, avoiding storage of past data and maintaining $O(n^2)$ computational complexity per step [1707.02876].

## 6. Theoretical Guarantees and Empirical Performance

wtDMD inherits the Koopman-invariant subspace structure of classical DMD, but the convergence to the limiting operator $A_\infty$ is accelerated:
\[
\|A_w - A_\infty\| = 
\begin{cases}
O(N^{-m})\ \forall m  & \text{(super-polynomial, smooth/quasiperiodic)}, \\
O(e^{-cN})            & \text{(exponential, analytic)}, \\
O(1/N)                & \text{(chaotic, same as unweighted case)}.
\end{cases}
\]
In empirical studies, such as laminar cylinder wake flow at $\mathrm{Re}=100$, relative error $E_w(N)$ for $A_w$ is several orders of magnitude smaller than unweighted DMD $E(N)$ for moderate to large $N$ ($N\gtrsim 200$), with leading Koopman eigenvalues also more accurate [2511.17772]. In high-dimensional, sparse, or noise-contaminated contexts, low-rank truncation in weighted bases filters noise and improves robustness, especially when combined with online updates [2101.00466].

## 7. Application Scenarios and Numerical Examples

wtDMD has proven effective in diverse settings:

- **Fluid Dynamics:** Orders-of-magnitude acceleration in convergence of modal decompositions, improved spectral sharpness, and cleaner frequency recovery using physical mass-matrix weights [2511.17772, 1708.02685].
- **Transport Networks:** High-order weighted DMD for metro OD-matrix forecasting with exponential weighting achieves consistent improvement and robustness over full retraining, with compact online updates [2101.00466].
- **Real-Time and Time-Varying Systems:** Online wtDMD with forgetting factors rapidly adapts to system changes while maintaining low variance when tuned appropriately [1707.02876].
- **General Multivariate Time Series:** Domain-informed weights (physical, statistical, or measurement-driven) allow problem-specific tailoring, improved numerical conditioning, and enhanced interpretability [1708.02685].

| Study/Domain                   | Type of Weight      | Benefit                          |
|-------------------------------|---------------------|----------------------------------|
| Fluid flows [2511.17772]      | Tapered Birkhoff    | Super-polynomial convergence     |
| Metro transportation [2101.00466] | Exponential in time  | Adaptation to nonstationarity    |
| Numerical PDE [1708.02685]    | Mass matrix         | Physical energy norm, robustness |

A common theme is the ease of implementation: modifying standard DMD code to include weighted averages or replace the data inner product is straightforward, whether for batch, recursive, or online computation.

## 8. Selection of Weights and Open Directions

Weight selection is problem-dependent:

- **Tapered weights**: For stationary/smooth systems, choose bump functions vanishing at endpoints.
- **Exponential decay**: For streaming/time-varying systems, set forgetting ratio $\rho$ according to desired memory decay (e.g., half-life).
- **Inner-product weights**: Derive from discretization, measurement noise, or physical principles.

Open challenges include optimal tuning of weights for robustness and interpretability, joint spatial-temporal weighting for non-uniform sampling, efficient online updates for large-scale $W$, and rigorous augmented backward/perturbation theory in the weighted setting [1708.02685].

## References

- "Weighted Birkhoff Averages Accelerate Data-Driven Methods" [2511.17772]
- "Real-time forecasting of metro origin-destination matrices with high-order weighted dynamic mode decomposition" [2101.00466]
- "Data driven modal decompositions: analysis and enhancements" [1708.02685]
- "Online dynamic mode decomposition for time-varying systems" [1707.02876]

Source: https://www.emergentmind.com/topics/weighted-dynamic-mode-decomposition-wtdmd