Tensor Dynamic Mode Decomposition (TDMD)
- TDMD is a family of tensor-based DMD techniques that extend classical methods to naturally handle multidimensional data.
- The third-order T-product formulation leverages FFT-based slice-wise SVD and block-circulant operations to efficiently compute reduced-order models.
- Alternative formulations like TT-based and star_M-product methods offer significant runtime and memory improvements over traditional matrix DMD.
Tensor Dynamic Mode Decomposition (TDMD) denotes tensorial extensions of dynamic mode decomposition for spatiotemporal data that are naturally represented as tensors rather than as flattened matrices. In the 2025 third-order T-product formulation, TDMD identifies a third-order transition tensor satisfying and extracts tensorial dynamic modes and temporal dynamics from that operator; related literature also includes tensor-based DMD in Tensor-Train (TT) form and tensor-based DMD in the -product framework, all motivated by the observation that conventional DMD is matrix-based and may be inefficient or inadequate for images, videos, higher-order networks, and other inherently multidimensional data (He et al., 4 Aug 2025, Klus et al., 2016, Saibaba et al., 13 Aug 2025).
1. Position within dynamic mode decomposition
Classical DMD starts from two snapshot arrays,
and seeks a best-fit linear map with
After a truncated SVD , one forms the reduced operator
diagonalizes it, and reconstructs modes and temporal coefficients (Środa et al., 26 Sep 2025).
Tensor formulations retain that DMD logic while replacing matrix storage and matrix-only linear algebra by tensor representations, tensor pseudoinverses, and reduced operators defined in tensor algebras or compressed tensor networks. The literature contains several non-equivalent realizations of this idea.
| Formulation | Data representation | Reduced or fitted operator |
|---|---|---|
| Third-order T-product TDMD | ||
| TT-based tensor DMD | 0 | 1 |
| 2-based tensor DMD | 3 | 4 |
A common misconception is that TDMD names a single canonical algorithm. The literature instead presents distinct constructions based on different tensor models and operator algebras. This suggests that TDMD is best understood as a family of tensorial DMD schemes rather than a unique procedure.
2. Tensor models and algebraic foundations
The third-order T-product formulation is built on block-circulant unfolding and FFT-based slice-wise linear algebra. For 5, the T-product with 6 is
7
The framework includes a T-identity, T-transpose, T-pseudoinverse, and T-orthogonality. Tensor SVD and tensor eigenvalue decomposition generalize matrix SVD and EVD: 8 with 9 and 0 F-diagonal. Both TSVD and TEVD are implemented efficiently by applying FFT along the third mode, reducing to 1 independent matrix SVDs or EVDs (He et al., 4 Aug 2025).
The 2016 tensor-based DMD uses the Tensor-Train format. A 2-way tensor 3 is represented as
4
with TT-ranks 5, 6, and cores 7. The memory requirement is
8
The exposition explicitly attributes the TT format to Oseledets ’11, and under the standard successive-SVD construction the first 9 cores become left-orthonormal (Klus et al., 2016).
The 0-product framework defines tensor multiplication through a unitary transform 1. For 2, one first forms 3, multiplies frontal slices in the transform domain, and returns by 4. The product is associative, has an identity tensor, and supports a slice-wise conjugate transpose, pseudoinverse, and 5-unitary tensors. The same exposition states, following Kilmer–Kilmer–Kernfeld ’21, that one obtains a full 6-SVD
7
and that truncation to the largest 8 nonzero tubes gives the best Frobenius-norm t-rank-9 approximation (Saibaba et al., 13 Aug 2025).
3. Algorithmic constructions
In the third-order T-product formulation, one starts from a sequence of tensor snapshots 0, each in 1, and forms
2
The goal is to identify 3 such that
4
and to extract tensorial modes 5 and temporal dynamics 6. The reduced-order construction is: 7
8
9
The corresponding pseudocode performs FFT along mode 3, computes slice-wise economy SVDs, builds reduced matrices 0, diagonalizes them, and assembles 1 and 2 by inverse FFT and un-bcirc operations (He et al., 4 Aug 2025).
The TT-based construction begins with snapshots 3, 4, gathered into 5-mode tensors 6 and 7. Standard DMD would vectorize these to 8, 9, then form 0. The TT method instead computes the pseudoinverse of a tensor unfolding directly from TT cores. After left-orthonormalizing early cores, right-orthonormalizing later cores, and applying an SVD to the middle core, one obtains
1
This is the main theoretical result stated in the paper: no large-scale optimization is required, and the result is exact up to TT-truncation error. The reduced DMD matrix is then assembled from small factors,
2
and standard or exact modes are recovered by replacing the final TT core by the relevant low-dimensional vector or coefficient block (Klus et al., 2016).
In the 3-product formulation, the tensor-regression viewpoint is explicit: 4 After a truncated 5-SVD,
6
one forms the reduced tensor
7
computes a 8-Schur decomposition
9
and defines the tensor of modes by
0
State reconstruction is then written as
1
The same work also gives a randomized streaming algorithm that maintains two sketches, updates them batchwise with Gaussian sketch-tensors, and then invokes a static 2-DMD on the low-rank approximation (Saibaba et al., 13 Aug 2025).
A further extension integrates tensor-train DMD into a predictor-corrector method for nonequilibrium Green’s function calculations in quantics tensor-train form. There, 3 is orthogonalized and decomposed about a central bond as
4
After eigendecomposition, the predictor takes the form
5
and is coupled to a causality-preserving block-time-stepping corrector that iterates only on newly added time blocks (Środa et al., 26 Sep 2025).
4. Computational scaling and compression
The third-order T-product paper provides an explicit complexity comparison. Let 6 be the spatial dimension, 7 the number of snapshots, 8 the lateral mode size, 9 the number of tensor channels, and 0. TDMD slice-wise performs an SVD of an 1 matrix per frontal slice, giving
2
Standard flatten-then-DMD instead requires the SVD of an 3 matrix,
4
Memory-wise, TDMD stores 5 parameters in 6 plus 7 in 8, versus 9 for full DMD (He et al., 4 Aug 2025).
The TT formulation emphasizes that matrix DMD on ambient dimension 0 requires 1 memory for 2 and 3 if 4 is formed, while the TT representation uses
5
memory and has a cost to build 6 from small factors of 7. The paper’s conclusion is that if the data admits low TT ranks 8, one gains orders-of-magnitude in time and memory (Klus et al., 2016).
The 9-product work gives a parallel cost comparison. For matrix DMD on 00 and 01, the dominant term is 02. For 03-DMD with t-rank 04, the t-SVD cost is
05
the Schur step costs 06, and mode recombination costs 07, with 08 if 09 is FFT-based. It also states that transforms and per-slice operations are embarrassingly parallel (Saibaba et al., 13 Aug 2025).
For QTT-based predictor-corrector TDMD, QTT-SVD and pseudoinverse for DMD cost 10, contractions cost 11, and the block solver per iteration is also 12, where 13 is bond dimension and 14. The corresponding motivation is that direct matrix representations of two-time functions scale as 15, whereas QTT storage scales as 16 (Środa et al., 26 Sep 2025).
Across these variants, the shared computational principle is low-rank tensor structure. What differs is the algebra in which “rank” is defined: tubal rank in the T-product setting, TT-ranks in TT/QTT, and t-rank in the 17-product framework.
5. Empirical performance and application domains
The 2025 third-order T-product TDMD paper reports two benchmark categories. On synthetic data consisting of 18 tensors with 20 snapshots, TDMD achieves relative reconstruction errors on the order of 19 to 20 across rank truncations 21 down to 22, whereas standard DMD with flattening gives a fixed error of approximately 23, insensitive to truncation. Runtime is approximately 24–25 s for TDMD versus 26–27 s for DMD, and memory usage is 28–29 MB versus 30–31 MB. On video data with 32 frames, TDMD yields per-frame relative error of approximately 33–34, while DMD yields approximately 35–36; in dynamic component separation, TDMD cleanly extracts a static background and moving square, while DMD mixing persists (He et al., 4 Aug 2025).
The 2016 TT-based study illustrates tensor DMD on fluid-dynamics problems. For a two-dimensional von Kármán vortex street on a 37 grid with 38 snapshots, standard DMD uses 39, whereas the tensor formulation stores 40 in TT format with ranks 41 and 42. The reported wall-clock runtime is approximately 43 for standard DMD and 44 for TDMD, corresponding to a 45 speed-up, and visual DMD modes match to machine precision. For two merging vortices with 46 up to 47 and 48 time steps, the paper reports approximately 49 speed-up for exact TT and up to 50 for 51, with relative errors in eigenvalues and modes below 52 for small 53. For flow around a blunt body with data 54, TT truncation with 55 yields runtime 56 versus 57, first two eigenvalue error approximately 58, and mode-error 59. The paper’s summary states that TDMD reduced memory and runtime by factors of 60–61 while producing the same dynamical spectra and spatial modes up to TT-truncation error (Klus et al., 2016).
The 62-product study evaluates cylinder-wake flow at 63, NOAA sea-surface temperature data, and a streaming cylinder dataset. On the cylinder-wake dataset of 150 snapshots of vorticity on a 64 grid, 65-DMDII consistently attains lower reconstruction relative error at fixed storage, often half or less than either DMD or 66-DMD. On the first 200 of 1,727 weekly NOAA SST maps on a 67 grid, standard DMD slightly outperforms 68-DMDII at low storage, but the errors converge as storage grows. In a streaming test with 200 snapshots on a 69 grid split into 20 batches of 10, streaming 70-DMDII yields 71–72 lower reconstruction error on each batch and overall, and end-to-end CPU time for 73-DMD is often 74–75 faster at the same error level (Saibaba et al., 13 Aug 2025).
The QTT-NEGF predictor-corrector application extends tensor DMD into many-body nonequilibrium simulation. Applied to the Hubbard model on a 76 lattice within the nonequilibrium 77 approximation, it demonstrates stable propagation up to 78 inverse hoppings, exceeding both matrix-based implementations and previous QTT solvers. The predictor typically reduces the initial error on a new block to approximately 79, and the corrector then requires 80 iterations to reach approximately 81 (Środa et al., 26 Sep 2025).
6. Implementation practice and conceptual boundaries
The third-order T-product paper gives explicit implementation guidelines. Tubal rank 82 is chosen by inspecting the singular-tube Frobenius norms 83 and dropping those below a tolerance 84, with 85 given as an example. For separating persistent versus transient modes, it recommends 86 on 87. It also recommends the MATLAB “tensor-tensor-product-toolbox” available at github.com/lu-group, or Python implementations based on FFT with NumPy/SciPy for slice-wise SVD/EVD, together with three efficiency tips: precompute FFT along mode 3 once, use economy-size SVD with 88, and parallelize across slices 89 (He et al., 4 Aug 2025).
The 90-product paper places tensor DMD in direct relation to traditional DMD and physics-informed DMD. It states that
91
is equivalent to a constrained matrix regression over a structured subspace 92 of block-structured matrices, and interprets 93-DMD as the case in which the operator must lie in the 94-algebra defined by 95. This provides an explicit connection to piDMD, which also imposes subspace constraints on 96 (Saibaba et al., 13 Aug 2025).
A second misconception is that tensorization by itself guarantees exact recovery or superior results. The literature qualifies that point. In the TT framework, the pseudoinverse theorem is exact apart from TT-truncation error (Klus et al., 2016). In the third-order T-product formulation, the practical algorithm is a reduced-order approximation with chosen tubal rank (He et al., 4 Aug 2025). In the 97-product setting, accuracy depends on the selected transform 98, the truncation strategy, and whether one uses fixed-rank tr-tSVDM or slice-adaptive tr-tSVDMII (Saibaba et al., 13 Aug 2025). The numerical evidence consistently favors structure-preserving tensor formulations over flatten-then-DMD on the reported examples, but the reported comparisons are framework-specific rather than universal.
A third misconception is that tensor DMD is confined to fluid mechanics or image-like data. The cited applications do include vortex streets, merging vortices, blunt-body flow, cylinder wakes, sea-surface temperature fields, and video sequences, but the QTT predictor-corrector formulation is presented as a general framework not limited to nonequilibrium Green’s functions, requiring only that data at fixed times be stored in QTT form and that one can perform a self-consistent or nonlinear update on a small time block while holding the past fixed (Środa et al., 26 Sep 2025).
Taken together, these works define TDMD as a technically diverse but conceptually coherent research area: DMD-style Koopman-oriented regression and modal analysis carried out in tensor representations that preserve multiway structure, expose low-rank organization, and replace large dense matrix operations by tensor-algebraic or tensor-network computations.