---
title: High Order Dynamic Mode Decomposition (HODMD)
url: https://www.emergentmind.com/topics/high-order-dynamic-mode-decomposition-hodmd
type: topic
---

# High Order Dynamic Mode Decomposition (HODMD)

Searching arXiv for recent and relevant HODMD papers to ground the article.
High Order Dynamic Mode Decomposition (HODMD) is a data-driven modal decomposition and reduced-order modelling technique that extends classical Dynamic Mode Decomposition (DMD) by incorporating time-delay embedding, or equivalently a higher-order linear recurrence, to extract coherent spatio-temporal structures from noisy, transient, and spectrally rich measurements. Its distinctive regime is the one in which the temporal or spectral complexity of the signal exceeds what the available spatial measurements can resolve, so that delayed coordinates are used to increase the effective dimension of the observable space without changing the sensor network. Across recent work, HODMD has been used for reduced-order forecasting, modal identification, feature extraction, clustering, and surrogate modelling in underground-farm digital twins, large-scale circuits, echocardiography, intraventricular hemodynamics, power systems, reacting flows, bubble columns, mechanical vibrations, and time-parallel fluid simulation [2306.15089][2306.10864][2508.03131][2502.06186][2411.15809].

## 1. Classical DMD and the higher-order extension

Classical DMD starts from uniformly sampled snapshots $x_k \in \mathbb{R}^n$ and forms the data matrices
$$
X = [x_1, x_2, \dots, x_{m-1}], \qquad
Y = [x_2, x_3, \dots, x_m].
$$
After a thin or truncated SVD,
$$
X = U \Sigma V^*,
$$
one defines the reduced operator
$$
\tilde{A} = U^* Y V \Sigma^{-1},
$$
solves
$$
\tilde{A} W = W \Lambda,
$$
and recovers DMD modes
$$
\Phi = Y V \Sigma^{-1} W.
$$
With discrete-time eigenvalues $\lambda_i$, the continuous-time rates are
$$
\omega_i = \frac{\log(\lambda_i)}{\Delta t} = \alpha_i + i 2\pi f_i,
$$
so that
$$
x(t) \approx \sum_{i=1}^{r} b_i \phi_i e^{\omega_i t}.
$$
This representation yields oscillation frequencies, growth or decay rates, and spatial modes in a compact spectral model [2306.15089][2508.03131][2203.11574].

HODMD replaces the one-step closure of classical DMD by a $d$-step memory. In the Hankel or delay-embedding view, one forms
$$
z_k = [x_k; x_{k+1}; \dots; x_{k+d-1}] \in \mathbb{R}^{dn},
$$
builds shifted augmented matrices from the $z_k$, and then applies the standard DMD pipeline in the augmented space. In the autoregressive view, HODMD assumes
$$
x_{k+d} = A_1 x_k + A_2 x_{k+1} + \cdots + A_d x_{k+d-1},
$$
which can be written as a first-order companion evolution for the stacked state. Setting $d=1$ recovers standard DMD. The central benefit is that time-delay embedding increases the effective dimensionality from $n$ to $dn$, allowing more oscillatory content to be resolved when few sensors are available or when standard DMD is underdetermined [2306.15089][2508.03131][2203.11574].

This “higher order” designation refers to temporal memory, not to a fundamentally different spectral objective. HODMD still produces modes with exponential time dependence, but it estimates their eigenvalues and amplitudes in an augmented coordinate system that is better conditioned for noisy, multiscale, or quasi-periodic data.

## 2. Equivalent formulations and theoretical generalizations

The most common implementation of HODMD is the block-companion formulation. If
$$
y_k = [x_k^\top, x_{k+1}^\top, \dots, x_{k+d-1}^\top]^\top,
$$
then
$$
y_{k+1} = \tilde{A} y_k,
$$
with $\tilde{A}$ a companion operator whose upper blocks shift the delay window and whose last block row encodes the $d$-step recurrence. The eigenpairs of this augmented operator determine the HODMD modes and their discrete-time eigenvalues, and the original-state reconstruction is obtained by selecting the first block of each augmented mode. This equivalence between delayed embedding and higher-order autoregression explains why HODMD is often described simultaneously as a Koopman-inspired delay method and as a data-driven AR($d$) model [2508.03131][2507.21716].

Several variants extend this core construction. In multidimensional HODMD, or mdHODMD, the raw field data are first compressed by HOSVD and HODMD is then applied to the temporal coefficients rather than directly to the full tensor. In intraventricular-flow modelling, this tensor-based formulation was combined with spectral constraints that retained harmonics near the cardiac fundamental and pruned modes using a growth-rate threshold, after which the retained modes were enforced to have $\delta_m=0$ for long-horizon stability [2507.21716]. In reacting-flow analysis, multi-dimensional HODMD similarly used HOSVD to exploit the variable-by-space-by-time structure of combustion datasets before applying the delayed Koopman model [2203.11574].

A different line of theory embeds HODMD into constrained Koopman regression. Invariant Consistent DMD shows that HODMD can be recovered by imposing linear functional constraints that encode the block-shift relationships among delayed observables, thereby placing higher-order and affine DMD in a common constrained framework [2312.08278]. An even more abstract formulation analyzes higher-order dynamical systems directly through higher-order Liouville operators acting on signal-valued RKHSs. In that setting, systems such as $\ddot y(t)=f(y(t))$ are handled without augmenting the measured output by numerical differentiation of the full trajectory, and the resulting computations remain structurally close to first-order occupation-kernel DMD [2101.02646].

These formulations suggest that HODMD is not a single algorithmic variant but a family of closely related spectral estimators built around the same principle: enrich temporal observability by incorporating delayed coordinates or higher-order evolution constraints.

## 3. Computational workflow and parameterization

Most practical HODMD pipelines share a common sequence: preprocess the data, construct delayed snapshots, reduce dimension by SVD or HOSVD, estimate the reduced operator, compute eigenpairs, select modes, fit amplitudes by least squares, and reconstruct or forecast. What varies across applications is how aggressively the preprocessing, truncation, and mode-selection stages are tuned [2306.15089][2508.03131][2404.19579][2301.07976].

Preprocessing is often decisive. In the underground-farm study, occasional missing samples were linearly interpolated and the signals were mean-centered; the authors report that standardization to zero mean significantly improved reconstruction and forecasts [2306.15089]. In echocardiography pipelines, cropping, grayscale conversion, temporal homogenization, and sequence splitting to preserve uniform $\Delta t$ were required before HODMD was applied to vectorized frames or to image tensors [2404.19579]. In reacting-flow databases, centering and scaling were essential because temperature and species concentrations differed by many orders of magnitude; range scaling and Pareto-type scalings changed both clustering behaviour and reconstruction accuracy [2301.07976].

The delay order $d$ is usually selected empirically. Underground-farm forecasting used a grid search on three-day RRMSE and selected $d=710$, $710$, and $910$ for three monthly scenarios sampled every ten minutes [2306.15089]. Circuit MOR used the embedding size $s$ and recommended the empirical rule $sp>2q$ to ensure sufficient augmented dimension, with errors on the IBMPG1t benchmark dropping from $6.29\%$ at $s=400$ to $0.016\%$ at $s=500$ [2508.03131]. In echocardiography, sequence-dependent choices such as $d=\lfloor K/3 \rfloor$, $d=\lfloor K/5 \rfloor$, or $d=50$ were used to stabilize cardiac and respiratory frequencies [2404.19579]. In power systems, Li, Wen, and Schäfer selected $d=8$ for IEEE 14-bus and $d=15$ for WECC after inspecting reconstruction error and the recovery of oscillatory decay [2502.06186].

Rank truncation is handled by singular-value thresholds, fixed retained ranks, or sparsity-promoting DMD. Circuit MOR retained enough singular values to capture at least $99.9\%$ energy [2508.03131]. Mechanical-vibration analysis recommends optimal hard-thresholding and, in noisy measurements, TLS-type operator estimation instead of ordinary least squares [2306.10864]. In underground-farm modelling, forward-backward DMD was used to reduce bias due to sensor noise, while mode selection relied on an integral contribution criterion rather than on raw amplitude alone, excluding numerically transient modes with very large $|\alpha|$ [2306.15089].

Mode selection is application-dependent. Some studies retain modes by amplitude tolerance, others by cumulative contribution, spectral windows, or cluster-specific reconstruction error. In h-HODMD, variables are iteratively grouped according to which cluster-specific HODMD reconstruction best fits them, producing dedicated mode sets for chemically or dynamically coherent subsets rather than a single global basis [2301.07976]. In spectrally constrained mdHODMD for ventricular flow, modes were pruned by growth-rate threshold $\delta_{\text{tune}}$ and by closeness to harmonic bands near $2\pi k$ [2507.21716].

## 4. Empirical uses and reported performance

Recent applications indicate that HODMD is used both as a reduced-order predictor and as a modal-analysis tool, with quantitative gains reported in forecasting stability, reconstruction fidelity, speedup, and feature quality across domains [2306.15089][2508.03131][2411.15809][2507.21716][2502.06186][2304.00076][2203.11574][2306.10864][2503.03109].

| Domain | Role of HODMD | Reported outcome |
|---|---|---|
| Underground agricultural farm | Interpretable reduced-order digital-twin model for VPD | Three physically interpretable mode pairs; three-day forecasts; average RMSE $0.177$ and $0.118$ in typical scenarios |
| Large-scale circuits | Data-driven model order reduction | Speedups of $\sim 4.8\times$–$8.2\times$ with sub-percent $L_2$ errors |
| Echocardiography classification | Feature extraction and data augmentation | Accuracy improvement of up to $22$ percentage points on unseen data |
| Intraventricular flow | mdHODMD reduced-order model with spectral constraints | Errors below $5\%$ for one geometry and below $10\%$ for the second; speed-up factor of at least $10^5$ |
| Power-system frequency dynamics | Reconstruction, forecasting, and modal identification | Test RRMSE $15.2\%$ on IEEE 14-bus and $36.7\%$ on WECC; local and global modes identified |
| Mechanical vibrations | High-resolution spectral decomposition | Frequency error below $0.1$ Hz in simulated close-mode tests; sharp KDS spectra beyond FFT limits |

In building and environmental modelling, HODMD identified three recurring conjugate mode pairs in an underground hydroponic farm: a mean-trend pair at $\pm 0.000172$ Hz, a lighting-cycle pair at $\pm 0.00695$ Hz, and a miscellaneous operational pair at $\pm 0.0139$ Hz. Six dominant modes sufficed for two typical seasonal scenarios, whereas twelve were retained in a heatwave case with stronger transients [2306.15089]. In bubble-column hydrodynamics, HODMD consistently recovered low-frequency plume oscillation modes near $0.03$–$0.07$ Hz and higher-frequency content near $0.85$–$0.93$ Hz, and six measurement points in top, centre, and bottom regions were sufficient to recover the dominant frequency across all tested superficial velocities [2304.00076].

In large-scale circuits, HODMD was reported to overcome reconstruction failures caused by insufficient spatial resolution. For the linear transmission line, the reported $L_2$ error was $0.053\%$ with an $8.17\times$ speedup; for the IBMPG1t power-grid benchmark the method achieved $0.061\%$ error, a maximum amplitude difference below $0.001$ V, and a $4.81\times$ speedup; for IBMPG6t, the reported $L_2$ error was $0.028\%$ with a $4.78\times$ speedup [2508.03131].

In cardiovascular flow ROMs, mdHODMD learned from as few as the first three simulated cycles and predicted ten cycles beyond the training window. The reported reconstruction and prediction errors remained below $5\%$ for one idealized ventricle and below $10\%$ for another, while the speed-up factor relative to full CFD was approximately $1.5\times 10^5$ and $1.7\times 10^5$ for the two geometries [2507.21716]. In power systems, Li, Wen, and Schäfer reported that HODMD identified both local and inter-area oscillations in the WECC system, including local modes at $1.26$ Hz and $0.77$ Hz and global modes at $0.68$ Hz and $0.10$ Hz, with damping percentages of $3.05\%$, $3.59\%$, $4.53\%$, and $51.94\%$ for selected modes [2502.06186].

Medical-imaging work uses HODMD differently. In one study, dominant HODMD modes from echocardiography videos were turned into images and appended to the training database, increasing unseen four-class accuracy from $52\%$ to $74\%$ and five-class unseen accuracy from $42\%$ to $67\%$ [2411.15809]. In a related ViT pipeline for small datasets, HODMD-derived reconstructions and mode images improved sequence-level classification, with the best configuration reaching per-sequence accuracy $0.77$ [2404.19579].

## 5. Relation to neighboring methods and common misconceptions

HODMD is often contrasted first with standard DMD. The distinction is not merely that HODMD produces more modes; rather, it changes the regression problem by fitting the evolution in a delay-embedded space. This is why HODMD can recover frequencies that standard DMD misses when the sensor network is sparse or when the dominant dynamics are distributed across several time scales [2306.15089][2508.03131][2502.06186].

It is also frequently contrasted with classical spectral tools such as FFT, STFT, and PSD. In bubble columns and mechanical vibrations, the reported limitation of FFT-based methods is not that they fail universally, but that they are local, point-dependent, and constrained by time-bandwidth trade-offs. HODMD instead yields global coherent modes together with growth or decay rates and can reconstruct damped oscillations with high spectral resolution from multi-point or full-field data [2304.00076][2306.10864]. The kernel density spectrum used in vibration analysis is a post-processing device for HODMD poles, not an alternative dynamical model [2306.10864].

Compared with black-box predictors, HODMD retains an explicitly interpretable modal structure. The underground-farm study positions it against SARIMA and ANN-type models, arguing that HODMD is more stable under atypical conditions because it filters noise by emphasizing coherent global dynamics instead of fitting local fluctuations [2306.15089]. In circuits, HODMD is contrasted with projection-based MOR methods such as PRIMA, Krylov, and balanced truncation because it does not require explicit circuit matrices after snapshot acquisition and does not impose constraints on circuit topology or component type [2508.03131]. In power systems, HODMD outperformed standard DMD and also outperformed or matched nonlinear baselines such as LANDO and SINDy on the reported benchmarks [2502.06186].

A recurring misconception is that HODMD is intrinsically nonlinear. The evidence across these studies suggests a more precise statement: HODMD uses a linear superposition in delayed or lifted coordinates and therefore still inherits Koopman-style linearization assumptions. This is why papers repeatedly list limitations such as sensitivity to parameter selection, extrapolation risk outside the training regime, and degraded performance under strong nonstationarity or abrupt regime changes [2306.15089][2507.21716][2411.15809]. Another misconception, especially in medical applications, is to treat HODMD as a classifier. In the echocardiography studies, HODMD is a feature extractor and augmentation mechanism; the actual classifiers are a CNN or a ViT trained on HODMD-derived images [2411.15809][2404.19579].

## 6. Limitations, variants, and current directions

The limitations reported across domains are consistent. HODMD assumes a modal expansion of the form
$$
x(t) \approx \sum_{j=1}^{r} b_j \phi_j e^{\omega_j t},
$$
so model quality depends on how well the underlying dynamics can be represented by delayed linear recurrence. External forcings, abrupt transients, moving boundaries, sparse sensor placement, and regime changes can all force the inclusion of additional modes, reduce interpretability, or destabilize extrapolation [2306.15089][2507.21716][2503.03109]. The memory footprint also grows with delay order because the stacked matrices scale with the augmented dimension, a practical issue emphasized in circuit simulation and time-parallel PDE solvers [2508.03131][2503.03109].

Several variants attempt to address these issues. h-HODMD replaces a single global model by iteratively clustered models and, in reacting-flow databases, improved reconstruction for most variables relative to standard HODMD; under Range scaling, improvements of approximately $40\%$ in RRMSE were reported for key radicals such as OH, O, H$_2$O$_2$, and CH$_3$ [2301.07976]. Spectrally constrained mdHODMD uses HOSVD denoising, harmonic filtering, and explicit control of growth rates to stabilize long-horizon predictions in periodic cardiac flows [2507.21716]. Invariant Consistent DMD incorporates linear constraints that preserve functional relationships among observables and consistency along geometric invariants, recovering HODMD as a special case while also enabling eigenfunctions at eigenvalue $1$ associated with invariant sets [2312.08278].

Open directions are explicitly identified in several studies. For non-periodic cardiac dynamics, proposed remedies include adaptive windows, time-varying operators, and piecewise HODMD across phases [2507.21716]. For deployment in large-scale time-parallel simulation, randomized SVD and parallelized HODMD steps are proposed to reduce the SVD bottleneck [2503.03109]. In echocardiography, future work points toward larger datasets, view normalization, and the use of numerical spectral features alongside images [2404.19579]. A plausible implication is that current research is shifting from HODMD as a stand-alone modal estimator toward HODMD as a modular component inside broader pipelines for ROM, control, feature learning, and structure-preserving Koopman regression.

Source: https://www.emergentmind.com/topics/high-order-dynamic-mode-decomposition-hodmd