Papers
Topics
Authors
Recent
Search
2000 character limit reached

ODE-Diff: ODE-Based Diffusion Design

Updated 9 July 2026
  • ODE-Diff is a family of ODE-guided diffusion frameworks that integrate probability-flow ODEs for tasks like PDE inversion, OD network generation, and anomaly detection.
  • It leverages learned score networks to approximate gradients, enabling deterministic sampling, continuous normalizing flows, and accelerated inference.
  • Empirical results demonstrate substantial performance gains, with lower error rates and improved convergence compared to traditional stochastic methods.

ODE-Diff is a paper-specific label rather than a single standardized method. In the cited literature, it denotes at least three distinct constructions: an ODE-based diffusion posterior sampler for Bayesian inverse problems in partial differential equations, a graph denoising diffusion framework for large-scale Origin–Destination network generation, and a broader class of diffusion ODE or probability-flow ODE methods used for likelihood estimation, reconstruction, anomaly detection, and OOD scoring (Jiang et al., 2024, Rong et al., 2023, Hu et al., 2023, Bellier et al., 2024). This suggests a family resemblance rather than a single canonical algorithm: the common thread is diffusion-model denoising or score learning, while the role of the ODE, the conditioning variables, and the inference target vary substantially across domains.

1. Nomenclature and paper-specific meanings

In the cited works, the same label is attached to different technical objects. One usage defines “ODE-Diff” as ODE-based Diffusion Posterior Sampling for PDE inverse problems. Another uses “ODE-Diff” for complexity-aware denoising diffusion on Origin–Destination graphs. Related papers do not always use the exact name as the primary title term, but they operationalize diffusion ODEs in ways that are directly relevant to the same concept cluster (Jiang et al., 2024, Rong et al., 2023, Hu et al., 2023, Bellier et al., 2024).

Usage Domain Core mechanism
ODE-Diff / ODE-DPS PDE inverse problems Probability-flow ODE with likelihood guidance
ODE-Diff Origin–Destination network generation Two-stage graph denoising diffusion
Diffusion ODE / ODE-Diff Medical anomaly detection Exact likelihood of multi-scale features
ODEED Earth observation OOD detection Deterministic PF-ODE encode–decode reconstruction

The terminological ambiguity matters. In the PDE and anomaly-detection lines, “ODE” refers to the ordinary differential equation induced by the diffusion model’s probability flow. In the Origin–Destination line, the name identifies a diffusion framework for OD networks, with discrete and continuous denoising stages over graph topology and edge weights rather than a posterior-sampling ODE in the same sense. A common misconception is therefore to treat all instances of “ODE-Diff” as variants of one numerical sampler; the cited literature does not support that interpretation.

2. Probability-flow ODE foundations

A central mathematical template in several of these works is score-based diffusion. The forward process is an Itô SDE

dx=f(x,t)dt+g(t)dw,d x = f(x,t)\,dt + g(t)\,d w,

with terminal distribution approximately Gaussian. Anderson’s reverse-time construction yields

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,

and the deterministic probability-flow ODE is

dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).

In the variance-preserving setting,

dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,

so the corresponding ODE becomes

dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).

Replacing the unknown score by a learned network sθ(x,t)s_\theta(x,t) yields a practical deterministic sampler (Jiang et al., 2024, Hu et al., 2023).

Two consequences recur across the literature. First, the ODE shares the same time marginals pt(x)p_t(x) as the reverse SDE, but eliminates stochastic sampling variance. Second, because the ODE is deterministic, it can be treated as a continuous normalizing flow. AnoDODE makes this explicit through the instantaneous change-of-variables relation

ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),

which enables exact log-likelihood computation up to numerical integration and divergence estimation via the Hutchinson estimator (Hu et al., 2023). ODEED uses the same deterministic structure differently: it encodes a test image from t=0t=0 to a chosen t0t_0 and decodes it back to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,0, then scores the sample by the reconstruction discrepancy (Bellier et al., 2024).

3. ODE-Diff as Bayesian posterior sampling for PDE inverse problems

In "ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equation" (Jiang et al., 2024), ODE-Diff denotes an unsupervised inversion methodology for Bayesian PDE inverse problems. The unknown parameter dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,1 may be a source term, an initial condition, or a coefficient field; the PDE state dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,2 satisfies

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,3

with boundary and/or initial conditions, and the observation model is

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,4

The posterior is

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,5

with Gaussian likelihood dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,6. The diffusion model learns the prior dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,7 from unpaired samples of dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,8, not the conditional dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,9, so no paired dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).0 dataset is required.

The posterior-guided sampler is obtained by score decomposition,

dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).1

and by adding the likelihood score to the probability-flow ODE drift:

dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).2

Under the VP specialization used in the paper,

dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).3

with time-dependent guidance implemented through a step-size schedule dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).4.

For PDE inverse problems, the forward map is dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).5, and under Gaussian noise the likelihood gradient is

dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).6

Because the diffusion state is dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).7 rather than dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).8, the method uses the ODE-consistent estimator

dxdt=f(x,t)12g(t)2xlogpt(x).\frac{d x}{d t} = f(x,t) - \frac{1}{2} g(t)^2 \nabla_x \log p_t(x).9

then computes guidance at dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,0. To alleviate small gradients near boundaries, the paper introduces an adaptive weighted norm dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,1, with weights dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,2 designed from the sensitivity of the forward map.

The discrete backward sampler uses dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,3 time steps, initializes dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,4, computes the prior score dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,5, forms dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,6, performs a deterministic ODE update, and then applies the guidance step

dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,7

with dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,8. The score model is trained by denoising score matching on unpaired prior samples synthesized as sums of trigonometric basis functions with random coefficients decaying with mode indices. No PDE constraints are enforced during training; physics enters only at sampling through the likelihood term.

Theoretical claims are correspondingly limited. The paper shows marginal equivalence between a family of SDEs and the probability-flow ODE through a shared Fokker–Planck equation, and argues that the deterministic ODE reduces Monte Carlo variance. At the same time, posterior sampling remains approximate because it relies on both a learned score dx=β(t)2xdt+β(t)dw,d x = -\frac{\beta(t)}{2}x\,dt + \sqrt{\beta(t)}\,d w,9 and the approximation dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).0. The paper states that rigorous posterior consistency under model mismatch remains an open theoretical question.

Empirically, the reported relative dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).1 errors are substantially lower than the listed baselines. For the heat inverse source task, ODE-DPS yields dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).2, dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).3, and dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).4 across three cases, versus Landweber at approximately dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).5, dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).6, and dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).7, improved Landweber at dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).8, dxdt=β(t)2xβ(t)2xlogpt(x).\frac{d x}{d t} = -\frac{\beta(t)}{2}x - \frac{\beta(t)}{2}\nabla_x \log p_t(x).9, and sθ(x,t)s_\theta(x,t)0, and Tikhonov at approximately sθ(x,t)s_\theta(x,t)1, sθ(x,t)s_\theta(x,t)2, and sθ(x,t)s_\theta(x,t)3. For heat inverse initial value, ODE-DPS yields sθ(x,t)s_\theta(x,t)4, sθ(x,t)s_\theta(x,t)5, and sθ(x,t)s_\theta(x,t)6, compared with sθ(x,t)s_\theta(x,t)7, sθ(x,t)s_\theta(x,t)8, and sθ(x,t)s_\theta(x,t)9 for Landweber. For the wave inverse source problem, ODE-DPS reports pt(x)p_t(x)0, against pt(x)p_t(x)1 for Landweber, pt(x)p_t(x)2 for improved Landweber, and pt(x)p_t(x)3 for Tikhonov. The paper also reports mild sensitivity across pt(x)p_t(x)4 and pt(x)p_t(x)5, and noise robustness with errors rising from pt(x)p_t(x)6 to pt(x)p_t(x)7 as pt(x)p_t(x)8 increases from pt(x)p_t(x)9 to ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),0.

4. ODE-Diff as graph denoising diffusion for Origin–Destination networks

In "Complexity-aware Large Scale Origin-Destination Network Generation via Diffusion Model" (Rong et al., 2023), ODE-Diff is a city-scale conditional graph generator. A city is partitioned into ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),1 non-overlapping regions ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),2, forming a directed weighted graph ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),3. The binary OD matrix ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),4 marks edge existence, and the continuous matrix ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),5 stores flows ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),6. Conditioning comes from region-level features ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),7 and pairwise distances ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),8, aggregated into city characteristics ddtlogpt(zt)=tr ⁣(f~θz(zt,t)),\frac{d}{dt}\log p_t(z_t) = -\operatorname{tr}\!\left(\frac{\partial \tilde f_\theta}{\partial z}(z_t,t)\right),9. The model factorizes

t=0t=00

The framework is explicitly two-stage. The topology stage uses structured discrete diffusion for binary edges, with time-dependent transition matrix

t=0t=01

and cross-entropy training objective

t=0t=02

The flow stage uses continuous DDPM-style denoising on masked entries,

t=0t=03

with reverse model

t=0t=04

trained by

t=0t=05

To reduce cascade error, training uses teacher forcing with

t=0t=06

The denoiser is a graph transformer with node property augmentation. Node embeddings encode demographics and POIs; edge inputs concatenate origin and destination embeddings with t=0t=07; time-step embeddings indicate the diffusion step. The graph transformer layer uses multi-head attention with edge-dependent bias,

t=0t=08

followed by softmax attention and updates of both node states t=0t=09 and edge states t0t_00. The node property augmentation module injects statistics such as in-degree, out-degree, strength, and centrality proxies to better reproduce heavy-tailed and assortativity-like patterns.

Training uses t0t_01 diffusion steps with a cosine noise schedule and Adam at learning rate t0t_02. The benchmark comprises New York City (t0t_03), Cook County/Chicago (t0t_04), and Seattle (t0t_05), with OD matrices from 2018 LODES commuting flows and NZRt0t_06 equal to t0t_07, t0t_08, and t0t_09, respectively. Models are trained on Cook County and tested on NYC and Seattle.

The reported results emphasize both flow accuracy and network realism. On NYC, ODE-Diff achieves RMSE dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,00 versus best baseline GMEL dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,01, NRMSE dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,02 versus dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,03, and CPC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,04, while JSDdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,05. On Seattle, it reports RMSE dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,06 versus best baseline DGM dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,07, NRMSE dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,08 versus dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,09, and CPC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,10 versus RF dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,11, with JSDdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,12. For topology generation, the model reports CPCdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,13 and degree JSD dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,14 on NYC, and CPCdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,15 and degree JSD dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,16 on Seattle. Ablations attribute dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,17 CPC improvement to node property augmentation in topology, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,18 CPC improvement to node property augmentation in flow, and approximately dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,19 improvement to the two-stage cascade relative to naïve diffusion.

This usage of ODE-Diff is technically distinct from PF-ODE posterior samplers. Its emphasis is conditional joint modeling of sparse graph topology and positive edge weights at city scale, not deterministic integration of a probability-flow ODE for Bayesian inversion. The paper’s reported limitations are correspondingly different: stationarity assumptions across cities, sensitivity to conditioning quality, and residual topology–weight coupling at inference time.

5. Diffusion ODEs for anomaly detection and OOD scoring

AnoDODE and ODEED use diffusion ODEs in a third sense: as deterministic density estimators or reconstruction operators for abnormality scoring rather than as posterior samplers or OD-graph generators (Hu et al., 2023, Bellier et al., 2024).

AnoDODE models the density of multi-scale feature tensors extracted from medical images. It uses EfficientNet-B5, frozen and ImageNet-pretrained, to extract features from 2D axial MRI slices at input sizes dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,20, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,21, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,22, and dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,23, yielding feature maps of sizes dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,24, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,25, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,26, and dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,27 with dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,28 channels. For each scale, it trains a UNet score network on normal data under a VPSDE with dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,29, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,30, and computes exact log-likelihoods through the probability-flow ODE and the Hutchinson trace estimator. The image-level anomaly score is the average bits-per-dimension across scales,

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,31

Localization is reconstruction-based: a decoder is trained on normal data, features are diffused forward to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,32, denoised by a Predictor–Corrector sampler for dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,33 iterations with Langevin SNR dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,34, decoded back to image space, and compared to the original image by squared residuals. The paper reports that dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,35 works well empirically. On BraTS2021, with dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,36 healthy training slices and a test set containing dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,37 abnormal and dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,38 healthy slices, AnoDODE reports AUROC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,39, F1 dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,40, and ACC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,41, exceeding the listed baselines including RD4AD and CS-Flow.

ODEED applies the probability-flow ODE to Earth observation OOD detection through deterministic encode–decode reconstruction. A trained denoiser dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,42 defines the score approximation

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,43

and the PF-ODE is integrated with Heun’s method. A test image dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,44 is encoded to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,45, decoded back to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,46, and scored by

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,47

with dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,48 chosen as MSE or LPIPS. The implementation uses dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,49 Heun steps typically and dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,50 when dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,51. On SpaceNet 8 near-OOD pre/post-flood detection, ODEED+LPIPS reports Germany AUC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,52 and FPR@95 dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,53, and Louisiana AUC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,54 and FPR@95 dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,55. On non-flooded/flooded detection, ODEED+MSE reports Germany AUC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,56 and FPR@95 dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,57, and Louisiana AUC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,58 and FPR@95 dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,59. For domain OOD under geographical shift, however, ODEED is weak; DeepKNN is reported as stronger, with Germany AUC dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,60 and FPR@95 dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,61.

These two lines clarify a second common misconception: deterministic diffusion ODEs do not imply a single scoring principle. AnoDODE uses exact feature-density estimation via continuous normalizing flow theory, whereas ODEED uses deterministic reconstruction residual as a plausibility score. Their failure modes also differ. AnoDODE highlights solver cost, dependence on feature extractor choice, and sensitivity of localization to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,62. ODEED highlights strong performance on near-OOD local changes but weakness on large domain shifts.

6. Acceleration, computational trade-offs, and open questions

Broader ODE-based diffusion research has also treated the ODE not as the task definition but as the locus of sampling acceleration. "ODEdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,63(ODEdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,64): Shortcutting the Time and Length in Diffusion and Flow Models for Faster Sampling" (Gudovskiy et al., 26 Jun 2025) introduces an outer probability-flow ODE in time and an inner discretized ODE across transformer blocks. With dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,65 active blocks,

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,66

Training augments conditional flow matching with a length-consistency term,

dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,67

and time-wise consistency via time-shortcut conditioning dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,68. The resulting model is solver-agnostic in time and allows sampling with arbitrary numbers of time steps and active transformer blocks.

The reported performance is explicitly a quality–complexity trade-off. On CelebA-HQ-256, for a dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,69-image minibatch excluding the VAE, Shortcut Models with Euler dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,70 yield FID dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,71 in dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,72 s. ODEdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,73dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,74 with dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,75 and adaptive Dopri5 yields FID dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,76 in dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,77 s at tolerance dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,78, and FID dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,79 in dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,80 s at tolerance dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,81. Memory scales with active length, with multipliers dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,82 for dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,83, dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,84 for dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,85, and dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,86 for dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,87. The paper summarizes the gains as up to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,88 latency reduction in the most efficient mode and up to dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,89 FID-point improvement for high-quality sampling.

Across the cited ODE-Diff literature, reported limitations are consistent with the role assigned to the ODE. PDE inversion requires a PDE solve and ideally a gradient at each step, with total complexity dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,90. The OD-network model assumes transferable relations between city characteristics and mobility patterns and remains sensitive to topology errors at inference. AnoDODE incurs ODE-likelihood NFEs and depends on a frozen feature extractor. ODEED requires calibration of dx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,91 and degrades under large geographical shifts. ODEdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,92(ODEdx=[f(x,t)g(t)2xlogpt(x)]dt+g(t)dwˉ,d x = \big[f(x,t) - g(t)^2 \nabla_x \log p_t(x)\big]dt + g(t)\,d\bar w,93) still suffers quality degradation under extreme shortcuts in time or length.

A plausible implication is that “ODE-Diff” is best understood as an ODE-centered design space rather than a single named algorithm. Within that design space, the ODE can serve as a posterior transport equation, a deterministic likelihood engine, an encode–decode reconstruction path, or a compute-control mechanism. The cited papers show that these choices lead to different strengths: low-error Bayesian inversion for PDEs, realistic sparse network generation for urban mobility, high-performing anomaly and near-OOD detection, and improved sampling latency–quality trade-offs.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to ODE-Diff.