Papers
Topics
Authors
Recent
Search
2000 character limit reached

Interpolating Stochastic Differential Equations (iSDEs)

Updated 5 July 2026
  • Interpolating SDEs are stochastic processes that interpolate between endpoint distributions, enabling exact finite-time transport from a Gaussian prior to a target density.
  • They employ Fokker–Planck and Hamilton–Jacobi–Bellman formulations, with forward-backward SDE representations and neural network solvers to compute potentials and scores.
  • iSDEs have practical applications in generative modeling, high-dimensional sampling, speech restoration, and infinite-dimensional inverse problems, backed by theoretical performance guarantees.

Searching arXiv for papers on interpolating stochastic differential equations and stochastic interpolants. Interpolating stochastic differential equations (iSDEs) are stochastic processes constructed so that their time marginals realize a prescribed interpolation between endpoint distributions. In recent generative-model literature, they are used to bridge a Gaussian prior and a target density, or a clean signal and a degraded observation, by specifying a stochastic interpolant and then deriving a forward or reverse SDE whose marginal law matches that interpolant at each time (George et al., 1 Feb 2025, Lay et al., 10 Mar 2026). Closely related terminology also appears in infinite-dimensional Hilbert-space bridges and, in a distinct stochastic PDE literature, for equations that interpolate the stochastic heat and wave equations (Yu et al., 2 Feb 2026, Chen et al., 2021).

1. Finite-time transport by stochastic interpolants

A finite-dimensional iSDE can be built from a Gaussian prior and a target density by choosing π0=N(0,r(0)2Id)\pi_0=\mathcal N(0,r(0)^2 I_d) and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z, together with smooth positive functions g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+ such that g(0)=0g(0)=0 and g/rg/r is non-decreasing. With independent random variables xνx^*\sim \nu and zN(0,Id)z\sim\mathcal N(0,I_d), the half interpolant is defined by

xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.

Its marginal density is

ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),

with ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d) and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z0 imposed so as to determine π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z1 (George et al., 1 Feb 2025).

Writing the score as π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z2, the same construction yields a Fokker–Planck equation

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z3

where π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z4 is arbitrary and

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z5

By the converse of Fokker–Planck theory, the Itô SDE

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z6

has exactly π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z7 as its marginal at time π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z8. In this formulation, simulating the SDE transports the Gaussian prior to π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z9 in time g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+0 provided g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+1 and g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+2 can be evaluated (George et al., 1 Feb 2025).

Within this line of work, iSDEs are characterized by two features. First, they allow a non-degenerate Gaussian prior and exact transport in finite time g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+3. Second, the framework generalizes the Föllmer process (Schrödinger-bridge with Dirac prior) to Gaussian priors in finite time (George et al., 1 Feb 2025).

2. Hamilton–Jacobi–Bellman structure and FBSDE formulation

The conditional expectation g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+4 can be expressed through a re-parameterized potential

g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+5

with

g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+6

where g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+7 is a design parameter ensuring well-posedness. The function g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+8 solves the backward nonlinear Hamilton–Jacobi–Bellman equation

g,r:[0,T]R+g,r:[0,T]\to\mathbb R_+9

with terminal condition

g(0)=0g(0)=00

Here

g(0)=0g(0)=01

and

g(0)=0g(0)=02

Once g(0)=0g(0)=03 is known,

g(0)=0g(0)=04

and g(0)=0g(0)=05 also follows from g(0)=0g(0)=06 (George et al., 1 Feb 2025).

This PDE admits a forward–backward stochastic differential equation representation of the form

g(0)=0g(0)=07

with

g(0)=0g(0)=08

By standard Pardoux–Peng theory, the solution can be read off from the FBSDE

g(0)=0g(0)=09

g/rg/r0

with the identities

g/rg/r1

Accordingly, solving the FBSDE yields both g/rg/r2 and g/rg/r3 along forward sample paths (George et al., 1 Feb 2025).

A plausible implication is that the iSDE construction converts the transport problem into a nonlinear backward PDE whose gradient simultaneously determines the conditional bridge term and the score.

3. Learning, sampling, and theoretical guarantees

A machine-learning-based solver can parameterize g/rg/r4 by a neural network g/rg/r5 and compute g/rg/r6 by auto-differentiation. The training procedure samples a random time g/rg/r7, a state g/rg/r8, and a Gaussian increment g/rg/r9, then forms a one-step Euler discretization of the FBSDE:

xνx^*\sim \nu0

xνx^*\sim \nu1

xνx^*\sim \nu2

xνx^*\sim \nu3

Training minimizes the local martingale-matching loss

xνx^*\sim \nu4

together with the terminal-condition penalty

xνx^*\sim \nu5

and optimizes xνx^*\sim \nu6 by stochastic gradient descent (Adam) to drive xνx^*\sim \nu7 (George et al., 1 Feb 2025).

After training, sampling proceeds by initializing

xνx^*\sim \nu8

then iterating an Euler update in which the drift and score are re-computed from the learned xνx^*\sim \nu9:

zN(0,Id)z\sim\mathcal N(0,I_d)0

The details specify that zN(0,Id)z\sim\mathcal N(0,I_d)1 is reconstructed from zN(0,Id)z\sim\mathcal N(0,I_d)2, and both zN(0,Id)z\sim\mathcal N(0,I_d)3 and zN(0,Id)z\sim\mathcal N(0,I_d)4 are then evaluated from the learned potential (George et al., 1 Feb 2025).

Under smoothness conditions on zN(0,Id)z\sim\mathcal N(0,I_d)5, the FBSDE system admits a unique adapted solution and produces the classical solution of the HJB PDE. Relative to Path-Integral Sampler (PIS), Denosing Diffusion Sampler (DDS) and Time-Reversed Diffusion Sampler (DIS), iSDE allows a non-degenerate Gaussian prior and exact transport in finite time zN(0,Id)z\sim\mathcal N(0,I_d)6, and training does not require back-prop through stochastic paths (no neural SDE gradients), only one-step Euler losses. The numerical experiments report competitive performance on multimodal and high-dimensional targets, and ability to estimate normalization constants via the same learned zN(0,Id)z\sim\mathcal N(0,I_d)7 (George et al., 1 Feb 2025).

4. Discrete-time analysis and schedule design

A complementary line of work studies stochastic interpolants directly in discrete time. Given a base distribution zN(0,Id)z\sim\mathcal N(0,I_d)8, a target distribution zN(0,Id)z\sim\mathcal N(0,I_d)9, a coupling xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.0 of them, a twice-differentiable interpolant xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.1 with xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.2 and xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.3, and a noise-scale function xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.4 with xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.5, the latent process is

xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.6

The associated continuous-time dynamics can be written as

xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.7

with

xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.8

xt=g(t)x+r(t)z,0tT.x_t = g(t)\,x^* + r(t)\,z,\qquad 0\le t\le T.9

The Euler–Maruyama discretization is

ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),0

for step sizes ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),1 (Liu et al., 13 Feb 2025).

Liu et al. derive a finite-time KL bound under moment and estimator-accuracy assumptions. The main theorem states

ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),2

and Taylor–Itô expansions give

ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),3

If the coupling ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),4 is chosen optimally, the leading discretization error scales like ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),5 up to powers of ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),6, and the overall KL-error bound may be expressed as

ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),7

To nearly minimize ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),8 subject to ρ(t,x):=Law{xt}(x),\rho(t,x):=\mathrm{Law}\{x_t\}(x),9, the proposed design sets ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)0 with ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)1, implemented as an “exponential” partition around the midpoint ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)2 (Liu et al., 13 Feb 2025).

The toy experiments compare uniform steps against exponentially decaying steps on a “checkerboard” ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)3 “spiral” example. The nonuniform schedule converges up to an order-of-magnitude faster, with 10× fewer steps to reach the same error, and additional experiments vary the base distribution to illustrate dependence on ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)4 (Liu et al., 13 Feb 2025).

5. Conditional iSDEs and fast solvers for speech restoration

In conditional diffusion models for speech restoration, the iSDE formalism is used to interpolate between a clean signal ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)5 and an observed degraded signal ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)6. The forward process is

ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)7

with ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)8 chosen so that the marginal ρ(0,)=N(0,r(0)2Id)\rho(0,\cdot)=\mathcal N(0,r(0)^2I_d)9 remains Gaussian with mean

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z00

Defining the interpolation schedule π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z01 uniquely fixes the drift:

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z02

The reverse family of processes is

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z03

where π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z04 gives the Probability Flow ODE and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z05 gives the standard time-reversed SDE. Setting π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z06 recovers unconditional DPMs as a special case, while SGMSE+ uses an OU-Variance-Exploding iSDE (Lay et al., 10 Mar 2026).

The fast solver derives from splitting the reverse dynamics into a linear part

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z07

with

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z08

and a nonlinear correction π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z09 involving the learned score π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z10. A Taylor-series expansion of π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z11 around π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z12 yields the π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z13th-order non-linear correction

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z14

with scalar weights π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z15 that can be precomputed in closed form for common iSDEs such as OUVE/fOUVE, or via scalar quadrature otherwise. For π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z16, the resulting 2-stage scheme “iSDE–2S–π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z17” uses 2 network-evaluations per step, so with π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z18 steps only 10 evaluations (Lay et al., 10 Mar 2026).

The implementation uses a 2D–UNet (NCSN++ backbone), denoising-score matching or π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z19-prediction loss, and an STFT-domain representation with a 32 ms Hann window and 16 ms hop. The experimental tasks are single-channel speech restoration on Noise Reduction (WHAMv2), Dereverberation (EARS-Reverb-v2), Declipping, MP3-decoding, and Bandwidth-Extension, evaluated by wideband PESQ, DistillMOS, SI-SDR, Log-Spectral Distance (LSD), and Fréchet Audio Distance (FAD). On Declipping, Dereverberation, and Noise-Reduction, iSDE–2S–0 achieves PESQ/SI-SDR/DistMOS on par with adaptive RK45 but with only 10 NFE, whereas other solvers need 40–90 NFE. On BWE and MP3 tasks, RK2(mid) and iSDE–2S–0 are roughly equivalent, and both greatly outperform Euler–Maruyama/PC at low NFE. An ablation reports that π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z20 suffices for 10-step performance, while tuning π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z21 on Noise-Reduction shows best PESQ/DistMOS at π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z22 (Lay et al., 10 Mar 2026).

6. Infinite-dimensional extensions, stable time-series variants, and distinct SPDE usage

In a separable Hilbert space π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z23, stochastic interpolants are defined by fixing two probability measures π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z24, a coupling π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z25 on π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z26, Gaussian noise π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z27 with positive-definite trace-class covariance operator π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z28, and scalar schedules π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z29 satisfying

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z30

The interpolant is

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z31

Its law is realized by the SDE

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z32

with drift

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z33

where π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z34 and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z35 are conditional expectations. Under either a Bayesian-prior case, where the coupling has density π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z36 with π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z37 twice–Fréchet-differentiable and strongly convex, or a manifold case, where π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z38 is supported on a bounded subset of the Cameron–Martin space, the drift is Lipschitz on π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z39. Strong existence follows on π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z40, uniqueness holds under an additional independence condition on coordinates of π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z41, and the π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z42-Wasserstein gap between exact and approximate dynamics is controlled by the mean-square training errors of π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z43 and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z44. The framework is applied to Darcy flow and Navier–Stokes vorticity inverse problems, and the abstract reports state-of-the-art results on complex PDE-based benchmarks (Yu et al., 2 Feb 2026).

A separate machine-learning usage appears in irregular time-series analysis, where Oh et al. formulate iSDEs as stable classes of Neural SDEs. The latent process

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z45

is instantiated as a Langevin-type SDE, a Linear-Noise SDE, or a Geometric SDE. All three satisfy Lipschitz and linear-growth conditions and admit unique strong solutions; the LSDE is ergodic with a unique invariant Gibbs measure under mild dissipativity, the LNSDE admits exponential mean-square stability under sufficiently large π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z46, and the GSDE preserves nonnegativity with π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z47 absorbing and admits almost-sure exponential stability if π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z48. The observed series enters through a controlled path π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z49 and an augmented drift π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z50. Reported results include PhysioNet Mortality interpolation MSE π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z51 for Neural LSDE, PhysioNet Sepsis AUROC π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z52 for Neural LNSDE, Speech Commands accuracy π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z53 for Neural LSDE, and average accuracy about π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z54 with rank about π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z55 for Neural LNSDE over 30 UEA/UCR datasets, compared with π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z56 and rank π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z57 for a naïve Neural SDE (Oh et al., 2024).

The acronym also has a distinct meaning in stochastic PDE theory. One-parameter “interpolating” SPDEs are defined by

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z58

with Caputo derivative order π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z59, fractional Laplacian order π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z60, and time-independent spatial Gaussian noise. Here π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z61 recovers the classical Stochastic Heat Equation and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z62 recovers the classical Stochastic Wave Equation. Under a nonnegativity assumption on the Green function, the mild form is

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z63

The solvability theory distinguishes a global-existence regime, a local-existence regime with blow-up at a deterministic time π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z64, and exact moment asymptotics of the form

π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z65

The critical line π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z66 produces a phase transition in the π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z67-plane, and for pure white noise the classical critical dimensions π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z68 for SHE and π1(x)=π^(x)/Z\pi_1(x)=\hat\pi(x)/Z69 for SWE emerge as special cases (Chen et al., 2021).

This suggests that “iSDE” has become an umbrella acronym rather than a single standardized object. In current arXiv usage, the dominant meaning concerns stochastic interpolant constructions for finite-time probabilistic transport and conditional generation, but the term also covers infinite-dimensional bridges, stability-oriented Neural SDE architectures for interpolation tasks, and interpolation families of SPDEs.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Interpolating Stochastic Differential Equations (iSDEs).