Interpolating Stochastic Differential Equations (iSDEs)
- Interpolating SDEs are stochastic processes that interpolate between endpoint distributions, enabling exact finite-time transport from a Gaussian prior to a target density.
- They employ Fokker–Planck and Hamilton–Jacobi–Bellman formulations, with forward-backward SDE representations and neural network solvers to compute potentials and scores.
- iSDEs have practical applications in generative modeling, high-dimensional sampling, speech restoration, and infinite-dimensional inverse problems, backed by theoretical performance guarantees.
Searching arXiv for papers on interpolating stochastic differential equations and stochastic interpolants. Interpolating stochastic differential equations (iSDEs) are stochastic processes constructed so that their time marginals realize a prescribed interpolation between endpoint distributions. In recent generative-model literature, they are used to bridge a Gaussian prior and a target density, or a clean signal and a degraded observation, by specifying a stochastic interpolant and then deriving a forward or reverse SDE whose marginal law matches that interpolant at each time (George et al., 1 Feb 2025, Lay et al., 10 Mar 2026). Closely related terminology also appears in infinite-dimensional Hilbert-space bridges and, in a distinct stochastic PDE literature, for equations that interpolate the stochastic heat and wave equations (Yu et al., 2 Feb 2026, Chen et al., 2021).
1. Finite-time transport by stochastic interpolants
A finite-dimensional iSDE can be built from a Gaussian prior and a target density by choosing and , together with smooth positive functions such that and is non-decreasing. With independent random variables and , the half interpolant is defined by
Its marginal density is
with and 0 imposed so as to determine 1 (George et al., 1 Feb 2025).
Writing the score as 2, the same construction yields a Fokker–Planck equation
3
where 4 is arbitrary and
5
By the converse of Fokker–Planck theory, the Itô SDE
6
has exactly 7 as its marginal at time 8. In this formulation, simulating the SDE transports the Gaussian prior to 9 in time 0 provided 1 and 2 can be evaluated (George et al., 1 Feb 2025).
Within this line of work, iSDEs are characterized by two features. First, they allow a non-degenerate Gaussian prior and exact transport in finite time 3. Second, the framework generalizes the Föllmer process (Schrödinger-bridge with Dirac prior) to Gaussian priors in finite time (George et al., 1 Feb 2025).
2. Hamilton–Jacobi–Bellman structure and FBSDE formulation
The conditional expectation 4 can be expressed through a re-parameterized potential
5
with
6
where 7 is a design parameter ensuring well-posedness. The function 8 solves the backward nonlinear Hamilton–Jacobi–Bellman equation
9
with terminal condition
0
Here
1
and
2
Once 3 is known,
4
and 5 also follows from 6 (George et al., 1 Feb 2025).
This PDE admits a forward–backward stochastic differential equation representation of the form
7
with
8
By standard Pardoux–Peng theory, the solution can be read off from the FBSDE
9
0
with the identities
1
Accordingly, solving the FBSDE yields both 2 and 3 along forward sample paths (George et al., 1 Feb 2025).
A plausible implication is that the iSDE construction converts the transport problem into a nonlinear backward PDE whose gradient simultaneously determines the conditional bridge term and the score.
3. Learning, sampling, and theoretical guarantees
A machine-learning-based solver can parameterize 4 by a neural network 5 and compute 6 by auto-differentiation. The training procedure samples a random time 7, a state 8, and a Gaussian increment 9, then forms a one-step Euler discretization of the FBSDE:
0
1
2
3
Training minimizes the local martingale-matching loss
4
together with the terminal-condition penalty
5
and optimizes 6 by stochastic gradient descent (Adam) to drive 7 (George et al., 1 Feb 2025).
After training, sampling proceeds by initializing
8
then iterating an Euler update in which the drift and score are re-computed from the learned 9:
0
The details specify that 1 is reconstructed from 2, and both 3 and 4 are then evaluated from the learned potential (George et al., 1 Feb 2025).
Under smoothness conditions on 5, the FBSDE system admits a unique adapted solution and produces the classical solution of the HJB PDE. Relative to Path-Integral Sampler (PIS), Denosing Diffusion Sampler (DDS) and Time-Reversed Diffusion Sampler (DIS), iSDE allows a non-degenerate Gaussian prior and exact transport in finite time 6, and training does not require back-prop through stochastic paths (no neural SDE gradients), only one-step Euler losses. The numerical experiments report competitive performance on multimodal and high-dimensional targets, and ability to estimate normalization constants via the same learned 7 (George et al., 1 Feb 2025).
4. Discrete-time analysis and schedule design
A complementary line of work studies stochastic interpolants directly in discrete time. Given a base distribution 8, a target distribution 9, a coupling 0 of them, a twice-differentiable interpolant 1 with 2 and 3, and a noise-scale function 4 with 5, the latent process is
6
The associated continuous-time dynamics can be written as
7
with
8
9
The Euler–Maruyama discretization is
0
for step sizes 1 (Liu et al., 13 Feb 2025).
Liu et al. derive a finite-time KL bound under moment and estimator-accuracy assumptions. The main theorem states
2
and Taylor–Itô expansions give
3
If the coupling 4 is chosen optimally, the leading discretization error scales like 5 up to powers of 6, and the overall KL-error bound may be expressed as
7
To nearly minimize 8 subject to 9, the proposed design sets 0 with 1, implemented as an “exponential” partition around the midpoint 2 (Liu et al., 13 Feb 2025).
The toy experiments compare uniform steps against exponentially decaying steps on a “checkerboard” 3 “spiral” example. The nonuniform schedule converges up to an order-of-magnitude faster, with 10× fewer steps to reach the same error, and additional experiments vary the base distribution to illustrate dependence on 4 (Liu et al., 13 Feb 2025).
5. Conditional iSDEs and fast solvers for speech restoration
In conditional diffusion models for speech restoration, the iSDE formalism is used to interpolate between a clean signal 5 and an observed degraded signal 6. The forward process is
7
with 8 chosen so that the marginal 9 remains Gaussian with mean
00
Defining the interpolation schedule 01 uniquely fixes the drift:
02
The reverse family of processes is
03
where 04 gives the Probability Flow ODE and 05 gives the standard time-reversed SDE. Setting 06 recovers unconditional DPMs as a special case, while SGMSE+ uses an OU-Variance-Exploding iSDE (Lay et al., 10 Mar 2026).
The fast solver derives from splitting the reverse dynamics into a linear part
07
with
08
and a nonlinear correction 09 involving the learned score 10. A Taylor-series expansion of 11 around 12 yields the 13th-order non-linear correction
14
with scalar weights 15 that can be precomputed in closed form for common iSDEs such as OUVE/fOUVE, or via scalar quadrature otherwise. For 16, the resulting 2-stage scheme “iSDE–2S–17” uses 2 network-evaluations per step, so with 18 steps only 10 evaluations (Lay et al., 10 Mar 2026).
The implementation uses a 2D–UNet (NCSN++ backbone), denoising-score matching or 19-prediction loss, and an STFT-domain representation with a 32 ms Hann window and 16 ms hop. The experimental tasks are single-channel speech restoration on Noise Reduction (WHAMv2), Dereverberation (EARS-Reverb-v2), Declipping, MP3-decoding, and Bandwidth-Extension, evaluated by wideband PESQ, DistillMOS, SI-SDR, Log-Spectral Distance (LSD), and Fréchet Audio Distance (FAD). On Declipping, Dereverberation, and Noise-Reduction, iSDE–2S–0 achieves PESQ/SI-SDR/DistMOS on par with adaptive RK45 but with only 10 NFE, whereas other solvers need 40–90 NFE. On BWE and MP3 tasks, RK2(mid) and iSDE–2S–0 are roughly equivalent, and both greatly outperform Euler–Maruyama/PC at low NFE. An ablation reports that 20 suffices for 10-step performance, while tuning 21 on Noise-Reduction shows best PESQ/DistMOS at 22 (Lay et al., 10 Mar 2026).
6. Infinite-dimensional extensions, stable time-series variants, and distinct SPDE usage
In a separable Hilbert space 23, stochastic interpolants are defined by fixing two probability measures 24, a coupling 25 on 26, Gaussian noise 27 with positive-definite trace-class covariance operator 28, and scalar schedules 29 satisfying
30
The interpolant is
31
Its law is realized by the SDE
32
with drift
33
where 34 and 35 are conditional expectations. Under either a Bayesian-prior case, where the coupling has density 36 with 37 twice–Fréchet-differentiable and strongly convex, or a manifold case, where 38 is supported on a bounded subset of the Cameron–Martin space, the drift is Lipschitz on 39. Strong existence follows on 40, uniqueness holds under an additional independence condition on coordinates of 41, and the 42-Wasserstein gap between exact and approximate dynamics is controlled by the mean-square training errors of 43 and 44. The framework is applied to Darcy flow and Navier–Stokes vorticity inverse problems, and the abstract reports state-of-the-art results on complex PDE-based benchmarks (Yu et al., 2 Feb 2026).
A separate machine-learning usage appears in irregular time-series analysis, where Oh et al. formulate iSDEs as stable classes of Neural SDEs. The latent process
45
is instantiated as a Langevin-type SDE, a Linear-Noise SDE, or a Geometric SDE. All three satisfy Lipschitz and linear-growth conditions and admit unique strong solutions; the LSDE is ergodic with a unique invariant Gibbs measure under mild dissipativity, the LNSDE admits exponential mean-square stability under sufficiently large 46, and the GSDE preserves nonnegativity with 47 absorbing and admits almost-sure exponential stability if 48. The observed series enters through a controlled path 49 and an augmented drift 50. Reported results include PhysioNet Mortality interpolation MSE 51 for Neural LSDE, PhysioNet Sepsis AUROC 52 for Neural LNSDE, Speech Commands accuracy 53 for Neural LSDE, and average accuracy about 54 with rank about 55 for Neural LNSDE over 30 UEA/UCR datasets, compared with 56 and rank 57 for a naïve Neural SDE (Oh et al., 2024).
The acronym also has a distinct meaning in stochastic PDE theory. One-parameter “interpolating” SPDEs are defined by
58
with Caputo derivative order 59, fractional Laplacian order 60, and time-independent spatial Gaussian noise. Here 61 recovers the classical Stochastic Heat Equation and 62 recovers the classical Stochastic Wave Equation. Under a nonnegativity assumption on the Green function, the mild form is
63
The solvability theory distinguishes a global-existence regime, a local-existence regime with blow-up at a deterministic time 64, and exact moment asymptotics of the form
65
The critical line 66 produces a phase transition in the 67-plane, and for pure white noise the classical critical dimensions 68 for SHE and 69 for SWE emerge as special cases (Chen et al., 2021).
This suggests that “iSDE” has become an umbrella acronym rather than a single standardized object. In current arXiv usage, the dominant meaning concerns stochastic interpolant constructions for finite-time probabilistic transport and conditional generation, but the term also covers infinite-dimensional bridges, stability-oriented Neural SDE architectures for interpolation tasks, and interpolation families of SPDEs.