Papers
Topics
Authors
Recent
Search
2000 character limit reached

Diffeomorphic B-spline Flows

Updated 1 April 2026
  • Diffeomorphic B-spline flows are smooth, invertible transformations parameterized by B-spline functions that ensure continuity and stability.
  • They leverage the local support and analytic inversion of B-spline bases to model complex static distributions and dynamic systems efficiently.
  • Rigorous derivative constraints guarantee diffeomorphism and bi-Lipschitz continuity, offering state-of-the-art interpolation and sampling in practical applications.

A diffeomorphic B-spline flow is a type of normalizing flow where the invertible transformation is parameterized via (possibly non-uniform) B-spline functions and is constructed to be diffeomorphic, i.e., smooth and invertible with a smooth inverse. These models leverage the local support and high smoothness of B-spline bases to define continuous, non-oscillatory, and stable flows, with rigorous conditions ensuring diffeomorphism and (bi-)Lipschitz continuity. Diffeomorphic B-spline flows have been developed both for modeling static probability distributions and for learning complex dynamical systems from sparse or irregular observations, as exemplified by the SplineFlow and Neural Diffeomorphic Non-uniform B-spline Flow frameworks (Rathod et al., 30 Jan 2026, Hong et al., 2023).

1. Mathematical Foundations

Diffeomorphic B-spline flows generalize the notion of continuous normalizing flows (CNFs) and discrete coupling-based flows by introducing transformations parameterized by B-splines. In the CNF setting, the state zt∈Rdz_t \in \mathbb{R}^d evolves according to an ODE:

dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]

with vtv_t a time-dependent vector field parameterized, for example, by a neural network. If vtv_t is globally Lipschitz, by classical ODE theory the time-tt map z0↦ztz_0 \mapsto z_t is a C1\mathcal{C}^1 diffeomorphism (Rathod et al., 30 Jan 2026). For coupling-based flows, the transformation in each (possibly one-dimensional) channel is parameterized as a B-spline function, leading to a piecewise polynomial and highly smooth (at least Ck−2\mathcal{C}^{k-2} for B-splines of order kk) invertible transformation (Hong et al., 2023).

Let {tj}\{t_j\} be (possibly non-uniform, possibly periodic) knots and dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]0 control points, then the B-spline basis of order dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]1 is constructed recursively as: dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]2 where dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]3, and dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]4 is compactly supported on dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]5. The transformation is then

dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]6

for each (active) channel in a coupling flow or as a vector path dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]7 when interpolating trajectories in CNFs.

2. Diffeomorphism and Regularity Conditions

A mapping parameterized by B-splines is a diffeomorphism if it is invertible and possesses sufficient smoothness (regularity). The fundamental sufficient condition, as established in (Hong et al., 2023), is for the transformation’s derivative to be strictly positive and bounded: dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]8 with dztdt=vt(zt),t∈[0,1]\frac{d z_t}{dt} = v_t(z_t), \quad t \in [0,1]9. If, for all vtv_t0, vtv_t1 for positive constants vtv_t2, then vtv_t3 everywhere and vtv_t4 is a vtv_t5-diffeomorphism and bi-Lipschitz on vtv_t6. In practical neural parameterizations, these constraints are enforced via softplus and cumulative summation steps to guarantee monotonicity and invertibility. On periodic domains such as vtv_t7, appropriate constraints and matching of endpoint derivatives yield a periodic diffeomorphism.

The analytic inverse for cubic B-spline (vtv_t8) transforms is constructed locally by inverting a cubic equation per cell, which allows for efficient, exact inversion and evaluation of derivatives.

3. Flow Matching and B-spline Conditional Paths

In the context of flow matching for dynamical systems, diffeomorphic B-spline flows enable the interpolation of observed states at arbitrary timepoints using smooth B-spline curves. Suppose observations vtv_t9 are given at times vtv_t0; a control point solution yields vtv_t1 such that vtv_t2 and vtv_t3 (where vtv_t4 is the spline degree) (Rathod et al., 30 Jan 2026). This avoids the instability and oscillation of high-degree polynomial interpolants.

For the conditional flow, the target distribution at each vtv_t5 is modeled as

vtv_t6

with the target velocity given by vtv_t7. The regression objective minimizes the mean squared error between the neural velocity field vtv_t8 and the spline derivative vtv_t9, i.e.,

tt0

with stochastic extensions handled by introducing a separate score network for SDE-based training.

4. Implementation and Algorithmic Aspects

Diffeomorphic B-spline flows can be implemented as CNFs with B-spline trajectory interpolants or as standard (discrete) normalizing flows with B-spline parameterizations in coupling layers. Algorithmic steps for SplineFlow (Rathod et al., 30 Jan 2026) include:

  • Solving a linear system per trajectory to obtain control-point coefficients for the spline interpolant.
  • Uniform sampling over the time domain and conditional Gaussian sampling from the spline-defined marginal.
  • Efficient computation of spline derivatives (and, for cubic B-splines, analytic inversion).
  • Regularization or architectural constraints guarantee strict monotonicity and bounded derivatives throughout training, as described in (Hong et al., 2023).
  • At evaluation, the density evolution can be tracked by integrating the instantaneous divergence along the path or through direct Jacobian–trace computation.

Analytic inversion for cubic B-spline flows enables efficient sampling and log-density computation, with full inverses and higher derivatives accessible in closed form within each cell.

5. Theoretical Properties and Guarantees

The theoretical underpinnings for diffeomorphic B-spline flows include:

  • Approximation error: If the ground truth tt1, SplineFlow’s tt2-degree spline interpolant achieves

tt3

in contrast to tt4 for linear paths (Rathod et al., 30 Jan 2026).

  • Validity of the conditional path: The conditional formulation produces marginals matching observed data at all tt5 and satisfies the continuity equation for the induced velocity field.
  • Diffeomorphism: Enforced via bounded positive derivative constraints; tt6 regularity is both necessary and sufficient for physical interpretability in domains such as force field modeling in molecular dynamics (Hong et al., 2023).
  • Bi-Lipschitzness: The lower and upper bound constraints on the derivative guarantee quantitative stability and invertibility.
  • Periodic extension: On tt7, parameter tying yields maps that are diffeomorphisms of the circle with all derivatives up to order tt8 matched at the boundaries.

6. Empirical Evaluation and Applications

Diffeomorphic B-spline flows have demonstrated strong empirical performance across deterministic and stochastic dynamical systems and data distributions with complex support:

  • For dynamical systems, SplineFlow (Rathod et al., 30 Jan 2026) surpasses NeuralODE, LatentODE, and TrajectoryFM (linear) models in mean squared error, especially under nonlinear or irregular observation sampling regimes. In high-complexity systems (e.g., chaotic Lorenz), higher-degree B-splines recover the attractor structure lost by linear path approaches.
  • On stochastic SDE inference tasks, the variance-reduced spline-based flow-matching schemes outperform static and non-spline baselines on multiple distributional metrics (Wasserstein, MMD).
  • For biological trajectory data (e.g., single-cell fate inference), SplineFlow achieves superior interpolation and extrapolation accuracy versus alternative flow-matching and optimal transport approaches.
  • In static distribution modeling, especially for applications demanding well-defined second-order derivatives (e.g., force computation in physical simulation with Boltzmann generators), the neural diffeomorphic non-uniform B-spline flows (Hong et al., 2023) attain negative log-likelihood and force error competitive with infinitely smooth bump-function flows, but with much faster sampling (approximately tt9 speedup).

A summary of qualitative and quantitative findings from both frameworks is provided below:

Property / Metric SplineFlow (Rathod et al., 30 Jan 2026) Neural Diffeomorphic B-spline (Hong et al., 2023)
Interpolation accuracy (ODE) SOTA for nonlinear, irregular data Not applicable
Stability, smoothness Arbitrary degree, non-oscillatory z0↦ztz_0 \mapsto z_t0 (e.g. cubic, z0↦ztz_0 \mapsto z_t1)
Inverse, log-det computation Standard CNF or explicit Jacobian Analytic for z0↦ztz_0 \mapsto z_t2 (e.g. cubic)
Force-matching error (MD/Boltz) Not evaluated Matches or beats smooth flows
Sampling runtime Simulation-free (fast) z0↦ztz_0 \mapsto z_t3/sample

Empirical ablations confirm the importance of spline degree: for highly nonlinear or oscillatory dynamics, z0↦ztz_0 \mapsto z_t4 is essential; for smoother systems, linear paths suffice. In high-dimensional physical modeling, spline flows provide robust force fields and improved dynamic stability compared to RQ-spline or non-B-spline competitors.

7. Limitations and Outlook

Limitations of current diffeomorphic B-spline flows include:

  • Occasional numerical instability in analytic inversion, primarily with cubic-root solvers under force-matching losses.
  • Higher parameter and computational requirements versus traditional affine coupling flows, though substantially less than infinitely smooth non-analytic normalizing flows.
  • Expressivity in high-dimensional full tensor-product B-spline flows is impractical; coupling-style architectures are typically adopted.

Despite these constraints, diffeomorphic B-spline flows constitute a flexible modeling class balancing smoothness, invertibility, analytic tractability, and empirical accuracy, with diverse applications in dynamical system inference and computational physics. Their success suggests further exploration into higher-order, domain-adapted, and structured B-spline-based transformations for both continuous and discrete-time generative modeling (Rathod et al., 30 Jan 2026, Hong et al., 2023).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Diffeomorphic B-spline Flows.