ReFlow: ODE-based Generative Methods

Updated 5 July 2026

ReFlow is a family of ODE-based generative models that employ trajectory rectification to produce nearly straight transport paths, enabling efficient simulation with few steps.
It uses recursive rectification to refine pretrained models and minimize discretization error, enhancing performance in speech, image, and molecular applications.
Critiques focus on recursive instability and endpoint distribution mismatches, prompting corrective methods like balanced coupling and density regularization.

ReFlow denotes a family of trajectory-rectification procedures built on rectified flow and flow matching. In its basic form, a time-dependent velocity field $v_\theta$ defines an ODE

$dZ_t = v_\theta(Z_t,t)\,dt,$

while training uses linear interpolants

$X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$

and regresses the model toward the displacement $X_1-X_0$ , so that transport paths become as straight as possible and can be simulated accurately with few ODE steps (Guan et al., 2023). Across the cited literature, ReFlow appears both as a recursive rectification procedure applied to pretrained diffusion or flow models and as a broader design principle for few-step or one-step generation in conditional settings such as text-to-speech, voice conversion, image generation, molecular conformer generation, reinforcement learning, and protein backbone generation (Ke et al., 5 Mar 2025, Cao et al., 13 Jul 2025).

1. Foundational formulation

The canonical ReFlow formulation is an ODE-based generative model. In the speech literature, the governing dynamics are written as

$dZ_t=v(Z_t,t)dt,$

with $Z_0\sim \pi_0$ and $Z_1$ expected to follow the data distribution $\pi_1$ , and training minimizes

$\hat{\theta}=\mathop{\arg\min}\limits_{\theta} \mathbb{E} \big[||(X_{1}-X_{0})-v(X_{t},t)||^{2}\big],$

where

$X_t=tX_1+(1-t)X_0,\qquad t\sim Uniform([0,1]).$

This replaces denoising-noise prediction or score estimation with direct regression of a velocity or drift field (Guan et al., 2023). ReFlow-VC uses the same structure in a conditional form,

$dZ_t = v_\theta(Z_t,t)\,dt,$ 0

where $dZ_t = v_\theta(Z_t,t)\,dt,$ 1 is a fused speaker condition feature (Ren et al., 1 Jun 2025).

In continuous-normalizing-flow conformer generation, the same idea appears as

$dZ_t = v_\theta(Z_t,t)\,dt,$ 2

transporting a source distribution $dZ_t = v_\theta(Z_t,t)\,dt,$ 3 to a target conformer distribution $dZ_t = v_\theta(Z_t,t)\,dt,$ 4. There the paper explicitly separates training acceleration from inference acceleration: SO(3)-Averaged Flow addresses the former, whereas ReFlow and distillation address the latter, enabling few-step or even one-step conformer generation with high quality (Cao et al., 13 Jul 2025).

This shared structure distinguishes ReFlow from DDPM-style or score-based formulations. The cited papers repeatedly describe it as deterministic ODE transport, trained by least-squares regression toward displacement or target velocity, with straightness being the property that makes coarse numerical integration viable (Guan et al., 2023).

2. Recursive rectification and the ReFlow family

The defining ReFlow operation is recursive or staged rectification. In ReFlow-TTS, if a trained rectified-flow transport is denoted by

$dZ_t = v_\theta(Z_t,t)\,dt,$ 5

then a second rectified flow is recursively defined as

$dZ_t = v_\theta(Z_t,t)\,dt,$ 6

where $dZ_t = v_\theta(Z_t,t)\,dt,$ 7 is sampled from the Gaussian distribution and $dZ_t = v_\theta(Z_t,t)\,dt,$ 8 is generated by the first ReFlow procedure. The stated purpose is to further reduce transport cost and make trajectories straighter, thereby reducing discretization error during numerical simulation (Guan et al., 2023).

A related teacher–student view appears in recursive image-generation ReFlow. A base rectified-flow model is first trained under an initial coupling $dZ_t = v_\theta(Z_t,t)\,dt,$ 9. Then one uses the trained model itself to generate paired samples $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 0, treats them as a new coupling $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 1, and retrains the next rectified-flow model on those synthetic pairs. The recursive objective is written as

$X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 2

(Zhu et al., 2024).

Later work generalizes this idea beyond a single global interval. ProReflow formulates rectification over temporal windows and then progressively merges them. Rather than directly fitting a few-window or one-window student to the original teacher trajectory, it first learns easier local straight-line approximations and then progressively reflows larger windows, using a schedule such as $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 3 on SDv1.5 (Ke et al., 5 Mar 2025). MA-Reflow then treats both vanilla ReFlow and piecewise ReFlow as members of a single teacher–student ODE distillation family, with $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 4 corresponding to vanilla ReFlow and $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 5 to piecewise variants (Wang et al., 28 Jun 2026).

Taken together, these papers suggest that ReFlow is best viewed not as a single architecture but as a family of coupling-construction and trajectory-rectification procedures layered on top of a flow model.

3. Theoretical limitations and critiques

A central criticism of standard ReFlow is that recursive straightening can be statistically unstable. One line of analysis studies denoising autoencoders as a proxy for recursive self-training and proves that repeated training on self-generated samples causes the learned operator norm to shrink: $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 6 The paper interprets this as model collapse and argues that rectified flow suffers from the same failure mode under recursive ReFlow, whereas incorporating real data prevents collapse by maintaining a positive lower bound on the learned operator norm (Zhu et al., 2024).

A different critique targets the endpoint distribution. VRFNO argues that standard ReFlow trains on deterministic couplings built from images generated by a previous model rather than real images, creating a distribution gap between images in those couplings and real images. The paper further argues that literal trajectory crossings are extremely rare in high-dimensional image space, and that the practical difficulty is better understood as approximate crossing plus endpoint-distribution mismatch (Dai et al., 14 Jul 2025).

MA-Reflow identifies a more structural limitation: trajectory matching alone does not determine the student-induced marginal distribution. The paper gives an explicit counterexample in which two student vector fields attain the same trajectory-matching loss on every interval but induce different endpoint laws. This motivates a marginal-alignment regularizer because density evolution depends on the divergence of the student field, which velocity MSE does not control (Wang et al., 28 Jun 2026).

Balanced conic rectified flow reaches a related conclusion experimentally. It argues that generated-pair-only ReFlow becomes biased toward generated data, exhibits reconstruction discrepancy between real and fake samples, and can drift away from the real target distribution across reflow steps (Seong et al., 29 Oct 2025).

These critiques do not reject ReFlow; they instead delimit the conditions under which pure self-generated rectification is insufficient.

4. Design space and corrective variants

The recent literature treats ReFlow as a large design space spanning coupling construction, loss design, solver choice, and regularization.

On the training side, Simple ReFlow argues that several earlier heuristic practices degraded sample quality and proposes seven improvements. These include sample-dependent loss normalization

$X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 7

a time distribution $X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 8, a theory-preserving modified quadratic loss

$X_t = tX_1 + (1-t)X_0,\qquad t\in[0,1],$ 9

reduced UNet dropout, mixed forward and backward pairs, projected couplings, and an inference schedule combining sigmoid time discretization with DPM-Solver and $X_1-X_0$ 0 (Kim et al., 2024).

On the coupling side, Real-data Augmented Reflow uses reverse ODE integration of real images to construct approximate real image–noise pairs and mixes them with synthetic forward pairs (Zhu et al., 2024). Balanced conic rectified flow instead uses real pairs

$X_1-X_0$ 1

and augments them with Slerp-based source-side perturbations to form conic neighborhoods around inverse latents, while still retaining fake pairs for global transport coverage (Seong et al., 29 Oct 2025). MA-Reflow regularizes each distillation interval with

$X_1-X_0$ 2

computed by integrating an augmented student ODE that tracks both endpoint position and log-density change (Wang et al., 28 Jun 2026).

On the solver side, FireFlow studies the inverse problem for distilled rectified-flow models such as FLUX. It proposes a midpoint-like solver that reuses the previous step’s midpoint velocity,

$X_1-X_0$ 3

and proves $X_1-X_0$ 4 global truncation error under $X_1-X_0$ 5, enabling accurate inversion and editing in $X_1-X_0$ 6 steps (Deng et al., 2024). ReFlex, by contrast, treats editing as a feature-extraction and attention-adaptation problem inside multimodal transformer blocks and uses a mid-step latent rather than a fully inverted latent for feature extraction (Kim et al., 2 Jul 2025).

A plausible implication is that ReFlow practice has shifted from “straighten trajectories by any available self-distillation recipe” toward explicit control of coupling quality, density evolution, and numerical stiffness.

5. Domain-specific applications

The same rectification principle has been specialized to markedly different conditional generative problems.

Domain	ReFlow instantiation	Representative reported result
Text-to-speech	Conditional rectified flow over Mel-spectrograms	ReFlow-TTS (1step): NFE $X_1-X_0$ 7, FD $X_1-X_0$ 8, MOS $X_1-X_0$ 9; ReFlow-TTS (RK45 solver): NFE $dZ_t=v(Z_t,t)dt,$ 0, FD $dZ_t=v(Z_t,t)dt,$ 1, MOS $dZ_t=v(Z_t,t)dt,$ 2 (Guan et al., 2023)
Voice conversion	Zero-shot VC with fused speaker conditioning	ReFlow-VC at 1 step: NMOS $dZ_t=v(Z_t,t)dt,$ 3, SMOS $dZ_t=v(Z_t,t)dt,$ 4, CER $dZ_t=v(Z_t,t)dt,$ 5, WER $dZ_t=v(Z_t,t)dt,$ 6, SECS $dZ_t=v(Z_t,t)dt,$ 7 (Ren et al., 1 Jun 2025)
Text-to-image	Reflow-style acceleration of SDv1.5/SDXL	ProReflow-II: FID $dZ_t=v(Z_t,t)dt,$ 8 with only 4 sampling steps on COCO-2014 validation, close to the 32-step DDIM teacher FID $dZ_t=v(Z_t,t)dt,$ 9 (Ke et al., 5 Mar 2025)
Few-step flow models	One-shot ReFlow from diffusion teachers	Simple ReFlow achieves FID $Z_0\sim \pi_0$ 0 / $Z_0\sim \pi_0$ 1 on CIFAR10 without / with guidance at 9 NFEs (Kim et al., 2024)
Molecular conformers	Few-step or one-step conformer generation	Reflow and distillation enable few-steps or even one-step molecular conformer generation with high quality (Cao et al., 13 Jul 2025)
Flow-based RL	Explicit Reflow regularization inside policy gradients	ReFPO*: 10-step Reward $Z_0\sim \pi_0$ 2, 1-step Reward $Z_0\sim \pi_0$ 3, versus FPO $Z_0\sim \pi_0$ 4 and $Z_0\sim \pi_0$ 5 (Wang et al., 19 Jun 2026)
Embodied video RL	Corrective reflow toward within-group positive prototypes	CreFlow improves downstream execution success to $Z_0\sim \pi_0$ 6 versus Vidar $Z_0\sim \pi_0$ 7 and DiffusionNFT $Z_0\sim \pi_0$ 8 (Ni et al., 14 May 2026)
Protein backbone generation	ReFlow on pretrained SE(3) $Z_0\sim \pi_0$ 9 flow models	The paper reports that ReFlow is particularly sensitive to the choice of coupling generation and annealing, and that image-domain design choices do not directly translate to proteins (Chen et al., 13 Oct 2025)

These results show a recurring trade-off. One-step or very-low-NFE generation is often already competitive, but the highest quality in speech and some image settings may still come from more expensive solvers such as RK45 or from larger NFE budgets (Guan et al., 2023). In proteins, the cited paper is explicit that the image-domain design space does not transfer unchanged, especially for coupling generation and annealing (Chen et al., 13 Oct 2025).

6. Polysemy and other uses of the term

“ReFlow” and “Reflow” are not unique to rectified-flow generative modeling. In the same arXiv corpus, the term designates several unrelated systems and processes.

In human–computer interaction, “Reflow” is a pixel-based system for automatically refining mobile user interfaces from screenshots. Its pipeline extracts a layout from an app screenshot, refines the layout, and re-renders the UI; in a user study, applications optimized by Reflow led to, on average, $Z_1$ 0 faster selection time with minimal layout disruption (Wu et al., 2022).

In model compression, “REFLOW” stands for “Restoring Flow of Low-variance signals,” a post-pruning BatchNorm recalibration method for one-shot pruning. It does not update trainable weights; instead it recalibrates BatchNorm statistics to mitigate signal collapse, and the paper reports that on ResNeXt-101 / ImageNet at $Z_1$ 1 sparsity, REFLOW restores top-1 accuracy from below $Z_1$ 2 to $Z_1$ 3 (Saikumar et al., 18 Feb 2025).

In manufacturing, “reflow” denotes the solder-melting stage of surface mount technology. One paper studies component self-alignment during reflow soldering and develops an optimization model for pre-reflow placement parameters (Parviziomran et al., 2020). Another models and optimizes the regional center temperature field of a reflow furnace using a first-order ODE and process constraints such as time above $Z_1$ 4 and peak temperature $Z_1$ 5 (Sui et al., 2022).

In dynamic scene reconstruction, “ReFlow” names a monocular 4D reconstruction framework rather than a rectified-flow generator. There it denotes self-correction motion learning from raw video, combining Complete Canonical Space Construction, Separation-Based Dynamic Scene Modeling, and a self-correction flow-matching mechanism based on Full Flow Matching and Camera Flow Matching (Liang et al., 2 Apr 2026).

This polysemy is important: the generative-modeling meaning of ReFlow concerns trajectory rectification in learned ODE transports, whereas the HCI, pruning, reconstruction, and manufacturing uses denote unrelated methods or physical processes.