HDFlow: Hierarchical Diffusion-Flow Patterns

• HDFlow is a design pattern that organizes generative processes into hierarchical levels using coarse-to-fine diffusion and structured latent states.
• It leverages multiscale feature pyramids, staged refinement, and explicit flow or diffusion-only modules to reduce search space and boost performance.
• Hybrid implementations show that combining diffusion with flow components can achieve state-of-the-art speed and accuracy in applications like video interpolation and graph generation.

Searching arXiv for the cited papers and related HDFlow terminology to ground the article. {"^^^^^^^^6query6 Flow Diffusion for Efficient Frame Interpolation\" OR ^^^^^^^^6ti:\6 Diffusion Autoencoders and Disentangled Image Manipulation\" OR ^^^^^^^^6ti:\6 Enhancing LLM Complex Problem-Solving with Hybrid Thinking and Dynamic Workflows\" OR ^^^^^^^^6ti:\6 Hierarchical Planning with Diffusion\" OR ^^^^^^^^6ti:\6 Hierarchical Image Steganography\"","max_results":^^^^6ti:\6query6^^^^,"sort_by":"relevance"} {"^^^^^^^^6query6 &&&^^^^6ti:\6^^^^&&&, &&&^^^^6 OR ti:\6^^^^&&&, &&&^^^^6 OR ti:\6^^^^&&&, &&&^^^^6 OR ti:\6^^^^&&&, &&&^^^^6 OR ti:\6^^^^&&&, Zang et al., 29 Jun 2025, Zhou et al., 8 Oct 2025, Cheng et al., 12 Nov 2025, Liu et al., 2024)","max_results":^^^^6ti:\6 OR ti:\6^^^^,"sort_by":"submittedDate"} Hierarchical Diffusion-Flow (HDFlow) denotes a non-uniform research theme rather than a single canonical architecture. In its most direct generative-modeling sense, it refers to hierarchical, coarse-to-fine diffusion over a structured flow representation, most clearly exemplified by “Hierarchical Flow Diffusion for Efficient Frame Interpolation” (&&&^^^^6ti:\6^^^^&&&). Adjacent work uses similar multiscale principles without an explicit flow component, or combines diffusion with flow in modular ways, while the paper titled “HDFlow” (&&&^^^^6ti:\6ti:\6^^^^&&&) concerns hybrid LLM reasoning rather than diffusion modeling. This suggests that HDFlow is best understood as a design pattern centered on multilevel structure, staged refinement, and structured intermediate variables.

^^^^6ti:\6^^^^. Terminology and scope

Current arXiv usage separates at least four meanings that are easy to conflate. First, “Hierarchical Flow Diffusion” is an explicit video-frame-interpolation method built around bilateral optical flow and coarse-to-fine diffusion (&&&^^^^6ti:\6^^^^&&&). Second, several hierarchical diffusion papers are conceptually close to HDFlow but explicitly state that they contain no normalizing flow, flow matching, or invertible transport machinery, as in Hierarchical Diffusion Autoencoders and Hierarchical Diffuser (&&&^^^^6query6^^^^&&&). Third, some hybrid systems genuinely combine diffusion and flow components, but define hierarchy in ways other than scale, such as importance tiers in steganography (&&&^^^^6 OR ti:\6^^^^&&&). Fourth, the title “HDFlow” itself is already occupied by a framework for hybrid fast/slow LLM reasoning, not by a hierarchical diffusion-flow generator (&&&^^^^6ti:\6ti:\6^^^^&&&).

Work	Domain	Relation to “HDFlow”
“Hierarchical Flow Diffusion for Efficient Frame Interpolation” (&&&^^^^6ti:\6^^^^&&&)	Video frame interpolation	Most direct HDFlow-style usage
“Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation” (&&&^^^^6query6^^^^&&&)	Image autoencoding and editing	Hierarchical diffusion, explicitly not a flow model
“Diffusion-Based Hierarchical Image Steganography” (&&&^^^^6 OR ti:\6^^^^&&&)	Steganography	Modular diffusion-plus-flow pipeline
“Hierarchical Discrete Flow Matching for Graph Generation” (&&&^^^^6 OR ti:\6^^^^&&&)	Graph generation	Close discrete HDFlow variant
“HDFlow: Enhancing LLM Complex Problem-Solving with Hybrid Thinking and Dynamic Workflows” (&&&^^^^6ti:\6ti:\6^^^^&&&)	LLM reasoning	Official HDFlow title, unrelated to diffusion modeling

A useful working definition therefore treats HDFlow as a family of architectures in which hierarchy constrains a diffusion-like or flow-like generation process through coarse-to-fine scales, structured latent states, or staged transport. The precise meaning of “hierarchy” varies substantially across papers.

^^^^6 OR ti:\6^^^^. Canonical formulation in frame interpolation

The clearest generative instantiation is the frame-interpolation system that models bilateral optical flow explicitly by hierarchical diffusion and then synthesizes the middle frame with a flow-guided decoder (&&&^^^^6ti:\6^^^^&&&). Its central claim is that denoising in optical-flow space is more effective than denoising directly in image-latent space because the flow space is a much smaller search space in the denoising procedure.

The formulation uses bilateral flow anchored at the unknown middle frame. If PRESERVED_PLACEHOLDER_^^^^6query6^^^^ and PRESERVED_PLACEHOLDER_^^^^6ti:\6^^^^ are the two input frames and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^ is the interpolated frame, the image synthesizer is

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^

where PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^ and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^ are the optical flows from $I_t$ to $I_0$ and $I_1$. During training, pseudo bilateral flow is obtained from a pretrained RAFT model. The synthesizer is a multiscale ResNet-based encoder-decoder that predicts a ^^^^6ti:\6^^^^-channel blending mask $M$ and a ^^^^6 OR ti:\6^^^^-channel residual map PRESERVED_PLACEHOLDER_^^^^6ti:\6query6^^^^, with final reconstruction

PRESERVED_PLACEHOLDER_^^^^6ti:\6ti:\6^^^^

Hierarchy is realized as multi-scale coarse-to-fine diffusion over a feature pyramid. The encoder extracts feature pairs PRESERVED_PLACEHOLDER_^^^^6ti:\6 OR ti:\6^^^^, level PRESERVED_PLACEHOLDER_^^^^6ti:\6 OR ti:\6^^^^ has spatial resolution PRESERVED_PLACEHOLDER_^^^^6ti:\6 OR ti:\6^^^^ of the original image, and diffusion is performed across three pyramid levels, from PRESERVED_PLACEHOLDER_^^^^6ti:\6 OR ti:\6^^^^ to PRESERVED_PLACEHOLDER_^^^^6ti:\66^^^^ to PRESERVED_PLACEHOLDER_^^^^6ti:\6^^^^7. At each level, the denoising U-Net predicts clean bilateral flow from noisy flow and conditioning features:

PRESERVED_PLACEHOLDER_^^^^6ti:\6^^^^8

The diffusion timeline is partitioned across pyramid levels, and when the process moves to a finer stage the coarser prediction is upsampled by PRESERVED_PLACEHOLDER_^^^^6ti:\6^^^^9 and re-noised before further denoising. The flow model is supervised at all scales with

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6query6^^^^

while the synthesizer uses

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6ti:\6^^^^

with PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^.

The architecture shares the denoising U-Net across feature levels, with separate feature and flow projectors per scale. After separate training of the synthesizer and the diffusion model, both are jointly fine-tuned end to end. Empirically, the method is reported as state of the art in accuracy and ^^^^6ti:\6query6^^^^+ times faster than other diffusion-based methods; on the same RTX-^^^^6 OR ti:\6query6relevance6query6^^^^ and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ input pair, runtime is PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ s for LDMVFI, PRESERVED_PLACEHOLDER_^^^^6 OR ti:\66^^^^ s for CBBD, PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^7 s for SGM-VFI, and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^8 s for the proposed method. For ^^^^6 OR ti:\6 OR ti:\66^^^^×^^^^6 OR ti:\6 OR ti:\66^^^^-resolution diffusion inference, the reported total runtime is PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^9 ms, broken down into encoder PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6query6^^^^ ms, scale-PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6ti:\6^^^^ PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ ms, scale-PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ ms, scale-PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ PRESERVED_PLACEHOLDER_^^^^6 OR ti:\66^^^^ ms, and decoder PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^7 ms (&&&^^^^6ti:\6^^^^&&&).

^^^^6 OR ti:\6^^^^. Hierarchical latent organization in image, language, and tree generation

A second major line of work uses hierarchy to organize semantics across latent levels without adding a flow component. Hierarchical Diffusion Autoencoders replace the single bottleneck of earlier diffusion autoencoders with a coarse-to-fine feature hierarchy, typically derived from U-Net feature levels, and argue that higher hierarchy levels capture high-level semantics while lower levels capture fine appearance and detail (&&&^^^^6query6^^^^&&&). Linear probing on CelebA-HQ shows this scale-wise specialization: the high-level code is stronger on attributes such as Smile, Eyeglass, and Young, while the low-level code is stronger on Blackhair, PaleSkin, Brownhair, and ^^^^6 OR ti:\6^^^^_o_Clock_Shadow. A capacity-matched comparison is especially important: after ^^^^6ti:\6query6query6query6^^^^ training steps, validation reconstruction MSE is PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^8 for DAE(^^^^6 OR ti:\6 OR ti:\66query6^^^^) and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^9 for HDAE, while parameter counts are PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6query6^^^^M and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6ti:\6^^^^M respectively. The paper is explicit that this is not a flow model; the contribution is hierarchical latent organization for diffusion decoding, plus a truncated-feature-based approach for disentangled editing.

In language modeling, Hierarchical Diffusion LLMs define hierarchy over semantic abstraction levels rather than over spatial scale (Zhou et al., 8 Oct 2025). The main instantiation uses the chain

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^

where PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ is a word token, PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ is a cluster-level token, and PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ is mask. The forward marginal is

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\66^^^^

so corruption moves each token independently to a higher-level ancestor with coarser semantics. The reverse model always predicts word-level probabilities, but the ELBO decomposes into a cluster-to-word cross-entropy term and a mask-to-cluster cross-entropy term. The paper shows that MDLM is recovered as a special case when the hierarchy collapses to one cluster, so the method generalizes masked discrete diffusion by replacing flat noise with ancestor-based semantic noise.

HDTree introduces another non-flow interpretation of hierarchy, this time as a rooted binary tree over quantized latent codes (Zang et al., 29 Jun 2025). Inputs are encoded as PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^7, then quantized into a root-to-leaf path

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^8

where each PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^9 chooses the nearest valid child code at depth PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6query6^^^^. The diffusion process itself remains a conditional DDPM in data space, with PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6ti:\6^^^^ acting as the conditioning variable. This produces a unified hierarchical codebook plus quantized diffusion process, and it avoids branch-specific modules by using one encoder, one shared tree-structured codebook, and one diffusion decoder.

^^^^6 OR ti:\6^^^^. Hybrid diffusion–flow variants and graph formulations

Some papers combine diffusion and flow more literally, but define hierarchy in domain-specific ways. In diffusion-based hierarchical image steganography, hierarchy is defined by payload importance and robustness rather than by multiresolution feature depth (&&&^^^^6 OR ti:\6^^^^&&&). Tier-^^^^6ti:\6^^^^ content is concealed through a diffusion inversion backbone, then refined by a two-stage Enhance-Flow; Tier-^^^^6 OR ti:\6^^^^ images or text are embedded into the generated container through an invertible Embed-Flow. The result is a modular pipeline in which diffusion provides robust Tier-^^^^6ti:\6^^^^ concealment and flow modules provide reversible enhancement and high-capacity secondary hiding. The paper explicitly notes that this is not a single unified probabilistic diffusion-flow model, but it is a clear hybrid architecture.

On the graph side, hierarchical discrete flow matching is close to an HDFlow formulation in a stricter algorithmic sense (&&&^^^^6 OR ti:\6^^^^&&&). Graph generation is factorized across levels as

PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^

where PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ is a deterministic expansion of the coarser graph into a spanning supergraph at the finer level. Hierarchy is induced by node clustering and quotient-graph construction, while discrete flow matching refines each expanded sparse graph into its target graph. The main computational claim is that hierarchy reduces complexity from PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^ pairwise evaluation to PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6 OR ti:\6^^^^, and the reported number of function evaluations drops to PRESERVED_PLACEHOLDER_^^^^6 OR ti:\66^^^^, PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^7, or PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^8, compared with PRESERVED_PLACEHOLDER_^^^^6 OR ti:\6^^^^9 or more in diffusion baselines. On ZINC^^^^6 OR ti:\6 OR ti:\6query6^^^^k, for example, dense DFM with ^^^^6ti:\6 OR ti:\6^^^^8 NFEs takes $I_t$^^^^6query6^^^^ s, while HDFM with ^^^^6ti:\6 OR ti:\6^^^^8 NFEs takes $I_t$^^^^6ti:\6^^^^ s and HDFM with ^^^^6 OR ti:\6 OR ti:\6^^^^ NFEs takes $I_t$^^^^6 OR ti:\6^^^^ s.

A different graph formulation appears in continuous geometry-aware graph diffusion via hyperbolic neural PDE, where hierarchy is encoded geometrically by negative curvature rather than by explicit coarsening (Liu et al., 2024). The method reformulates propagation as a continuous-time diffusion-flow on the Poincaré ball, with node-wise attention acting as diffusivity inside a hyperbolic graph diffusion equation. Its local, global, and local-global diffusivity schemes operationalize diffusion over low- and high-order proximity. This is not a multiresolution HDFlow model, but it is an explicit continuous-time diffusion-flow framework for hierarchical graph structure.

Flow-only work can also inform the HDFlow concept. Fractal Flow introduces recursive normalizing flows with LDA-structured latent priors and a coarse-to-fine recursive architecture, but it is not a diffusion model (&&&^^^^6 OR ti:\6^^^^9&&&). Its relevance is architectural: it demonstrates that hierarchical latent semantics, recursive refinement, and interpretable module design can be built into exact generative models without branch-specific transforms.

^^^^6 OR ti:\6^^^^. Hierarchical planning and control

In offline reinforcement learning and planning, hierarchy is usually temporal rather than spatial. Hierarchical Diffuser defines a two-level planner in which a high-level Sparse Diffuser generates jumpy subgoals every $I_t$^^^^6 OR ti:\6^^^^ steps and a low-level diffusion model fills in dense segments between them (&&&^^^^6 OR ti:\6^^^^&&&). The hierarchy is simple and explicit: subgoals are every $I_t$^^^^6 OR ti:\6^^^^-th state, and lower-level generation is conditioned by clamping segment endpoints to adjacent subgoals. The method contains no flow component, but it shows that temporal abstraction can improve both receptive field and efficiency. On AntMaze-Large, Diffuser obtains $I_t$^^^^6 OR ti:\6^^^^ while HD reaches $I_t$6; on Maze^^^^6 OR ti:\6^^^^D-Medium, training time per ^^^^6ti:\6query6query6^^^^ updates is $I_t$7 s for HD and $I_t$8 s for Diffuser.

CHD sharpens the planning argument by diagnosing the failure of weakly coupled hierarchy (&&&^^^^6 OR ti:\6ti:\6^^^^&&&). The paper attributes long-horizon degradation to loose coupling between high-level sub-goal selection and low-level trajectory generation, then proposes Coupled Hierarchical Diffusion, in which HL sub-goals and LL trajectories are modeled within a unified hierarchical objective and a shared classifier passes LL feedback upstream so that sub-goals self-correct while sampling proceeds. The practical reverse process factorizes HL and LL denoising kernels, but restores bidirectional interaction through classifier guidance and an asynchronous parallel schedule. This is still diffusion-only, yet it is especially relevant to HDFlow because it makes coupling—not just multiscale decomposition—the central design requirement for coherent long-horizon plans.

SIHD extends the same area by replacing a fixed two-layer temporal hierarchy with an adaptively constructed one derived from state-graph structural information (&&&^^^^6 OR ti:\6^^^^&&&). It builds a k-nearest-neighbor state graph, minimizes structural entropy to obtain an encoding tree, and uses the resulting communities to define multiple temporal scales. Lower diffusion layers are conditioned on structural information gain rather than only on reward prediction, and the base layer includes a structural entropy regularizer intended to encourage exploration of underrepresented states while avoiding extrapolation errors. Reported gains are largest on long-horizon navigation tasks: average improvements are $I_t$9 on single-task Maze^^^^6 OR ti:\6^^^^D, $I_0$^^^^6query6^^^^ on multi-task Maze^^^^6 OR ti:\6^^^^D, and $I_0$^^^^6ti:\6^^^^ on AntMaze, with an $I_0$^^^^6 OR ti:\6^^^^ reduction in training time and a $I_0$^^^^6 OR ti:\6^^^^ reduction in planning time relative to Diffuser on Maze^^^^6 OR ti:\6^^^^D.

6. Empirical themes, misconceptions, and open directions

A recurring empirical theme is that hierarchical structure often matters more than merely enlarging a flat latent or increasing denoising budget. HDAE’s comparison against DAE(^^^^6 OR ti:\6 OR ti:\66query6^^^^) shows better reconstruction at nearly identical parameter count, which the authors interpret as evidence that hierarchical conditioning is superior to simply enlarging a flat bottleneck (&&&^^^^6query6^^^^&&&). In graph generation, HDFM shows that a hierarchy can simultaneously reduce the search space and improve fidelity by constraining generation to sparse expanded supergraphs rather than dense arbitrary graphs (&&&^^^^6 OR ti:\6^^^^&&&). In planning, CHD argues that hierarchy without cross-level correction is insufficient, and SIHD argues that fixed hierarchy without adaptive temporal scales is insufficient (&&&^^^^6 OR ti:\6ti:\6^^^^&&&).

Several misconceptions are therefore worth excluding. One is that every HDFlow-like method contains an explicit flow model. This is false for HDAE, Hierarchical Diffuser, SIHD, HDLM, and HDTree, all of which are diffusion-first or diffusion-only formulations (&&&^^^^6ti:\6ti:\6^^^^&&&). A second is that “hierarchy” always means the same thing. Across the cited literature it can mean multiscale feature pyramids, temporal abstraction, semantic-scale abstraction, quotient-graph coarsening, importance-dependent robustness tiers, or hyperbolic geometry (&&&^^^^6 OR ti:\6^^^^&&&). A third is that the title “HDFlow” uniquely identifies a hierarchical diffusion-flow generator; in current arXiv usage it also names a framework for hybrid fast/slow LLM reasoning (&&&^^^^6ti:\6ti:\6^^^^&&&).

The open research direction suggested by this body of work is not the replacement of diffusion by flow, but the integration of their strongest motifs. A plausible implication is that a more complete HDFlow formulation would combine adaptive hierarchy construction, explicit coupled coarse-to-fine inference, and either discrete or continuous transport across levels. The surveyed papers already provide most of these ingredients separately: structured hierarchical latent spaces, coarse-to-fine diffusion schedules, hybrid diffusion-plus-flow modules, discrete flow matching over hierarchical supports, and coupled multilevel planning objectives. What remains uneven across the literature is a single unified formulation that combines hierarchical latent design, cross-level correction, and explicit flow machinery within one end-to-end model.