---
title: Trajectory-Controllable Unfolding Framework
url: https://www.emergentmind.com/topics/trajectory-controllable-unfolding-framework
type: topic
---

# Trajectory-Controllable Unfolding Framework

Searching arXiv for the explicitly trajectory-controllable unfolding paper and closely related trajectory-control work.

Searching arXiv for "trajectory-controllable unfolding framework" and "Progressive Flow-inspired Unfolding".

A trajectory-controllable unfolding framework is an unfolding architecture in which the *path* of intermediate states is treated as an explicit design object rather than a by-product of iterative inference. The phrase is used explicitly by FLoUNet for coded aperture snapshot spectral imaging (CASSI), where the central objective is to make reconstruction evolve along a smooth, progressively improving trajectory from a noisy initial estimate to a high-quality hyperspectral image, instead of allowing abrupt stage-to-stage jumps and poorly regulated intermediate outputs [2509.12079]. A broader reading is also suggested by adjacent trajectory-conditioned generative systems, in which latent or physical state is unfolded under explicit motion, structural, or behavioral constraints rather than only endpoint supervision.

## 1. Canonical formulation in deep unfolding

In its canonical usage, the framework addresses severely ill-posed inverse problems in which a latent state must be reconstructed through a finite sequence of learned updates. For CASSI, the unknown hyperspectral image \(\mathbf{x}\in\mathbb{R}^n\) and compressed measurement \(\mathbf{y}\in\mathbb{R}^m\) satisfy
\[
\mathbf{y}=\mathbf{A}\mathbf{x}+\mathbf{n},
\]
with \(m\ll n\). Reconstruction is posed as a MAP problem,
\[
\hat{\mathbf{x}}=\arg\min_{\mathbf{x}} \frac{1}{2}\|\mathbf{y}-\mathbf{A}\mathbf{x}\|_2^2-\log p(\mathbf{x}),
\]
and standard deep unfolding alternates a data-fidelity update with a learned proximal or denoising step. The generic form given is
\[
\mathbf{z}_k \leftarrow \mathbf{x}_k-\gamma \frac{\partial}{\partial \mathbf{x}_k}\left\|\mathbf{W}(\mathbf{y}-\mathbf{H}\mathbf{x}_k)\right\|_2^2,\qquad
\mathbf{x}_{k+1}\leftarrow \operatorname{prox}_{\sigma}(\mathbf{z}_k),
\]
with the proximal operator
\[
\operatorname{prox}_{\lambda h}(\mathbf{v})=\arg\min_{\mathbf{x}}\left\{\frac{1}{2\lambda}\|\mathbf{x}-\mathbf{v}\|_2^2+h(\mathbf{x})\right\}.
\]

The defining claim of the trajectory-controllable variant is that conventional unfolding controls the endpoint but not the *intermediate reconstruction trajectory*. Intermediate stages may improve erratically, later stages may dominate disproportionately, and optimization may become sensitive to initialization. In this formulation, trajectory controllability means that each stage should correspond to a meaningful partial restoration step and that the entire stage sequence should approximate a gradual transport from measurement-corrupted input to clean output, not merely a stack of denoisers [2509.12079].

## 2. Flow-inspired stage dynamics and trajectory supervision

FLoUNet instantiates this idea by replacing abrupt denoiser overwrites with a controlled interpolative update. The proposed stage transition is
\[
x_{k+1}=\left(1-\frac{s}{K}\right)\mathcal{D}_\sigma(x_k)+\frac{s}{K}x_k,
\]
where \(x_k\) is the current estimate, \(\mathcal{D}_\sigma(x_k)\) is the denoiser output, \(K\) is the number of unfolding stages, and \(s/K\) is a learned progression coefficient. The next state is therefore a convex interpolation between the current estimate and its denoised target. This replaces unconstrained stage replacement with a bounded transport step.

After denoising, measurement consistency is restored by back-projection:
\[
\mathbf{x}_{k+1}=\arg\min_{\mathbf{x}}\|\mathbf{x}-\mathbf{x}_k\|_2^2 \quad \text{s.t.}\quad \mathbf{A}\mathbf{x}=\mathbf{y},
\]
whose closed-form update is
\[
\mathbf{x}_{k+1}=\mathbf{x}_k-\mathbf{A}^{\dagger}(\mathbf{A}\mathbf{x}_k-\mathbf{y}),
\]
with
\[
\mathbf{A}^{\dagger}\approx \mathbf{A}^\top(\mathbf{A}\mathbf{A}^\top+\eta \mathbf{I})^{-1}.
\]
The paper notes that in CASSI, \(\mathbf{A}\mathbf{A}^\top\) is diagonal, making this step efficient.

Trajectory control is reinforced during training by an explicit intermediate-stage loss. The manuscript writes
\[
\mathcal{L}_{\text{traj}}=\sum_{k=1}^{K}\alpha(k,K)\,\left\|x_k-\left(\left(1-\frac{s}{K}\right)x+\frac{s}{K}x_k\right)\right\|_2^2,
\]
with stage weighting
\[
\alpha(s,t)=1-\exp\left(-k\cdot \frac{s}{t}\right),\qquad k>0.
\]
The manuscript also notes that several equations contain typographical or indexing inconsistencies, but its intended meaning is clear: intermediate outputs are explicitly supervised to lie on a progressive path between degraded and clean states [2509.12079].

## 3. Architectural realization

The trajectory-controllable update rule is paired with a stage architecture in which each unfolding block contains a proximal network and a back-projection step. The proximal network is built around an efficient spatial-spectral Transformer tailored to hyperspectral data. For a local window feature
\[
X\in\mathbb{R}^{L^2\times C},
\]
spectral attention treats channels as tokens:
\[
Q=\operatorname{Conv}_{1\times 1}(X),\quad K=\operatorname{Conv}_{1\times 1}(X),\quad V=\operatorname{Conv}_{1\times 1}(X),
\]
\[
\operatorname{Attn}_{\text{spec}}=\operatorname{Softmax}\left(\frac{Q^\top K}{\sqrt{L^2}}\right)\in\mathbb{R}^{C\times C},
\qquad
Y=\operatorname{Attn}_{\text{spec}}V^\top.
\]
Deeper layers use low-rank spatial attention with \(C'<C\):
\[
Q,K\in\mathbb{R}^{L^2\times C'},\qquad V\in\mathbb{R}^{L^2\times C},
\]
\[
\operatorname{Attention}_{\text{spa}}=\operatorname{Softmax}\left(\frac{QK^\top}{\sqrt{C'}}\right)\in\mathbb{R}^{L^2\times L^2}.
\]
The efficiency rationale is local windows, spectral attention in shallow layers, and low-rank spatial attention in deeper layers.

A second architectural component is the frequency-aware fusion module inserted into U-Net skip connections. The fusion is written as
\[
\hat{\mathbf{F}}_{dec}^{t+1}=\hat{\mathbf{F}}_{enc}^{t}+\hat{\mathbf{F}}_{dec}^{t},
\]
with
\[
\hat{\mathbf{F}}_{dec}^{t}=\mathcal{F}^{\text{UP}}\left(\mathcal{F}^{\text{LP}}(\mathbf{F}_{dec}^{t})\right),\qquad
\hat{\mathbf{F}}_{enc}^{t}=\mathcal{F}^{\text{HP}}(\mathbf{F}_{enc}^{t})+\mathbf{F}_{enc}^{t}.
\]
Decoder features are channel-aligned by
\[
\mathbf{F}_{dec}^{k}=\operatorname{Conv}_{1\times 1}(\mathbf{F}_{dec}^{k}).
\]
The low-pass branch promotes coarse semantic consistency; the high-pass branch enhances edges and fine textures. The paper explicitly ties skip-connection design to trajectory shaping, arguing that stable inter-stage information flow is part of controllable unfolding rather than an orthogonal architectural detail [2509.12079].

## 4. What is controlled

The control mechanism has two coupled parts: interpolative stage transition and intermediate trajectory supervision. The first bounds how far any one stage may move from the current state; the second makes each stage accountable to a progressive restoration target. The resulting process is deterministic rather than stochastic. There is no noise injection during inference, and the method is described as closer to a discrete flow or residual transport than to standard stochastic diffusion sampling.

This control is not a guarantee of monotonic objective decrease. The paper does not prove monotonic PSNR improvement or derive a neural ODE limit. Instead, it imposes smoothness, bounded stage transitions, learned progression coefficients, and measurement consistency after each denoising step. In that sense, “trajectory-controllable” denotes regulation of the *optimization path* itself.

The empirical support is stage-centric rather than endpoint-only. The trajectory-focused ablation shows that removing skip connections causes the process to become “targetless” and the trajectory to be lost, especially at the second stage; weight sharing across stages regularizes convergence; and with the proposed design, stage losses decrease more gradually. This suggests that trajectory controllability, in this framework, is not reducible to a single interpolation scalar but depends on update rule, supervision, and internal feature transport jointly [2509.12079].

## 5. Relation to adjacent trajectory-controlled systems

A broader editorial usage of the term is suggested by contemporaneous work in video generation, choreography, and trajectory prediction, although these papers do not all use “unfolding” in the same strict sense. In image-to-video generation, FlexTraj turns motion control into a unified structured conditioning problem over time through point trajectories carrying segmentation ID, temporally consistent trajectory ID, and optional color cues, then injects these controls into a pretrained video diffusion transformer by efficient sequence concatenation [2510.08527]. ATI likewise treats camera motion, object translation, and local deformation as point-wise trajectories, transporting latent image features along user-defined paths with Gaussian spatialization before patchification in DiT-based image-to-video models [2505.22944]. MagicMotion organizes controllable video generation as a dense-to-sparse curriculum over masks, boxes, and sparse boxes, with a Trajectory ControlNet branch and latent segmentation loss to preserve object structure under weakening control signals [2503.16421]. FreeTraj demonstrates that pretrained video diffusion models already expose motion sensitivity through low-frequency initial noise and attention routing, allowing tuning-free trajectory steering by modifying noise construction and early attention computation [2406.16863]. FlashMotion shows that few-step controllable generation requires not only generator distillation but explicit re-alignment of the control adapter to the compressed denoising dynamics, using hybrid diffusion and adversarial finetuning [2603.12146].

Outside video synthesis, related formulations use trajectory control in different state spaces. TCDiff separates multi-dancer root trajectories from detailed group motion generation, keeping trajectories fixed during diffusion and correcting lower-body realization with a footwork adaptor and relative forward-kinematic loss [2403.06189]. TAE factorizes vehicle-trajectory latents into intention, aggressiveness, and residual components within a semi-supervised adversarial autoencoder, making trajectory generation and prediction behavior-aware but not explicitly stage-unfolded [2203.01261]. PrefCVAE aligns a semantic latent with average future velocity through weak preference pairs, enabling controllably diverse trajectory prediction via ordered latent traversal [2510.10731]. Topology-Driven Trajectory Optimization uses a differentiable local homotopy invariant to specify clockwise, counterclockwise, or non-interacting multi-vehicle passing patterns as optimization constraints [2503.05471]. Taken together, these works suggest that a broader trajectory-controllable unfolding framework can mean explicit control over latent evolution, structured motion memory, semantic trajectory latents, or topological interaction modes, even when the domain is not inverse reconstruction.

## 6. Empirical profile, limitations, and significance

On simulated hyperspectral reconstruction, FLoUNet-9stg reports the best average PSNR among the compared methods, with **40.27** PSNR and **0.975** SSIM, compared with **40.09 / 0.979** for LADE-9stg and **39.57** PSNR for RDLUF-MixS\(^2\)-9stg. The 3-stage model is also strong, at **39.17** PSNR and **0.970** SSIM with **1.35M** parameters and **26.18G** FLOPs, supporting the claim that explicit trajectory supervision can make shallow unfolding models effective [2509.12079].

The ablation table isolates the trajectory-oriented contributions. The paper reports: Base-1 at **36.77 / 0.949**, then **+ HS2Former** at **38.76 / 0.972**, **+ FreqFusion** at **39.01 / 0.970**, and **+ Trajectory Loss** at **39.17 / 0.971**. This indicates that the hybrid Transformer gives the largest boost, frequency-aware skip fusion adds further gains, and explicit trajectory supervision improves PSNR again beyond backbone changes alone. The significance of the framework therefore lies less in a single module than in the coupling of controlled update dynamics, architecture, and supervision.

Its limitations are equally explicit. The paper notes typographical inconsistencies in several formal expressions, especially the MAP equation, conditional-expectation proposition, and trajectory loss; it does not specify in detail whether the learned interpolation coefficient is a scalar, vector, or data-dependent quantity; it gives no rigorous monotonicity proof; and real-data evidence is qualitative, with some blur and artifacts remaining. A plausible implication is that the framework establishes a practical and conceptually clear notion of trajectory-controlled unfolding without yet closing the gap between suggestive flow-inspired intuition and a fully developed theory of stage-wise constrained dynamics.

In that sense, the trajectory-controllable unfolding framework is best understood as a design principle for iterative models: control not only the final state but also the route taken to reach it, supervise intermediate states against a meaningful progression, and build the architecture so that information transfer across stages is itself trajectory-aware. FLoUNet provides the clearest explicit formulation of that principle [2509.12079].

Source: https://www.emergentmind.com/topics/trajectory-controllable-unfolding-framework