ChunkFlow: Towards Continuity-Consistent Chunked Policy Learning

Abstract: Vision-language action (VLA) models increasingly adopt chunked action heads to satisfy real-time constraints; however, this introduces boundary jitter: overlapping regions between consecutive chunks often yield inconsistent predictions, degrading temporal coherence and the task success rate. Existing methods, such as inference-time blending, merely reweight mismatched proposals without correcting underlying errors, leading to residual accumulation under biased or noisy histories. We propose ChunkFlow, a seam-aware training-and-execution framework for chunked policies that aligns chunk structure with boundary execution. It partitions each chunk into frozen, editable, and future zones, applies deterministic overlap blending at execution, and trains raw predictions with seam and first- and second-order continuity losses. History corruption and scheduled sampling improve robustness to executed-history errors, while an AWAC fine-tuning stage adapts the policy without removing these structural regularizers. Under mild smoothness assumptions, pre-blending seam discrepancies provably decay with increasing overlap. Experiments on CALVIN, LIBERO, and real robots show an improved success-stability trade-off with low-latency inference. Project page: https://cytoderm-ai.github.io/chunkflow.

• The paper presents a novel framework that integrates structure-aligned overlap blending, continuity-regularized optimization, and advantage-weighted fine-tuning to mitigate boundary discontinuities.
• It leverages deterministic overlap blending and seamless discrepancy losses to enhance action smoothness and boost long-horizon task success rates across benchmarks.
• Empirical evaluations on simulated and real-robot tasks confirm that ChunkFlow effectively reduces temporal artifacts and outperforms traditional and autoregressive methods.

Continuity-Consistent Chunked Policy Learning with ChunkFlow

Motivation and Problem Statement

Vision-language action (VLA) models have advanced robotic manipulation by mapping open-ended instructions to executable actions. Deployment efficiency is increased by action-chunking heads, which emit short sequences ("chunks") per inference. However, temporal discontinuities arise at chunk boundaries—each chunk predicts actions under slightly shifted inputs, leading to boundary jitter, degraded coherence, and frequent task failures. Existing mitigation strategies, such as inference-time blending, operate heuristically and fail to address upstream prediction errors, resulting in error accumulation and instability in long-horizon deployments. ChunkFlow targets these deficiencies by aligning chunk structure with boundary execution and introducing seam-aware training and deterministic blending.

ChunkFlow Framework

ChunkFlow comprises three integrated modules:

1. Structure-Aligned Overlap Blending: Each action chunk is partitioned into three zones—frozen, editable, and future; temporally overlapping regions are deterministically blended to suppress discontinuities without introducing additional inference latency.
2. Continuity-Regularized Policy Optimization: Seam and first-/second-order continuity losses are imposed during training, promoting temporal consistency across chunk transitions. History corruption and scheduled sampling increase robustness against noisy executed histories.
3. Structure-Preserving Advantage-Weighted Fine-Tuning: Following imitation learning, reinforcement fine-tuning (AWAC with expectile critics) adapts policy performance while retaining seam consistency and continuity regularization.

Figure 1: ChunkFlow architecture—action chunks overlap, blended for seam continuity, and are regularized during training for stability.

Deterministic Overlap Blending and Seam Regularization

Deterministic blending is introduced for seamless chunk transitions. For overlapping steps ($O$), control is interpolated linearly between the prior and current chunk, requiring only $\mathcal{O}(d)$ computation per overlap step. Training introduces a seam discrepancy loss that penalizes mismatch in overlapping windows, effectively guiding the policy to produce blendable actions.

The theoretical analysis demonstrates that, under local smoothness assumptions and proportional input drift, seam error decays quadratically with overlap ($O$), confirming empirical findings.

Continuity Constraints and Robust Execution History

Continuity regularization comprises:

• First-order (total variation) and second-order (curvature/jerk) derivative penalties on chunk actions.
• History corruption (dropout and noise injection) and scheduled sampling during training, ensuring robustness to imperfect rollouts.

The cumulative deviation between predicted and clean trajectories is provably bounded by the regularization strength, supporting stable long-horizon behavior under moderate smoothness assumptions.

Reinforcement Fine-Tuning with Structural Constraints

Advantage-weighted updates are performed with continuity and seam losses retained throughout RL fine-tuning. Stepwise advantage estimation uses expectile critics, and chunked policy adaptation is grounded in executed histories (post-blending). This enables reward-aligned improvements without violating learned chunk structure, ensuring rollouts remain temporally stable.

Empirical Evaluation

Benchmarks

ChunkFlow is evaluated on CALVIN, LIBERO, and real-robot manipulation tasks, including cloth strip grasping and block insertion Figure 2. Metrics include task success rate, episode length, action smoothness via mean squared derivative differences, seam discrepancy (Bjumps), high-frequency spectral energy ratio, and reasoning latency.

Figure 2: Real-world rollout on Strip-cloth grasping, with end-effector roll-angle traces showing reduced boundary-induced spikes under ChunkFlow.

Main Results

• CALVIN: ChunkFlow achieves 4.30 average sequence length with lowest temporal variation (MSD-$\Delta a$ = 0.075, MSD-$\Delta^2 a$ = 0.154), seam discrepancy (Bjumps = 0.209), and HF ratio (0.431), outperforming diffusion, autoregressive, and classical baselines that suffer from boundary jitter or spectral bursts.
• LIBERO: ChunkFlow yields 93.4% long-horizon success rate, outperforming PI0.5 (92.6%), OpenVLA (53.7%), and others, with substantially lower motion deviation and spectral artifacts (MSD-$\Delta a$ = 0.042, HF ratio = 0.135, TV-L1 = 0.011). Amortized reasoning latency is minimized (4.43 ms) due to efficient chunked rollout.
• Real-Robot: ChunkFlow executes with minimal boundary artifacts and stable long-horizon behavior.

Figure 3: ChunkFlow suppresses high-frequency spectral energy (>2.5 Hz), demonstrating stable action derivatives compared to baselines.

Smoothness–Performance Trade-off

ChunkFlow lies on the Pareto frontier for task success versus trajectory smoothness, balancing high performance with stable execution. Heuristic post-processing filters (e.g., low-pass, EMA) fail to correct structural discontinuities or long-horizon instability.

Figure 4: ChunkFlow achieves optimal trade-off between success and smoothness compared to smoothing heuristics and baseline histories.

Ablation Studies

• Overlap and Chunk Length: Moderate overlap ($O=8$) and chunk length ($L=10$) yield optimal seam suppression and smoothness; excessive regularization induces phase lag or seam drift.
• Policy History: Short history ($p=4$) minimizes boundary instability, while excessive memory induces error accumulation.
• Inference-Time Stability: Only training-time regularization enforces robust chunk transitions; inference-only smoothing heuristics or classical filters cannot resolve structural artifacts.
• Reinforcement Adaptation: Safe RL fine-tuning with continuity constraints maintains smooth execution and suppresses spectral instability; unconstrained RL degrades seam alignment.

Figure 5: Log-scaled PSD of action derivatives under varying overlap and chunk lengths, indicating that only default ChunkFlow settings maintain low high-frequency energy.

Theoretical and Practical Implications

ChunkFlow establishes that chunked execution in robotic policy learning requires structural alignment at both training and inference stages. Seam-aware blending and continuity losses, enforced during learning, are critical for overcoming boundary artifacts that degrade long-horizon stability. Theoretically, quadratic suppression of seam errors with overlap and bounded deviation via regularization support robust compositional control.

Practically, ChunkFlow's parameter-free blending and single-pass deployment enable low-latency real-time robot control with increased smoothness and task success. The framework is agnostic to multimodal encoder design and readily integrates with existing VLA and generative policy backbones.

Future Directions

Potential future developments include:

• Integration with hierarchical temporal abstractions and world-model predictive control.
• Online adaptation to dynamic environments with variable chunk horizons.
• Robustness under real-world hardware constraints and expanded compositional instruction tasks.
• Extending structural alignment to multi-agent or multi-task embodied AI settings.

Conclusion

ChunkFlow delivers a continuity-consistent framework for chunked policy learning in robotic manipulation. By unifying overlap-aware blending, structural seam regularization, and reward-driven adaptation, it achieves smooth, temporally stable, and successful long-horizon execution. Empirical results demonstrate superiority over classical, generative, and autoregressive policies, underscoring the necessity of execution-indexed learning for chunked controllers (2607.12992).