Future Chunk Prediction: Definition and Examples
- Future Chunk Prediction (FCP) are methods for predicting and managing temporally extended future intervals rather than single future frames, tokens, or actions.
- FCP is used in various domains such as human motion forecasting, speech synthesis, video generation, and robot control.
- Specific FCP methods include ResChunk for human motion, DCAR for speech, and ChunkFlow for consistent chunk execution.
Future Chunk Prediction (FCP) is a family of methods that predicts, represents, supervises, or adaptively executes temporally extended future chunks rather than restricting computation to a single next frame, token, action, or latent state. The term is used in several related but nonidentical senses: chunk-level residual pose forecasting, dynamic multi-token speech synthesis, multi-horizon video prediction, future latent-state prediction for model-based control, and adaptive selection of chunk commitment boundaries. Across these settings, FCP addresses the tension between temporal coherence, long-horizon prediction, inference cost, and feedback frequency.
1. Terminology and conceptual scope
FCP does not denote a single canonical objective or architecture. Its common structural element is a temporal abstraction in which a model predicts or reasons about a contiguous future interval. Depending on the domain, the predicted object may be:
- a sequence of absolute poses generated through residual changes between consecutive chunks;
- a variable-length block of speech tokens;
- several future video chunks at distinct temporal offsets;
- a future latent state at an action-chunk boundary;
- an action chunk together with a predicted future representation;
- or an execution boundary specifying how much of a predicted chunk should be trusted before replanning.
The term is therefore broader than next-token prediction, but narrower than arbitrary long-horizon prediction. In explicit FCP, the future target is usually temporally structured and aligned with a source context or action sequence. In adjacent approaches, the future object may instead be an execution duration or future context required by a downstream policy.
The acronym FCP is ambiguous in the literature. In “Meta Theorem for Hardness on FCP-Problem,” FCP means Fewest Clues Problem, not Future Chunk Prediction; that work defines an FCP variant of an NP problem as the problem of specifying at most certificate entries so that exactly one solution remains compatible with the clues, and studies -completeness under structured parsimonious reductions (Nagao et al., 16 Apr 2025). In the machine-learning literature considered here, FCP refers to Future Chunk Prediction.
A useful distinction is between prediction horizon, chunk length, and execution horizon. The prediction horizon is the temporal extent represented by a model output. The chunk length is the number of frames, tokens, actions, or latent states in that output. The execution horizon is the portion of a predicted chunk that is committed before new observations are obtained. These quantities may coincide, but methods such as Dynamic Execution Horizon Prediction explicitly separate them: a pretrained policy predicts an -action chunk, while a learned branch selects an execution horizon , executes the first actions, discards the remainder, and replans (Zhao et al., 9 Jun 2026).
2. Chunk-level prediction and residual temporal structure
In human-motion forecasting, ResChunk formulates prediction as forecasting a future sequence of poses from an observed sequence. With joints, values per joint, and , the observed sequence is , while the target is . In the reported experiments, angle-axis coordinates give 0, with 50 observed frames and 50 future frames at 50 Hz.
The model divides the future into six temporal chunks. If 1 is the final observed chunk, the first future chunk is generated as
2
and subsequent chunks are generated recursively:
3
Equivalently,
4
The final outputs are absolute poses, but the model predicts learned residual pose changes between consecutive chunks. Thus, 5 approximates 6, rather than representing a single global residual from the entire input to the entire output. The chunk recursion enforces temporal continuity at boundaries and is intended to mitigate long-horizon over-smoothing and mode collapse in graph-based motion prediction. The architecture predicts the residual tensors in one feed-forward computation; “autoregressive” describes the residual dependency structure rather than a frame-by-frame recurrent loop (Zand et al., 2023).
ResChunk combines this temporal organization with graph processing at two body scales. The fine-scale path operates on the original joint representation, while a second path learns sequence-dependent body components. For each pair of joints 7, latent edge variables 8 are inferred by message passing over a fully connected graph without self-loops. A Concrete/Gumbel-softmax relaxation with temperature 9 makes categorical edge sampling differentiable. Hierarchical agglomerative clustering is applied to the resulting pairwise correlation matrix, and the pose of each learned group is computed by averaging the poses of its members. The grouping can vary across motion sequences and can associate distant joints when they participate similarly in an action.
The training objective combines fine- and coarse-scale prediction or reconstruction terms with a KL regularization term for the latent graph. The experiments on CMU Mocap and Human3.6M report MPJPE at multiple horizons. On Human3.6M, average MPJPE is 0, 1, 2, and 3 mm at 4, 5, 6, and 7 ms, respectively; at 8 ms, the average is 9 mm. Ablations show degradation when the coarse scale is removed, learned groups are replaced by predefined groups, or chunk residuals are replaced by one global residual. Four chunks generally improve over one, whereas seven can improve some short-term results while harming long-term forecasting.
3. Dynamic future chunks in speech and video generation
In autoregressive speech synthesis, conventional next-token prediction requires one sequential decision per acoustic token. DCAR changes the transition granularity by predicting a variable-length block
0
where the lightweight policy selects 1 from a permitted set such as 2 or 3. The selected chunk is committed, appended to the prefix, and used to produce the next policy state. Tokens within a chunk are predicted internally in parallel, but chunks remain sequential and conditioned on the accepted prefix.
Training proceeds in two stages. First, multiple prediction heads are trained from the same prefix with a multi-token objective:
4
where 5. The reported setting 6 gives equal weight to the future heads. Second, a dynamic policy is trained on-policy using a clipped GRPO/PPO-style objective, group-relative advantages, KL regularization, and generated-speech WER as the principal reward. The “chase-then-exceed” strategy combines schedules from a profiled good range with schedules sampled from the learned policy, while an inner-chunk mask applies policy gradients only when a new chunk size is selected.
With HuBERT 50-Hz tokens, FAR obtains WER 7 and RTF 8, while DCAR with range 9 obtains WER 0, RTF 1, and reported speedup 2. The stated 3 improvement is a relative WER reduction from 4 to 5, not a percentage-point increase in human intelligibility. With 6-Tokenizer tokens, the reported WER decreases from 7 for FAR to 8 for DCAR with range 9, a relative reduction of approximately 0. The method preserves approximately the same SECS and UTMOS in the main HuBERT evaluation. Its policy overhead means that dynamic scheduling is not unconditionally faster than fixed chunking; the benefit is adaptive speed–quality control (Li et al., 27 Jun 2025).
Next Forcing applies a related idea to causal video-world modeling. The standard model denoises the current 1-frame chunk, while auxiliary Multi-Chunk Prediction modules predict the next2, next3, and next4 chunks. The future targets are independently noised, and each MCP module predicts the flow-matching velocity of its corresponding target. The modules form a causal chain across prediction depths: main-model features feed next5, whose internal representation feeds next6, which feeds next7. Features from main-model layers 8 are fused, and the default MCP loss weights are 9, 0, and 1. The main and MCP timestep-shift parameters are 2 and 3.
Next Forcing is hybrid during training: future targets are supervised simultaneously, but the auxiliary prediction chain is causal across depth. At inference, MCP modules can be discarded for zero-overhead deployment, or the next4 module can be retained to predict the next video chunk in parallel with the current one. The latter mode reports approximately 5 inference acceleration. On RoboTwin, Next Forcing obtains 6 Clean and 7 Random success, compared with 8 and 9 for LingBot-VA. At 50 fps and 5k training steps, it obtains 0 Clean and 1 Random success, compared with 2 and 3 for the baseline (Xu et al., 9 Jun 2026).
Prospective Forcing uses parallel offset-specific heads in a rolling-window autoregressive video generator. With window size 4, the newest hidden representation predicts future chunks at offsets 5; the main configuration uses 6. Training aligns the predicted future features and velocities with detached backbone outputs when the corresponding chunks later enter the rolling window. At inference, learned candidate embeddings generate multiple next-chunk candidates, and a verifier either accepts one candidate or rejects all and falls back to ordinary rolling generation. On 30-second videos, standard inference uses 46 sampling and 46 cache-update passes, while verified inference uses 37 sampling and 46 cache-update passes, producing reported speed 7. The verifier accepts 8 of proposals. The method reports VBench Total 9, VBench Quality 0, and VBench-Long Quality 1 (Shen et al., 10 Oct 2026).
“Looking Ahead” defines FCP as an auxiliary training objective for autoregressive video diffusion that predicts a temporally separated target chunk 2 from a source representation 3, while withholding the intervening chunks 4. Offset-specific auxiliary DiT branches operate in parallel and receive intermediate generator features through AdaLN. The total objective combines ordinary teacher-forced flow matching with clean- and noisy-source FCP losses. The auxiliary branches are discarded at inference, so FCP changes the learned representation rather than the autoregressive inference procedure (Gao et al., 21 Oct 2026).
On Physics-IQ Verified with Wan2.2-TI2V-5B, teacher forcing obtains I2V IQ 5 and V2V IQ 6, while FCP with five offsets obtains 7 and 8. Ablations favor parallel over chained prediction, combined clean and noisy source supervision, and source-chunk-only conditioning. Adding explicit text conditioning to the auxiliary predictor reduces IQ from 9 to 0, consistent with the objective of preventing prompt information from directly revealing future events. The reported training-only FCP leaves inference unchanged and requires no external pretrained visual encoder.
4. Future latent states and action chunks in control
FCP in control systems frequently predicts future latent states conditioned on action chunks. FlexiWorld samples goal spans of 1, 2, or 3 primitive actions and partitions each span into variable-length chunks with individual lengths in 4. Each chunk 5 is paired with its start and end observations, defining a transition
6
The action encoder is causal and maps arbitrary-length primitive action sequences to a fixed-dimensional representation augmented with a learned chunk-length embedding. The predictor operates at chunk boundaries rather than primitive-action resolution. The actor is autoregressive within each chunk, and Student Forcing replaces expert within-chunk prefixes with greedily generated prefixes with probability 7.
FlexiWorld combines local and final-goal latent intent, mixed-span supervision, variable-length chunks, and ARCEM residual search. ARCEM perturbs actor-generated primitive actions with residuals, feeds each perturbed action back into subsequent within-chunk action generation, and uses the world model to evaluate predicted boundary latents. With 128 candidates per iteration, three CEM iterations, 16 elites, and residual temperature 8, the method obtains mean success 9 across PushT, Cube, Reacher, and TwoRoom, compared with 00 for the strongest listed baseline. Changing the planning chunk length from 01 to 02 produces approximately 03 faster ARCEM planning with comparable mean success (Ren et al., 28 Sep 2026).
Chunk-wise Model-based Policy Optimization (CMPO) uses a fixed-length action chunk and a direct chunk world model:
04
05
The world model and actor jointly predict a hypothetical future in one forward computation. A value expansion is differentiated through the direct chunk mapping rather than through recurrent one-step model applications. At execution, only the first action is executed, after which a new chunk is generated from the next observation. Thus, CMPO uses FCP for training-time value expansion but retains closed-loop environment control.
The method is built on TD-MPC2 and evaluated on 19 HumanoidBench tasks. On an NVIDIA RTX 4090, reported inference time is 06 ms for CMPO versus 07 ms for TD-MPC2 on Walk, and 08 ms versus 09 ms on Run. Training time at 200k steps is approximately half that of TD-MPC2 in the listed settings. Performance declines at 10, demonstrating that direct chunk prediction mitigates recurrent compounding error without making long-horizon prediction intrinsically easy. The “without collaborative chunk modeling” variant, which uses a chunk policy with a single-step dynamics model, performs substantially worse, indicating that chunking the actor alone is insufficient (Song et al., 10 Oct 2026).
JEPA Policy predicts an expert action chunk and a single future observation representation from the same demonstration segment:
11
The future target is a globally pooled image embedding of one future observation, with default 12, rather than a future action chunk, observation sequence, or multi-step rollout. Action and future-representation tokens interact through a shared Transformer, and the future loss shapes the action-generating representation through shared parameters. The main nine-task mean success is 13, compared with 14 for action-only MIP. The method adds 15 ms to MIP’s 16 ms latency, whereas the evaluated 100-step Diffusion Policy requires 17 ms (Xu et al., 9 Sep 2026).
FutureRTC predicts execution-time context for asynchronous VLA control. If a new action chunk is generated 18 control steps before it begins execution, the method predicts the future proprioceptive state and visual latent at the execution boundary. The State Correction Module rolls the state forward and predicts a residual correction, while the Observation Prediction Module transports and synthesizes visual features using committed robot motion as an explicit prior. A policy-consistency loss aligns actions produced from predicted context with actions produced from true execution-time context.
FutureRTC therefore predicts
19
rather than directly predicting the next action chunk. The frozen VLA then generates the chunk from that predicted context and executes it from its first action. In LIBERO evaluations with 20, FutureRTC reports success rates of 21, 22, 23, and 24 at delays 25, respectively. The SmolVLA-450M results are 26, 27, 28, and 29. The visual-latent ablation shows that state correction alone is insufficient at large delays, while adding predicted visual features produces the dominant improvement (Jiang et al., 27 Jul 2026).
5. Adaptive execution horizons and consequence-aware commitment
Several methods treat the execution boundary itself as a future-prediction problem. DEHP attaches a lightweight categorical horizon branch to a frozen chunk policy. Given the current state and an 30-action chunk, the branch predicts 31. The first 32 actions are executed open-loop and the remaining actions are discarded. Training uses online PPO in a semi-Markov formulation, with variable-duration temporal-difference targets and step-discounted generalized advantage estimation. The method improves the trade-off between efficiency during free-space motion and reactivity during grasping, alignment, contact, and insertion. On multi-stage peg insertion, DEHP obtains 33 success at zero action noise versus 34 for fixed-horizon behavior cloning, and 35 versus 36 at action noise 37 (Zhao et al., 9 Jun 2026).
CA38C extends adaptive horizon selection by basing commitment on agreement among imagined consequences rather than similarity among actions. A frozen policy samples 39 candidate action chunks under the same context. A frozen action-conditioned world model generates candidate future latent sequences using shared sampling noise. Candidate disagreement is measured by
40
and normalized by predicted motion from the current latent:
41
A width-three temporal average smooths the disagreement curve. The execution horizon is selected by Bayesian Information Criterion comparison between a single linear trend and a hinge model with a nonnegative post-change slope. If the hinge model is supported, the controller commits to the estimated change point; otherwise it commits to the longest valid prefix.
CA42C also selects the candidate closest to consensus over the chosen prefix. The reported settings use 43, 44, ten world-model diffusion steps, and realized horizons approximately in 45. On LIBERO-Plus with 46, average success increases from 47 for the fixed baseline to 48 for the complete method. Adaptive horizon selection alone produces 49, whereas consensus selection alone produces 50, indicating that adaptive execution-horizon estimation is the principal mechanism. On real-robot Block Separation and Parcel Sorting, average success increases from 51 to 52 (Li et al., 6 Oct 2026).
ChunkFlow addresses a different boundary problem: inconsistency between overlapping predictions from successive action chunks. A length-53 chunk has overlap 54 and stride 55. The method distinguishes frozen, editable seam, and future zones. In the overlap, it applies deterministic linear blending between the previous chunk’s tail and the current chunk’s prediction. Training adds boundary, total-variation, and second-order continuity losses to behavior cloning, while history corruption and scheduled sampling expose the policy to executed-history errors. An optional AWAC stage uses post-blending actions for reward evaluation while preserving structural regularizers on raw predictions.
Under local Lipschitz and input-drift assumptions, the expected pre-blending seam discrepancy scales as 56. On CALVIN ABC–D, the reported default configuration has 57 and 58; on LIBERO-Long it obtains 59 success and 60 ms amortized action inference latency. The method’s central claim is not that blending alone solves FCP, but that chunk execution, overlap structure, history semantics, and continuity losses should be trained as a coherent contract (Yang et al., 14 Jul 2026).
FutureRTC, ChunkFlow, DEHP, and CA61C address different components of the chunk boundary problem:
| Method | Primary predicted or controlled object | Base policy modification |
|---|---|---|
| FutureRTC | Future execution-time visual latent and state | Frozen VLA with plug-in adapter |
| ChunkFlow | Seam-consistent overlapping action predictions | Training and deterministic execution framework |
| DEHP | Execution horizon 62 for a generated chunk | Frozen chunk policy; RL-trained length head |
| CA63C | Consensus-supported prefix and replanning boundary | Frozen policy and world model |
These methods show that future prediction and future commitment are separable. A policy may predict a plausible long-horizon chunk while still needing to replan before executing its entire content. Conversely, an adaptive boundary controller may improve feedback cadence without predicting the content of the next chunk in advance.
6. Objectives, evaluation, and unresolved issues
FCP objectives differ according to the predicted domain. Residual chunk forecasting supervises target-to-target temporal differences; speech FCP uses multi-token cross-entropy and on-policy WER rewards; video FCP uses future flow-matching losses; latent world models use boundary-state prediction losses; CMPO uses differentiable value expansion; and adaptive commitment methods use policy or change-point objectives.
A recurring design choice is whether future predictions are independent, chained, or recursively rolled out. Parallel offset-specific predictors avoid allowing a farther-horizon head to consume an intermediate prediction that may leak withheld information. Chained predictors can impose structured temporal dependencies, as in Next Forcing, but may expose later predictions to intermediate representations. Recursive world-model rollouts preserve temporal feedback but introduce compounding model error and BPTT difficulties. Direct chunk models avoid recurrent invocation but must learn a more difficult long-horizon mapping.
Another issue is whether future prediction should remain active at inference. Training-only objectives, such as “Looking Ahead,” can improve representation quality while leaving inference unchanged. Prospective Forcing and Next Forcing retain auxiliary predictions for speculative acceleration. CMPO uses future prediction primarily during training-time optimization. FutureRTC uses future context prediction online to compensate for asynchronous execution. These choices produce different computational trade-offs: auxiliary modules can be discarded, retained for parallel prediction, or integrated into the control loop.
Evaluation also varies substantially. Motion forecasting uses MPJPE at multiple time horizons. Speech synthesis reports WER, UTMOS, SECS, RTF, and speedup. Video generation uses physical-plausibility, VBench, FVD, abnormal-ratio, and drift metrics. Robot control uses task success, execution steps, execution time, velocity and acceleration profiles, and robustness to delay or action noise. The literature therefore does not support a single universal FCP metric.
Several limitations recur across domains:
- Longer horizons are not automatically better: distant targets are less predictable, and excessive temporal recursion or auxiliary supervision can reduce quality.
- Prediction error is not equivalent to control risk: latent error, action error, and consequence disagreement measure different properties.
- Direct multi-step prediction trades recurrent compounding for approximation difficulty: CMPO’s degradation at 64 illustrates this trade-off.
- Fixed chunk size is often inadequate: the appropriate horizon depends on task phase, temporal resolution, scene dynamics, and execution latency.
- World-model and representation dependence remains substantial: false agreement, false disagreement, latent collapse, and representation insensitivity can mislead adaptive policies.
- Boundary consistency requires execution-aware training: inference-time blending alone can lower visible discontinuities without correcting the underlying predictions or histories.
- Multimodality is unresolved: deterministic regression or diagonal Gaussian action models may average incompatible futures, while candidate sampling and residual search provide only partial remedies.
- Physical plausibility is not fully captured by visual similarity: future-chunk supervision is motivated precisely by cases where local appearance continuity permits incorrect dynamics.
- Calibration is incomplete: BIC-selected change points and future-prediction errors are model-selection or diagnostic signals, not generally calibrated probabilities of safety or success.
- Training cost can increase: auxiliary heads, future targets, world-model rollouts, and online reinforcement learning add memory, computation, or environment-interaction requirements.
Taken together, the research defines FCP as a design space rather than a single algorithm. Its central principle is to make a model’s internal state, output structure, or execution policy sensitive to temporally extended consequences. This may be achieved by predicting residual changes between future chunks, supervising multiple future offsets, forecasting future latent states conditioned on action chunks, generating variable-length token blocks, predicting future execution contexts, or selecting commitment boundaries from imagined consequence agreement. The common objective is to reduce the limitations of purely local next-step prediction while preserving sufficient causal feedback for stable, efficient, and physically coherent long-horizon behavior.