StreamVLA: Dual-System VLA Architecture

• StreamVLA is a dual-system vision-language-action architecture that decouples high-level reasoning from continuous control for efficient robotic manipulation.
• It employs a novel Lock-and-Gated mechanism to trigger multimodal planning only at sub-task boundaries, minimizing redundant inference.
• The design achieves a 48% reduction in latency (128 ms/step) and superior performance on long-horizon tasks compared to larger models.

StreamVLA is a dual-system, parameter-efficient Vision-Language-Action (VLA) architecture designed to achieve robust, low-latency long-horizon robotic manipulation by decoupling high-level multimodal reasoning (planning) from continuous control, using a self-gated hierarchical approach to minimize redundant inference. It unifies task decomposition, goal imagination, and high-frequency action generation within a single transformer backbone, leveraging a novel "Lock-and-Gated" mechanism that conditionally triggers expensive multimodal reasoning only at sub-task boundaries, and otherwise relies on a time-invariant completion-state anchor to optimize steady-state action execution (Wu et al., 1 Feb 2026).

1. Architectural Design and Computational Flow

StreamVLA organizes its computation within a dual-system hierarchy inspired by cognitive control theory. The architecture comprises:

• System 2 ("Slow Thinking", Sparse Inference):
  • Sub-task head $\mathcal{H}_{\rm sub}$—a causal LLM (LM) for textual task decomposition.
  • Imagination head $\mathcal{H}_{\rm img}$—an Infinity-style autoregressive model for visual completion state prediction.
• System 1 ("Fast Action", Dense Inference):
  • Flow-matching action head $\mathcal{H}_{\rm act}$, outputting $K$-step action chunks conditioned on a composite embedding (current sensory, proprioceptive, and locked intent/goal imagery).
• Shared Transformer Backbone $\mathcal{T}$, ingesting multi-view visual encodings $E_v(O_t)$, proprioceptive inputs $E_p(p_t)$, and latent instruction $E_\ell(\mathcal{I})$ to produce $h_t$:

$$h_t = \mathcal{T}\bigl[E_v(O_t)\Vert E_p(p_t)\Vert E_\ell(\mathcal{I})\bigr]$$

During each control step, computation proceeds as follows:

$\mathcal{T}$1

System 2 is only invoked upon detection of sub-task transition; otherwise, System 1 operates recurrently, conditioned on "locked" goal and intent (Wu et al., 1 Feb 2026).

2. Lock-and-Gated Mechanism

The Lock-and-Gated mechanism is central to computational efficiency and goal stability. At each timestep, a discrepancy score $\mathcal{H}_{\rm img}$0 quantifies the current observation’s divergence from the locked completion state:

$\mathcal{H}_{\rm img}$1

with gating variable

$\mathcal{H}_{\rm img}$2

where $\mathcal{H}_{\rm img}$3 is held-out validated.

• If $\mathcal{H}_{\rm img}$4: Enter Full Mode; invoke System 2 to (re-)generate sub-task $\mathcal{H}_{\rm img}$5, and completion state $\mathcal{H}_{\rm img}$6 (locking both until the next transition).
• If $\mathcal{H}_{\rm img}$7: Enter Skip Mode; System 1 acts using cached $\mathcal{H}_{\rm img}$8, $\mathcal{H}_{\rm img}$9.

Inferential pseudocode: $\mathcal{T}$2 This structure ensures that both textual plan and goal state remain invariant during sub-task execution, only updating at genuine task boundaries (Wu et al., 1 Feb 2026).

3. Task Decomposition, Goal Imagination, and Anchoring

Sub-task boundaries are detected and leveraged via explicit language modeling, while sub-goal anchoring is realized through a predicted completion state image, not a generic future frame:

• Sub-task LM loss:

$\mathcal{H}_{\rm act}$0

• Image-head loss (bitwise AR):

$\mathcal{H}_{\rm act}$1

Ground-truth sub-task intervals and completion images are derived from demonstration traces using semi-automatic labeling or simulation rules.

Time-invariant goal anchoring means that, once $\mathcal{H}_{\rm act}$2 (completion state) is locked, it is held constant for all steps of the sub-task. This ensures that policy output

$\mathcal{H}_{\rm act}$3

remains robust to execution rate variations within the sub-task, and

$\mathcal{H}_{\rm act}$4

for $\mathcal{H}_{\rm act}$5 inside the same segment, modulo current observation. The completion state is a semantic anchor (e.g., "drawer closed") rather than a timestamped prediction, enhancing sub-goal stability under real-world disturbances (Wu et al., 1 Feb 2026).

4. Conditional Flow Matching for Continuous Control

Action generation in StreamVLA uses Conditional Flow Matching (CFM) to enable efficient, non-autoregressive chunked action rollout:

• Forward (diffusion) process: $\mathcal{H}_{\rm act}$6 is expert action, $\mathcal{H}_{\rm act}$7.
• Score prediction: At diffusion time $\mathcal{H}_{\rm act}$8, the model synthesizes $\mathcal{H}_{\rm act}$9 and predicts $K$0.
• Loss:

$K$1

At inference, the action head executes in closed-form (ODE solver-based) without the need for autoregressive decoding, unlocking substantial speed gains.

Due to gating, System 2 is bypassed in 72% of steps, with the "fast path" head producing up to $K$2 continuous actions per activation, capitalizing on long stretches of unperturbed execution (Wu et al., 1 Feb 2026).

5. Training Procedure and Multi-Task Optimization

Training StreamVLA employs a multi-task loss:

$K$3

with $K$4 as the binary cross-entropy (BCE) between $K$5 and ground-truth transition labels. Empirical scaling:

• $K$6
• $K$7
• $K$8

A two-stage curriculum is used:

1. Freeze backbone and action head; optimize the sub-task and imagination heads.
2. Joint fine-tuning of all modules.

Sub-task boundaries and completion images are derived from demonstration mining, ensuring the gating and decomposition network's supervision is well-aligned with policy execution (Wu et al., 1 Feb 2026).

6. Latency, Computational Efficiency, and Empirical Results

The gated reasoning mechanism yields significant latency reductions and robust empirical performance:

• Autoregressive heads skipped: 72% of all control steps.
• Latency: Full-reasoning baseline ≈ 244 ms/step; StreamVLA ≈ 128 ms/step (48% reduction).
• FLOPs savings: Proportional to reduction in AR decoding, since backbone and fast head remain always active.

Benchmark Results:

• LIBERO (long-horizon manipulation): Spatial 99.2%, Object 99.4%, Goal 98.6%, Long 96.6%; overall avg. 98.5%. Surpasses 7B-param baselines by ∼1.4% using only 3B parameters.
• RoboTwin 2.0: Easy 71.3% (vs. 62.7%); Hard 37.2% (vs. 26%).
• Real-world (AgileX Piper):
  • Spelling: 90%
  • Insertion: 70%
  • Interference Spelling: 55%
  • (vs. next best methods 40–45%, 35%, 10–15%)

Natural recovery: When human perturbations occur and $K$9 spikes, $\mathcal{T}$0 triggers System 2, resulting in re-planned intent and recovery without explicit hand-coded interventions.

7. Contextual Significance and Comparison

StreamVLA's approach is distinct from other streaming vision-language architectures (e.g., StreamingVLM (Xu et al., 10 Oct 2025), StarStream (Zhang et al., 19 Aug 2025)) in two principal respects:

1. Dual-system gating tied to semantic task structure, rather than uniform streaming over dense sensory streams.
2. Explicit use of completion-state goal imagination, yielding time-invariant sub-goal anchors that decouple planning and control, in contrast to traditional rolling-window attention or continuous vision-language token streaming.

A plausible implication is that time-invariant semantic anchoring and conditional flow-matching can generalize to other domains requiring temporally-extended, goal-directed behavior with minimal reasoning overhead.

Summary Table: StreamVLA Key Metrics and Features

Feature	Value/Description	Source
Skipped reasoning steps	72%	(Wu et al., 1 Feb 2026)
Inference latency	128 ms/step (vs. 244 ms baseline)	(Wu et al., 1 Feb 2026)
LIBERO success rate	98.5% (avg. across tasks)	(Wu et al., 1 Feb 2026)
Parameters	3B (vs. 7B baselines)	(Wu et al., 1 Feb 2026)
Empirical advantage	+1.4% over best baseline (LIBERO)	(Wu et al., 1 Feb 2026)
Recovery on real interference	Natural/reset-free, via gating	(Wu et al., 1 Feb 2026)

StreamVLA demonstrates that self-gated, completion-state-anchored hierarchical VLA models can achieve SOTA long-horizon manipulation performance with sharply reduced computation by selectively invoking high-level reasoning only when sub-task transitions or disturbances are detected, representing a notable advance in efficient multimodal robotic policy design (Wu et al., 1 Feb 2026).