Wan-Streamer v0.2: Higher Resolution, Same Latency

Abstract: We present Wan-Streamer v0.2, a latency-preserving upgrade of the native-streaming, end-to-end audio-visual interaction model. v0.2 keeps the v0.1 modeling formulation, but raises the interactive output stream from 192x336 to 640x368 while preserving approximately 200 ms model-side signal-to-signal latency at 25 FPS. The higher-resolution stream supports scene-grounded mid-shot agents whose posture, gaze, hands, nearby objects, and local scene layout remain legible during real-time conversation. To support the larger visual stream without adding user-visible delay, v0.2 keeps the thinker as a single-GPU low-latency path for streaming perception, the short language/state Transformer pass that builds the generation cache, and final decoding. The performer becomes a multi-GPU Ulysses-style context-parallel group for the expensive next-unit latent generation. Each performer rank writes incoming K/V into a pre-sharded local cache. The long high-resolution latent video sequence is split across ranks for denoising and gathered through Ulysses communication, while the much shorter audio latent sequence is generated without sequence sharding. In this split, the thinker's language/state computation reaches the performer only as K/V conditioning, so no separate language sequence has to be communicated inside the performer group. This concentrates additional hardware on visual generation while preserving the compact thinker-performer boundary, keeping total remote interaction latency at approximately 550 ms when a 350 ms bidirectional network budget is included.

• The paper demonstrates that upgrading video resolution to 640×368 achieves higher visual fidelity while preserving ~200ms model latency in a native-streaming system.
• It introduces a bifurcated Thinker–Performer model where the single-GPU Thinker manages lag-sensitive tasks and the multi-GPU Performer efficiently denoises high-resolution video latents.
• Experimental outcomes show improved legibility of facial expressions and environmental details, enabling more immersive, scene-grounded digital agent interactions.

Wan-Streamer v0.2: Preserving Latency in High-Resolution, Native-Streaming Audio-Visual Dialogue

Model Formulation and Upgrade

Wan-Streamer v0.2 advances the paradigm of end-to-end native-streaming multimodal interaction established by v0.1. The architecture frames spoken dialogue, language, and rich visual signals on a shared, block-causal timeline coordinated by a single Transformer. This causal modeling allows audio, video, and linguistic histories to jointly condition agent generation, maintaining tight temporal coherence between modalities during real-time exchange.

In v0.2, the system's output video resolution is elevated from 192×336 to 640×368 at a fixed 25 FPS, targeting a significantly broader and higher-fidelity visual composition. This enhancement preserves posture, hand motion, gaze, physical context, and scene layout, expanding the setting from face-centric, close-up interaction to mid-shot, scene-grounded digital agents. Critically, this upgrade is achieved while maintaining approximately 200 ms model-side signal-to-signal latency.

Figure 1: Wan-Streamer architecture; block-causal audio, language, and video states evolve on a unified timeline and are processed via block-causal attention.

Latency-Preserving Infrastructure

Meeting the increased computational cost of high-resolution video generation without degrading responsiveness necessitated a re-architecting of model serving. Wan-Streamer v0.2 bifurcates the model into two optimized paths:

• Thinker: Resides on a single GPU and manages lag-sensitive perception, causal language/state update, KV-cache construction, and final audio-visual decoding. The Thinker's output is a compact K/V cache slice that incorporates all language/state information necessary for visual and acoustic generation.
• Performer: Implements a Ulysses-style context-parallel group distributed across multiple GPUs. Each Performer rank manages a sharded segment of the total long-sequence K/V cache and is responsible for denoising a disjoint subsequence of the high-resolution video latent. Ulysses collective operations all-to-all/gather efficiently synchronize denoising results across ranks.

  Figure 2: v0.2 system decomposition, showing the single-GPU Thinker for low-latency tasks and Ulysses-style, multi-GPU Performer for context-parallel video latent generation.

Audio latents, being much shorter, bypass sequence sharding to avoid unnecessary parallelism overhead. Only the video sequence is partitioned for parallel denoising, isolating the computational load and preserving the Thinker–Performer interface as a low-latency boundary. Typical remote interaction latency remains at ≈550 ms when including the same 350 ms bidirectional network budget as previously established in v0.1.

Experimental Outcomes

Evaluations retain the same response boundary definition used in v0.1, isolating model-side processing for fair comparison against latency baselines. Despite the much larger visual output, v0.2 achieves model-side “signal-to-signal” delay near 200 ms at 25 FPS, demonstrating that the serving decomposition and context-parallel denoising approach scale efficiently.

Qualitative inspection of generated 640×368 interaction sequences confirms legibility improvements: facial expression, gaze shifts, manual gestures, and environmental details are all preserved for both listening and speaking states, across typical video-call and mid-shot contexts. The temporal stability of latent generation and decoding avoids artifacts commonly manifest in runtime-constrained, high-resolution synthesis. The richer context enables new forms of situated interaction and embodies a shift towards immersive, conversational AI agents.

Implications and Directions

Wan-Streamer v0.2’s design demonstrates that native-streaming causal modeling and real-time multimodal response can scale to substantially higher visual fidelity without recourse to offline postprocessing or increased perceptual delay. The modular Thinker–Performer split—particularly the isolated, context-parallel Performer path—presents a template for efficiently scaling interactive multimodal agents in both research and deployment.

This work also provides an experimental foundation for direct, fine-grained synchrony of audio, language, and visual modalities over long horizons, relevant for downstream settings such as persistent embodied assistants, digitally mediated telepresence, and interactive human-model world modeling. Future directions will likely include: extension to 3D or world-centric representations, finer control of agent-environment interaction, exploration of more granular agent body/scene state modeling, and throughput scaling for large-population deployment.

Conclusion

Wan-Streamer v0.2 achieves high-resolution (640×368) real-time audio-visual streaming while strictly preserving model-side latency. Through a principled, latency-aware Thinker–Performer decomposition using a Ulysses-style context-parallel group for visual denoising, the system supports scene-grounded, mid-shot digital agents with legible expression, posture, and environmental context. This upgrade establishes a new operational ceiling for low-latency, end-to-end, multimodal interactive models (2607.04443).