Scope of modeling future uncertainty in video understanding

Determine how far video understanding models should extend beyond deterministic prediction to represent and reason about future uncertainty, including modeling multiple plausible futures and integrating uncertainty into planning and decision-making processes.

Background

The paper argues that real-world environments are fundamentally uncertain and that video understanding should support decision-making under uncertainty, not just deterministic prediction.

This motivates extending models to reason over multiple plausible futures, evaluate goals and costs, and operate effectively in embodied, online settings.