Robust video tracking under rapid motion and severe occlusion

Develop robust video tracking methods that remain reliable in scenarios involving rapid motions or severe occlusions, thereby providing dependable trajectory information for sketch animation generation based on CoTracker-tracked points.

Background

The HyperSketch framework uses trajectory consistency loss based on tracking information extracted by CoTracker to maintain temporally coherent vector sketch strokes. The paper notes that tracking quality can deteriorate when objects move rapidly or become severely occluded, which directly undermines the reliability of the trajectory constraints used during optimization.

Although the authors experimented with alternative trackers, including SpaTrackerV2 and Shape of Motion, they identify robust tracking in these challenging video conditions as an unresolved problem. Solving it would improve the temporal coherence and applicability of controllable video sketch generation in difficult scenes.

References

Gruden, Jang, et al. also report that longer gaps in humpback whale song can fragment a single trajectory into multiple tracks and identifies joining the resulting 2-D track fragments as future work.

— Bridging Echolocation Gaps in Automated Beaked Whale Tracking  (2609.10768 - Ma et al., 9 Sep 2026) in Section 1, State of the Art

Though we explored alternatives such as SpaTrackerV2 and Shape of Motion, robust tracking in challenging scenarios remains an open problem.

— HyperSketch: Controllable Video Sketching in a Style Hyperspace  (2609.00919 - Zhu et al., 1 Sep 2026) in Section “Limitations & Future work”

However, their findings highlight that instrument tracking remains an open challenge, particularly in complex scenarios during conventional laparoscopic surgery.

— Augmenting Real-time Visualization in Minimally Invasive Surgery with Particle Filtering and Depth-Aware Occlusion Handling  (2610.18422 - Sarkar et al., 13 Oct 2026) in Section I, Introduction