Create and explore imaginative 3D worlds with our new product Dreamfield (opens in a new tab)

Compare streaming SISO with the original offline SISO implementation

Conduct a systematic comparison between the evaluated online single-pass streaming adaptation of SISO and the original offline re-clustering cache manager using the authors’ reference implementation, in order to determine whether the reported performance differences arise from the policy itself or from the streaming adaptation.

Background

The paper evaluates a single-pass online adaptation of SISO because the original SISO cache manager re-clusters query logs offline. The adaptation maps SISO’s merge step to online per-insert merging, limits its search to sampled entries, and uses maintenance rounds to update cluster statistics.

Because this implementation differs materially from the original offline design, the reported poor performance of streaming SISO cannot be attributed unambiguously to SISO’s underlying policy. A direct comparison against the reference implementation is therefore left unresolved and would clarify the effect of the implementation and operating mode.

References

SISO's original cache manager re-clusters query logs offline; our implementation maps its merge step to online per-insert merging with the search bounded at 1{,}024 sampled entries, and drives its M/D/1-based adaptive retrieval threshold $\theta_R$ from a sliding-window hit rate. As in the original design, $\theta_R$ does not influence victim selection. We therefore evaluate this adapted, online single-pass variant, denoted streaming SISO throughout, rather than the original offline re-clustering manager; its results should be read as characterizing the streaming adaptation, and a comparison against the authors' reference implementation is left to future work.

— Which Eviction Policy Should an LLM Cache Use? A Systematic Study Across Workloads, Capacities, and Encoders  (2608.20280 - Kulkarni et al., 20 Aug 2026) in Section 3, subsection “Classical and LLM-Serving Policies,” paragraph “Streaming SISO”