Characterize the effect of relaxed acceptance on output diversity

Characterize how epsilon-threshold acceptance in HyCo changes the diversity of generated outputs relative to exact verification and the verifier’s original sampling distribution.

Background

HyCo’s default epsilon-threshold acceptance rule can accept drafted tokens that the verifier did not sample, so it does not preserve the verifier’s sampling distribution. The paper evaluates quality using judge scores and summary metrics, but these evaluations do not address whether the relaxed rule changes output diversity. Establishing this effect would clarify an important quality and distributional consequence of lossy acceptance.

References

The question-only judge and reference-summary-based HELMET metrics do not comprehensively assess factual consistency, and we do not establish how relaxed acceptance changes output diversity.

— HyCo: Hybrid Drafting for Cost-Efficient Mobile-Cloud Speculative Decoding  (2610.21436 - Bae et al., 15 Oct 2026) in Limitations, subsection “Distribution and quality”