Generalization of OPSD findings beyond Qwen3 models

Determine whether the reported findings about privileged reference information in on-policy self-distillation generalize to model families other than Qwen3.

Background

The study evaluates on-policy self-distillation using Qwen3 models at 8B, 4B, and 1.7B scales. Its conclusions concern how reference-conditioned teacher supervision, reference-free teacher behavior, and mismatched references affect student performance and distributional alignment in these models. The authors explicitly leave unresolved whether these findings extend to other model families, making cross-family validation an open empirical problem.