Extend MetaOPD to broader models and tasks
Extend the empirical evaluation of MetaOPD, a bilevel on-policy distillation framework that learns token weights from post-update validation loss, to broader model families and task domains.
References
Extending these findings to broader models and tasks, relating local update quality to long-horizon learning, and reducing meta-update cost remain open directions.
— MetaOPD: Meta-Learned Token Weighting for On-Policy Distillation
(2610.11989 - Wang et al., 8 Oct 2026) in Section Conclusion