Matched-input comparison of ordinary knowledge distillation
Determine whether applying ordinary knowledge distillation to both original and evidence-removed inputs yields results that differ from the Evidence-Conditioned Dependency Distillation approach, thereby establishing the effect of the matched-input training comparison.
References
Finally, the present comparisons do not include ordinary KD applied to both original and evidence-removed inputs. The current ablations therefore support the design choices within ECDD, while leaving this matched-input comparison open.
— When Evidence Vanishes: Distilling Visual-Evidence Dependency in Medical Vision-Language Models
(2610.23469 - Lan et al., 16 Oct 2026) in Section 4.6, Limitations