Transfer or reuse rehearsed updates across checkpoints

Determine whether rehearsed updates used by Update-Matched Unlearning can be transferred or reused across different base-unlearned checkpoints, thereby avoiding the requirement to perform a separate rehearsal for every checkpoint.

Background

The current Update-Matched Unlearning procedure requires each base-unlearned checkpoint to undergo its own rehearsal, which increases computational cost and limits reuse across related model states. The conclusion identifies transferability and reuse of rehearsed updates as a future research direction.

The unresolved issue is whether an update recorded for one checkpoint remains sufficiently representative when applied to another checkpoint, while still enabling effective resistance to relearning and preservation of plasticity.

References

Future work will study full-parameter and adaptive fine-tuning attacks and investigate whether rehearsed updates can be transferred or reused across checkpoints.

— Not All Change Is Damage: Update-Matched Unlearning for Large Language Models  (2610.21230 - Li et al., 15 Oct 2026) in Section 6, “Conclusion,” final paragraph