Develop adaptive forgetting budgets

Develop adaptive forgetting budgets that adjust dynamically based on task importance or context, rather than remaining fixed across all edits, to improve stability–adaptability trade-offs in gated continual self-editing.

Background

The paper introduces a gated continual self-editing framework that controls catastrophic forgetting by enforcing a budget on update-induced changes using one of three metrics: EM drop, bits increase, or KL divergence. In all experiments, this budget is fixed per run and applied uniformly across sequential LoRA merges.

The authors note that fixed thresholds can be either overly rigid or permissive depending on the edit, task importance, and context. They therefore flag the need for dynamically adjusting budgets to better reflect varying risk tolerances and priorities across edits, which could enhance performance while maintaining reliability.