Variation of geometric decay and consolidation break-even

Determine how the geometric plasticity-decay constant β and the consolidation break-even point vary with model architecture, task characteristics, and optimizer choice in sequential bounded in-cell updates.

Background

CellFill’s sequential-update experiment uses four disjoint tasks on one Qwen3-1.7B model, with one rank, one optimizer configuration, one seed, and one consolidation variant. The measured writable-room decay is approximately geometric, with β = 0.825 ± 0.002, while consolidation restores writable room at the cost of changing the artifact.

Because the sequential evidence comes from a single configuration, the paper does not establish that the measured decay constant or the point at which consolidation becomes beneficial transfers across models, tasks, or optimization procedures. The authors explicitly leave those dependencies unresolved.

References

How the geometric constant $\beta$ and the consolidation break-even point vary with model, task and optimizer remains open.

Nothing Changed but the Model: CellFill -- Bounded In-Cell Learning for Bit-Identical, Revocable Updates to Quantized LLMs  (2608.20873 - Liu et al., 21 Aug 2026) in Section Discussion and outlook, subsection “A version lifecycle”