---
title: 'Wasure: Forgetting and Memory Governance'
url: https://www.emergentmind.com/topics/wasure
type: topic
---

# Wasure: Forgetting and Memory Governance

In current arXiv usage, **Wasure** denotes a heterogeneous cluster of technical ideas centered on forgetting, selective erasure, and memory governance, rather than a single algorithm or formalism. In machine learning, forgetting is explicitly described as the Japanese term *wasure* and refers to deliberate modification of a model’s internal state so that past data or learned parameters lose influence on future predictions [2405.20620]. The term also appears in analyses of bounded Hebbian memories [1805.12368], differentiable working-memory control [1809.11087], machine unlearning and forgetting audits [2402.15109; 2004.10129; 2412.16780; 2604.17785; 2606.03808], formal forgetting in logic and Answer Set Programming (ASP) [2305.07233; 1707.05152], and, in a distinct sense, as the name of a modular WebAssembly benchmarking toolkit [2602.05488].

## 1. Terminological scope and major usages

A common misconception is that *Wasure* names a single unlearning method. In the cited literature, it instead labels several technically distinct objects that share a concern with removing, attenuating, suppressing, or governing memory-like influence.

| Usage in the literature | Core object | Representative source |
|---|---|---|
| Adaptive forgetting in ML | Deliberate reduction of past-data influence | [2405.20620] |
| Exponential forgetting in associative memory | Bounded Hebbian memory with age-dependent retrieval loss | [1805.12368] |
| Controlled forgetting in neural memory | Erase/add external-memory architecture | [1809.11087] |
| Machine unlearning | Approximate or selective removal of training-data effects | [2402.15109], [2604.17785], [2606.03808], [2412.16780] |
| Auditing whether forgetting occurred | Statistical test based on shadow models and K-S distances | [2004.10129] |
| Logical forgetting | Standard and weak forgetting operators | [2305.07233] |
| Forgetting in ASP | Relaxations of strong persistence | [1707.05152] |
| WebAssembly benchmarking toolkit | Modular CLI system named “Wasure” | [2602.05488] |
| Agent memory governance | Two-counter Memory Worth signal for suppression or deprecation | [2604.12007] |

This breadth suggests that *Wasure* functions less as a discipline-specific term of art than as a recurring label for operations that determine what information should cease to affect future computation.

## 2. Associative-memory formulations and exponential forgetting

In the survey literature, forgetting is defined as “any deliberate modification of a model’s internal state so that past data or learned parameters lose influence on future predictions” [2405.20620]. That framing is instantiated sharply in the bounded Hebbian model studied by Marinari, which revisits the memory “which forgets,” introduced by Parisi in 1986 [1805.12368]. The update rule is a Hebb-like increment followed by hard clipping:
$$
w_{ij}(t+1)=\mathrm{clip}\!\left(w_{ij}(t)+\frac{1}{N}\xi_i^\mu \xi_j^\mu,\,-A,\,A\right).
$$
Here \(w_{ij}(t)\) is the synaptic strength from neuron \(j\) to \(i\), \(N\) is the number of binary neurons \(\sigma_i\in\{\pm1\}\), \(\xi_i^\mu\in\{\pm1\}\) is the \(i\)-th bit of pattern \(\mu\), and \(A>0\) is the saturation threshold of synaptic efficacy [1805.12368].

The model’s motivation is confusion avoidance. In the classical Hopfield model, presenting too many patterns with \(p/N>\alpha_c\approx0.14\) yields catastrophic interference; with saturation at \(\pm A\), conflicting contributions cannot accumulate without bound, so new patterns overwrite older ones and the network remains able to learn recently presented inputs [1805.12368]. Numerical studies show that, for optimal \(A\), the maximal fraction of recognized patterns is
\[
\rho_{\max}\simeq 0.0431(5),
\]
with critical bound
\[
A_{\max}(N\to\infty)\simeq 0.357(5),
\]
in good agreement with the analytical result \(A_{\max}\approx0.354\) from van Hemmen–Keller–Kühn (1988) [1805.12368].

The large-\(N\) behavior is especially important. With \(N\to\infty\), \(p\to\infty\), and \(R=p/N\) fixed, patterns presented \(m\) steps before the current time are retrieved with probability tending to \(1\) when \(m<R_{\mathrm{rec}}\cdot N\) and \(0\) when \(m>R_{\mathrm{rec}}\cdot N\), with \(R_{\mathrm{rec}}=1\) asymptotically; only the most recent \(N\) patterns are retrievable [1805.12368]. The basin of attraction \(B(m)\), defined as the probability that a random initial state converges under zero-temperature steepest-descent dynamics to a pattern of age \(m\), obeys
\[
B(m)\sim C\exp(-\alpha m),
\]
and \(\log B(m)\) versus \(m\) is nearly linear over more than five decades [1805.12368].

Marinari identifies this exponentially collapsing basin as “a clearly non physiological feature of the model” [1805.12368]. The paper further notes that true biological memory does not exhibit an unrelenting exponential decay of accessibility with age, and that a model requiring nearly continuum-valued synapses while real synapses have only “\(\simeq 10\) distinguishable states” is difficult to reconcile with experimental plasticity time-courses [1805.12368]. This establishes an enduring distinction within *wasure* research: forgetting can be computationally stabilizing while still being biologically implausible.

## 3. Differentiable working memory and memory governance

A second line of work treats forgetting not as passive decay but as active control. The Differentiable Working Memory (DWM) model is an RNN controller plus a small external memory buffer, trained end-to-end to emulate human working memory rather than episodic storage [1809.11087]. Its defining properties are limited capacity, sequential access, and manipulation capability: the controller can selectively retain, overwrite, or erase items.

At each time step, DWM reads from memory, updates the controller state, edits memory through an erase-plus-add operation, and shifts the focus of attention. The memory edit is
\[
M_t = M_{t-1}\odot(E-w_{t-1}\otimes e_t)+w_{t-1}\otimes a_t,
\]
where \(e_t\in[0,1]^d\) is the learned erase vector and \(a_t\in\mathbb{R}^d\) the add vector [1809.11087]. Bookmarks \(B_t^i\) store prior attention patterns, allowing the controller to return its focus to previous locations. The erase mechanism is explicitly differentiable: when \(e\approx 1\) in feature dimension \(j\), the content at the addressed locations is zeroed out [1809.11087].

No explicit forget-penalty regularizer is required. According to the paper, task structure itself drives controlled forgetting: in the “Ignore” task, recalling distracting subsequences is penalized; in the “Forget” task, the model must reproduce \(y_i\) immediately but later recall only the \(x_i\) [1809.11087]. DWM learned to skip writing irrelevant \(y_i\) or overwrite or erase it immediately after reproducing it. In limited-memory regimes, it discovered a two-mode strategy in which attention freezes on \(y\)-subsequences and advances on \(x\)-subsequences, reducing memory footprint [1809.11087].

The quantitative comparison is striking. LSTM with more than \(5\) million parameters and DNC with approximately \(4.8\)K parameters either failed entirely or did not generalize beyond sequence lengths of about \(100\), whereas DWM with \(1{,}066\) parameters generalized perfectly to length \(1{,}000\), two orders of magnitude longer than the training sequences [1809.11087]. In this usage, *wasure* denotes learned selectivity in addressable memory rather than irreversible deletion.

A related but operationally different formulation appears in agent memory governance. “When to Forget: A Memory Governance Primitive” introduces **Memory Worth (MW)**, a two-counter signal per memory unit that tracks weighted co-occurrence with successful and failed outcomes [2604.12007]. For memory \(m\), the counters are
\[
\mathrm{hits}_T^+(m)=\sum_{t=1}^T w_t(m)\mathbf{1}[m\in M_t]\mathbf{1}[y_t=+1], \quad
\mathrm{hits}_T^-(m)=\sum_{t=1}^T w_t(m)\mathbf{1}[m\in M_t]\mathbf{1}[y_t=-1],
\]
and
\[
MW_T(m)=
\begin{cases}
\dfrac{\mathrm{hits}_T^+(m)}{\mathrm{hits}_T^+(m)+\mathrm{hits}_T^-(m)} & \text{if } \mathrm{hits}_T^++\mathrm{hits}_T^->0,\\[6pt]
0.5 & \text{otherwise.}
\end{cases}
\]
Under stationarity, exploration, conditional independence, bounded outcomes, minimum weight, and outcome stationarity, \(MW_T(m)\to p^+(m)\) almost surely, where \(p^+(m)=\Pr[y_t=+1\mid m\in M_t]\) [2604.12007].

The paper is explicit that \(p^+(m)\) is associational rather than causal. Nevertheless, after \(10{,}000\) synthetic episodes the Spearman rank-correlation between Memory Worth and true utilities reaches \(\rho=0.89\pm0.02\) across \(20\) independent seeds, compared to \(\rho=0.00\) for systems that never update their assessments [2604.12007]. In a retrieval-realistic micro-experiment using all-MiniLM-L6-v2, stale memories cross the low-value threshold at \(MW=0.17\) while specialist memories remain high-value at \(MW=0.77\) across \(3{,}000\) episodes [2604.12007]. This extends *wasure* from deletion or erasure to ongoing governance over whether a memory should be trusted, suppressed, or deprecated.

## 4. Machine unlearning, selective forgetting, and forgetting audits

The survey on forgetting organizes machine forgetting along the dimensions of content of forgetting, recoverability, and extent of erasure, while also distinguishing Active from Passive methods [2405.20620]. Item-level, feature-level, class-level, task-level, and stream-level forgetting are all recognized; forgetting may be irrecoverable or recoverable, exact or approximate [2405.20620]. This taxonomy is useful because most concrete *wasure* systems occupy only one region of that design space.

A recent token-level selective-unlearning method is **Entropy-guided Token Weighting (ETW)**. Large-language-model unlearning is posed as an update combining retain loss and forget loss,
\[
L(\theta)=L_r(x_r,y_r;\theta)+\lambda L_f(x_f,y_f;\theta),
\]
where the forget objective uses per-token weights \(\omega_i\) [2604.17785]. ETW defines token entropy
\[
H_i=-\sum_{v\in V} p_{\hat\theta}(v\mid y^f_{<i},x_f)\log p_{\hat\theta}(v\mid y^f_{<i},x_f),
\]
with \(\hat\theta\) a stop-gradient copy of \(\theta\), and sets
\[
\omega_i^{ETW}=n\frac{H_i}{\sum_{j=1}^n H_j}.
\]
The method is motivated by the observation that informative tokens tend to have higher entropy, whereas structural tokens tend to have lower entropy [2604.17785]. On TOFU and WMDP across \(1\)B, \(3\)B, and \(7\)B models, ETW achieves the highest ROC-AUC, approximately \(0.72\), for separating human-annotated informative tokens from structural tokens, and yields the lowest aggregated score on the TOFU \(10\%\) forget split while also reducing forget-set accuracy more than comparators at equal retained-set MMLU accuracy in WMDP [2604.17785].

A different approach is **MU-Mis**, which treats a sample’s contribution to learning as reflected in the learned model’s input sensitivity [2402.15109]. The unlearning loss for a forget sample \(x\) of class \(c\) compares the target-class Jacobian norm with that of an irrelevant class \(c'\):
\[
\mathcal{L}(w;x)=\|\nabla_x f_c(w,x)\|_F^2-\|\nabla_x f_{c'}(w,x)\|_F^2.
\]
The method minimizes the sum of this quantity over the forget set and does so without using the remaining data during unlearning [2402.15109]. On CIFAR-100 full-class forgetting for “rocket,” MU-Mis obtains \(Acc_r=76.3\), \(Acc_f=0.0\), and \(MIA=0.0\), close to Retrain’s \(76.9\), \(0.0\), and \(5.6\), while being \(10^2\)–\(10^3\times\) faster than full retraining when \(|\mathcal{D}_f|\ll|\mathcal{D}|\) [2402.15109].

**PURGE** explicitly exploits the duality between continual learning and machine unlearning. It projects forget gradients against retain gradients so that each step does not increase retain-set loss, adds multi-layer representation erasure, and replaces a uniform unlearning target with a retain-confusion target [2606.03808]. If \(\langle g_f,g_r\rangle<0\), the forget gradient is replaced by
\[
\tilde g_f=g_f-\frac{\langle g_f,g_r\rangle}{\|g_r\|^2}g_r.
\]
The representation-erasure term averages \(\|h_\ell^f-\bar h_\ell^r\|_2^2\) over intermediate layers, and automatic stopping uses a retain-loss budget and a forget-accuracy target [2606.03808]. Across CIFAR-10, MNIST, SVHN, STL10, and PathMNIST, PURGE “consistently keeps retain accuracy above 96% while achieving MIA AUROC close to 0.5”; on CIFAR-10 class-0 forgetting it reports \(TA=84.5\%\), \(FA=8.4\%\), \(RA=96.3\%\), and \(MIA=0.496\) [2606.03808].

A complementary perspective keeps model weights fixed and instead learns a universal perturbation. **Forget vectors** define a data-agnostic perturbation \(\delta\) by minimizing a forget loss on \(\mathcal{D}_f\), a retain cross-entropy on \(\mathcal{D}_r\), and an \(\ell_2\) penalty [2412.16780]. The same work introduces “forget vector arithmetic,” in which class-specific vectors \(\delta_k\) are linearly combined to forget arbitrary subsets of classes [2412.16780]. On CIFAR-10 class-wise forgetting, “Ours” achieves \(UA\approx97.9\%\), \(MIA\approx99.6\%\), \(RA=97.3\%\), and \(TA=90.9\%\), while optimization takes approximately \(10\)–\(25\) minutes compared with retraining at “\(\gg100\) min” [2412.16780].

Whether a model has actually forgotten can itself be formalized as an audit problem. Liu and Tsaftaris define a scalar statistic
\[
\rho=\frac{KS_*}{KS_C},
\]
where \(KS_*\) is the two-sample Kolmogorov–Smirnov distance between a target model and a self-shadow model on the query dataset \(D_Q\), and \(KS_C\) is the corresponding distance between the self-shadow and a calibration shadow [2004.10129]. The rule is simple: declare “forgotten” if \(\rho\ge1\), “not forgotten” if \(\rho<1\). On MNIST/SVHN/CIFAR-10, pure MNIST yields \(\rho=0.082\) and is classified as not forgotten, whereas pure SVHN yields \(\rho=1.000\) and is classified as forgotten; in ACDC cardiac diagnosis, \(1.5\)T \(+10\%\) \(3\)T gives \(\rho=0.750\) and is classified as not forgotten [2004.10129].

Taken together, these systems show that *wasure* in contemporary ML spans token weighting, sensitivity suppression, gradient projection, input perturbation, and post hoc verification. The survey’s distinction between exact and approximate forgetting is therefore central rather than peripheral [2405.20620].

## 5. Logical and answer-set formulations of forgetting

Outside statistical learning, *wasure* corresponds to formal operators that eliminate symbols while preserving selected inferential behavior. In propositional logic, standard forgetting of \(P\) from a theory \(Th(P,Q)\) is equivalent to existential quantification,
\[
Forget(Th(P,Q),P)\equiv \exists P\,Th(P,Q),
\]
and preserves all entailments of \(Q\)-formulas \(A\): \(Th(P,Q)\models A\) iff \(Forget(Th(P,Q),P)\models A\) [2305.07233]. The same paper introduces **weak forgetting**, dual to standard forgetting, and shows
\[
WeakForget(Th(P,Q),P)\equiv \forall P\,Th(P,Q).
\]
Standard forgetting aligns with strongest necessary conditions, while weak forgetting aligns with weakest sufficient conditions [2305.07233].

The paper also gives an algorithmic perspective via quantifier elimination and Ackermann-style elimination. In the propositional case, if \(B(p)\) is positive in \(p\), then
\[
\exists p[(p\to A)\wedge B(p)]\equiv B(p:=A),
\]
with a dual form when \(B(p)\) is negative in \(p\) [2305.07233]. The framework is extended to first-order logic, where standard and weak forgetting become \(\exists R\,Th(R,S)\) and \(\forall R\,Th(R,S)\), respectively [2305.07233].

Illustrative examples underscore the semantic difference. For \(Th=\{lt\lor lp\}\) over \(P=\{lt\}\) and \(Q=\{lp\}\), standard forgetting gives \(\top\), while weak forgetting gives \(lp\) [2305.07233]. The paper interprets this as retaining the sufficient condition \(lp\) when the \(lt\)-sensor is unavailable.

In ASP, the central reference point is **strong persistence (SP)**. Forgetting an atom set \(V\) from a program \(P\) should preserve, under any added context \(R\) using only atoms outside \(V\), exactly the projections of the answer sets of \(P\cup R\) onto the remaining atoms [1707.05152]. However, SP is not always attainable. The criterion \(\Omega\) characterizes precisely when an SP-satisfying forgetting operator exists; the existence theorem states that such an operator exists on \((P,V)\) iff \(\Omega\) does not hold [1707.05152].

When \(\Omega\) holds, three alternatives are analyzed. \(\mathcal{F}_{SP}\) preserves old answer sets but may introduce new ones; \(\mathcal{F}_R\), based on relativized equivalence, avoids new answer sets but may lose old ones; and \(\mathcal{F}_M\) preserves exactly the projected old answer sets but fails strong invariance [1707.05152]. The paper summarizes the trade-off succinctly: when one must forget but cannot satisfy strong persistence, one must choose between accepting new answer sets, accepting lost answer sets, or accepting loss of invariance. This makes *wasure* in logic a problem of preserving the right inferential invariants under symbol elimination.

## 6. Wasure as a WebAssembly benchmarking toolkit

In a completely different usage, **Wasure** is the name of a “lightweight, Python-based command-line toolkit” for systematic, reproducible, and extensible WebAssembly benchmarking [2602.05488]. The motivation is the multidimensionality of Wasm performance evaluation across runtime engines, hardware architectures, application domains, source languages, benchmark suites, and runtime configurations [2602.05488].

The toolkit is organized into three phases: **Preparation**, **Execution**, and **Evaluation**. Preparation includes benchmark management and runtime management; execution includes the run module and the check module; evaluation includes export and plotting [2602.05488]. Its stated design goals are ease of use, extensibility through simple JSON configurations, portability on Unix-like hosts, and accuracy through low-overhead timing, memory and resource tracking, timeouts, and repeatable trials [2602.05488]. Supported runtimes include wasmtime, wasmer, V8, SpiderMonkey, JavaScriptCore, WAMR, WasmEdge, wasm3, Wizard, wasmi, and wazero; bundled benchmark suites include mibench, ostrich, dhrystone, polybench, libsodium, wasm-r3, wasm-features, and wasi-proposals; source languages include C/C++, Rust, AssemblyScript, Java, Scala, Kotlin, and OCaml [2602.05488].

The command-line interface uses subcommands such as `wasure list benchmarks`, `wasure list runtimes`, `wasure install <runtime>`, `wasure run`, `wasure check`, `wasure export`, and `wasure plot` [2602.05488]. Runtime and benchmark descriptors reside under `runtimes/` and `benchmarks/` folders, allowing new entries to be added without changing the core code [2602.05488].

Beyond timing, Wasure integrates Wizard’s non-intrusive instrumentation to emit events for executed instructions and cycles, basic block entries and function calls, reads and writes to linear memory and global variables, integer versus floating-point operations, and indirect call instructions [2602.05488]. The resulting dynamic analysis reveals strong benchmark heterogeneity: overall coverage is below \(70\%\) across suites, only mibench and dhrystone exceed \(65\%\) function coverage, in most suites less than \(10\%\) of instructions account for \(95\%\) of runtime, polybench and ostrich are floating-point heavy, mibench, dhrystone, libsodium, and wasm-r3 are integer-dominated, certain ostrich workloads show extreme indirect-call behavior, and dhrystone and libsodium exhibit more than \(10^{10}\) memory accesses [2602.05488]. PCA clustering identifies wasm-r3 and libsodium as outliers in function diversity and memory intensity [2602.05488].

This use of the term does not concern forgetting in the algorithmic or logical sense. Rather, it is a proper name for benchmarking infrastructure. Its presence alongside the forgetting literature is a reminder that *Wasure* is lexically stable across papers while semantically diverse.

## 7. Conceptual unities and persistent tensions

Despite the diversity of usages, several recurrent themes are visible across the literature. First, forgetting is repeatedly framed as adaptive rather than merely defective: the survey explicitly links it to avoiding cognitive overload, adapting to changing environments, and preventing “experience over-fitting” [2405.20620]. Second, the hardest technical issue is nearly always the privacy–utility or plasticity–stability tension. In associative memory, saturation prevents catastrophic interference but produces exponentially tiny basins for old memories [1805.12368]. In unlearning, ETW, MU-Mis, PURGE, and forget vectors each try to erase target information while preserving retained performance [2604.17785; 2402.15109; 2606.03808; 2412.16780]. In logical settings, forgetting preserves some inferential content while sacrificing others when strong persistence cannot be maintained [2305.07233; 1707.05152]. In agent memory governance, MW is designed for suppression and deprecation, yet remains only associational and is vulnerable to hitchhiker and task-difficulty confounds [2604.12007].

A second recurring issue is evaluation. In machine unlearning, exact forgetting is defined relative to retraining-from-scratch ideals, but many practical methods are approximate [2405.20620]. PURGE targets MIA AUROC close to \(0.5\), MU-Mis reports remaining-data accuracy, forget-data accuracy, and membership-inference risk, ETW emphasizes aggregated score and privacy leakage, and Liu–Tsaftaris propose a dedicated audit ratio \(\rho\) for deciding whether forgetting occurred [2606.03808; 2402.15109; 2604.17785; 2004.10129]. This suggests that *wasure* is not only an intervention problem but also a verification problem.

Finally, the literature repeatedly identifies open-endedness rather than closure. The survey calls for cross-disciplinary forgetting, forgetting verification, interpretable forgetting, hybrid forgetting, source-free forgetting, and a “Goldilocks zone of forgetting” [2405.20620]. Marinari argues that hard cut-offs should be replaced by more graded or stochastic forgetting, such as palimpsest schemes and multi-timescale plasticity, to avoid exponentially collapsing retrieval basins while preserving capacity of order \(O(N)\) [1805.12368]. The cumulative picture is that *Wasure* marks an active research area in which erasure, suppression, abstraction, and governance are technically unified by a single question: how should past information stop mattering without destroying the computational system that once relied on it?

Source: https://www.emergentmind.com/topics/wasure