Epistemic Forgetting
- Epistemic Forgetting is the process by which knowledge-bearing systems lose retrievability and discriminative capacity through mechanisms such as erasure, unlearning, and downskilling.
- It is modeled through techniques like retrieval geometry, discounted Bayesian updating, and uncertainty management to quantify dynamics comparable to human memory decay.
- The concept also spans normative dimensions, connecting controlled unlearning and exclusion to governance, accountability, and epistemic justice in data systems.
Epistemic forgetting denotes processes through which a knowledge-bearing system loses usable access to information, weakens the force of prior evidence, or ceases to preserve the distinctions that made a proposition, variable, skill, or reasoning framework action-guiding. Recent work treats it not as a single operation but as a heterogeneous family: loss of retrievability and discriminability in semantic spaces, discounted evidential force in sequential inference, downskilling in logical models, collapse of framework-selection boundaries in modular agents, and state-transforming operations such as contraction, ignoration, revocation, marginalization, and conditionalization on epistemic states (Barman et al., 27 Mar 2026, Tran et al., 28 Dec 2025, Liang et al., 2024, Wang, 16 Mar 2026, Beierle et al., 29 Aug 2025). This suggests that epistemic forgetting is best understood as a structural transformation of what can be known, retrieved, inferred, or responsibly acted upon, rather than as mere deletion.
1. Conceptual scope and principal distinctions
A central recent clarification treats forgetting as “an umbrella term for sociotechnical processes through which something becomes unavailable, varying in agency (intentional vs. incidental), temporality (momentary vs. durable), reversibility (recoverable vs. irreversible), and scale (individual records vs. population-level).” Within that umbrella, erasure is “an operational act that removes or disables access to data artifacts,” unlearning is “an intentional technical intervention aimed at removing (or bounding) the influence of specific data on learned parameters and downstream outputs,” and exclusion is “upstream decisions not to collect, label, or include certain people, events, or categories in datasets” (Makovska et al., 24 Feb 2026). In parallel, a general framework of epistemic forgetting on epistemic states distinguishes five abstract types: contraction (), ignoration ( and ), revocation (), marginalization (), and conditionalization () (Beierle et al., 29 Aug 2025).
Machine-learning work introduces a further operational distinction between selective forgetting, treated as beneficial and intentional, and catastrophic forgetting, treated as harmful loss of previously learned information. The survey literature organizes selective forgetting by content of forgetting (item-, feature-, class-, task-, and stream-level), recoverability of forgetting (irrecoverable versus recoverable, including ephemeral, inhibitory, and gradient forgetting), and extent of forgetting (exact versus approximate) (Sha et al., 2024). Exact forgetting is defined counterfactually: the post-forgetting model should behave like a model never trained on the removed data. Approximate forgetting weakens that requirement to practical attenuation of influence.
At the representational level, some work defines epistemic forgetting not as deletion of stored content but as loss of access. In "The Geometry of Forgetting" (Barman et al., 27 Mar 2026), forgetting is explicitly framed as loss of retrievability and discriminability within a meaning-structured space: what is “forgotten” is often not erased from storage, but becomes inaccessible, outcompeted, or confusable with nearby alternatives. This yields a broad conceptual convergence: epistemic forgetting often concerns the transformation of availability, not simply the destruction of traces.
2. Retrieval geometry, evidence decay, and uncertainty management
One influential line models forgetting as a property of retrieval geometry. In the geometric account, each memory item is stored as an embedding vector produced by a frozen pre-trained encoder, optionally concatenated with contextual information and projected through a trained linear layer with LayerNorm. Retrieval is similarity-based, with score
with , and forgetting is measured as decline in retrieval accuracy as a function of age and competitor load (Barman et al., 27 Mar 2026). The paper’s core comparative result is that temporal decay alone and no competitors yields a fitted forgetting exponent , whereas adding distractors with the same temporal decay function yields 0, with 95% CI 1 and 2, close to the human benchmark 3. The same work reports that production embedding models with nominal dimensions 4, 5, and 6 have participation-ratio effective dimensionalities 7, 8, and 9, respectively, implying that interference is governed by effective rather than advertised dimensionality. False memory appears as the complementary effect: with BGE-large on the 24 standard DRM lists, the critical-lure false alarm rate is 0 at threshold 1, compared with a human rate of approximately 2, and the threshold was chosen because it yields zero unrelated false alarms (Barman et al., 27 Mar 2026). In this picture, forgetting and distortion are coupled consequences of proximity-based retrieval in crowded semantic neighborhoods.
A second line treats forgetting as discounted evidence integration. "Forgetting as a Feature: Cognitive Alignment of LLMs" formalizes epistemic forgetting as discounted Bayesian updating,
3
with 4, and operationalizes prompting-time forgetting by exponential recency weights
5
The stated interpretation is that forgetting is not discrete deletion but attenuation of prior evidential force, supporting a stability–plasticity trade-off under nonstationarity and finite resources (Tran et al., 28 Dec 2025). The same paper introduces benchmark families—Temporal Recall, Concept Drift, and Associative Memory—but also notes, in effect, that the forgetting-specific empirical case is limited by mismatches in the reported experiments.
A third line uses explicit uncertainty-carrying belief states. In "The Silent Scholar Problem" (Chong et al., 24 Dec 2025), each proposition 6 is tracked by a Beta posterior with discounted pseudo-counts
7
so that
8
The effective sample size satisfies
9
with equilibrium
0
The paper argues that this prevents asymptotic collapse of epistemic uncertainty and creates a “homeostatic motive” for external interaction: old evidence loses force, uncertainty re-emerges, and agents have a standing incentive to seek fresh feedback (Chong et al., 24 Dec 2025). A plausible implication is that epistemic forgetting can be engineered not only as loss but as a control mechanism for continual belief maintenance.
3. Discriminatory capacity, downskilling, and framework selection
Another major tradition models epistemic forgetting as loss of discriminatory or inferential competence rather than weakening of stored content. "Epistemic Skills: Logical Dynamics of Knowing and Forgetting" introduces weighted models 1, where 2 is a skill set attached to each world-pair and 3 is the capability set of agent 4. Individual knowledge is defined by
5
so skills determine which worlds an agent can distinguish. Forgetting is then formalized as downskilling:
6
where 7 (Liang et al., 2024). The underlying ontology is explicit: forgetting is not deletion of facts or alteration of valuation 8, but reduction of discriminatory capacity. Knowledge can be lost because more worlds become epistemically accessible once skills are removed. Group modalities 9, 0, 1, and 2 extend this to mutual, common, distributed, and field knowledge, so forgetting can propagate into social epistemic structure without being primitive group-forgetting.
A closely related but architecturally distinct notion appears in "Universe Routing: Why Self-Evolving Agents Need Epistemic Control" (Wang, 16 Mar 2026). There, a “belief space universe” is defined as a tuple 3 of axioms, inference procedure, and solver, and universes are epistemically incompatible when one contains assumptions equivalent to the negation of the other. The router solves
4
over 5 universes, including STAT_FREQ, STAT_BAYES, PHYS_CLASSICAL, PHYS_QUANTUM, PHYS_RELATIVITY, STAT_MIXED, and STAT_ILL_POSED. In this setting, epistemic forgetting is not loss of factual content but collapse of previously learned universe boundaries. The consequence is “wrong in kind”: the system invokes the wrong epistemology rather than merely producing a noisier answer. Empirically, hard routing and soft routing both achieve 6 accuracy, but hard routing takes 7ms versus 8ms; in continual learning from 5 to 7 universes, Naive Fine-tuning yields 9 old-universe accuracy and 0 forgetting, EWC yields 1 and 2, while Rehearsal (10\%) reaches 3 old-universe accuracy and 4 forgetting (Wang, 16 Mar 2026). The paper’s interpretation is that epistemic forgetting here is forgetting how to reason—specifically, forgetting which incompatible reasoning framework a query belongs to.
Taken together, these models shift the object of forgetting from propositions to capacities. This suggests that epistemic forgetting may consist in losing the resources that keep alternatives apart: skill sets in logical models, or decision boundaries between incompatible inferential spaces in modular agents.
4. Formal operators on epistemic states, Kripke models, and compiled languages
A substantial formal literature studies epistemic forgetting as an operation on explicit epistemic structures. In knowledge-structure semantics, a model is
5
with background theory 6 and observable variables 7 for each agent. Agent 8’s knowledge is truth across all states agreeing on 9, and forgetting appears as elimination of unobservable variables. The key result is that, when 0,
1
so knowledge is characterized by the weakest sufficient condition of 2 over 3; common knowledge is characterized by a generalized weakest sufficient condition expressed by a greatest fixed point (Su et al., 2014). Here forgetting is not a dynamic event but the computational core of observability-based epistemic reasoning.
At the level of epistemic states with richer semantics, "Forgetting Formulas and Signature Elements in Epistemic States" shows that marginalisation is the correct extension of Delgrande-style forgetting of signature elements to ordinal conditional functions. For 4,
5
and the induced beliefs satisfy
6
The same paper proves a sharp negative result: extending analogous postulates to forgetting arbitrary formulas in epistemic states forces triviality, so that 7 for each 8 (Becker et al., 2021). In this sense, variable/signature forgetting and formula forgetting have fundamentally different rationality profiles.
Dynamic-epistemic treatments of forgetting whether a complex proposition use more interventionist model transformations. "Forgetting complex propositions" defines a modality
9
for forgetting whether 0, based on the prime implicate clausal forms 1 and 2. A model transformation 3 creates clause-falsifying copies of the original model, and
4
holds iff 5 holds after every minimal way of falsifying one clause in 6 and one clause in 7 (Fernández-Duque et al., 2015). Because different minimal choices can yield non-bisimilar outcomes, forgetting whether a complex formula is inherently non-unique. The same paper represents the construction in action model logic and gives a sound and complete axiomatization.
Compiled representations provide a different route to tractable forgetting. In multi-agent epistemic logic, forgetting is defined as variable elimination:
8
the strongest consequence of 9 over the reduced variable set 0. The key structural condition is logical separability, which enables modular forgetting on separable terms:
1
The compiled normal form SDNF supports tractable forgetting provided the base propositional language supports 2 or 3 (Fang et al., 2018). This is an algorithmic rather than ontological contribution: epistemic forgetting becomes feasible because epistemic formulas are compiled into a separability-preserving language.
Belief-contraction work in dynamic epistemic logic models forgetting-like uncertainty increase directly on Kripke models. For contraction on 4,
5
The dynamic clause is
6
This models belief loss by re-opening 7-possibilities, and generalized event models add a second relation 8 to represent newly introduced event possibilities (Belardinelli et al., 30 Jun 2026). The operation is not variable forgetting or forgetting whether, but it is a direct formalization of epistemic loosening.
5. Continual learning, modular memory, and machine-learning implementations
In neural continual learning, epistemic forgetting often appears as controlled release of certainty rather than overwrite. "Bayesian continual learning and forgetting in neural networks" introduces MESU, which replaces full sequential Bayes with a truncated posterior over only the last 9 tasks and derives a learning–forgetting factorization in which forgetting appears as an inverse-likelihood term for the oldest retained data (Bonnet et al., 18 Apr 2025). The approximate posterior is mean-field Gaussian,
0
so forgetting acts by pulling means and variances back toward the prior, preventing vanishing uncertainty and “catastrophic remembering.” On 200 sequential permuted MNIST tasks, MESU slightly outperforms EWC Online and SI on tasks inside its memory window—1 versus 2 and 3—while FOO-VB Diagonal shows catastrophic remembering, with new-task accuracy saturating around 4. In a long-training experiment on MNIST, MESU maintains nonzero mean 5 and ROC AUC for OOD detection stays near 6 (Bonnet et al., 18 Apr 2025). The paper’s conceptual claim is that epistemic forgetting here is uncertainty-mediated selective de-consolidation.
The broader machine-learning survey literature systematizes this design space. Selective forgetting is divided into active forgetting, intended to improve performance, and passive forgetting, driven mainly by privacy, security, or usability. Exact forgetting requires that “the model state replicate the state it would have in the complete absence of the forgotten data,” whereas approximate forgetting weakens that requirement to practical attenuation. The same survey treats forgetting as support for generalization, overfitting mitigation, compression, and privacy preservation, and notes that “learning and forgetting should be considered different aspects of a cognitive process of belief updating” (Sha et al., 2024). In attention and long-context models, forgetting may take the form of bounded retention, as in Expire-span, where each memory 7 is assigned an expire-span 8 determining how long it remains accessible.
These implementations differ sharply in mechanism—uncertainty release, replay-preserved modularity, recency weighting, memory expiration—but converge on a common principle: epistemic forgetting is often engineered to regulate interference, preserve plasticity, or remove obsolete influence without requiring complete erasure of representational content.
6. Governance, unlearning, and epistemic justice
The governance literature insists that epistemic forgetting cannot be reduced to a single technical primitive. Data systems are described as “infrastructures of memory,” and forgetting is said to operate through erasure, unlearning, exclusion, semantic dependencies, and access-limiting arrangements that alter what systems, institutions, and publics can know (Makovska et al., 24 Feb 2026). On this view, deleting records from storage does not remove their influence on trained models, and unlearning is therefore only one component of responsible forgetting. The normative proposal is that unlearning become a first-class capability in knowledge infrastructures and be evaluated not only by compliance or utility retention, but also by transparency, accountability, and epistemic justice. The same work emphasizes the dual character of forgetting: it can protect rights and reduce harm, but it can also enable silencing, remove evidence, and reproduce epistemic injustice by erasing underrepresented perspectives.
Survey work on machine forgetting aligns with this normative turn by connecting unlearning to GDPR and CCPA, by treating completeness as the requirement that forgotten data leave “no residual trace,” and by emphasizing data lineage management as a way to track how evidence enters model knowledge and how its removal should propagate (Sha et al., 2024). Exact versus approximate forgetting is therefore not only a technical distinction but also a governance distinction: exact forgetting approximates counterfactual non-acquisition, while approximate forgetting manages residual influence pragmatically.
A broader implication follows from the contrast between protective and harmful forgetting. Some recent work explicitly argues that forgetting is “not an exception to knowledge, but its condition” (Makovska et al., 24 Feb 2026). This suggests that epistemic forgetting is constitutive of knowledge systems: they must decide what becomes unavailable, what remains actionable, and whose traces continue to count as evidence. In computational settings, that decision is simultaneously technical, epistemic, and political.