Papers
Topics
Authors
Recent
Search
2000 character limit reached

Epistemic Forgetting

Updated 9 July 2026
  • Epistemic Forgetting is the process by which knowledge-bearing systems lose retrievability and discriminative capacity through mechanisms such as erasure, unlearning, and downskilling.
  • It is modeled through techniques like retrieval geometry, discounted Bayesian updating, and uncertainty management to quantify dynamics comparable to human memory decay.
  • The concept also spans normative dimensions, connecting controlled unlearning and exclusion to governance, accountability, and epistemic justice in data systems.

Epistemic forgetting denotes processes through which a knowledge-bearing system loses usable access to information, weakens the force of prior evidence, or ceases to preserve the distinctions that made a proposition, variable, skill, or reasoning framework action-guiding. Recent work treats it not as a single operation but as a heterogeneous family: loss of retrievability and discriminability in semantic spaces, discounted evidential force in sequential inference, downskilling in logical models, collapse of framework-selection boundaries in modular agents, and state-transforming operations such as contraction, ignoration, revocation, marginalization, and conditionalization on epistemic states (Barman et al., 27 Mar 2026, Tran et al., 28 Dec 2025, Liang et al., 2024, Wang, 16 Mar 2026, Beierle et al., 29 Aug 2025). This suggests that epistemic forgetting is best understood as a structural transformation of what can be known, retrieved, inferred, or responsibly acted upon, rather than as mere deletion.

1. Conceptual scope and principal distinctions

A central recent clarification treats forgetting as “an umbrella term for sociotechnical processes through which something becomes unavailable, varying in agency (intentional vs. incidental), temporality (momentary vs. durable), reversibility (recoverable vs. irreversible), and scale (individual records vs. population-level).” Within that umbrella, erasure is “an operational act that removes or disables access to data artifacts,” unlearning is “an intentional technical intervention aimed at removing (or bounding) the influence of specific data on learned parameters and downstream outputs,” and exclusion is “upstream decisions not to collect, label, or include certain people, events, or categories in datasets” (Makovska et al., 24 Feb 2026). In parallel, a general framework of epistemic forgetting on epistemic states distinguishes five abstract types: contraction (ΨA⊭A\Psi^\circ_A \not\models A), ignoration (ΨA⊭A\Psi^\circ_A \not\models A and ΨA⊭A\Psi^\circ_A \not\models \overline A), revocation (ΨAA\Psi^\circ_A \models \overline A), marginalization (ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}), and conditionalization (ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A) (Beierle et al., 29 Aug 2025).

Machine-learning work introduces a further operational distinction between selective forgetting, treated as beneficial and intentional, and catastrophic forgetting, treated as harmful loss of previously learned information. The survey literature organizes selective forgetting by content of forgetting (item-, feature-, class-, task-, and stream-level), recoverability of forgetting (irrecoverable versus recoverable, including ephemeral, inhibitory, and gradient forgetting), and extent of forgetting (exact versus approximate) (Sha et al., 2024). Exact forgetting is defined counterfactually: the post-forgetting model should behave like a model never trained on the removed data. Approximate forgetting weakens that requirement to practical attenuation of influence.

At the representational level, some work defines epistemic forgetting not as deletion of stored content but as loss of access. In "The Geometry of Forgetting" (Barman et al., 27 Mar 2026), forgetting is explicitly framed as loss of retrievability and discriminability within a meaning-structured space: what is “forgotten” is often not erased from storage, but becomes inaccessible, outcompeted, or confusable with nearby alternatives. This yields a broad conceptual convergence: epistemic forgetting often concerns the transformation of availability, not simply the destruction of traces.

2. Retrieval geometry, evidence decay, and uncertainty management

One influential line models forgetting as a property of retrieval geometry. In the geometric account, each memory item is stored as an embedding vector produced by a frozen pre-trained encoder, optionally concatenated with contextual information and projected through a trained linear layer with LayerNorm. Retrieval is similarity-based, with score

score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},

with ψ=0.5\psi = 0.5, and forgetting is measured as decline in retrieval accuracy as a function of age and competitor load (Barman et al., 27 Mar 2026). The paper’s core comparative result is that temporal decay alone and no competitors yields a fitted forgetting exponent b0.009b \approx 0.009, whereas adding 10,00010{,}000 distractors with the same temporal decay function yields ΨA⊭A\Psi^\circ_A \not\models A0, with 95% CI ΨA⊭A\Psi^\circ_A \not\models A1 and ΨA⊭A\Psi^\circ_A \not\models A2, close to the human benchmark ΨA⊭A\Psi^\circ_A \not\models A3. The same work reports that production embedding models with nominal dimensions ΨA⊭A\Psi^\circ_A \not\models A4, ΨA⊭A\Psi^\circ_A \not\models A5, and ΨA⊭A\Psi^\circ_A \not\models A6 have participation-ratio effective dimensionalities ΨA⊭A\Psi^\circ_A \not\models A7, ΨA⊭A\Psi^\circ_A \not\models A8, and ΨA⊭A\Psi^\circ_A \not\models A9, respectively, implying that interference is governed by effective rather than advertised dimensionality. False memory appears as the complementary effect: with BGE-large on the 24 standard DRM lists, the critical-lure false alarm rate is ΨA⊭A\Psi^\circ_A \not\models \overline A0 at threshold ΨA⊭A\Psi^\circ_A \not\models \overline A1, compared with a human rate of approximately ΨA⊭A\Psi^\circ_A \not\models \overline A2, and the threshold was chosen because it yields zero unrelated false alarms (Barman et al., 27 Mar 2026). In this picture, forgetting and distortion are coupled consequences of proximity-based retrieval in crowded semantic neighborhoods.

A second line treats forgetting as discounted evidence integration. "Forgetting as a Feature: Cognitive Alignment of LLMs" formalizes epistemic forgetting as discounted Bayesian updating,

ΨA⊭A\Psi^\circ_A \not\models \overline A3

with ΨA⊭A\Psi^\circ_A \not\models \overline A4, and operationalizes prompting-time forgetting by exponential recency weights

ΨA⊭A\Psi^\circ_A \not\models \overline A5

The stated interpretation is that forgetting is not discrete deletion but attenuation of prior evidential force, supporting a stability–plasticity trade-off under nonstationarity and finite resources (Tran et al., 28 Dec 2025). The same paper introduces benchmark families—Temporal Recall, Concept Drift, and Associative Memory—but also notes, in effect, that the forgetting-specific empirical case is limited by mismatches in the reported experiments.

A third line uses explicit uncertainty-carrying belief states. In "The Silent Scholar Problem" (Chong et al., 24 Dec 2025), each proposition ΨA⊭A\Psi^\circ_A \not\models \overline A6 is tracked by a Beta posterior with discounted pseudo-counts

ΨA⊭A\Psi^\circ_A \not\models \overline A7

so that

ΨA⊭A\Psi^\circ_A \not\models \overline A8

The effective sample size satisfies

ΨA⊭A\Psi^\circ_A \not\models \overline A9

with equilibrium

ΨAA\Psi^\circ_A \models \overline A0

The paper argues that this prevents asymptotic collapse of epistemic uncertainty and creates a “homeostatic motive” for external interaction: old evidence loses force, uncertainty re-emerges, and agents have a standing incentive to seek fresh feedback (Chong et al., 24 Dec 2025). A plausible implication is that epistemic forgetting can be engineered not only as loss but as a control mechanism for continual belief maintenance.

3. Discriminatory capacity, downskilling, and framework selection

Another major tradition models epistemic forgetting as loss of discriminatory or inferential competence rather than weakening of stored content. "Epistemic Skills: Logical Dynamics of Knowing and Forgetting" introduces weighted models ΨAA\Psi^\circ_A \models \overline A1, where ΨAA\Psi^\circ_A \models \overline A2 is a skill set attached to each world-pair and ΨAA\Psi^\circ_A \models \overline A3 is the capability set of agent ΨAA\Psi^\circ_A \models \overline A4. Individual knowledge is defined by

ΨAA\Psi^\circ_A \models \overline A5

so skills determine which worlds an agent can distinguish. Forgetting is then formalized as downskilling:

ΨAA\Psi^\circ_A \models \overline A6

where ΨAA\Psi^\circ_A \models \overline A7 (Liang et al., 2024). The underlying ontology is explicit: forgetting is not deletion of facts or alteration of valuation ΨAA\Psi^\circ_A \models \overline A8, but reduction of discriminatory capacity. Knowledge can be lost because more worlds become epistemically accessible once skills are removed. Group modalities ΨAA\Psi^\circ_A \models \overline A9, ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}0, ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}1, and ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}2 extend this to mutual, common, distributed, and field knowledge, so forgetting can propagate into social epistemic structure without being primitive group-forgetting.

A closely related but architecturally distinct notion appears in "Universe Routing: Why Self-Evolving Agents Need Epistemic Control" (Wang, 16 Mar 2026). There, a “belief space universe” is defined as a tuple ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}3 of axioms, inference procedure, and solver, and universes are epistemically incompatible when one contains assumptions equivalent to the negation of the other. The router solves

ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}4

over ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}5 universes, including STAT_FREQ, STAT_BAYES, PHYS_CLASSICAL, PHYS_QUANTUM, PHYS_RELATIVITY, STAT_MIXED, and STAT_ILL_POSED. In this setting, epistemic forgetting is not loss of factual content but collapse of previously learned universe boundaries. The consequence is “wrong in kind”: the system invokes the wrong epistemology rather than merely producing a noisier answer. Empirically, hard routing and soft routing both achieve ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}6 accuracy, but hard routing takes ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}7ms versus ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}8ms; in continual learning from 5 to 7 universes, Naive Fine-tuning yields ΨA=ΨΣΣA\Psi^\circ_A=\Psi_{\Sigma\setminus \Sigma_A}9 old-universe accuracy and ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A0 forgetting, EWC yields ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A1 and ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A2, while Rehearsal (10\%) reaches ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A3 old-universe accuracy and ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A4 forgetting (Wang, 16 Mar 2026). The paper’s interpretation is that epistemic forgetting here is forgetting how to reason—specifically, forgetting which incompatible reasoning framework a query belongs to.

Taken together, these models shift the object of forgetting from propositions to capacities. This suggests that epistemic forgetting may consist in losing the resources that keep alternatives apart: skill sets in logical models, or decision boundaries between incompatible inferential spaces in modular agents.

4. Formal operators on epistemic states, Kripke models, and compiled languages

A substantial formal literature studies epistemic forgetting as an operation on explicit epistemic structures. In knowledge-structure semantics, a model is

ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A5

with background theory ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A6 and observable variables ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A7 for each agent. Agent ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A8’s knowledge is truth across all states agreeing on ΨA=ΨA\Psi^\circ_A=\Psi\mid \overline A9, and forgetting appears as elimination of unobservable variables. The key result is that, when score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},0,

score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},1

so knowledge is characterized by the weakest sufficient condition of score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},2 over score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},3; common knowledge is characterized by a generalized weakest sufficient condition expressed by a greatest fixed point (Su et al., 2014). Here forgetting is not a dynamic event but the computational core of observability-based epistemic reasoning.

At the level of epistemic states with richer semantics, "Forgetting Formulas and Signature Elements in Epistemic States" shows that marginalisation is the correct extension of Delgrande-style forgetting of signature elements to ordinal conditional functions. For score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},4,

score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},5

and the induced beliefs satisfy

score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},6

The same paper proves a sharp negative result: extending analogous postulates to forgetting arbitrary formulas in epistemic states forces triviality, so that score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},7 for each score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},8 (Becker et al., 2021). In this sense, variable/signature forgetting and formula forgetting have fundamentally different rationality profiles.

Dynamic-epistemic treatments of forgetting whether a complex proposition use more interventionist model transformations. "Forgetting complex propositions" defines a modality

score=cos(q,m)×(1+βt)ψ,\text{score} = \cos(\mathbf{q}, \mathbf{m}) \times (1 + \beta t)^{-\psi},9

for forgetting whether ψ=0.5\psi = 0.50, based on the prime implicate clausal forms ψ=0.5\psi = 0.51 and ψ=0.5\psi = 0.52. A model transformation ψ=0.5\psi = 0.53 creates clause-falsifying copies of the original model, and

ψ=0.5\psi = 0.54

holds iff ψ=0.5\psi = 0.55 holds after every minimal way of falsifying one clause in ψ=0.5\psi = 0.56 and one clause in ψ=0.5\psi = 0.57 (Fernández-Duque et al., 2015). Because different minimal choices can yield non-bisimilar outcomes, forgetting whether a complex formula is inherently non-unique. The same paper represents the construction in action model logic and gives a sound and complete axiomatization.

Compiled representations provide a different route to tractable forgetting. In multi-agent epistemic logic, forgetting is defined as variable elimination:

ψ=0.5\psi = 0.58

the strongest consequence of ψ=0.5\psi = 0.59 over the reduced variable set b0.009b \approx 0.0090. The key structural condition is logical separability, which enables modular forgetting on separable terms:

b0.009b \approx 0.0091

The compiled normal form SDNF supports tractable forgetting provided the base propositional language supports b0.009b \approx 0.0092 or b0.009b \approx 0.0093 (Fang et al., 2018). This is an algorithmic rather than ontological contribution: epistemic forgetting becomes feasible because epistemic formulas are compiled into a separability-preserving language.

Belief-contraction work in dynamic epistemic logic models forgetting-like uncertainty increase directly on Kripke models. For contraction on b0.009b \approx 0.0094,

b0.009b \approx 0.0095

The dynamic clause is

b0.009b \approx 0.0096

This models belief loss by re-opening b0.009b \approx 0.0097-possibilities, and generalized event models add a second relation b0.009b \approx 0.0098 to represent newly introduced event possibilities (Belardinelli et al., 30 Jun 2026). The operation is not variable forgetting or forgetting whether, but it is a direct formalization of epistemic loosening.

5. Continual learning, modular memory, and machine-learning implementations

In neural continual learning, epistemic forgetting often appears as controlled release of certainty rather than overwrite. "Bayesian continual learning and forgetting in neural networks" introduces MESU, which replaces full sequential Bayes with a truncated posterior over only the last b0.009b \approx 0.0099 tasks and derives a learning–forgetting factorization in which forgetting appears as an inverse-likelihood term for the oldest retained data (Bonnet et al., 18 Apr 2025). The approximate posterior is mean-field Gaussian,

10,00010{,}0000

so forgetting acts by pulling means and variances back toward the prior, preventing vanishing uncertainty and “catastrophic remembering.” On 200 sequential permuted MNIST tasks, MESU slightly outperforms EWC Online and SI on tasks inside its memory window—10,00010{,}0001 versus 10,00010{,}0002 and 10,00010{,}0003—while FOO-VB Diagonal shows catastrophic remembering, with new-task accuracy saturating around 10,00010{,}0004. In a long-training experiment on MNIST, MESU maintains nonzero mean 10,00010{,}0005 and ROC AUC for OOD detection stays near 10,00010{,}0006 (Bonnet et al., 18 Apr 2025). The paper’s conceptual claim is that epistemic forgetting here is uncertainty-mediated selective de-consolidation.

The broader machine-learning survey literature systematizes this design space. Selective forgetting is divided into active forgetting, intended to improve performance, and passive forgetting, driven mainly by privacy, security, or usability. Exact forgetting requires that “the model state replicate the state it would have in the complete absence of the forgotten data,” whereas approximate forgetting weakens that requirement to practical attenuation. The same survey treats forgetting as support for generalization, overfitting mitigation, compression, and privacy preservation, and notes that “learning and forgetting should be considered different aspects of a cognitive process of belief updating” (Sha et al., 2024). In attention and long-context models, forgetting may take the form of bounded retention, as in Expire-span, where each memory 10,00010{,}0007 is assigned an expire-span 10,00010{,}0008 determining how long it remains accessible.

These implementations differ sharply in mechanism—uncertainty release, replay-preserved modularity, recency weighting, memory expiration—but converge on a common principle: epistemic forgetting is often engineered to regulate interference, preserve plasticity, or remove obsolete influence without requiring complete erasure of representational content.

6. Governance, unlearning, and epistemic justice

The governance literature insists that epistemic forgetting cannot be reduced to a single technical primitive. Data systems are described as “infrastructures of memory,” and forgetting is said to operate through erasure, unlearning, exclusion, semantic dependencies, and access-limiting arrangements that alter what systems, institutions, and publics can know (Makovska et al., 24 Feb 2026). On this view, deleting records from storage does not remove their influence on trained models, and unlearning is therefore only one component of responsible forgetting. The normative proposal is that unlearning become a first-class capability in knowledge infrastructures and be evaluated not only by compliance or utility retention, but also by transparency, accountability, and epistemic justice. The same work emphasizes the dual character of forgetting: it can protect rights and reduce harm, but it can also enable silencing, remove evidence, and reproduce epistemic injustice by erasing underrepresented perspectives.

Survey work on machine forgetting aligns with this normative turn by connecting unlearning to GDPR and CCPA, by treating completeness as the requirement that forgotten data leave “no residual trace,” and by emphasizing data lineage management as a way to track how evidence enters model knowledge and how its removal should propagate (Sha et al., 2024). Exact versus approximate forgetting is therefore not only a technical distinction but also a governance distinction: exact forgetting approximates counterfactual non-acquisition, while approximate forgetting manages residual influence pragmatically.

A broader implication follows from the contrast between protective and harmful forgetting. Some recent work explicitly argues that forgetting is “not an exception to knowledge, but its condition” (Makovska et al., 24 Feb 2026). This suggests that epistemic forgetting is constitutive of knowledge systems: they must decide what becomes unavailable, what remains actionable, and whose traces continue to count as evidence. In computational settings, that decision is simultaneously technical, epistemic, and political.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Epistemic Forgetting.