Memory Distortion in Cognitive and AI Systems
- Memory distortion is a phenomenon characterized by systematic deviations between actual events and remembered details due to constraints like finite memory and interference.
- It spans multiple fields—from cognitive experiments on false recollection to algorithmic studies in AI and information theory—highlighting varied impacts on decision quality and representation.
- Applications include optimizing caching systems, improving agent memory design, and understanding biases in human memory, offering actionable insights into compression and fidelity trade-offs.
Memory distortion denotes a family of phenomena in which remembered, represented, or reconstructed information departs systematically from an objective baseline because of finite memory, post-event inputs, causal encoding constraints, or memory-dependent fidelity criteria. In recent literature, the term spans false recollection induced by AI-edited media, similarity-induced bias in visual working memory, decision-quality loss caused by compressing histories into a bounded set of runtime states, and information-theoretic trade-offs in which memory resources alter achievable distortion, subjective time, or reward valuation (Pataranutaporn et al., 2024, Cao et al., 14 Jul 2025, Zou et al., 11 May 2026, Ortega et al., 2016, Abin et al., 29 Jan 2026). This suggests that the unifying issue is not simply inaccuracy, but which distinctions a system preserves, merges, or reweights under constraint.
1. Conceptual scope across cognitive science, AI, and information theory
The modern literature uses “memory distortion” in at least four technically distinct senses. In human-memory experiments, it refers to systematic deviation between what is recalled and what actually occurred or was originally experienced. In agent-memory research, it denotes the loss in achievable decision quality induced by compressing many histories into a few reusable runtime states. In communications and caching, it refers to fidelity loss—typically squared-error distortion—under explicit memory budgets. In rate–distortion theory with memory, it denotes settings in which distortion depends on past reproductions, so the fidelity criterion itself has memory.
| Domain | Memory object | Distortion object |
|---|---|---|
| Human recollection | episodic record of an original image or event | false recollection, misattribution, suggestibility |
| Subjective time and choice | predictive dependencies between past and future sensorimotor interactions | renormalized subjective time axis and reward discounting |
| Agent memory | reusable runtime states | loss in achievable decision quality |
| Communications and caching | cache memory, causal state, or past reproductions | MSE or memory-dependent distortion |
Despite their heterogeneity, these formulations share a structural theme: memory is not a passive archive but a constrained representational resource. In one class of models, the constraint is biological or cognitive; in another, it is algorithmic; in another, it is a formal budget in bits, states, or channel rate. A plausible implication is that “memory distortion” is best understood as a systems-level phenomenon in which compression, interference, and causal structure determine what information remains operationally available.
2. Coding-efficient memory, subjective time, and intertemporal valuation
A particularly influential formalization treats memory distortion as a consequence of coding efficiency in sensorimotor representation. In this framework, agent–environment interaction is a stochastic process generating action–observation sequences, and the agent maintains a minimal sufficient statistic , the “present,” containing precisely the information in the past that helps predict the future (Ortega et al., 2016). The central quantity is predictive information,
which measures the minimal bits of memory linking past to future.
Within this account, subjective duration is not identified with clock time but with the amount of re-encoding required when new interaction data change the present. The pointwise “present” is
and the perceived duration of a new interaction is
Events that strongly constrain future behavior therefore require more bits to encode and are perceived as longer, whereas predictable or behaviorally irrelevant interactions produce little change in and feel short.
The same framework defines subjective time over a window of physical time as cumulative predictive information,
Different probabilistic model classes induce different growth laws. For a finite model, 0; for a parametric model, 1; for a nonparametric model, 2 with 3. All are sublinear in physical time, so the subjective time axis is renormalized: early, information-rich periods dilate, whereas later periods compress as predictive dependencies saturate.
Valuation is coupled to the same information constraint through a free-energy control objective,
4
Its optimizer is a Gibbs posterior over futures, and the resulting change in choice probability is proportional to “rejoice” or negative regret. Because predictive information grows differently across model classes, discounting laws differ as well: finite models induce linear decay to zero, parametric models induce exponential discounting in subjective time, and nonparametric models induce hyperbolic discounting. Mapping subjective time back to physical time can transform exponential discounting in 5 into hyperbolic discounting in 6. The framework therefore unifies temporal distortion and intertemporal preference by a single coding-efficiency principle: interactions that most constrain future behavior feel longer and are assigned greater current value.
3. Decision-centric memory distortion in bounded agents
A more recent formulation relocates memory distortion from perceptual timing to bounded decision-making. Histories 7, queries 8, actions 9, and reward means 0 define a setting in which the full-history oracle value is 1, while the answer-time memory state is a discrete variable 2 produced by a query-aware encoder 3 (Zou et al., 11 May 2026). Distortion is explicitly decision-level: 4 Memory is valuable not because it reconstructs the past, but because it preserves the distinctions between histories that must remain separate under a fixed budget to support good decisions.
This perspective yields an exact forgetting boundary. For a fixed query 5, tolerance 6, and nonempty set 7, safe merging is equivalent to the existence of a single action 8 with 9 for all 0. Equivalently, a one-state encoder and deterministic decision rule can achieve worst-case distortion at most 1 on 2 if and only if the histories in 3 share a common 4-optimal action. Descriptive similarity is therefore neither necessary nor sufficient for safe forgetting. This is sharpened by the cluster decision radius
5
and the pairwise decision distance
6
The budgeted trade-off is summarized by the worst-case frontier
7
with corresponding covering and packing numbers 8 and 9. Any stochastic memory supporting worst-case distortion at most 0 must satisfy
1
where 2 is uniform over a maximum packing. The paper also states that deciding whether 3 is NP-complete, which rules out exact global optimization in the deterministic 4-slot setting.
The resulting algorithm, DeMem, implements conservative online refinement. It maintains counts 5, empirical means 6, confidence radii
7
one-sided lower bounds on pairwise decision distance, and cluster-radius certificates. It builds a cannot-link graph over observed contexts, performs binary search over conflict thresholds, and uses greedy degeneracy coloring to produce a feasible 8-way partition; per-epoch time is 9. With probability at least 0,
1
while the minimax lower bound is
2
Empirically, DeMem attained the best overall LoCoMo accuracy on both backbones, with 3 for GPT-4o-mini and 4 for GPT-4.1-mini; descriptive retrieval recalled approximately 5–6 of gold evidence under matched budget, whereas DeMem reached 7, compared to an oracle at 8. In this literature, memory distortion is the irreducible decision loss created by compressing histories more aggressively than the action structure permits.
4. Causal rate–distortion and distortion functions with memory
In information theory, memory distortion arises in two related but distinct ways. One concerns sources and channels that have memory, so realizable coding must be causal. The other concerns fidelity criteria that themselves depend on past reconstructions. Both settings depart from the classical memoryless rate–distortion paradigm (Kourtellaris et al., 2013, Kourtellaris et al., 2013, Abin et al., 29 Jan 2026).
For sources with memory, the key object is the nonanticipative reproduction distribution
9
which enforces that reproduction at time 0 depends only on current and past source symbols and past reproductions. The associated nonanticipative rate–distortion function is
1
where directed information replaces the classical mutual-information objective. The causal formulation is equivalent to Gorbunov–Pinsker nonanticipatory 2-entropy, and under stationarity admits an exponential-tilt Gibbs form for the optimal kernel. Achievability of symbol-by-symbol coding with memory without anticipation follows when the optimal causal reproduction is realizable by an encoder–channel–decoder cascade and the matching condition 3 holds.
The case study of a Binary Symmetric Markov Source 4 under Hamming distortion over a Binary State Symmetric Channel yields exact matching. For 5,
6
with 7, 8, and 9. Setting the channel parameters 0, 1, and cost 2 makes channel capacity equal to 3. Under that alignment, the identity mapping 4 and 5 is optimal, and the matched symbol-by-symbol scheme achieves average distortion 6. The papers also provide Hoeffding-type bounds for Markov chains showing exponential decay of excess distortion probability.
A different generalization places memory not in the source but in the distortion measure. “Subjective distortion” defines the per-block average distortion as
7
with fixed initial symbol 8. The source is i.i.d., but the instantaneous fidelity cost depends on the current source symbol, the current representation, and the previous representation. This yields a multi-letter noncausal characterization via Han’s information-spectrum theorem and single-letter bounds. The Markov-kernel inner bound uses a stationary kernel 9 and achieves
0
while the simpler memoryless-kernel bound is
1
Outer bounds are obtained through an independent-copy replacement and a relaxation to 2 subject to the same average distortion. When 3 reduces to a memoryless distortion 4, the upper and lower bounds coincide with the classical rate–distortion function. These results show that distortion may inherit memory either from the source-channel architecture or from the fidelity criterion itself.
5. Cache memory, effective rate, and reconstruction distortion
In caching and wireless video delivery, memory distortion has an explicitly engineering meaning: finite cache memory and finite delivery rate together determine the reconstruction distortion at the receiver. The common Gaussian source model treats each file 5 as successively refinable under squared-error distortion, with file-specific distortion–rate function
6
so every additional bit per sample in effective rate reduces MSE exponentially (Hassanzadeh et al., 2019, Hassanzadeh et al., 2015).
The central quantity is effective rate. In Local Cache-aided Unicast (LC-U), the effective rate seen by user 7 for file 8 is 9, where 0 is cache memory devoted to the file and 1 is delivered unicast refinement. Placement solves the convex reverse-water-filling problem
2
with solution
3
Delivery for a realized demand 4 is another reverse-water-filling problem across users,
5
Cooperative Cache-aided Coded Multicast replaces pure unicast refinement with a split 6, where 7 is the coded multicast portion and 8 is residual uncoded enhancement. The storing range
9
specifies the cumulative rate guaranteed by coded multicast for file 00 to user 01, and the packet caching probability is
02
The paper specializes coded delivery to RF-GCC, obtains closed-form upper bounds 03 and 04, and uses these bounds to optimize memory allocation and storing ranges under heterogeneous cache sizes, popularity distributions, and file variances.
This framework formalizes a distortion–rate–memory region. A tuple 05 is achievable if 06 and 07, with optimal distortion–rate–memory function
08
The key mechanism is additive in rate but exponential in distortion: cache memory contributes linearly to effective rate, whereas distortion decays as 09. Coded multicast improves the aggregate effective rate delivered under the same broadcast budget and thereby lowers expected distortion significantly beyond unicast baselines.
The numerical consequences are substantial. In the heterogeneous case with Zipf 10, 11, 12, and 13, CC-CM reduces expected distortion by approximately 14 versus LC-U at 15 and 16, and by approximately 17 at 18 and 19. In the uniform case with 20 and 21, the reduction is approximately 22 at 23 and 24, reaching approximately 25 at 26. In this literature, “memory distortion” is not mnemonic error but the fidelity penalty or improvement produced by explicit memory-rate allocation.
6. False recollection from AI-edited images and videos
In experimental human-memory research, memory distortion retains its classical sense: any systematic deviation between what is recalled and what actually occurred or was originally experienced. A recent pre-registered study operationalized a false memory as an incorrect answer to a masked-detail question about an original image after exposure to AI-altered material (Pataranutaporn et al., 2024). The paradigm strongly implicates source misattribution, because participants first saw original images and later saw edited images or generated videos before being asked about the originals.
The study recruited 27 U.S.-based adults, randomized 28 per condition, with gender balanced 29 female:male and age 30–31 (32, 33). Participants viewed 34 original images for two minutes, completed a two-minute Pac-Man filler, and were then exposed to one of four conditions: unedited images, AI-edited images, AI-generated videos of unedited images, or AI-generated videos of AI-edited images. Adobe Photoshop AI was used to modify 35 of the 36 images, and Luma’s Dream Machine generated 37-second videos. All altered stimuli were labeled “AI-enhanced image.”
The primary outcome was false memories over the 38 targeted items. Mean false-memory rates were 39 in the control condition, 40 for AI-generated videos of unedited images, 41 for AI-edited images, and 42 for AI-generated videos of AI-edited images. Shapiro–Wilk indicated non-normality, and a one-way Kruskal–Wallis test yielded 43, 44. Dunn post hoc tests with FDR correction showed significant differences for control versus AI-edited images (45), control versus AI-generated videos of AI-edited images (46), and AI-generated videos of unedited images versus AI-generated videos of AI-edited images (47). Relative to control, AI-edited images increased false recollections by 48, AI-generated videos of unedited images by 49, and AI-generated videos of AI-edited images by 50.
Correct memory declined correspondingly. Mean non-false memory rates were 51 in control, 52 for AI-generated videos of unedited images, 53 for AI-edited images, and 54 for AI-generated videos of AI-edited images. Confidence in false memories also increased: mean confidence on a 55–56 scale was 57 in control, 58 for AI-edited images, and 59 for AI-generated videos of AI-edited images, with Kruskal–Wallis 60, 61. The weighted score combining accuracy and certainty dropped sharply from 62 in control to 63 in the video-of-edited condition; one-way ANOVA gave 64, 65, with partial 66. Among measured moderators, age had a small negative coefficient, 67, 68, 69, 70, implying slightly lower odds of false memories with increasing age.
The proposed mechanisms are familiar from the misinformation literature but updated for generative media. The paper identifies perceptual realism and fluency, source monitoring errors, gist strengthening under Fuzzy-trace theory, imagination inflation, and the misinformation effect as plausible drivers. Passive labels were not sufficient to prevent distortion: despite “AI-enhanced” disclosure, false memories and confidence rose. The strongest distortions were observed for “AI-generated videos of AI-edited images,” especially for people and environmental edits. The study therefore places memory distortion at the intersection of synthetic media, HCI, and eyewitness reliability, with direct implications for provenance tracking, interface warnings, and evidentiary standards.
7. Similarity-induced distortion in visual working memory
A separate experimental tradition studies distortion of visual working memory during retention. Here, memory distortion is a retroactive change in the stored representation of a target item induced by intervening perceptual input and tasks, operationalized as a shift in the reported item on a circular stimulus wheel away from the original target and toward the compared item (Cao et al., 14 Jul 2025). The paper uses the term similarity-induced memory bias (SIMB) for this attraction-like effect and distinguishes it from slow drift, generic interference, and categorical bias.
The experiments introduce an AI-driven framework for generating naturalistic object stimuli from behavior-based dimensions. Forty-two dimensions were categorized as visual, semantic, and mixed. “Image wheels” were formed by smoothly editing the activation of two selected object dimensions in the latent space of a generative model while preserving base-image identity and appearance; “dimension wheels” were generated directly from dimension activation values without requiring visual similarity to the base image. The underlying controllable generation framework adopts a two-stage strategy, first modeling 71 and then 72, where 73 denotes conditioning parameters, 74 CLIP embeddings, and 75 the generated image. The wheel construction uses dimensional guidance,
76
smoothness guidance,
77
and, for image wheels, CLIP guidance,
78
The behavioral paradigm used set size 79. The memory item was shown for 80 ms, followed by a 81 ms retention interval, two same–different similarity judgments during retention, a 82 ms delay, and then wheel-based report. The Image Wheels Induction Experiment involved 83 participants and 84 trials per participant, comprising 85 baseline trials and 86 induction trials. The Dimension Wheels Induction Experiment involved 87 participants with matched procedure and trial counts. Low-confidence trials were excluded, baseline accuracy below 88 led to participant exclusion, and induction trials were counted as valid only if the participant selected the induction item in both similarity judgments.
The principal metric was the bias score, printed as
89
that is, the unsigned angular deviation between reported and target wheel positions. The main result is that perceptual comparison increased memory distortion relative to baseline in both experiments. Across wheel types, image wheels produced larger distortions than dimension wheels, with mean accuracy 90 and mean bias 91 for image wheels, versus accuracy 92 and mean bias 93 for dimension wheels. This indicates that holistic visual similarity is a strong driver of distortion, but dimension-level similarity alone is sufficient.
Dimension category further modulated vulnerability. In the Image Wheels Induction Experiment, visual dimensions yielded accuracy 94 and bias 95, whereas semantic dimensions yielded accuracy 96 and bias 97. In the Dimension Wheels Induction Experiment, visual dimensions yielded accuracy 98 and bias 99, whereas semantic dimensions yielded accuracy 00 and bias 01. Mixed dimensions occupied intermediate positions, and mixed+semantic distortion dropped to 02 in the dimension-wheel condition. The paper reports no inferential statistics, confidence intervals, or mixture-model fits, but the descriptive pattern is consistent: visual dimensions are more prone to comparison-induced distortion than semantic dimensions.
The proposed mechanism is representational overlap. Comparing a stored target to a similar input engages overlapping feature codes and increases the weight of shared features, thereby biasing the stored representation toward the inducer. Semantic organization may stabilize memory through schema-based priors and deeper processing, reducing vulnerability. In this account, memory distortion is neither random error nor mere overload; it is a structured displacement along behaviorally meaningful similarity dimensions.