---
title: Carousel Memory Across Domains
url: https://www.emergentmind.com/topics/carousel-memory
type: topic
---

# Carousel Memory Across Domains

Carousel memory is a domain-dependent term used to denote the retention and operational use of structured history in systems organized around carousel-like entities. In recommender systems, it refers to a serialized memory of cross-surface user interactions with carousels, items, and search events, operationalized as next-token prediction in a shared sequence model [2605.23702]. In click modeling, it denotes dependence on ordered panel, page, slot, topic, exposure, and click history in carousel interfaces [2506.18548]. In continual learning, it names a hierarchical episodic-memory design that rotates samples between RAM and storage to mitigate catastrophic forgetting [2110.07276]. In pulsar astrophysics, it refers to the persistence of a rotating spark-carousel pattern across emission heights and observing frequencies, recoverable through geometry-induced phase offsets in subpulse modulation [1812.01010]. These usages are technically unrelated, but each centers on retained structure that reappears in later inference, prediction, or measurement.

## 1. Terminological scope and common abstraction

The expression “carousel memory” does not designate a single canonical construct across the literature. Instead, it appears in multiple research areas with different objects of study, different mathematical formalisms, and different operational goals. In streaming discovery, the relevant object is the user’s cross-surface interaction history, serialized into a “user story” sequence containing attributes, sessions, watch events with surface and carousel context, and search events [2605.23702]. In interface modeling, the object is the ordered interaction history over vertically stacked horizontal lists, formalized through dependencies on topics $T$, displayed items $Y$, and prior clicks $C'$ [2506.18548]. In continual learning, the object is a replay buffer hierarchy spanning RAM and persistent storage, with asynchronous sample rotation [2110.07276]. In pulsar studies, the object is the rotating spark pattern on the polar cap, whose imprint is retained by plasma subbeams and re-sampled at different frequencies and heights [1812.01010].

A plausible unifying interpretation is that carousel memory always denotes persistence under structured re-exposure. What is retained differs by field: behavioral context in recommendation, exposure and click history in interface models, training examples in continual learning, and spark-pattern geometry in pulsar emission. The term “memory” is therefore not metaphorically uniform: in some cases it is an explicit data structure, in others a probabilistic conditioning set, a systems mechanism, or a physical imprint.

## 2. Cross-surface behavioral memory in unified ranking

In TubiFM, carousel memory is the unified, tokenized account of how a viewer encounters, engages with, and responds to carousels across discovery surfaces [2605.23702]. Rather than maintaining separate logs or features for item ranking, carousel ranking, and search, the system serializes the entire cross-surface journey into a single “user story” sequence. The fixed linearization is attributes $\rightarrow$ sessions $\rightarrow$ events in chronological order. A watch event records the surface, the carousel identity, the watched item identifier, viewing duration, and temporal context including day-of-week, hour, session markers, and elapsed inter-session time. Search events are recorded for every query, including search-as-you-type intermediates and queries that do not lead to a watch. The sequence is simultaneously the retained memory and the interface by which downstream ranking tasks are posed.

The token schema interleaves the pretrained Llama 3.2 1B tokenizer’s BPE vocabulary with new domain-specific atomic tokens. The grammar includes structural tokens such as `<|begin_sessions|>` and `<|session|>`, event tokens `<|watch|>` and `<|search|>`, surface tokens such as `<|surface=home|>` and `<|surface=search|>`, carousel tokens `<|carousel(name)|>` and `<|carousel(MASK)|>`, atomic item identifier tokens of the form `<|id(SYN###|Title)|>`, and reserved unknown item and carousel tokens. An auxiliary catalog corpus ties domain tokens back to text, with user-story and catalog corpora sampled at a $20\!:\!1$ ratio.

All ranking tasks are trained as next-token prediction under the standard autoregressive cross-entropy objective
$$
L = -\sum_{t=1}^{T} \log p(x_t \mid x_{<t}; \theta).
$$
Task prompts alter only the head tokens that define what should be predicted next. At inference, a single forward pass scores candidates by the logit of their token at the next-token position. For carousel ranking,
$$
s(c \mid \text{story}) = \operatorname{logit}(\text{next} = \langle\!\mid \text{carousel}(c)\mid\!\rangle),
$$
and for item ranking,
$$
s(i \mid \text{story}, \text{context}) = \operatorname{logit}(\text{next} = \langle\!\mid \text{id}(i)\mid\!\rangle).
$$
The same story can therefore be reused for carousel ordering, item ranking, or search ranking simply by changing the prompt suffix.

The memory contribution of the carousel-specific fields is explicit. Watches are tagged with their source carousel and surface, enabling the model to associate carousel identities with engagement signals such as viewing duration. Queries that do not lead to watches remain in memory as negative search exposure signals. The schema does not serialize pure impression logs for non-clicked items within a carousel; exposure for carousels is therefore represented primarily through watched associations, while search retains negative signals through non-converting queries. To mitigate container bias, TubiFM replaces the observed surface+carousel pair with `<|surface=home|><|carousel(MASK)|>` with probability $0.1$ during training, and uses an item-UNK rate of $0.001$ for robustness to new catalog items.

The reported empirical evidence links this serialized carousel memory to both ranking quality and systems simplification. TubiFM uses Llama 3.2 1B with context length 1024 tokens and average serialized story length approximately 560 tokens; training data comprise approximately 20M viewers, approximately 800M watches, approximately 66M searches, approximately 100K titles, and approximately 1K carousels across four primary surfaces. In offline evaluation, unified TubiFM outperforms specialist baselines across item, carousel, and search ranking. For carousel ranking against the strongest baseline, HSTU, HR@8 is $0.8343$ versus $0.7724$ and NDCG@8 is $0.6366$ versus $0.5362$; HR@50 and HR@100 are $0.9859$ and $0.9961$. Online A/B tests report search TVT $+3.9\%$, carousel TVT $+0.30\%$, and item TVT $+0.14\%$ with item ranking statistically neutral. Across all three tasks, TubiFM serves on L40S GPUs and reduces p99 ranking latency from approximately $500\text{ms}$ to approximately $200\text{ms}$ [2605.23702].

This formulation places carousel memory at the center of a unified discovery stack. The significance lies less in a new standalone memory module than in the use of one serialized behavioral history as a common conditioning substrate for multiple tasks that are usually siloed.

## 3. Carousel interfaces and click-model memory

In click modeling, carousel memory is defined through the dependence structure of click probability in interfaces composed of multiple titled horizontal lists stacked vertically [2506.18548]. Unlike single-list search, where examination is typically modeled as top-to-bottom sequential with position bias, carousel interfaces require joint modeling of vertical panel selection and horizontal paging or swiping. This induces panel/page bias, topic-conditioned interactions, sequential dependence, and revisitation. The memory-bearing variables include carousel topics $T_i$, items $Y_{i,p,j}$ at panel $i$, page $p$, and slot $j$, prior clicks $C'$, dwell times, scroll events, revisit indicators, and session metadata.

The paper organizes click-model design around three key choices: global dependencies, sequentiality, and factorization. Global dependencies specify which observed variables influence click probability, choosing a subset $X \subseteq \{T, Y, C'\}$ and modeling
$$
P(C \mid T, Y, C') = P(C \mid X).
$$
Memory is explicitly enabled when $X$ includes $C'$; topic-conditioned memory requires $T$; exposure memory within a carousel requires $Y$. The taxonomy includes Random $P(C)$, Topics-Only $P(C \mid T)$, Items-Only $P(C \mid Y)$, Items-Clicks $P(C \mid Y, C')$, Topics-Clicks $P(C \mid T, C')$, Topics-Items $P(C \mid T, Y)$, and Fully Dependent $P(C \mid T, Y, C')$.

Sequentiality determines which subsequences condition each click. Within a carousel, this may take the form $P(C_{i,j} \mid Y_{i,1:j}, \dots)$; across carousels, topic-order memory may be encoded as $P(C_{i,j} \mid T_{1:i}, \dots)$. Factorization determines how these variables combine. The paper contrasts PBM-like multiplicative decompositions with memory-aware forms such as a Topic $\times$ Item $\times$ Click-history product $f(T)\cdot g(Y)\cdot h(C')$, or attention-based mixtures over history.

For carousel click modeling with horizontal pages, the session history is formalized as $H_{<i,p,j}$, the sigma-field of past observables up to location $(i,p,j)$. This includes topics $T_{1:i}$, exposed items, prior clicks with earlier timestamps, dwell time $d$, scroll events $s$, revisit counts, and session metadata. A general memory-aware factorization decomposes clicks into examination, relevance, and click decision:
$$
P(C_{i,p,j}=1, E_{i,p,j}, R_{i,p,j} \mid H_{<i,p,j})
=
P(E_{i,p,j} \mid H_{<i,p,j}) \cdot P(R_{i,p,j}) \cdot P(C_{i,p,j}=1 \mid E_{i,p,j}, R_{i,p,j}, H_{<i,p,j}).
$$
A compact history-conditioned click probability is
$$
P(C_{i,p,j}=1 \mid H_{<i,p,j})
=
P(E_{i,p,j}=1 \mid H_{<i,p,j}) \cdot \sigma(\lambda \cdot R_{i,p,j} + u^\top \psi(H_{<i,p,j})).
$$

The examination component can encode panel, page, and slot bias together with memory terms:
$$
P(E_{i,p,j}=1 \mid H_{<i,p,j})
=
\sigma(\alpha_i + \beta_p + \gamma_j + \theta^\top \phi(H_{<i,p,j})),
$$
where $\alpha_i$ is panel/topic bias, $\beta_p$ page bias, and $\gamma_j$ slot bias. The history features $\phi(H)$ may include count_seen$(i)$, time_since_seen$(i)$, sum_dwell$(i)$, last_click_pos$(i)$, clicked_in_topic$(i)$, and vertical and horizontal scroll events. This formalism makes “carousel memory” a probabilistic dependence on ordered interface history rather than a stored representation in the systems sense.

The paper also derives a novel Topics–Items design that includes exposure memory and topic-order memory but excludes click-history memory:
$$
P(C_{i,j}=1 \mid T, Y, C') = P(C_{i,j}=1 \mid T, Y),
$$
with sequentiality
$$
P(C_{i,j}=1 \mid T, Y) = P(C_{i,j}=1 \mid T_{1:i}, Y_{i,1:j}).
$$
Two factorizations are given:
$$
P(C_{i,j}=1 \mid T_{1:i}, Y_{i,1:j}) = f(T_{1:i}) \cdot g(Y_{i,1:j}),
$$
and
$$
P(C_{i,j}=1 \mid T_{1:i}, Y_{i,1:j}) = f'(Y_{i,j}) \cdot g'(T_{1:i}, Y_{i,1:j-1}).
$$
This distinguishes exposure-memory models from Fully Dependent models such as CCM1, which condition on $T$, $Y$, and $C'$.

Neural versions replace explicit PGM factorization with hidden-state or attention-based sequence modeling. An RNN formulation orders navigation events by timestamp,
$$
h_t = \operatorname{RNN}(h_{t-1}, x_t), \qquad P(C_t=1) = \sigma(w^\top h_t),
$$
while a transformer uses attention over prior history,
$$
\alpha_{t,k} = \operatorname{softmax}(q_t^\top K), \qquad h_t = \sum_{k<t} \alpha_{t,k} V_k.
$$
In these models, memory is carried by hidden states or attention weights over prior exposures, clicks, dwell, and revisitation [2506.18548].

A common misconception is that carousel interfaces can be treated as minor variants of single-list ranking. The taxonomy argues against that view by making panel/page bias, topic-order effects, and revisitation first-class components of the conditioning structure. Another misconception is that click memory must always be click-history memory; the Topics–Items design shows that exposure memory and topic-order memory can be modeled without conditioning on $C'$.

## 4. Hierarchical episodic memory in continual learning

In continual learning, Carousel Memory, abbreviated CarM, is a hierarchical episodic-memory management strategy designed for rehearsal-based continual learning under tight RAM budgets [2110.07276]. The problem setting is a non-i.i.d. stream of tasks $T_1,\dots,T_T$, where standard rehearsal-based methods maintain a small episodic memory in RAM and replay stored samples during training. Conventional methods discard samples that overflow the RAM buffer permanently. CarM instead exploits the device memory hierarchy—small, fast RAM and larger, slower persistent storage—to preserve past experiences in storage and rotate them back into RAM asynchronously.

The architecture has two principal buffers: EM, a RAM buffer supplying replay samples, and ES, a storage buffer holding all or most past samples. It also includes a stream buffer for incoming data, fetch workers that pre-process training bundles, a swap worker that decides which in-RAM samples to replace and issues storage I/O, a gate function and policies that control swapping, and optional EM partitioning to parallelize reads and writes. The execution pipeline contains five stages: data incoming, training, EM updating, storage updating, and storage sample retrieving.

The training objective is written as
$$
\arg\min_\theta \sum_{\text{task id}=1}^{i} \mathbb{E}_{(x,y)\sim ES \cup T_i}[L(f(x,\theta),y)],
$$
where $(x,y)\in EM$ during training, and CarM continually refreshes EM from ES so that replay support expands over time. The central systems mechanism is asynchronous overlap of retrieval $R_i^b$ with training $T_{i+1}^b$, avoiding the slowdown of a synchronized sequence $T_1^b \rightarrow R_1^b \rightarrow T_2^b \rightarrow R_2^b \dots$.

The gate function determines which samples are swapped:
$$
\sigma_i = \mathbf{1}(s(x_i) > \tau),
$$
where $s(x_i)\in[0,1]$ is a score and $\tau\in[0,1]$ controls the fraction replaced. Three policies are reported. Random marks a random $\tau$ proportion of the mini-batch to be swapped. Entropy keeps hard samples and swaps easy ones using
$$
s(x_i) = \frac{1}{U}\left[g(x_i)H(f(x_i)) + (1-g(x_i))(U-H(f(x_i)))\right],
$$
where $g(x_i)=\mathbf{1}(f(x_i)=y_i)$, $H(\cdot)$ is prediction entropy, and $U$ is maximum entropy. Dynamic uses Random in early passes and Entropy in later passes. When ES is full, storage eviction is random per class to maintain class balance.

CarM is presented as a drop-in memory-management layer compatible with seven rehearsal-based methods: ER, iCaRL, TinyER, BiC, GDumb, DER++, and RM. It does not alter the model architecture or core loss, except that the paper studies distillation reweighting for methods such as iCaRL. The modified iCaRL objective is
$$
\mathcal{L}_{\text{modified}}(x_i)
=
\alpha \mathcal{L}_{\text{icarl}}(x_i)
-
(1-\alpha)\sum_{y=1}^{t}\{\delta_{y=y_i}\log g_y(x_i)+\delta_{y\neq y_i}\log(1-g_y(x_i))\},
$$
and the reported empirical result is that small $\alpha$ values, specifically $0$ to $0.1$, work best with CarM.

The empirical results characterize CarM as a memory-capacity extension with limited efficiency cost. Across evaluated datasets, final average accuracy improvements are substantial. On the CIFAR subset, DER++ improves from $72.17$ to $90.05$ with CarM-50 and $90.58$ with CarM-100, while forgetting decreases from $24.45$ to $2.78$–$3.38$. On Tiny-ImageNet, DER++ rises from $19.38$ to $47.74$ with CarM-50, the largest reported gain at $+28.4$ percentage points. On ImageNet-1000, RM improves from $24.08$ to $43.69$ and $44.36$, and DER++ from $12.11$ to $35.90$ and $36.89$. Async CarM preserves near-original training efficiency, whereas Sync serialization incurs large slowdowns; for example, DER++ shows $+0.3\%/+2.4\%$ Async overhead versus $+71.6\%/+38.8\%$ Sync overhead on CIFAR/ImageNet [2110.07276].

Here, carousel memory does not refer to a carousel user interface or a rotating physical pattern. It designates rotation of replay samples through a memory hierarchy. The naming foregrounds recurrence and reintroduction rather than spatial layout. This suggests that, in continual learning, the crucial semantic content of the term is not “carousel” as UI element but “carousel” as controlled circulation.

## 5. Persistent spark patterns in pulsar radio emission

In pulsar astrophysics, carousel memory refers to the persistence and recoverable mapping of a rotating spark pattern on the polar cap across different emission heights and observing frequencies [1812.01010]. In the carousel model, regularly spaced sparks in the polar acceleration gap circulate around the magnetic axis due to the $E\times B$ drift. Each spark seeds a plasma subbeam flowing along magnetic field lines, and the geometry of these subbeams retains the spark pattern as they propagate to radio-emission altitudes. Different frequencies then sample the same underlying pattern at different carousel rotation phases.

The basic quantities are the observed subpulse modulation period $P_3^{\rm obs}$, the true modulation period $P_3$, the carousel circulation period $P_4$, and the number of sparks $N_{\rm sp}$, related by
$$
\frac{P}{P_3}=n+\frac{P}{P_3^{\rm obs}}, \qquad P_4 = N_{\rm sp} P_3,
$$
where $n$ is the alias order. The viewing geometry is parameterized by magnetic inclination angle $\alpha$, impact parameter $\beta$, $\zeta=\alpha+\beta$, emission-cone radius $\rho$, magnetic azimuth $\psi\equiv \chi(\phi)$, and pulse longitude $\phi$ relative to the fiducial plane $\phi_0$.

The magnetic azimuth is
$$
\chi(\phi)=\arctan\left(\frac{\sin\zeta\,\sin(\phi-\phi_0)}{\sin\alpha\,\cos\zeta-\cos\alpha\,\sin\zeta\,\cos(\phi-\phi_0)}\right).
$$
The modulation phase envelope is
$$
\Theta(\phi)
=
-N_{\rm sp}\,\beta\,\chi(\phi)
+
\left(n+\frac{P}{P_3^{\rm obs}}\right)\phi
+
\Theta_0.
$$
For simultaneous observations at two frequencies $\nu_1,\nu_2$, the expected inter-frequency phase offset is
$$
\Delta\Theta
=
-N_{\rm sp}\,\beta\,\Delta\chi
+
\left(n+\frac{P}{P_3^{\rm obs}}\right)\Delta\phi
+
\delta\Theta,
$$
where $\Delta\chi=\chi(\phi_1)-\chi(\phi_2)$, $\Delta\phi=\phi_2-\phi_1$, and
$$
\delta\Theta
=
\left(n+\frac{P}{P_3^{\rm obs}}\right)\frac{2\pi(r_{\nu_1}-r_{\nu_2})}{cP}.
$$
For typical altitude differences of a few hundred km and $P_3$ of seconds, $\delta\Theta$ is reported as negligible.

The “memory” resides in the fact that the same spark-carousel structure is preserved across emission heights, so the observer measures correlated modulation with predictable phase offsets. This permits aliasing resolution through observed quantities alone:
$$
\Delta\Theta_{\rm obs}
=
2\pi\left(n+\frac{P}{P_3^{\rm obs}}\right)\frac{\Delta t}{P},
$$
where $\Delta t_{\rm obs}$ is the fractional delay between fluctuation sequences measured at two frequencies. The method does not require $\alpha$, $\beta$, or $N$.

The paper’s case study of PSR B1237+25 uses a 327 MHz pulse sequence and analyzes two subsequences, S#11 and S#12. The observed modulation periods are $P_3^{\rm obs}=2.84P$ and $2.72P$. Cross-correlation of $P_3$-folds yields phase offsets of approximately $+137^\circ \pm (22$–$32^\circ)$ for components I vs II and approximately $-104^\circ$ to $-115^\circ \pm (36$–$47^\circ)$ for IV vs V. Cross-spectrum analysis gives $\Delta t_{\rm obs}=+1.09\pm0.14P$ for S#11 and $+1.30\pm0.35P$ for S#12 on I vs II, implying phase offsets consistent with the direct measurements. The aliasing equation yields $n\approx 0$, so $P_3\approx 2.7$–$2.8P$ is unaliased. With aberration-retardation-corrected component longitudes and geometry $\alpha=57.6^\circ$, $\beta=-0.3^\circ$, the paper estimates $\Delta\chi\approx 1.52^\circ \pm 0.25^\circ$, $N\approx 60$–$133$ broadened to $40$–$240$ allowing $\pm0.1^\circ$ in $\beta$, and hence $P_4\approx 113$–$680P$ [1812.01010].

The decisive observational signature is that inner and outer conal components share a common $P_3$ and show phase-locked modulation with equal magnitude and opposite sign across the fiducial plane. The paper interprets this as firm evidence that both cones originate from the same carousel of subbeams at different heights. In this usage, carousel memory is therefore a physical persistence property of the magnetospheric emission structure, encoded in measurable phase relations.

## 6. Comparative interpretation, misconceptions, and open distinctions

The four research usages differ in ontology, observables, and operational form. In TubiFM, carousel memory is a serialized behavioral sequence used directly for prediction across ranking tasks [2605.23702]. In carousel click models, it is a dependency structure over panel, page, slot, topic, exposure, and click history [2506.18548]. In CarM for continual learning, it is a hierarchical storage-and-replay mechanism [2110.07276]. In pulsar studies, it is the persistence of a spark pattern under propagation and multi-frequency sampling [1812.01010]. Treating these as a single concept would be misleading.

Several misconceptions are clarified by the source material. First, in recommendation settings, carousel memory does not mean complete exposure logging. TubiFM explicitly states that pure impression logs for non-clicked items within a carousel are not serialized; the strongest exposure signals are watches and searches themselves, although non-converting search queries are retained as negative signals [2605.23702]. Second, in click modeling, memory is not synonymous with prior clicks. The taxonomy makes clear that memory can arise from exposure history $Y$, topic order $T$, or click history $C'$, separately or jointly [2506.18548]. Third, in continual learning, Carousel Memory is not a new replay loss; it is a memory-management layer that leaves baseline learning rules largely intact, apart from optional retuning such as lowering distillation weight [2110.07276]. Fourth, in pulsar astrophysics, carousel memory is not a generic observational correlation; it is specifically tied to the preservation of a rotating spark pattern and to geometry-induced phase offsets predicted by the carousel model [1812.01010].

A plausible cross-domain implication is that “carousel memory” tends to emerge where later decisions depend on structured recurrence rather than isolated events. Yet the mechanism of recurrence varies sharply. Recommendation and click modeling focus on user-interface traversal and engagement history; continual learning focuses on sample circulation under hardware constraints; pulsar studies focus on the re-sampling of a persistent physical configuration. The shared phrase therefore names an abstract family resemblance—retained structured history—but not a transferable method.

Across domains, the term is most informative when read locally, within the modeling assumptions of the specific paper. In practice, that means distinguishing between tokenized event histories, conditional-dependence graphs, hierarchical replay systems, and geometric phase-memory in radio emission, even though all are described as forms of carousel memory.

Source: https://www.emergentmind.com/topics/carousel-memory