---
title: 'BRAIN: Bias-Mitigation Continual Learning'
url: https://www.emergentmind.com/topics/bias-mitigation-continual-learning-brain
type: topic
---

# BRAIN: Bias-Mitigation Continual Learning

Bias-Mitigation Continual Learning (BRAIN) is a continual-learning framework for Vision-Brain Understanding (VBU) that treats longitudinal fMRI acquisition as a non-stationary sequence of recording sessions rather than as a single pooled dataset. It was introduced to address the observation that brain responses are not stationary over time: as participants repeatedly view stimuli across sessions, memory for earlier stimuli decays, confidence decreases, recorded brain signals become weaker and less consistent, and the learned representation becomes increasingly misaligned. In this formulation, BRAIN targets four coupled phenomena—session shift, representation drift, compounding bias, and catastrophic forgetting—by combining a bias-aware contrastive objective with a continual-learning regularizer that preserves previously learned feature geometry [2508.18187].

## 1. Problem setting and conceptual scope

BRAIN is motivated by the realistic VBU setting in which fMRI data arrive over many recording sessions. At continual-learning step \(t\), the model receives a session dataset
\[
\mathcal{D}_t = \{(x^t, y^t)\},
\]
where \(x^t\) denotes the fMRI signal and \(y^t\) the corresponding image. An fMRI encoder \(F\) produces
\[
z^t = F(x^t, \theta_t) \in \mathbb{R}^d,
\]
while a frozen visual encoder \(V\) maps the image into a visual centroid
\[
c^t = V(y^t) \in \mathbb{R}^d.
\]
The model is then updated incrementally as new sessions arrive, rather than retrained from scratch on all sessions jointly [2508.18187].

The paper grounds this setup in two kinds of evidence from the Natural Scenes Dataset (NSD). First, metadata on participant responses to whether a stimulus had been seen before show that both response accuracy and consistency decrease over time. Second, an experimental model-performance test with a MindEye2-style retrieval model, trained and validated on session chunks with identical architecture and hyperparameters across steps, shows that retrieval performance drops noticeably as sessions progress. These results motivate the paper’s terminology: **bias** denotes a time-varying distortion in the fMRI distribution caused by memory decay and uncertainty; **session shift** denotes the change from \(p^{t-1}(x)\) to \(p^t(x)\); **representation drift** denotes the induced shift in learned features; and **forgetting** denotes the loss of knowledge about previous sessions when learning new ones [2508.18187].

This framing is narrower and more specific than generic continual-learning accounts of non-stationarity. The central claim is not merely that later sessions are different, but that later-session data are systematically less reliable and therefore introduce a compounding bias if training assumes stationarity. In that sense, BRAIN is a bias-mitigation method because it explicitly attempts to correct the current session’s distortion while preventing that distortion from overwriting earlier, cleaner knowledge.

## 2. Framework architecture and optimization objective

BRAIN adopts a continual-learning architecture with two coupled mechanisms: one for current-session debiasing and one for cross-session retention. The generic optimization target at step \(t\) is
\[
\theta_t^* = \text{argmin } \mathbb{E}_{x^t, y^t \in \mathcal{D}^t} [\mathcal{L}_{C}(x^t, y^t) + \lambda_{CL}\mathcal{L}_{CL}(x^t)],
\]
where \(\mathcal{L}_C\) is a contrastive alignment loss between brain and image embeddings, \(\mathcal{L}_{CL}\) is a continual-learning loss that preserves prior knowledge, and \(\lambda_{CL}\) controls the tradeoff [2508.18187].

| Component | Function | Mechanism |
|---|---|---|
| De-bias Contrastive Learning | Mitigate current-session bias | Session-dependent reweighting of contrastive alignment |
| Angular-based Forgetting Mitigation | Reduce catastrophic forgetting | Angular discrepancy between old and current intermediate features |
| Continual session update | Adapt to temporal drift | Initialize each step from previous weights |

Within this design, BRAIN does two things simultaneously. It corrects the learning signal from the current session, which may already be biased by degraded memory and uncertainty, and it constrains the model so that adaptation to the new session does not destroy the representational structure learned from earlier sessions. The paper emphasizes that this differs from simply pooling all sessions: pooling assumes that all sessions are identically distributed, whereas BRAIN assumes that the temporal order is informative and that later sessions are harder in a systematic way [2508.18187].

The method is therefore neither a pure replay strategy nor a pure regularization strategy in the ordinary continual-learning sense. Its contrastive term is already modified to reflect session-dependent bias, and its retention term is chosen to preserve angular structure rather than absolute feature magnitudes.

## 3. De-bias Contrastive Learning

The first technical contribution is **De-bias Contrastive Learning (DCL)**. The paper starts from the observation that prior VBU methods implicitly assume a stationary fMRI distribution,
\[
p^t(x) = p(x) \quad \forall t \le T,
\]
and then rewrites the expected contrastive loss to expose a session-dependent bias factor. This leads to
\[
w^t = \frac{1}{p(t)},
\]
which is interpreted as a measure of how far the current session has drifted from the unbiased or ideal distribution [2508.18187].

Because participant response accuracy decreases with session index, the paper models this factor as
\[
w^t = \frac{1}{p(t)} = e^{1 - r(t)},
\]
where \(r(t)\) is the response accuracy at session \(t\). The resulting DCL loss is written as
\[
\mathcal{L}_{C}(x^t, y^t) = -\text{log} \frac{\exp(z^t \times c^t)}{\sum_{z'} \exp(z' \times c^t)} e^{1 - r(t)}.
\]
Here, \(z^t \times c^t\) is the similarity between the brain embedding and the visual centroid, the numerator pulls the correct pair together, the denominator contrasts it against alternative brain features \(z'\), and the factor \(e^{1-r(t)}\) increases when participant accuracy is low, i.e. when the session is more biased [2508.18187].

The paper also provides an alternative estimate of the bias factor based on brain activity rather than behavioral response:
\[
w^t = e^{1-a(t)} = e^{1 - N_a / N_b},
\]
where \(N_a\) is the number of activated voxels and \(N_b\) is the total number of voxels. This variant is presented as a fallback when response labels are unavailable. In the ablation study, the brain-activation-based variant remains superior to prior baselines but is slightly worse than the response-accuracy version, making response accuracy the preferred bias signal when available [2508.18187].

The intended effect of DCL is not to equalize sessions or discard later data. Rather, it reweights learning so that harder, noisier, and more drifted sessions receive an explicitly bias-aware correction. This is the part of BRAIN that addresses compounding bias directly.

## 4. Angular-based Forgetting Mitigation

The second technical contribution is **Angular-based Forgetting Mitigation (AFM)**, which supplies the continual-learning regularizer. The paper formulates the retention term as a feature-distillation objective over intermediate layers:
\[
\mathcal{L}_{CL}(x^t) = \frac{1}{L}\sum_{i=1}^L \mathcal{D}_f\left(F_i(x^t, \theta_{t-1}), F_i(x^t, \theta_t)\right)
= \frac{1}{L}\sum_{i=1}^L \mathcal{D}_f\left(z^{t-1}_i, z^t_i\right),
\]
where \(L\) is the number of intermediate feature layers and \(z^{t-1}_i\), \(z^t_i\) are the features produced by the old and current models at layer \(i\) [2508.18187].

Instead of the Euclidean discrepancy often used in prior work,
\[
\| z_i^t - z_i^{t-1} \|_2^2,
\]
BRAIN uses an angular discrepancy:
\[
\mathcal{D}_f\left(z^{t-1}_i, z^t_i\right) =
\left\| 1 - \frac{z^{t-1}_i}{||z^{t-1}_i||} * \frac{z^{t}_i}{||z^t_i||}\right\| ^2_2.
\]
This is effectively a cosine-similarity-based regularizer. The rationale given in the paper is threefold: angular distance is less sensitive to scale changes in the representation space, it matches downstream retrieval tasks that already rely on angular or cosine similarity, and it allows the model to absorb new session-specific information without over-constraining feature magnitude [2508.18187].

The full BRAIN objective combines DCL and AFM:
\[
\mathcal{L} = \mathcal{L}_C(x^t, y^t) + \lambda_{CL}\mathcal{L}_{CL}(x^t),
\]
or, more explicitly,
\[
\mathcal{L} =
-\text{log} \frac{\exp(z^t \times c^t)}{\sum_{z'} \exp(z' \times c^t)} e^{1 - r(t)}
+\lambda_{CL}\frac{1}{L} \sum\left\| 1 - \frac{z^{t-1}_i}{||z^{t-1}_i||} * \frac{z^{t}_i}{||z^t_i||}\right\| ^2_2.
\]
At each learning step, the model is initialized from the previous step’s weights and trained on the current session with this joint loss. The first term addresses current-session bias; the second term preserves the angular geometry of earlier knowledge [2508.18187].

A persistent misconception in continual-learning discussions is that any strong retention term must necessarily freeze adaptation. AFM is intended to avoid exactly that failure mode. Because it constrains directions rather than magnitudes, the paper presents it as a softer and more geometry-aware retention mechanism than ordinary \(\ell_2\)-style feature matching.

## 5. Benchmarks, protocols, and empirical findings

The primary benchmark is NSD, which the paper considers especially suitable for continual-learning analysis because it provides multiple participants, many recording sessions per participant, repeated image presentations across sessions, fine-grained session metadata, and behavioral response information. Continual-learning splits are defined as \((N_{init}, N_s)\), where \(N_{init}\) is the number of sessions used to train the initial model and \(N_s\) is the number of sessions added per continual-learning step. Four protocols are evaluated: \((20, 2)\), \((20, 5)\), \((20, 10)\), and \((15, 5)\). Evaluation is performed on the current and previous sessions only, and retrieval is measured in both directions—Brain \(\rightarrow\) Image and Image \(\rightarrow\) Brain—using cosine similarity in a shared embedding space, typically in a 200-way setting with random distractors and Top-1 accuracy [2508.18187].

The baselines include **W/o CL**, **LwF**, **PLOP**, and a **Non-CL** baseline that trains on all sessions jointly. Across all continual-learning settings, BRAIN outperforms the continual-learning baselines. A representative example is subject 01 under \((20,2)\) for Brain \(\rightarrow\) Image retrieval: W/o CL drops from **61.57%** at the first step to **18.06%** at the last step, whereas BRAIN maintains **57.97%**. The average results in the main table also show BRAIN outperforming competing methods across all split settings and retrieval directions. The paper further reports that BRAIN can be competitive with, and sometimes surpass, the Non-CL baseline, which is notable because continual learning often sacrifices some accuracy for retention [2508.18187].

The ablation study isolates both major components. Replacing standard contrastive alignment with **DCL + RA** yields an improvement typically around **1%–4%** over vanilla contrastive learning with \(\ell_2\) regularization. Replacing Euclidean forgetting regularization with **AFM** improves performance by roughly **1%–3%** over the corresponding \(\ell_2\) version. The full model, **DCL + RA + AFM**, gives the best performance in both retrieval directions and across all subject/session configurations. A rehearsal-based variant retaining **10%** of previous data performs worse than the rehearsal-free version; the explanation proposed in the paper is that session-specific clusters are not well preserved by such a small rehearsal buffer [2508.18187].

Taken together, these results support the paper’s main claim that the degradation of longitudinal VBU models is not only a forgetting problem and not only a data-quality problem. It is the interaction of session-dependent bias and sequential updating, and BRAIN is designed to intervene at both points simultaneously.

## 6. Position within bias-mitigation continual learning research

The term **bias** is used differently across the broader continual-learning literature. BRAIN’s bias is a temporal distortion in brain-signal distributions caused by memory decay and uncertainty, whereas other works study spurious correlation, group fairness, online posterior bias, normalization-statistics recency bias, or noisy-label bias.

| Work | Bias target | Continual setting |
|---|---|---|
| BRAIN [2508.18187] | Session shift, representation drift, forgetting in longitudinal fMRI | VBU retrieval over recording sessions |
| BM-CL [2509.01730] | “Leveling-down effect” between best and worst groups | Fairness mitigation as domain/task-incremental CL |
| UER [2309.04081] | Bias toward current classes in dot-product logits | Online continual learning with replay |
| CBA / Dual-CBA [2308.06925], [2408.13991] | Posterior bias under catastrophic distribution shift | Online class-incremental CL |
| AdaB\(^2\)N [2310.08855] | Recency bias in BatchNorm statistics | Online and offline CL |
| ErrorEraser [2506.09347] | Bias-induced erroneous knowledge from noisy labels | Task-incremental CL |
| Fair affective robotics [2103.09233] | Demographic bias across gender and race | Domain-incremental FER and AU learning |

This comparison matters because BRAIN is not a fairness method in the group-based sense. BM-CL, for example, treats fairness improvement as a continual-learning problem and uses LwF or EWC to preserve best-group performance while improving worst-group performance, thereby reducing the “leveling-down effect” [2509.01730]. By contrast, BRAIN has no best-group/worst-group partition; its central non-stationarity is temporal and session-indexed. Likewise, UER addresses current-class bias in online replay by separating the roles of angle and norm in dot-product logits [2309.04081], while CBA and Dual-CBA learn adaptors to absorb posterior bias caused by online distribution shifts [2308.06925], [2408.13991]. AdaB\(^2\)N isolates a different mechanism—recency bias in normalization statistics [2310.08855]—and ErrorEraser treats continual learning as a problem of selective forgetting of bias-induced erroneous memories under noisy labels [2506.09347].

An earlier line of work on spurious correlation in continual learning showed that bias can transfer both forward and backward across tasks, can accumulate in longer task sequences, and can be reduced by a plug-in method called Group-class Balanced Greedy Sampling (BGS) with at most a slight loss of continual-learning performance [2303.11863]. That result is conceptually adjacent to BRAIN because both reject the assumption that continual learning need only preserve knowledge; they differ in the source of the bias being preserved. The same broader intuition also appears in affective robotics, where demographic variation is treated as a domain-incremental continual-learning problem to improve fairness across gender and race in facial expression recognition and action unit detection [2103.09233].

Within this landscape, BRAIN’s distinct contribution is to make VBU explicitly temporal, bias-aware, and continual. It treats longitudinal fMRI collection not as a nuisance around an otherwise static retrieval model, but as the defining structure of the learning problem. A plausible implication is that future VBU systems will need to combine session-aware bias modeling with more general continual-learning tools rather than relying on pooled-data training or purely task-agnostic replay.

Source: https://www.emergentmind.com/topics/bias-mitigation-continual-learning-brain