CLIFF: Continual Learning for Flake Layers

• The paper introduces CLIFF, utilizing a frozen ViT backbone and a linear base head supplemented by material-specific prompts and delta heads to combat catastrophic forgetting.
• It employs memory replay, a cosine-similarity gate, and knowledge distillation to maintain classification performance across sequentially arriving materials with scarce labels.
• The framework enables task-agnostic inference by aggregating residual corrections from material-specific modules, resulting in improved accuracy on diverse 2D material datasets.

Searching arXiv for the CLIFF paper and closely related continual-learning frameworks to ground the article in current literature. Continual-Learning Framework for Flake Layer Classification (CLIFF) is a material-incremental continual-learning system for automated layer-count identification of exfoliated two-dimensional material flakes from optical microscope images. It is designed for the setting in which materials arrive sequentially, labels are scarce, and naive sequential fine-tuning causes severe catastrophic forgetting. In CLIFF, a ViT-B/16 backbone $f_\theta$ and a linear base head $g_\phi$ are trained on a reference material and then frozen; each subsequent material is incorporated through a material-specific prompt, a learned material embedding, and a delta head that adds residual corrections to the frozen base logits. A prompt pool, a cosine-similarity gate, memory replay, and knowledge distillation complete the framework, yielding task-agnostic inference over all seen materials and thickness categories (Pandey et al., 24 Aug 2025).

1. Problem setting and scope

CLIFF addresses automated identification of the layer count of exfoliated 2D material flakes from optical microscope images. The classification targets are three shared thickness categories: Few, Mono, and Thick. The difficulty is not merely visual classification at fixed conditions; it is the combination of fine-grained thickness discrimination with substantial appearance shifts across materials and imaging setups. The description emphasizes that different materials have distinct optical responses, that illumination spectrum, intensity, substrate thickness, and camera response alter observed contrast and color, and that flakes themselves vary in shape, size, background noise, and contamination (Pandey et al., 24 Aug 2025).

The continual-learning formulation is material-incremental. Tasks are defined by materials, with $T1=$ BN, $T2=$ graphene, $T3=$ MoS$_2$, and $T4=$ WTe$_2$. At base stage, the model has access to a reference-material dataset $D_0$; later, for each new material $m$, it receives only that material’s dataset $g_\phi$0. The objective is to retain performance on all previously seen materials without retraining on the full historical data. This makes CLIFF closer to a domain-shifted continual classifier than to a static per-material predictor, because the layer classes are shared while the appearance of those classes is material-dependent (Pandey et al., 24 Aug 2025).

The paper presents this formulation as, to its knowledge, the first systematic study of continual learning in the domain of two-dimensional materials. A central implication is that forgetting must be handled not only at the class level, but also at the level of material-specific optical mappings: a monolayer is always a monolayer conceptually, yet its RGB manifestation differs across BN, graphene, MoS$g_\phi$1, and WTe$g_\phi$2 (Pandey et al., 24 Aug 2025).

2. Core architecture

CLIFF begins with a reference-material training stage. Given

$g_\phi$3

the backbone $g_\phi$4 and base head $g_\phi$5 are optimized with

$g_\phi$6

After this stage, both $g_\phi$7 and $g_\phi$8 are frozen for all later materials (Pandey et al., 24 Aug 2025).

For each new material $g_\phi$9, CLIFF adds three learnable components: a prompt $T1=$0, a material embedding $T1=$1, and a delta head $T1=$2. The prompted backbone feature is

$T1=$3

where $T1=$4 is prepended to the ViT input sequence. Each delta head receives a concatenation of the prompted feature and a material embedding: $T1=$5 The delta head is therefore a material-conditioned residual mapping from frozen backbone features to thickness logits (Pandey et al., 24 Aug 2025).

The final output is formed by concatenating corrected logits for all materials seen so far: $T1=$6 where $T1=$7 and $T1=$8. Prediction is obtained by a global argmax over this $T1=$9-dimensional vector, so CLIFF does not require material labels at test time. This is an important architectural property: although training is organized by material-defined tasks, inference is task-agnostic in the sense that material identity is not provided externally (Pandey et al., 24 Aug 2025).

The prompt mechanism is organized as a prompt pool. Each arriving material contributes a new prompt $T2=$0; during training on material $T2=$1, the new prompt and other $T2=$2-specific components are updated, while prompts for past materials are frozen. The paper contrasts this with shared-pool prompt selection in Learning-to-Prompt (L2P): CLIFF uses material-specific prompts and embeddings to preserve stronger disentanglement among materials (Pandey et al., 24 Aug 2025).

3. Gating, residual correction, and optimization

The cosine-similarity gate is introduced to modulate features and improve material identification. The description states that an auxiliary gate loss $T2=$3 is computed using cosine similarity between features and material embeddings. The role of the gate is therefore twofold: it provides a material-discriminative signal in embedding space and supports the material-specific corrections generated by the delta heads. Because the excerpt does not print a full gate equation, the architectural emphasis is on function rather than exact parameterization (Pandey et al., 24 Aug 2025).

During the continual stage, the backbone and base head remain frozen. Training focuses on the prompt $T2=$4, embedding $T2=$5, delta head $T2=$6, and related gating components. The total loss is

$T2=$7

Here, $T2=$8 is the classification loss on current material data, $T2=$9 is the replay loss on a memory buffer $T3=$0, and $T3=$1 aligns current outputs with those of a frozen teacher snapshot from the previous task on replayed samples (Pandey et al., 24 Aug 2025).

The memory buffer stores a small number of samples from previous tasks, and batches during training on material $T3=$2 mix new material samples with replayed samples. The teacher-student mechanism is explicitly task-sequential: the teacher is the CLIFF snapshot obtained after the previous material, and the student is the current model being trained on the next material. This combination of architectural separation and rehearsal-based stabilization is central to CLIFF’s operation. A common simplification would be to regard CLIFF as a prompt-only method; that is inaccurate. The method uses prompts, but it also uses material embeddings, delta heads, memory replay, and knowledge distillation (Pandey et al., 24 Aug 2025).

4. Empirical behavior

CLIFF is evaluated on optical microscopy data containing hBN, graphene, MoS$T3=$3, and WTe$T3=$4, with hBN used as the reference material. The reported baselines are Joint Training, Naive Fine-tuning, and L2P. Joint training serves as an upper bound because all materials are trained simultaneously and no continual-learning constraint is imposed (Pandey et al., 24 Aug 2025).

Method	Avg. Accuracy	Forgetting
Joint Training	92.11%	—
Naive Fine-tuning	17.85%	84.20%
L2P	36.99%	59.73%
CLIFF	56.96%	34.80%

The trajectory details clarify the nature of forgetting. Under naive fine-tuning, $T3=$5 drops from $T3=$6 after the first task to $T3=$7 after all four tasks, and $T3=$8 drops from $T3=$9 to $_2$0. L2P improves over naive fine-tuning but still exhibits substantial degradation: after $_2$1, its task accuracies are $_2$2 on $_2$3, $_2$4 on $_2$5, $_2$6 on $_2$7, and $_2$8 on $_2$9. CLIFF retains markedly more performance on earlier materials while remaining competitive on the newest one: after $T4=$0, it reports $T4=$1 on $T4=$2, $T4=$3 on $T4=$4, $T4=$5 on $T4=$6, and $T4=$7 on $T4=$8 (Pandey et al., 24 Aug 2025).

The qualitative interpretation given in the paper is that CLIFF’s material-specific delta heads and embeddings keep optical-domain corrections separated, while the frozen backbone and base head preserve a stable reference representation. This suggests that the method is not merely reducing interference statistically; it is also structuring the interference so that new materials are added as residual deviations from a common BN-trained reference rather than by overwriting a single shared classifier (Pandey et al., 24 Aug 2025).

5. Position within continual-learning research

CLIFF belongs to a broader family of continual-learning methods that trade off shared representation, task-specific adaptation, and explicit anti-forgetting mechanisms. In relation to other 2024–2025 frameworks, its design is notable for combining a frozen pretrained core with lightweight per-task residual modules and replay-based preservation (Pandey et al., 24 Aug 2025).

A useful contrast is the two-branch Generalizable Two-Branch (G2B) framework, where the output of each main-branch block is multiplicatively modulated by a soft mask generated by a lightweight side-branch CNN, while the main continual-learning model itself remains architecturally unchanged (Wu et al., 2024). Another contrast is the Pairwise Interaction Layer approach, which replaces the final layer with a sparse pairwise correlation layer combined with k-WTA and streaming Adagrad or S-MAS in a rehearsal-free, task-agnostic setting without task labels or boundaries (Keskinen, 2024). CLIFF does not follow either pattern. It freezes a base ViT and classifier, uses prompts to alter token processing, conditions residual logits on material embeddings, and relies on replay and distillation rather than a purely architectural or purely optimizer-level solution (Pandey et al., 24 Aug 2025).

From a unification standpoint, contemporary work has described continual learning through shared optimization primitives—cross-entropy on current data plus output-space and weight-space regularization, often expressed with Bregman divergences and sometimes enhanced with refresh learning (Wang et al., 2024). CLIFF can be read within that broader taxonomy as a method that combines architectural specialization with memory replay and teacher-based output preservation. A plausible implication is that its components are modular: replay and distillation provide generic CL stabilization, while prompts and delta heads encode the particular structure of material-incremental optical microscopy (Pandey et al., 24 Aug 2025).

6. Limitations, misconceptions, and future directions

The paper identifies two direct limitations. First, CLIFF depends on a memory buffer, and the reported retention improvements are explicitly tied to replay; larger buffers improve retention but increase storage overhead. Second, the method treats each material as a distinct task and does not explicitly exploit similarities among optically related materials. As the number of materials grows, the number of embeddings and delta heads grows linearly, so scalability to very large material libraries remains an open issue (Pandey et al., 24 Aug 2025).

Several misconceptions are addressed by the architecture itself. CLIFF is not a fully shared continual learner: the backbone and base head are frozen after reference-material training. Nor is it a purely task-conditioned test-time system: despite being trained with material-defined tasks, it performs task-agnostic inference by taking a global argmax over all material-thickness logits. Finally, it is not equivalent to generic prompt tuning. The prompt pool is only one component; the material embeddings, cosine-similarity gate, delta heads, replay buffer, and distillation term are all integral to the method (Pandey et al., 24 Aug 2025).

The future directions named in the paper focus on transferring knowledge between optically similar materials, for example through subspace clustering of material embeddings, shared delta heads for groups of similar materials, or regularization that keeps embeddings of similar materials close. Extensions to additional microscopy modalities, flake segmentation, and integration with automated experimental workflows are also identified. This suggests that CLIFF is best understood not as a finished universal solution, but as a domain-specific continual-learning template in which frozen shared structure and material-specific residual adaptation are jointly used to manage catastrophic forgetting in 2D-material identification (Pandey et al., 24 Aug 2025).