---
title: Few-Shot Continual Event Detection
url: https://www.emergentmind.com/topics/few-shot-continual-event-detection-fced
type: topic
---

# Few-Shot Continual Event Detection

Searching arXiv for recent and foundational papers on few-shot continual event detection and closely related few-shot event detection.
Few-Shot Continual Event Detection (FCED) denotes a class-incremental event detection setting in which a system must learn newly arriving event types from only a few labeled instances while retaining the ability to detect previously learned types. In the cited literature, closely related formulations appear under the names **few-shot incremental event detection**, **class-incremental few-shot event detection (CIFSED)**, and **continual few-shot event detection (CFED)**. Across these formulations, the common structure is sequential class introduction, severe label scarcity for novel classes, and evaluation over all classes observed so far rather than only the current task [2209.01979][2404.01767][2403.17733].

## 1. Definition and formal setting

FCED extends event detection beyond a fixed predefined label set. Standard event detection assumes a closed inventory of event types, whereas FCED requires the model to expand over time without retraining from scratch on the full dataset. The task couples two constraints that are usually studied separately: continual or incremental learning, and few-shot learning. The defining requirement is to learn new event classes with only a small support set while preserving performance on old classes [2209.01979].

One explicit formulation assumes a sequence of datasets
\[
D^{(0)}, D^{(1)}, \ldots, D^{(M)},
\]
where \(D^{(0)}\) is the **base session** with many labeled instances and each \(D^{(m)}\) for \(m \ge 1\) is a **few-shot novel-class session**. All sessions have disjoint event class sets. Each learning session is episodic: the support set has \(N\) classes and \(K\) labeled examples per class, and the query set contains unlabeled examples to classify. In the joint event detection formulation used for CIFSED, each sentence is tagged at the token level, with label space size \(2N+1\), corresponding to \(N\) labels for **B-CLASS**, \(N\) labels for **I-CLASS**, and one **O** label [2404.01767].

A second formulation describes a sequence of tasks
\[
\mathbb{T} = \{T_1, T_2, \dots, T_n\},
\]
with non-overlapping event types across tasks. The first task is a base task with enough labeled data, and later tasks are incremental few-shot tasks with 1, 5, or 10 examples per new type. At continual stage \(C_t\), training uses only the current task data, while evaluation is performed on the union of all observed labels so far [2403.17733].

A third formulation defines base classes \(C_b = \{C_b^1, \dots, C_b^g\}\) and \(m\) rounds of novel classes \(\{C_1, \dots, C_m\}\), where each round \(C_i\) contains \(n\) new classes and each new class has only \(k \in \{5,10\}\) labeled samples. After each round, a small number of representative samples are retained and replayed together with the next round’s new samples [2209.01979].

Across these formulations, the central objective is stable cumulative event detection under low-resource class expansion. The literature repeatedly identifies two core difficulties: **old knowledge forgetting** and **new class overfitting** [2404.01767][2403.17733].

## 2. Relation to adjacent problem formulations

FCED did not emerge in isolation. It inherits its few-shot component from earlier few-shot event detection (FSED), where event detection is reformulated as episodic metric learning over novel event types. An early line of work formulates event detection as **\(N+1\)-way \(K\)-shot** classification, where the additional class is a **NULL** class for non-event triggers. In this setup, a support set provides a few labeled trigger instances per event type, a query trigger is represented by a sentence and candidate trigger position, and prediction is made by comparing the query representation to support-derived class prototypes [2006.10093].

The knowledge-enhanced Bayesian line of FSED models each event type with a latent prototype vector \(V_t\), uses external event knowledge from **FrameNet**, and computes a predictive distribution
\[
p(Y_Q \mid X_Q, X_s, Y_s, F) = \int p(Y_Q \mid X_Q, V_{T_s})\, p(V_{T_s} \mid X_s, Y_s, F)\, dV_{T_s}.
\]
This framework is episodic rather than continual: it assumes a support set and query set for the current label subset and includes no memory buffer, replay mechanism, explicit anti-forgetting term, or class-incremental stream [2105.09509].

Prompt-based meta-learning provides another precursor. MetaEvent frames event detection as task-based meta-learning, using a cloze prompt, a trigger-aware soft verbalizer, and a contrastive objective based on maximum mean discrepancy (MMD) to learn class-separating features. It is designed for zero-shot and few-shot adaptation to unseen event types, but it does not include rehearsal, memory maintenance, or continual class-incremental evaluation [2305.17373].

These precursors clarify what FCED adds. Few-shot event detection targets fast adaptation to new types; incremental event detection targets retention under sequential updates; FCED requires both simultaneously. This suggests that FCED methods must combine a **novel-class learner** with explicit continual-learning machinery, rather than relying on episodic few-shot adaptation alone [2209.01979][2404.01767].

## 3. Core challenges

The literature converges on two recurrent failure modes. The first is **catastrophic forgetting** or **old knowledge forgetting**. When a detector is fine-tuned on new few-shot classes, it tends to drift away from earlier classes, especially because old classes are not fully available and sequential updates change the class distribution at each session. In FCED, this is intensified by very small replay memory and by the fact that full fine-tuning of a shared base model leads to knowledge interference between tasks [2404.01767][2509.24547].

The second is **new class overfitting**. Each incremental session may contain only one, three, five, or ten labeled examples per class, depending on the benchmark. Under such scarcity, the model can memorize the support set and generalize poorly to the query set or to future sessions. Prompt-KD treats prompt learning as a direct response to this problem, while HANet treats contrastive augmentation as a mechanism for increasing effective training diversity and improving representation invariance [2404.01767][2403.17733].

A more specific memory problem appears in CFED work that assumes only **one exemplar per event type** in memory. Replay then becomes weak because a single stored point does not adequately represent the class distribution. HANet addresses this by reconstructing a pseudo feature distribution around the stored exemplar [2403.17733].

Another recurring issue is imperfect semantic coverage from external knowledge sources. FrameNet-based methods use definitions, arguments, and lexical units as priors, but the matched frame may be incomplete, only partially aligned, or a super-ordinate frame. This is why adaptive offsets or gated corrections are introduced when knowledge is transferred into low-resource event representations [2105.09509][2209.01979].

## 4. Benchmarks, datasets, and evaluation protocols

FCED research is built largely on reconstructed or re-partitioned event detection corpora. **FewEvent** is especially central. One source reports **70,852 samples total**, **19 event types further divided into 100 event subtypes**, and after filtering **88 event types covering 15,681 samples** for the few-shot setup, split into **68 training types**, **10 validation types**, and **10 test types**, with no overlap and averaging over **5 random divisions** [2105.09509]. CIFSED work uses FewEvent with **70,852 instances**, **19 event classes subdivided into 100 subclasses**, and an average of about **700 instances per subclass** [2404.01767]. IFSED reconstructs a benchmark from FewEvent by cleaning the dataset, removing duplicates, sorting classes by sample count, and keeping **67 classes with more than 300 samples**, then reorganizing them into base, incremental, and OOD classes [2209.01979].

**MAVEN** is the other major benchmark. CIFSED reports **4,480 documents**, **118,732 event instances**, and **168 event classes**, using **100 classes with more than 200 instances** [2404.01767]. HANet also builds CFED benchmarks from MAVEN and ACE 2005, while LEAF evaluates on MAVEN with **168 event types** and **118,732 instances**, split into **5 tasks**, each with **4 event types**, under **4-way 5-shot** and **4-way 10-shot** settings [2403.17733][2509.24547].

The evaluation protocol is consistently cumulative. In CIFSED, the student is evaluated on
\[
D^{(0)} \cup D^{(1)} \cup \cdots \cup D^{(m)}.
\]
HANet evaluates each stage on all observed types at \(C_i^{test}\), and IFSED reports performance round by round on each learned class group, OOD classes, and forgetting rate [2404.01767][2403.17733][2209.01979].

The dominant metric is **micro F1**. CIFSED averages micro F1 over **5 random runs** [2404.01767]. HANet reports stage-wise \(F1_i\) and an overall continual score
\[
\bar{F1}_{micro} = \sum_{i=1}^{n} F1_i
\]
as described in the paper [2403.17733]. IFSED uses **F1-score** and defines forgetting rate as
\[
Rate_{forgetting} = \frac{\sum (p_n-p_{n-1})/p_n}{4}.
\]
This concentration on cumulative F1 reflects the fact that FCED is not merely about adapting to the current session; it is about preserving a growing event vocabulary [2209.01979].

## 5. Methodological families

A useful way to organize the literature is by the mechanism used to preserve old knowledge and the mechanism used to adapt to few-shot new classes.

| Family | Representative method | Central mechanism |
|---|---|---|
| Distillation + prompt adaptation | Prompt-KD | attention-based multi-teacher knowledge distillation; prompt learning with curriculum learning |
| Replay + external knowledge + distillation | IFSED-K / IFSED-KP | FrameNet-based knowledge, sample retention, hybrid distillation |
| Replay + augmentation + distillation | HANet | prototypical augmentation; contrastive augmentation |
| Expert modularization + semantics + distillation | LEAF | LoRA experts; semantic-aware routing; label-description contrastive learning |

**Prompt-KD** addresses forgetting through an **attention based multi-teacher knowledge distillation framework** with an **ancestor teacher** \(T^0\) trained on base classes and reused in all sessions, and a **father teacher** \(T^m\) derived from the previous student. The teacher outputs are combined by attention,
\[
p_{\text{tea}} = \sum_{i=1}^{K} \alpha_i p_i,
\]
with weights computed from teacher compatibility with ground truth. To reduce few-shot overfitting, Prompt-KD inserts a cloze prompt, “This is a [mask] event. [SEP] Its trigger words are [mask].” It further proposes a **three-stage curriculum learning prompt** with candidate sets \(\{\text{"before"}, \text{"now"}\}\) and \(\{\text{"before"}, \text{"recently"}, \text{"now"}\}\) in later stages [2404.01767].

**IFSED-K** and **IFSED-KP** combine external knowledge, replay, and distillation. They use **FrameNet** with lexical units \(L_t\), arguments/entities \(A_t\), and definitions \(D_t\),
\[
F_t = \{D_t, A_t, L_t\},
\]
and encode both class knowledge and sample sentences with BERT-based components. IFSED-K introduces an adaptive knowledge-enhanced posterior with offset
\[
\Delta h_t = \lambda_t \odot (s_t - k_t),
\]
while sample retention keeps the **\(j\) closest samples**, usually \(j=1\) or \(2\), to each class prototype for replay. Training uses a hybrid loss combining cross-entropy, feature-level distillation, and prediction-level distillation [2209.01979].

**HANet** is a memory-based framework with two augmentation layers. For old classes, **Prototypical Augmentation (PA)** reconstructs a pseudo feature space from a single exemplar per event type by assuming a Gaussian feature distribution
\[
\mathcal{N}(\mathbf{\mu}_j, \mathbf{\sigma}_j^2),
\]
sampling synthetic memory features for replay. For new classes, **Contrastive Augmentation (CA)** creates multiple sentence views by dropout, random token shuffle, or random token replacement, and applies contrastive losses at both sentence and trigger levels. Incremental training optimizes
\[
\mathcal{L}_{ce} + \mathcal{L}_{fd} + \mathcal{L}_{pd} + \mathcal{L}_{re} + \mathcal{L}_{cls} + \mathcal{L}_{trig}
\]
with corresponding weights [2403.17733].

**LEAF** replaces full fine-tuning with expert modularization. It keeps a **BERT-base-uncased** backbone fixed and attaches multiple **LoRA experts** to each transformer layer,
\[
E_k^l() = A_k^l B_k^l,
\]
then selects top-\(K\) experts for each instance using a semantic routing score
\[
s_k^l(x_i) = {W_k^l}^\top h_i^{CLS}.
\]
LEAF further adds a router loss, a label-description contrastive objective using event label descriptions generated by **Gemini 2.0**, and feature- and prediction-level distillation from the model after the previous task [2509.24547].

A recurring pattern across these methods is the combination of three ingredients: some form of **memory or prior preservation**, some form of **semantic regularization** for scarce new classes, and some form of **distillation or modularization** to reduce interference. This suggests that FCED has become a synthesis problem rather than a single-technique problem.

## 6. Empirical findings, limitations, and research trajectory

The earliest few-shot event detection work already showed that metric-based models benefit from additional support-set structure. In ACE-2005 experiments with disjoint train and test event types, adding **intra-cluster matching** and **inter-cluster information** losses improved prototypical variants substantially; for example, in **LSTM + Proto**, the reported micro-F1 moves from **65.94** to **77.56** under **+Intra+Inter** [2006.10093]. Knowledge-enhanced Bayesian meta-learning then showed that external event knowledge can matter even more strongly in purely episodic FSED, with **AKE-BML** outperforming **DMN-MPN** by roughly **15–23 F1 points** across six settings, including **88.99** versus **73.59** F1 in **5-way-5-shot** and **87.13** versus **67.84** in **10-way-15-shot** [2105.09509].

Once FCED is formulated explicitly, retention becomes measurable. In IFSED, the reported forgetting rates on **5-way-5-shot** are **70.33%** for **FINETUNE**, **26.05%** for **KCN**, **19.92%** for **AKE**, **16.42%** for **IFSED-KP**, and **22.54%** for **IFSED-K**. The paper’s stated conclusion is that **external knowledge + replay + hybrid distillation** improve continual few-shot event detection, and that the prototype or meta-learning version is especially strong in reducing forgetting [2209.01979].

Prompt-KD reports consistent gains over **PA-CRF-CIL** on both FewEvent and MAVEN. In **5-way 1-shot**, average F1 on FewEvent rises from **44.91** to **52.44**, and on MAVEN from **29.93** to **34.76**. In **10-way 1-shot**, FewEvent rises from **42.95** to **47.99**, and MAVEN from **26.64** to **30.88**. The paper further reports roughly **5–8% average F1 improvement on FewEvent** and roughly **4–5% average F1 improvement on MAVEN** [2404.01767].

HANet reports gains over prior continual and incremental baselines, including **+7.27% micro-F1** on **4-way 5-shot MAVEN** and **+8.44% micro-F1** on **2-way 5-shot ACE** over the previous best, with strong ablation evidence that both **PA** and **CA** matter. Removing **PA** lowers performance by about **2.09%** and **1.57%** on average in the reported settings; removing **CA** causes about **5.04%** and **4.27%** drops in \(\bar{F1}_{micro}\); removing both yields a decline of **9.46%** and **9.72%** [2403.17733].

LEAF advances the FCED line by treating interference itself as an architectural problem. On the final task, LEAF reports **51.2** on **4-way 5-shot MAVEN**, **54.9** on **4-way 10-shot MAVEN**, **55.5** on **2-way 5-shot ACE-2005**, and **61.6** on **2-way 10-shot ACE-2005**. The paper states that LEAF surpasses HANet by about **6%** on **2-way 5-shot** and about **3%** on **2-way 10-shot**, and achieves at least **10% higher F1** on MAVEN final task than older baselines and **24% higher F1** on ACE-2005 final task than older baselines [2509.24547].

Several limitations recur across the literature. IFSED notes that no development set is used during training in the reported experiments and that hyperparameters are chosen by experience and prior recommendations [2209.01979]. HANet assumes a fixed number of new event types per task and constant shot number, which the paper explicitly notes may not match real-world event emergence [2403.17733]. FrameNet-based methods depend on the coverage and alignment quality of an external knowledge base, and the need for adaptive offsets indicates that direct label-to-frame correspondence is often imperfect [2105.09509][2209.01979]. LEAF observes that too many experts can degrade performance in the few-shot regime, with **4 experts** performing best overall in its analysis [2509.24547].

The research trajectory therefore moves from **few-shot prototype formation**, to **knowledge-enhanced priors**, to **explicit continual formulations with replay and distillation**, and then toward **memory augmentation** and **modular expert routing**. A plausible implication is that FCED has matured into a setting where progress depends on balancing semantic transfer, memory efficiency, and interference control, rather than optimizing any one of these dimensions in isolation.

Source: https://www.emergentmind.com/topics/few-shot-continual-event-detection-fced