---
title: Online Continual Learning on Graphs
url: https://www.emergentmind.com/topics/online-continual-learning-on-graphs
type: topic
---

# Online Continual Learning on Graphs

Searching arXiv for relevant papers on online continual learning on graphs and related subareas.
First, I’ll look up recent arXiv papers directly related to online/continual graph learning, replay, streaming graph learning, and graph-structure adaptation.
Online continual learning on graphs studies sequential adaptation under graph-structured non-stationarity: graph data, graph topology, labels, or tasks arrive over time, historical raw data are often unavailable or bounded by memory, and the learner must update without catastrophic forgetting while remaining computationally viable on evolving neighborhoods and large graphs. In the current literature, this umbrella spans at least three closely related regimes: continual graph learning on sequences of task graphs or timestamped subgraphs, stricter node-streaming formulations in which a growing graph is updated online with bounded per-batch computation, and online graph-signal or graph-topology adaptation in which the graph or graph filter itself is learned from streaming observations [2202.10688][2408.09350][2508.03283][2301.06898][2110.11017].

## 1. Conceptual scope and problem formulation

A persistent theme in graph continual learning is that graph samples are not i.i.d. objects. In node-level settings, later graph data can be correlated with earlier graph data through topology, including inter-task edges, so the disappearance of old graph context can directly distort the distribution of new tasks [2408.09350]. More generally, graph lifelong learning has been framed as learning over an evolving graph sequence
\[
G=(G_1,G_2,\dots,G_t), \qquad G_t = G_{t-1} + \Delta G_t,
\]
together with a sequential task stream
\[
T=(T_1,T_2,\dots,T_t),
\]
while preserving performance on prior tasks [2202.10688].

The literature does not use a single protocol. Many influential methods are task-sequential rather than fully instance-online. E-CGL studies continual node classification on an evolving graph split into timestamped subgraphs/tasks \(G_1,\dots,G_T\), with replay from a bounded memory bank and sequential class or task expansion [2408.09350]. RAM-CG also assumes a task-incremental setting in which time step is visible during both training and testing, and only current graph data are available at each step [2308.08259]. G\(^2\)LoRA is explicitly framed as sequential/task-stream continual learning with explicit task sessions rather than fully instance-online learning [2606.01873]. CaT, PUMA, PromptCGL, and TA\(\mathbb{CO}\) likewise process incoming graph tasks or temporal subgraphs one period at a time rather than event by event [2309.09455][2312.14439][2502.06327][2401.03077].

By contrast, “Online Continual Graph Learning” formalizes a stricter node-streaming regime in which the graph at time \(t\) is
\[
\mathcal{G}^t=(\mathcal{V}^t,E^t,X^t), \qquad \mathcal{V}^t=\{v_i\}_{i\le t},
\]
and each arriving unit is a node tuple
\[
(v_t,\mathcal{N}(v_t),x_t),
\]
with anytime prediction and bounded per-batch compute central to the definition [2508.03283]. This stricter formulation was motivated by the observation that much prior “streaming” graph CL still processes large subgraphs or snapshots offline with multiple passes [2508.03283].

A second boundary of the field concerns what is being learned. Most graph continual learning papers target downstream prediction, usually node classification [2408.09350][2309.09455][2312.14439][2401.03077]. A different line targets online graph filters or graph topology itself: online FIR filter adaptation on expanding graphs [2301.06898], online graph topology estimation under dynamic environments [2110.05023], and a model-independent framework for learning time-varying graph structure from online data [2110.11017]. This suggests that “online continual learning on graphs” includes both continual prediction on graphs and continual adaptation of graph operators.

## 2. Learning regimes, task structure, and evaluation

The survey literature organizes graph lifelong learning through the continual-learning scenarios of **new instances (NI)**, **new classes (NC)**, and **new instances and classes (NIC)**, with NI and NIC described as often more realistic for graph domains [2202.10688]. More recent graph papers use the now-standard continual-learning taxonomies more explicitly. E-CGL benchmarks both task-incremental learning and class-incremental learning with disjoint label sets across tasks [2408.09350]. G\(^2\)LoRA supports class-incremental, domain-incremental, and task-incremental modes for text-attributed graphs, unifying node-, link-, and graph-level tasks under a graph–text alignment objective [2606.01873]. UGCL broadens the scope further to node-unit node classification, graph-unit graph classification, and graph-unit node classification, all under class-incremental evaluation without task identity at inference [2308.13982].

Temporal formulations need not coincide with class partitioning. TA\(\mathbb{CO}\) defines tasks by time periods in an expanding temporal graph, with edges assigned to period \(t\) according to the source-node timestamp and with overlap between old and new periods through shared nodes and cross-time edges [2401.03077]. ContinualGNN is even closer to task-free continual adaptation: it treats each graph update \(G^t=G^{t-1}+\Delta G^t\) as the current signal, detects nodes whose representations change significantly, and trains only on newly influenced nodes plus memory nodes [2009.10951].

Evaluation is highly standardized around a lower-triangular performance matrix. E-CGL uses \(\mathbf{M}^p\in\mathbb{R}^{T\times T}\), where \(\mathbf{M}^p_{i,j}\) is accuracy on task \(j\) after training through task \(i\), and derives average accuracy and average forgetting from it [2408.09350]. OCGL defines
\[
M\in\mathbb{R}^{T\times T}, \qquad \text{AP}=\frac{1}{T}\sum_{i=1}^T M_{T,i}, \qquad
\text{AF}=\frac{1}{T-1}\sum_{i=1}^{T-1} M_{T,i}-M_{i,i},
\]
and adds
\[
\text{AAP}=\frac{1}{n}\sum_{t=1}^n \text{AP}_t
\]
to measure anytime performance over the stream [2508.03283]. Other papers use closely related metrics such as ACC/BWF [2308.08259], AP/BWT [2309.09455][2312.14439], or task-wise rNMSE for online interpolation on expanding graphs [2301.06898].

A recurring protocol detail is that many graph benchmarks are transductive. CaT and PUMA explicitly assume the whole graph structure is observable for the current task, including test nodes, though only training nodes contribute supervision [2309.09455][2312.14439]. OCGL also uses a transductive setup in which validation and test nodes are available for message passing but excluded from the training loss [2508.03283]. This is important because, on graphs, unlabeled nodes still alter receptive fields and therefore the continual-learning dynamics.

## 3. Replay, condensation, coarsening, and structure-preserving memory

The survey taxonomy places rehearsal among the primary families of graph lifelong learning methods, alongside architectural, regularization, and hybrid approaches [2202.10688]. In graph settings, however, replay is rarely just sample rehearsal: the stored object may be nodes with neighborhoods, sparsified computational subgraphs, condensed synthetic graphs, or a bounded reduced graph that preserves topology.

| Family | Representative methods | Memory object |
|---|---|---|
| Node/subgraph replay | ER-GNN, SSM, E-CGL | replay nodes, labels, or sparsified subgraphs [2202.10688][2408.09350] |
| Condensation-based replay | CaT, PUMA | condensed synthetic graphs or edge-free synthetic memories [2309.09455][2312.14439] |
| Coarsened graph memory | TA\(\mathbb{CO}\) | bounded reduced graph with node-to-supernode mapping [2401.03077] |
| Replay with structural distillation | UGCL | graph-associated items plus local/global structure consistency losses [2308.13982] |

E-CGL exemplifies graph-aware node replay. It stores replay nodes and labels rather than full old subgraphs, but selects replay nodes using a combined importance and diversity score rather than random sampling [2408.09350]. Importance starts from PageRank and is augmented with attribute-aware transitions under a homophily assumption via an AttriRank-style approximation, while diversity is defined as the distance between a node feature and the average feature of its 1-hop neighbors [2408.09350]. Under a fixed memory budget, replay nodes are drawn from both selectors, with the best setting using 75% importance-sampled nodes and 25% diversity-sampled nodes [2408.09350].

CaT and PUMA turn replay into graph condensation. CaT first condenses each incoming graph into a small synthesized replay graph and then updates the model using only the Condensed Graph Memory rather than the whole incoming graph plus memory, a scheme called Training in Memory [2309.09455]. PUMA extends this idea in three ways stated explicitly in the paper: it incorporates pseudo-labeled unlabeled nodes during condensation, retrains from scratch on the evolving memory bank to rebalance optimization, and accelerates both condensation and replay via one-time propagation, wide random encoders, and MLP-based replay training on edge-free memories [2312.14439]. The result is a replay memory that stores only synthetic node features and labels, not explicit edges, while still approximating the original graph distribution in an embedding space [2312.14439].

TA\(\mathbb{CO}\) pursues a different memory design. Instead of storing sampled nodes or synthetic edge-free graphs, it maintains a bounded reduced graph \(\mathcal{G}_t^r\) plus a node-to-supernode mapping \(\mathcal{M}_t\), expands that reduced graph by combining it with the new temporal subgraph, and then coarsens the combined graph again to maintain stable size [2401.03077]. Its RePro coarsening algorithm merges connected node pairs according to cosine similarity of first-layer GNN representations, while Node Fidelity Preservation penalizes merges involving replay-buffer nodes to alleviate minority-class erosion under majority-vote coarsening [2401.03077]. The paper proves that the reduced-graph node count is upper-bounded by \(\frac{1-\gamma}{\gamma}\cdot n_{\max}\), where \(n_{\max}\) is the maximum number of new nodes in any task [2401.03077].

UGCL shows that replay need not only preserve labels. Its memory stores graph-associated items so that rehearsal can be combined with **Local Structure Distillation**, which aligns node-vs-neighbor relational geometry, and **Global Structure Distillation**, which aligns graph-level embeddings between the current model and the previous-task model [2308.13982]. This line of work treats local and global structure consistency as first-class replay targets rather than incidental side effects.

Empirically, replay-based graph-specific methods are repeatedly reported as stronger than generic regularization baselines in class-incremental graph learning. E-CGL states that replay-based graph-specific methods clearly outperform classical parameter-regularization methods in graph CL, especially in class-IL [2408.09350]. UGCL reports that rehearsal is much more effective than parameter regularization in its graph-unit node-classification experiments [2308.13982]. CaT and PUMA further argue that replay quality and replay balance are distinct problems: better memory objects are insufficient if a large current graph still overwhelms a tiny historical memory during optimization [2309.09455][2312.14439].

## 4. Replay-free regularization, prompting, and parameter-efficient adaptation

Replay is not the only design axis. A major body of work seeks replay-free continual graph learning through regularization, masking, prompting, or parameter-efficient adaptation. The survey already identified topology-aware regularization as a graph-specific departure from vanilla EWC-style penalties, with TWP preserving important aggregation parameters rather than only generic weights [2202.10688].

Recent replay-free work has pushed this substantially further. “Unbiased Online Curvature Approximation for Regularized Graph Continual Learning” formulates a general regularization framework in the curved parameter space induced by the Fisher Information Matrix and shows that EWC and its variants are special cases based on diagonal empirical FIM approximations at previous-task parameters [2509.12727]. Its main contribution is an unbiased online approximation of the **full** current-state FIM regularizer, computed implicitly through sampled predictive-label gradients without explicitly forming or storing the FIM itself [2509.12727]. In the paper’s replay-free class-incremental node-classification setting, this markedly improves forgetting relative to EWC-style baselines.

RAM-CG offers a different replay-free answer: preserve invariant latent relations while isolating task-specific decision structure [2308.08259]. The method learns relation-aware message passing channels intended to capture latent relations behind edges, freezes the relation-discovery module after the first task, and uses a task-awareness masking classifier that updates only previously unused or task-selected parameters [2308.08259]. This places the method between full parameter sharing and full architecture expansion, but it requires task identity at inference and is explicitly task-incremental [2308.08259].

PromptCGL replaces replay with prompt tuning. After pretraining a base GNN on an initial task, the backbone is frozen and later tasks learn only node-level and subgraph-level prompts plus a prediction layer [2502.06327]. Personalized prompts are generated for each node by a prompt generator that softly combines a small maintained prompt set, so storage scales as \(O(k\cdot d)\) rather than the replay-style \(O(N\cdot d)\) reported in the paper [2502.06327]. The framework assumes known task boundaries and retrieves the corresponding prompt bank entry at inference, so it is task-aware rather than task-agnostic [2502.06327].

G\(^2\)LoRA carries the same replay-free spirit into text-attributed graphs. It freezes a dual graph–text encoder and trains only lightweight adapters, but adds category-aware gradient projection, conditional backward transfer, and gradient magnitude modulation to balance update speeds between graph and text encoders [2606.01873]. Its setting is sequential and task-bounded rather than fully online, yet it is notable for unifying node-, link-, and graph-level tasks under a shared graph–text alignment loss and supporting class-, domain-, and task-incremental modes in one framework [2606.01873].

A practical misconception addressed by these papers is that replay-free necessarily means memory-free. PromptCGL stores task-specific prompts [2502.06327]. G\(^2\)LoRA stores historical subspaces, prototypes, and adapter structure [2606.01873]. Curvature-based replay-free regularization stores historical parameter snapshots and gradient queues rather than raw data [2509.12727]. Replay-free graph CL therefore removes raw-data rehearsal, not auxiliary state.

## 5. Strictly online adaptation: node streams, expanding graphs, filters, and graph topology

The stricter online regime emphasizes single-pass or low-pass updates, bounded per-batch computation, and predictions that are valid immediately after each batch. “Online Continual Graph Learning” crystallizes this regime and argues that graph OCL differs from standard OCL because message passing ties each sample to an \(L\)-hop neighborhood whose size scales roughly as \(O(d^L)\) and can grow over time through densification [2508.03283]. Its proposed systems-level remedy is neighborhood sampling: instead of feeding the full ego-graph \(\mathcal{G}_{v,L}^t\), the learner receives a subsampled version \(\widetilde{\mathcal{G}_{v,L}^t}\) so that per-batch memory and compute remain bounded [2508.03283].

ContinualGNN is an earlier snapshot-based precursor to this online perspective. It decomposes each update into learning **new patterns** on nodes whose \(L\)-layer representations change significantly,
\[
\mathcal{I}(\Delta G^t)=\{u\mid \|\Delta \mathbf{h}_u^{t,L}\|>\delta\},
\]
plus consolidation of **existing patterns** through replay and Fisher-weighted regularization estimated from memory [2009.10951]. This is not class-incremental learning; it is task-free continual node classification on evolving attributed graphs, where new nodes, changed edges, and changed node attributes alter neighborhood patterns over time [2009.10951].

A narrower but theoretically clean online formulation appears in “Online Filtering over Expanding Graphs”. There the graph grows by node arrivals only, with adjacency
\[
\mathbf{A}_{t+1}=
\begin{bmatrix}
\mathbf{A}_t & \mathbf{0}\\
\mathbf{a}_{t+1}^{\top} & 0
\end{bmatrix},
\]
and the learner performs online gradient descent on FIR graph-filter coefficients to interpolate the incoming node’s signal [2301.06898]. The paper proves a static regret bound
\[
R_T(\mathbf{u})\le \frac{\|\mathbf{u}\|_2^2}{2\eta}+\frac{\eta}{2}L^2T,
\]
so average regret vanishes with appropriate step-size scaling [2301.06898]. This does not address catastrophic forgetting in the CL sense, but it is a canonical example of online graph adaptation under strict sequential arrivals.

A related line studies online graph topology learning rather than downstream prediction. “Online Graph Learning in Dynamic Environments” updates an edge-weight vector \(\mathbf{w}_t\) for a weighted undirected graph by projected online gradient steps plus a dynamic prior \(\Phi\), obtaining sublinear **dynamic regret** relative to the best time-varying graph sequence in hindsight [2110.05023]. “Learning Time-Varying Graphs from Online Data” generalizes this idea into a model-independent prediction-correction framework in which the evolving sufficient statistic is the recursively updated covariance
\[
\hat{\boldsymbol{\Sigma}}_t=\gamma \hat{\boldsymbol{\Sigma}}_{t-1}+(1-\gamma)\mathbf{x}_t\mathbf{x}_t^\top,
\]
and the learned graph parameter may be a precision matrix, SEM coefficient matrix, or smoothness-based adjacency, depending on the model specialization [2110.11017]. These papers show that online graph learning can be formulated as continual tracking of graph structure itself, not only continual training of predictors defined on a fixed graph.

The efficiency problem remains central even in task-sequential graph CL. E-CGL argues that repeated GNN message passing is too expensive for large evolving graphs and trains an MLP whose weights are transferred into a GCN only at inference, obtaining reported average speedups of \(15.83\times\) in training and \(4.89\times\) in inference across four datasets [2408.09350]. This is not strict online learning, but it addresses the same systems bottleneck highlighted by OCGL: message passing becomes the dominant cost when graph neighborhoods grow.

## 6. Empirical regularities, misconceptions, and open problems

Several empirical regularities recur across the literature. First, graph-specific replay or memory mechanisms are usually stronger than generic regularization in difficult class-incremental settings [2408.09350][2308.13982]. Second, preserving topology or structural geometry is repeatedly beneficial: UGCL’s local/global structure distillation, TA\(\mathbb{CO}\)’s reduced-graph memory, and graph-aware replay buffers such as SSM or PDGNN in OCGL all outperform baselines that treat old samples as isolated feature-label pairs [2308.13982][2401.03077][2508.03283]. Third, efficiency innovations matter as much as anti-forgetting innovations; E-CGL’s MLP-training scheme, CaT/PUMA’s condensed memories, and OCGL’s sampled neighborhoods all target the cost of message passing on expanding graphs [2408.09350][2309.09455][2312.14439][2508.03283].

A common misconception is that all “streaming” graph continual learning is online in the strict OCL sense. Multiple papers explicitly reject that interpretation. E-CGL is task-by-task with delayed replay and 200 epochs per task, not one-shot online learning [2408.09350]. G\(^2\)LoRA is sequential and replay-free but uses task sessions, AdamW, and early stopping rather than single-pass updates [2606.01873]. RAM-CG, CaT, PUMA, PromptCGL, and TA\(\mathbb{CO}\) all assume explicit task or time-period boundaries and process each period as a batch [2308.08259][2309.09455][2312.14439][2502.06327][2401.03077]. This distinction matters because the requirements of bounded latency, anytime prediction, and one-pass data processing are much stricter than those of ordinary task-sequential continual learning [2508.03283].

Open problems are correspondingly layered. OCGL calls for stronger streaming evaluation protocols, better bounded-cost handling of neighborhood expansion, more effective memory designs for topology-aware replay, and methods that remain robust on heterophilous graphs, where its Roman Empire benchmark remains difficult [2508.03283]. E-CGL identifies stricter online settings with single-pass updates, privacy-preserving replay, richer dynamic topology evolution, heterogeneous graphs, graph-level tasks, and mechanisms for actively forgetting stale knowledge as open directions [2408.09350]. PUMA points to inductive or dynamic-graph settings with inter-task edges, uncertainty-aware pseudo-labeling, adaptive memory budgeting, and richer condensed memory representations [2312.14439]. The survey emphasizes uncertain neighborhoods, extreme evolution, global dependency learning, class imbalance, and the lack of standardized graph continual-learning benchmarks [2202.10688].

Taken together, the literature defines online continual learning on graphs less as a single benchmark than as a design space with competing constraints: retention vs plasticity, topology preservation vs memory budget, expressive message passing vs bounded online computation, and task-aware sequential adaptation vs truly task-free streaming. Current methods are strongest when the stream can be segmented into tasks or periods and when some form of structured memory—raw, synthetic, reduced, or parametric—is allowed. Strict node-streaming continual learning with dynamic topology, bounded compute, no raw replay, and task-agnostic inference remains substantially open [2508.03283].

Source: https://www.emergentmind.com/topics/online-continual-learning-on-graphs