Multi-Scale Spike Aggregation (MSSA)

• Multi-Scale Spike Aggregation (MSSA) is a neural module that hierarchically fuses spike-based features across local and semi-global scales for spatial-temporal analysis.
• It employs a two-level sampling strategy with importance-based pruning and LIF dynamics to achieve efficient multi-hop neighborhood aggregation.
• MSSA underpins various systems like SpikeSTAG, MSViT, and MSIT by adapting graph learning and cross-scale fusion to reduce computational complexity.

Multi-Scale Spike Aggregation (MSSA) is, in exact recent arXiv usage, the spatial graph-processing module introduced in SpikeSTAG for multivariate spatial-temporal forecasting, where it hierarchically aggregates neighborhood information through spiking SAGE layers under an adaptively learned graph (Hu et al., 4 Aug 2025). The acronym is, however, overloaded. In MSViT, MSSA denotes Multi-Scale Spiking Attention, and in MSIT it denotes Multi-Scale Self-Attention, not spike aggregation in the graph sense (Hua et al., 19 May 2025). This suggests that the contemporary literature contains both a narrow meaning—SpikeSTAG’s graph aggregator—and a broader family of spike- or event-domain modules that fuse information from multiple scales, receptive fields, or semantic levels under spiking or coordinate-aware constraints (Zhu et al., 2024).

1. Terminology and acronym scope

The exact expansion of MSSA depends on the paper, and that distinction is methodologically important rather than merely lexical.

Paper	Expansion of MSSA	Domain
SpikeSTAG (Hu et al., 4 Aug 2025)	Multi-Scale Spike Aggregation	Spatial graph modeling for multivariate time-series forecasting
MSViT (Hua et al., 19 May 2025)	Multi-Scale Spiking Attention	Hierarchical spiking vision transformer
MSIT (Zhu et al., 2024)	Multi-Scale Self-Attention	Arbitrary-scale image super-resolution

In SpikeSTAG, MSSA is the spatial core of a GNN-SNN collaboration architecture. In MSViT, the same acronym names a spike-driven attention block that fuses two scale-specific spike feature streams before gating the value branch. In MSIT, MSSA is a coordinate-aware self-attention mechanism over multi-scale latent codes for arbitrary-scale super-resolution. The literature therefore does not support treating these modules as interchangeable, even when all of them involve some form of multi-scale fusion or aggregation.

A further terminological caution arises in vision SNN work. SpikSSD does not use the acronym MSSA, but its Spiking Bi-direction Fusion Module performs an explicit multi-scale spike-domain fusion over a feature pyramid from $1/8$ to $1/128$ resolution, making it relevant as a neighboring design pattern rather than as an instance of the named module (Fan et al., 25 Jan 2025).

2. SpikeSTAG’s formal definition of MSSA

Within SpikeSTAG, MSSA operates in a multivariate spatial-temporal forecasting setting. The observed variables at time $t$ are written as

$\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$

and the model augments them with temporal covariates to form

$$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$

The architecture is a three-stage pipeline: preprocessing with time-feature embedding and adaptive graph learning, an Observation (OBS) Block for sequence-feature refinement, and then MSSA followed by the Dual-Path Spike Fusion (DSF) Block and prediction (Hu et al., 4 Aug 2025).

The learned graph is defined by

$$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$

where $\mathbf{E}\in\mathbb{R}^{N\times d}$ is the node embedding matrix. Before MSSA, the OBS block already injects local relational structure: $$\mathbf{x}_i' = \mathbf{x}_i + \sum_{j\in\mathcal{N}(i)} \alpha_{ij}\mathbf{v}_j.$$ Accordingly, MSSA does not receive raw observations; it receives temporally enriched and neighborhood-refined node features together with the adaptive adjacency.

The paper presents MSSA as a refinement of conventional GraphSAGE. Its stated purpose is to bridge a specific gap: prior SNN forecasters largely focus on temporal modeling, whereas many graph forecasting models rely on dense floating-point spatial propagation. MSSA is introduced to make graph aggregation both multi-hop and spike-driven, so that explicit spatial dependency modeling can coexist with event-driven temporal processing in the same forecasting architecture (Hu et al., 4 Aug 2025).

3. Sampling, multi-hop aggregation, and spiking dynamics

SpikeSTAG’s MSSA has two named subcomponents: importance-based sampling and spiking aggregation. For each node $i$, weak edges are first pruned by thresholding the learned adjacency: $C_i = \{\, j \mid A_{i,j} > T_i \,\}.$ The printed formula for $1/128$0 is corrupted in the manuscript, but the accompanying text explains it as the average weight of the outgoing edges of node $1/128$1, adapting to the local neighborhood without manual tuning. After pruning, perceptual-importance truncation is defined by

$1/128$2

and then top-$1/128$3 nodes are selected to form the neighborhood for the current sampling layer (Hu et al., 4 Aug 2025).

The “multi-scale” aspect is realized as a two-level sampling paradigm—local followed by semi-global. At the first scale, a node aggregates over a sampled local neighborhood; at the second, the same procedure is repeated over a broader neighborhood, yielding a two-hop representation. The paper explicitly describes repeating the same routine for the two-hop neighborhood $1/128$4.

For node $1/128$5 at aggregation scale or hop $1/128$6 in the manuscript’s notation, the pre-synaptic potential is

$1/128$7

where $1/128$8 is the spike train of neighbor node $1/128$9. This is then passed through an LIF layer: $t$0

The relevant LIF dynamics are written as

$t$1

Training uses a surrogate gradient, with derivative approximated by

$t$2

The paper notes neither an explicit internal normalization equation for MSSA nor a fusion equation combining $t$3 and $t$4. It also does not specify whether standard GraphSAGE self-feature concatenation is retained exactly. The documented mechanism is therefore clear at the level of sampled multi-hop spike aggregation, but not fully specified at every low-level implementation detail (Hu et al., 4 Aug 2025).

4. Computational role and relation to graph methods

MSSA is positioned as the spatial half of SpikeSTAG’s GNN-SNN collaboration. After OBS, MSSA produces a high-order spatial-temporal spike representation $t$5, which is then sent to DSF. DSF combines an LSTM branch with a spiking self-attention branch through a gate: $t$6

$t$7

$t$8

This makes MSSA complementary rather than terminal: it supplies the spatially structured spike features on which the later temporal fusion operates (Hu et al., 4 Aug 2025).

A central design claim is efficiency. When node features are one-bit spikes, the paper states that dense $t$9 multiplication can be replaced by Index-Mask Aggregation, where the model indexes active positions and sums feature vectors from sampled neighbors. The stated arithmetic intensity drops from

$\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$0

to

$\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$1

because only sampled edges are processed. The text further claims that memory footprint and runtime then scale linearly with graph size under the sampling budget $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$2 (Hu et al., 4 Aug 2025).

Relative to other graph methods, MSSA is closest conceptually to GraphSAGE. Compared with a GCN-style dense propagation, it does not aggregate over the full graph with dense matrix multiplication. Compared with GAT, its novelty is not learned dense attention coefficients per edge during each propagation step. Compared with standard GraphSAGE, the novelty lies in transferring sampled hierarchical aggregation into a spike-native setting where neighbor features are binary spike trains and the nonlinear update is LIF firing (Hu et al., 4 Aug 2025).

5. Vision-oriented relatives: attention and fusion modules with MSSA-like behavior

Although SpikeSTAG contains the exact term Multi-Scale Spike Aggregation, related SNN vision models instantiate closely related mechanisms under different names. In MSViT, MSSA explicitly means Multi-Scale Spiking Attention, not aggregation. Its input is a spike map

$\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$3

from which three spike-form branches are constructed: $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$4 Here $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$5 and $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$6 are two feature views at different scales or semantic levels, with the ablation section identifying $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$7 with a $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$8 branch and $\mathbf{Z}_t = [z_t^{(1)},\dots,z_t^{(N)}]^\top,$9 with a larger-kernel branch. MSSA then collapses each branch across channels and fuses the resulting per-token cues: $$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$0

$$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$1

The paper explicitly frames this as attention rather than generic aggregation because the fused signal functions as spike-based attention weights over the value stream (Hua et al., 19 May 2025).

SpikSSD provides another closely related pattern without using the term MSSA. Its Spiking Bi-direction Fusion Module receives feature maps at resolutions

$$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$2

and performs bidirectional cross-scale fusion through nearest-neighbor interpolation or max-pooling, followed by LIF, $$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$3 convolution, tdBN, membrane addition, and refinement by MDSF-Block. The paper emphasizes that this is not ANN-style weighted feature summation after decoding, but spike-domain aggregation by adding membrane synaptic inputs (Fan et al., 25 Jan 2025).

A third relative is Spiking Multiscale Attention (SMA), which performs parallel multiscale coding and then scale-weighted aggregation over spatiotemporal SNN features. Given

$$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$4

its encoder forms scale-specific features $$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$5, and the decoder computes temporal and channel weights $$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$6 and $$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$7. Final fusion is

$$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$8

The paper does not call this MSSA, but the operation is clearly a weighted multi-scale spike/event aggregation over scale branches (Shan et al., 2024).

6. Broader scientific uses of multi-scale spike aggregation

Outside deep SNN architecture design, the phrase “multi-scale spike aggregation” also aligns with two other research directions. In systems neuroscience, one approach turns spike trains into a directed functional interaction network and then aggregates neurons into assemblies across a continuum of graph resolutions. The multiscale structure there is governed by a synaptic-like temporal scale $$\mathbf{X}_t = [\mathbf{Z}_t^\top,\mathbf{m}_t^\top,\mathbf{h}_t^\top,\mathbf{d}_t^\top]^\top \in \mathbb{R}^{N+3}.$$9 in the pairwise interaction kernel and a graph-diffusion resolution parameter $$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$0 in Markov Stability. This framework reveals cell assemblies at multiple levels of granularity rather than a single prescribed clustering scale (Billeh et al., 2014).

A second, more mathematical direction represents population spike patterns as sets of event pairs on a cylinder and decomposes them into contributions from a fixed basis of helices. The key operation is

$$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$1

and the transform

$$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$2

serves as a compact fingerprint of a spike pattern. This work is highly relevant as an aggregation framework over neurons and time, but it is not explicitly multi-scale in the hierarchical sense; scale-like behavior emerges only indirectly through helix frequency and window choice (Busch et al., 2024).

A biologically plausible precursor appears in multi-scale visual object coding with spatial-frequency channels, first-spike latency coding, STDP, and winner-take-all inhibition. There, low-, medium-, and high-spatial-frequency LGN maps are added and converted to spike latencies before driving a shared V1 population. The aggregation is therefore explicit at the representation level, but not implemented as a learned fusion block (Sanchez-Garcia et al., 2022).

7. Empirical evidence, limitations, and current interpretive boundaries

The empirical status of MSSA differs sharply across papers. For SpikeSTAG, the paper reports that the complete model surpasses the state-of-the-art SNN-based iSpikformer on all datasets and outperforms traditional temporal models at long horizons, but it does not provide a dedicated ablation that removes MSSA while keeping the rest fixed. The available support for MSSA is therefore indirect: the architecture as a whole benefits from explicit spatial modeling, and MSSA is identified as the principal graph aggregation component, but its standalone contribution is not separately quantified (Hu et al., 4 Aug 2025).

By contrast, some neighboring modules have more explicit ablation support. In MSViT, the CIFAR100 ablation shows that cross-scale fusion of different branches is more effective than same-scale fusion or single-branch variants: MSSA(P+Q) + SSA reaches 81.98% with 7.59M params, outperforming MSSA(P+P) + SSA, MSSA(Q+Q) + SSA, and single-branch variants. The paper interprets this as evidence that the useful part is cross-scale fusion rather than same-scale duplication (Hua et al., 19 May 2025). In SpikSSD, adding SBFM improves GEN1 results from 34.7 mAP to 37.6 mAP for MDS-ResNet18 and from 37.4 to 39.2 for MDS-ResNet34, while the supplementary ablation further shows that bidirectional fusion outperforms one-way fusion (Fan et al., 25 Jan 2025).

Several limitations recur. SpikeSTAG’s threshold formula is corrupted in print, the multi-scale fusion equation is omitted, and exact top-$$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$3 values and hidden dimensions are not specified. MSViT contains a $$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$4 versus $$\mathbf{A} = \sigma\!\left(\mathbf{E}\mathbf{E}^\top\right) + \lambda \mathbf{I},$$5 inconsistency for one MSSA branch and a likely residual-stack notation error. SMA leaves some tensor broadcasting details under-formalized. In the mathematical helix framework, the representation preserves per-neuron phasor sums rather than the full spike set. These are not minor editorial issues: they delimit how precisely each method can be reimplemented from the manuscript alone (Hu et al., 4 Aug 2025).

The current literature therefore supports two complementary readings of MSSA. In the narrow sense, MSSA denotes SpikeSTAG’s graph-based, multi-hop, spike-native neighborhood aggregator for spatial-temporal forecasting (Hu et al., 4 Aug 2025). In the broader architectural sense, it denotes a family resemblance among modules that fuse scale-diverse spike or event features by channel summation, membrane-domain addition, scale-weighted fusion, or coordinate-aware attention under spiking constraints (Hua et al., 19 May 2025).