SlideMamba for Efficient WSI Analysis

• SlideMamba is a family of neural architectures that integrates graph-based local reasoning with input-adaptive state space models for scalable whole-slide image analysis.
• It employs innovative entropy-based adaptive fusion strategies to balance local and global features, achieving high predictive performance in clinical tasks.
• Empirical studies demonstrate that SlideMamba reduces computational cost by up to 7× compared to transformer-based methods while maintaining state-of-the-art accuracy.

SlideMamba refers to a family of neural architectures specifically designed for efficient and accurate whole-slide image (WSI) analysis in computational pathology. These frameworks integrate the local, relational inductive bias of graph neural networks (GNNs) with the scalable, long-range sequence modeling capacity of Mamba—an input-adaptive state space model (SSM)—to enable slide-level prediction on gigapixel medical images with substantial reductions in computational requirements compared to transformer- or graph-transformer-based methods (Lu et al., 23 May 2025, Khan et al., 25 Sep 2025).

1. Motivation and Problem Setting

Whole-slide images are gigapixel-scale digital pathology specimens, routinely comprising $N\approx 10^3$–$10^4$ distinct tiles or patches per slide. Accurate slide-level prediction for clinical or biological endpoints (e.g., cancer subtyping, mutation detection, Gleason grading) requires capturing both local tissue architecture (short-range dependencies) and heterogeneous, often distant, contextual patterns (long-range dependencies). Traditional GNN-based multiple instance learning (MIL) protocols, while scalable, often lack sufficient expressive power for such long-range modeling. In contrast, transformer-based MIL approaches capture extended context via self-attention but suffer from prohibitive $O(N^2)$ computational and memory complexity, which is untenable for typical WSI tile counts (Lu et al., 23 May 2025).

SlideMamba addresses this challenge by combining a lightweight graph backbone for relational reasoning with a Mamba-based state space module for efficient global aggregation, often mediated via adaptive fusion strategies.

2. Architectural Foundations

Two major frameworks exemplify the SlideMamba approach.

A. WSI-GMamba (Graph Mamba; (Lu et al., 23 May 2025))

• Pipeline: Each tile is encoded (e.g., with a frozen ResNet50), tiles are represented as nodes in a graph $G=(X,A)$. The adjacency $A = A_\text{rule} \oplus A_\text{sim}$ encodes local neighborhood plus cosine-similarity edges.
• GMamba Block: Performs (i) GCN message passing to propagate features, (ii) graph scanning to flatten the graph to $M$ sequences (using DFS and acyclic random walks), and (iii) aggregates each sequence with a bidirectional SSM (Bi-SSM), returning updated node features via re-projection.
• Classification Head: The final node embeddings are pooled using attention-based MIL (ABMIL) and classified with cross-entropy loss.

B. Adaptive Two-Stream Fusion SlideMamba (Khan et al., 25 Sep 2025)

• Dual Branches: Features from each tile (typically UNI encoder + position encoding) are propagated via both (i) SlideGraph+ (GINConv) backbone for local patterns and (ii) linearized and processed as a sequence by a Mamba SSM for global context.
• Entropy-Based Adaptive Fusion: At each block, outputs from both branches are fused using confidence scores derived from their (normalized) softmax predictive entropies. The fused representation is refined by an MLP and batch norm, and stacking multiple SlideMamba blocks precedes a global pooling/classification head.
• Fusion Formula:

$$H(\hat y) = -\frac{1}{\log C}\sum_{c=1}^C \hat y_c \log\hat y_c,$$

$$w_\text{SG}=1-H(\hat y_\text{SG}),\quad w_M = 1-H(\hat y_M),$$

$\alpha = \frac{w_M}{w_\text{SG} + w_M},$

$$X_\text{fused} = (1-\alpha)X_\text{SG} + \alpha X_M,$$

where $10^4$0 determines the data-driven reliance on local (GNN) or global (Mamba) information (Khan et al., 25 Sep 2025).

3. Core Computational Components

Component	Key Functionality	Complexity
GNN (GCN/GINConv)	Local, relational message passing	$10^4$1
Graph Scanning	DFS/ARW for sequence flattening	$10^4$2
Mamba SSM	Linear-time ($10^4$3) sequence aggregation	$10^4$4
Entropy Fusion	Confidence-based multi-stream combination	$10^4$5

GMamba Block Implementation:

Pseudocode for the GMamba block (WSI-GMamba variant):

$O(N^2)$2 (Lu et al., 23 May 2025)

4. Computational Efficiency and Scaling

SlideMamba frameworks are structured to scale linearly with the number of WSI tiles ($10^4$6), in contrast to the quadratic scaling of Transformers ($10^4$7). In empirical studies, WSI-GMamba achieves Transformer-level classification accuracy with %%%%18$$w_\text{SG}=1-H(\hat y_\text{SG}),\quad w_M = 1-H(\hat y_M),$$19%%%% fewer floating point operations: 1.8 G (SlideMamba) versus 10.3 G (LongMIL Transformer) (Lu et al., 23 May 2025). GPU memory requirements are similarly reduced (0.8 GB vs. 1.4–2.5 GB). Adaptive-fusion models (entropy-weighted) maintain linear compute by invoking a single pass of both the GNN and Mamba branches per block (Khan et al., 25 Sep 2025).

5. Empirical Performance and Evaluation

Benchmark results across multiple WSI datasets underscore the efficacy of SlideMamba models. In (Lu et al., 23 May 2025), mean AUC on slide-level classification tasks is 96.7% (WSI-GMamba), outperforming the best GNNs (92.8%), Mamba-only MIL (91.3%), pure Transformer MIL (95.8%), and competitive with Graph-Transformers (96.4%). FLOPs and memory usage are substantially reduced.

Table: Comparative Results (Khan et al., 25 Sep 2025) | Model | PRAUC | ROC AUC | Sensitivity | Specificity | |--------------------|----------------|----------------|-----------------|---------------| | MIL | 0.491 ± 0.042 | 0.714 ± 0.036 | 0.442 ± 0.090 | 0.854 ± 0.016 | | Trans-MIL | 0.390 ± 0.017 | 0.640 ± 0.031 | 0.297 ± 0.019 | 0.853 ± 0.031 | | SlideGraph+ | 0.748 ± 0.091 | 0.733 ± 0.085 | 0.638 ± 0.092 | 0.750 ± 0.040 | | GAT-Mamba | 0.703 ± 0.075 | 0.723 ± 0.070 | 0.712 ± 0.055 | 0.762 ± 0.120 | | Mamba only | 0.664 ± 0.063 | 0.660 ± 0.060 | 0.475 ± 0.071 | 0.875 ± 0.090 | | SlideMamba | 0.751 ± 0.050 | 0.738 ± 0.055 | 0.662 ± 0.083 | 0.725 ± 0.094 |

Ablation studies demonstrate:

• Bi-directional SSM outperforms single-direction aggregation.
• Mixed DFS+ARW graph scanning yields superior results versus either alone.
• Linear compute and memory scaling is maintained empirically as $O(N^2)$0 increases (Lu et al., 23 May 2025).

6. Position within the Broader Mamba and Sequence Modeling Landscape

SlideMamba architectures build on the broader Mamba SSM lineage, which aims to replace quadratic-cost self-attention with linear-time, hardware-aware state space modeling. Mamba achieves sequence modeling efficiency by:

• Learning input-dependent step-size gates $O(N^2)$1 for selective memory.
• Enabling bidirectional and parallel application for both sequence and 2D context.
• Supporting integration with other architectures (e.g., transformers, U-Nets, mixture-of-experts), as surveyed in (Zou et al., 2024).

SlideMamba’s formalism is closely related to recent kernel-unification interpretations: attention-based models realize adaptive, data-dependent kernel summations; Mamba SSMs correspond to parametric, input-gated convolution kernels over sequences; and hybrid layers blend these approaches (Zou et al., 2024). The entropy-based adaptive fusion mechanism is a recent innovation in SlideMamba, offering context-sensitive balancing between local (graph) and global (sequence) cues.

7. Limitations and Future Directions

Current SlideMamba limitations include:

• Fusion granularity is at slide-level; extending adaptive fusion to per-patch or region-level could yield finer interpretability and potentially improved performance.
• Empirical validation has focused on a limited set of cancer types (e.g., NSCLC gene fusion/mutation) and downstream tasks. Broader applications in diverse tissue contexts and pathologies remain largely unexplored.
• While Mamba-based models offer hardware efficiency, the dual-branch SlideMamba designs can incur greater inference cost than single-stream models; model compression or distillation could be pursued for deployment (Khan et al., 25 Sep 2025).

Ongoing work may explore novel integration strategies, multi-scale and patch-level fusion, active learning extensions, and generalization to other modalities where global and local dependencies are both critical.

---

References: (Lu et al., 23 May 2025) Graph Mamba for Efficient Whole Slide Image Understanding (Khan et al., 25 Sep 2025) SlideMamba: Entropy-Based Adaptive Fusion of GNN and Mamba for Enhanced Representation Learning in Digital Pathology (Zou et al., 2024) Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba