Hierarchical DenseNet Swint Architecture

• The paper demonstrates that integrating a modified DenseNet-201 stem with a Swin Transformer branch significantly enhances brain MRI classification accuracy (98.50%) by capturing both fine-grained textures and global morphology.
• The methodology employs dual residual connections and deep feature extraction modules to fuse features across scales, effectively preserving and aligning local and global diagnostic cues.
• The architecture’s hierarchical integration of local-to-global features reduces false negatives and proves robust in distinguishing diverse tumor classes with complex morphological traits.

The Hierarchical DenseNet Swint Architecture is a convolutional–transformer hybrid designed to achieve superior performance in large-scale brain MRI classification by integrating fine-grained texture modeling with robust global context reasoning. Architecturally, it fuses a modified DenseNet-201 convolutional stem with a Swin Transformerₜ branch, employing deep feature extraction blocks and dual residual pathways. This hybridization enables discriminative, hierarchical feature fusion—critical for maximizing sensitivity and specificity across tumor classes with diverse morphological and textural traits (Shah et al., 26 Jan 2026).

1. Overall Network Topology

Input to the system is a single MR slice of shape $224 \times 224 \times 3$. The architecture bifurcates into two parallel stems:

• DenseNet-201 Stem ("Stem CNN"): Customized for MRI spatial statistics, it focuses on structured local feature extraction through a progression of convolution, pooling, and densely connected composite blocks. The output feature map dimensions and channels progress through:
  • Conv1: $7 \times 7$ kernel, $64$ channels, stride $2 \to 112 \times 112 \times 64$
  • MaxPool: $3 \times 3$ kernel, stride $2 \to 56 \times 56 \times 64$
  • Series of DenseBlocks: escalating depth and channel count, interleaved with transitional convolutions and average pooling, culminating in a global average pooled tensor $F_d \in \mathbb{R}^{1 \times 1 \times 1920}$.
• Swin Transformerₜ Stem ("Global-context Branch"): Implements hierarchical self-attention for global morphological modeling.
  • PatchEmbedding partitions the input into $4 \times 4$ patches, each flattened and linearly projected to $d=96$ dimensions, creating $56 \times 56$ token grids.
  • Four Transformer stages with alternations of SwinBlocks and PatchMerging sequentially reduce spatial dimensions and increase channel dimensionality, concluding with a global average pooled feature $F_s \in \mathbb{R}^{1 \times 1 \times 768}$.

This dual-stem approach ensures simultaneous encoding of local micro-structure (e.g., irregular edges and texture variation) and holistic anatomical context (e.g., tumor positioning, mass effect).

2. Deep Feature Extraction (DFE) and Dual Residual (DR) Connection Mechanisms

Deep Feature Extraction (DFE) modules are interspersed within the DenseNet stem to bolster feature propagation and retention. Each DFE block applies a pair of convolution–BN–ReLU stacks with an intra-block skip connection: $$\tilde{X}^{(l+1)} = \sigma(W^{(l)}_{\mathrm{DFE},1} * X^{(l)} + b^{(l)}_{\mathrm{DFE},1})$$

$$X^{(l+1)} = \sigma(W^{(l)}_{\mathrm{DFE},2} * \tilde{X}^{(l+1)} + b^{(l)}_{\mathrm{DFE},2}) + X^{(l)}$$

where $*$ denotes 2D convolution and $\sigma$ is ReLU activation.

The Dual Residual (DR) route orchestrates feature fusion at both the input and output of the Swin Transformer:

• First Residual: Projects $F_d$ into the Swin token space, broadcasts across tokens, and concatenates with patch-embedded Swin input $X$ along the feature axis:

$R_1 = [F_p ; X] \in \mathbb{R}^{N \times 2d}$

where $F_p = W_D \cdot \mathrm{Vec}(F_d) + b_D$.

• Second Residual: Fuses Swin output $Y_s$ with a projection of $F_d$ via an additive skip-connection:

$R_2 = Y_s + \mathrm{Proj}_d(F_d)$

The classifier operates on the flattened $R_2$:

$$\hat{y} = \mathrm{Softmax}(W_c \cdot \mathrm{Vec}(R_2) + b_c)$$

This dual-residual formulation preserves both shallow and deep representations, mitigating feature decay and facilitating effective cross-branch conditioning.

3. Swin Transformer Staging and Multi-Scale Self-Attention

The Swin Transformerₜ branch utilizes windowed self-attention to balance computational efficiency with contextual reach:

• Patch Embedding: Formalized as

$$P = X_{\text{patch}} W_p + b_p, \quad P \in \mathbb{R}^{N \times d}$$

• Window Partitioning & Shift: Feature maps $F \in \mathbb{R}^{H'\times W'\times d}$ are split into $M \times M$ non-overlapping windows. Shifted windows are generated by a spatial shift of $(-\lfloor M/2 \rfloor, -\lfloor M/2 \rfloor)$, then repartitioned.
• Window-based Multi-Head Self-Attention: Each window receives standard transformer self-attention

$$\mathrm{Attention}(Q, K, V) = \mathrm{Softmax}\left(\frac{QK^\top}{\sqrt{d_h}} + B\right)V$$

with $Q, K, V$ projected from window tokens and $B$ a pre-computed relative position bias.

This staging enables the model to encode both locally concentrated and spatially distant relationships, tailored by shifted windowing to reduce information bottlenecking across window boundaries.

4. Feature-Dimension Alignment and Fusion Strategies

For consistent feature merging, both branches undergo channel and spatial alignment before fusion:

• Projections linearly map $F_{\mathrm{dense}} \in \mathbb{R}^{C_d}$ and $F_{\mathrm{swin}} \in \mathbb{R}^{C_s}$ to a common latent:

$$F_p = W_p F_{\mathrm{dense}} + b_p, \quad F_q = W_q F_{\mathrm{swin}} + b_q$$

• If sequence dimensions misalign, spatial upsampling or downsampling is performed to match $H_p \times W_p$ with $H_q \times W_q$.
• Final fusion is executed as

$F_{\mathrm{fused}} = \phi(W_f [F_p; F_q] + b_f)$

with channelwise concatenation $[\cdot;\cdot]$ and nonlinearity $\phi$ as ReLU or GELU.

This systematic alignment is necessary for robust, information-preserving combination prior to the softmax classifier.

5. Hierarchical Integration: Local-to-Global Feature Synergy

The hierarchical design underpins both multi-scale and multi-level integration:

• Early DenseNet layers (DenseBlocks 1 & 2) capture minute edge and textural cues.
• Deeper Swin stages (Stages 3 & 4) acquire coarse-scale global morphology and cross-cutting context.

At multiple resolution levels $i$, local DenseNet features $P_d^{(i)}$ are projected and optionally concatenated or summed with Swin branch activations. For this implementation, the two-residual scheme fuses all DenseNet features at the Swin input, with late fusion after the last Swin block. This bilateral exchange supports conditioning of global morphology on precise, spatially-localized cues, and vice versa.

The hierarchical fusion strategy, symbolically: $$R_2 = X + F_{\mathrm{dense}}(X) + F_{\mathrm{swin}}([F_{\mathrm{dense}}(X); X])$$ enables context-aware discrimination—vital for invariance to tumor size, texture, and anatomical idiosyncrasies.

6. Empirical Performance and Diagnostic Significance

Evaluation on a rigorously curated MRI dataset—40,260 images, four classes—resulted in a test set accuracy and recall of $98.50\%$. This architecture outperformed standalone CNNs, Vision Transformers, and simple hybrids (Shah et al., 26 Jan 2026). Notably, by learning both irregular and diffuse glioma traits (via the Boosted Feature Space setup) and the well-defined mass/location of meningioma or pituitary tumors (via the hierarchical DFE+DR paradigm), the approach demonstrably suppresses false negatives across all tumor entities. The clinical implication is high sensitivity for complex tumor phenotypes and reliability in identifying both textural and morphological aberrations.

Architecture Component	Primary Role	Output Dimensionality
DenseNet-201 Stem	Local convolutional texture extraction	$F_d \in \mathbb{R}^{1\times1\times1920}$
Swin Transformerₜ Stem	Long-range dependency, morphology modeling	$F_s \in \mathbb{R}^{1\times1\times768}$
Dual Residual Fusion	Hierarchical feature integration	$R_2 \in \mathbb{R}^{N \times d}$

This suggests the utility of deep, hierarchical architectures with dual residual channels for high-stakes, morphology-variant medical image diagnostics. A plausible implication is the extensibility of this framework to other organ systems or modalities demanding simultaneous fine and global feature modeling.