---
title: Res2Net Multi-Scale Convolution Module
url: https://www.emergentmind.com/topics/res2net-multi-scale-convolution
type: topic
---

# Res2Net Multi-Scale Convolution Module

Res2Net multi-scale convolution is a neural module that generalizes the conventional residual bottleneck by incorporating hierarchical, residual-like connections at a granular level within a single block. This design fundamentally augments the multi-scale representation capability of convolutional networks by enabling each block to capture features at multiple, fine-grained receptive fields. Res2Net has been shown to enhance performance across diverse tasks, including image classification, object detection, audio processing, and multivariate time series analysis, and can be further extended with gating mechanisms for improved control of information flow.

## 1. Res2Net Multi-Scale Convolution Module

The Res2Net block partitions the feature channels into multiple groups and links these via a sequence of residual-like, hierarchical convolutions. Given an input tensor \(X \in \mathbb{R}^{C \times H \times W}\) (or \(X \in \mathbb{R}^{C \times L}\) for 1D data), the process includes:

1. **Channel Expansion:** Apply a \(1 \times 1\) convolution to project the input to an intermediate feature map with \(C' = s \times w\) channels, where \(s\) is the number of scale groups and \(w\) is the number of channels per group.
2. **Group Splitting:** Divide the intermediate feature map into \(s\) groups: \(\{x_1, x_2, \ldots, x_s\}\), each \(x_i \in \mathbb{R}^{w \times H \times W}\).
3. **Hierarchical Convolutions:** For each group \(i\), compute the output as  
   \[
   y_i =
   \begin{cases}
      x_1,                           & i = 1 \\
      K_2(x_2),                      & i = 2 \\
      K_i(x_i + y_{i-1}),            & 3 \leq i \leq s
   \end{cases}
   \]
   where each \(K_i\) is a learnable \(3 \times 3\) convolution (or 1D convolution for time series).

4. **Fusion:** Concatenate \([y_1, \ldots, y_s]\) along the channel axis and apply a final \(1 \times 1\) convolution for channel fusion and compression.

5. **Residual Addition:** Add the original input tensor as in standard ResNets.

This module exposes each channel group to a different effective receptive field:
\[
\text{Receptive field of group } i = 1 + 2(i-1)
\]
allowing simultaneous extraction of both local and global patterns within a single block [1904.01169].

## 2. Theoretical Advantages and Parameter Efficiency

The granular multi-scale design of Res2Net introduces a “scale” dimension in addition to the traditional “depth,” “width,” and “cardinality.” When compared to standard bottleneck structures:

- The module realizes multiple effective receptive fields within each block due to the cascaded arrangement of residual links.
- Parameter count for the collection of \(3 \times 3\) convolutions is 
  \[
  (s-1) \cdot \frac{9 O^2}{s^2}
  \]
  which is lower than the single-path design of a standard ResNet bottleneck when \(O \approx I\) and \(s > 1\) [2010.15006].
- FLOPs and memory overhead remain close to baseline ResNet architectures for typical configurations (\(s=4\)), and runtime increases are marginal (\(1-5\,\text{ms}\) on 224\(\times\)224 images).

A key empirical finding is that increasing the scale \(s\), rather than only the width or depth, yields superior performance gains for fixed computational budgets [1904.01169].

## 3. Gated Res2Net Extension (GRes2Net)

The GRes2Net module extends the standard Res2Net block by integrating dynamic, learnable gates. For each residual connection (\(y_{i-1}\) added to \(x_i\)), a gate \(g_i \in (-1, 1)\) is computed via a small subnetwork \(a(\cdot)\):

\[
g_i = \tanh\left(
  a\Big(\mathrm{concat}\left(a(X),\,a(y_{i-1}),\,a(x_i)\right)\Big)
\right)
\]

The modified hierarchical computation becomes:

\[
y_i =
\begin{cases}
   x_1, & i = 1 \\
   K_2(x_2), & i = 2 \\
   K_i\big(x_i + g_i \odot y_{i-1}\big), & 3 \leq i \leq s
\end{cases}
\]

where \(\odot\) denotes elementwise multiplication. This enables explicit modeling of inter-channel correlations and selective modulation of cross-scale information transfer, mitigating the risk of propagating irrelevant or noisy signals across scales. Empirical results show consistent gains from gating in multivariate time series tasks [2009.11705].

## 4. Instantiations and Integration in Deep Backbones

Res2Net blocks have been deployed in varied forms across computer vision, speech, and time series domains:

- **Vision Backbones:** Used to replace the central \(3 \times 3\) convolution in residual blocks of ResNet, ResNeXt (scale \(s\) orthogonal to cardinality), and DLA architectures [1904.01169].
- **Speaker Verification:** Employed in deep CNNs for text-independent speaker embedding extraction. Scale increments from \(s=2\) up to \(s=8\) deliver significant improvements in equal error rate (EER), particularly for short utterances [2007.02480].
- **Time Series Analysis:** The GRes2Net structure forms the backbone for modeling both classification and forecasting tasks, with a multi-block stack, temporal pooling, and fully connected output layers [2009.11705].
- **Speech Anti-Spoofing:** Applied for adaptive fusion of multi-scale features, demonstrating robustness to unseen synthetic and replayed speech attacks. Integration with other modules, such as Squeeze-and-Excitation (SE) blocks, further enhances performance [2010.15006].

## 5. Empirical Evaluation and Comparative Results

Experiments on benchmark tasks confirm the multi-scale convolution’s practical advantages.

| Architecture         | Task / Dataset          | Metric           | ResNet   | Res2Net    | GRes2Net   |
|----------------------|------------------------|------------------|----------|------------|------------|
| ResNet vs. Res2Net   | ImageNet Classification| top-1 err (%)    | 23.85    | 22.01      | –          |
| Speaker Verification | VoxCeleb1-test (2 s)   | EER (%)          | 6.77     | 5.58       | –          |
| Time Series          | EGG (classification)   | Accuracy (%)     | 91.50    | 91.50      | 92.76      |
| Time Series          | Appliance Forecasting  | RMSE/MAE/R²      | 13.98/7.64/0.97 | 13.98/7.64/0.97 | 12.84/6.99/0.98 |

On vision tasks, Res2Net-50 reduces top-1 error from 23.85% (ResNet) to 22.01% on ImageNet [1904.01169]. On speech, Res2Net achieves 17.6% relative EER reduction on short VoxCeleb1 trials [2007.02480]. GRes2Net further improves classification/forecasting results over vanilla Res2Net in multivariate time series scenarios [2009.11705].

## 6. Context, Extensions, and Significance

Res2Net’s hierarchical multi-scale design distinguishes itself from previous efforts by embedding diverse receptive fields within each block, rather than only at different layers. This enables the block to represent fine- and coarse-grained context jointly and adaptively, a property especially beneficial when variable scale or context information is crucial—such as small- and large-object detection, or time-series with multiple temporal dependencies.

The GRes2Net extension introduces learned gates to dynamically control intra-block information flow, capturing complex inter-channel dependencies. This approach is particularly effective in domains with substantial channel-wise or temporal correlations.

Integration with established modules (e.g., Squeeze-and-Excitation), orthogonal scale and cardinality control in Res2NeXt, and consistent cross-domain performance gains underscore the versatility and significance of the Res2Net multi-scale convolutional paradigm [1904.01169, 2009.11705, 2007.02480, 2010.15006].

## 7. Notation and Implementation Summary

Key notation for the Res2Net (and GRes2Net) module:

| Symbol        | Meaning                                     |
|---------------|---------------------------------------------|
| \(X\)         | Input feature map (\(C \times L\) or \(C \times H \times W\))    |
| \(s\)         | Number of channel groups (scales)           |
| \(w\)         | Channels per group; \(C' = s \cdot w\)      |
| \(x_i\)       | \(i\)th group (\(w \times L\), \(w \times H \times W\))          |
| \(K_i(\cdot)\)| \(3 \times 3\) conv per group               |
| \(y_i\)       | Output of scale \(i\)                       |
| \(g_i\)       | Gate (GRes2Net) for inter-group connection  |

Each block can be reconstructed using the split–hierarchical–concat–compress flow and, if gated, with the dynamic computation of \(g_i\) as described above [1904.01169, 2009.11705].

Source: https://www.emergentmind.com/topics/res2net-multi-scale-convolution