---
title: 'MultiConv: Multi-kernel Gated Convolution'
url: https://www.emergentmind.com/topics/multi-kernel-gated-convolution-multiconv
type: topic
---

# MultiConv: Multi-kernel Gated Convolution

Searching arXiv for recent and foundational papers on Multi-kernel Gated Convolution and closely related formulations.
Multi-kernel Gated Convolution, often abbreviated as **MultiConv**, denotes a family of architectural patterns in which multiple convolutional branches with different receptive fields are combined with a learned gating mechanism that modulates their contribution to the output. Across the literature, the pattern appears in decoder adapters for thyroid ultrasound, spatial aggregation blocks in modern ConvNets, recurrent ConvLSTM transitions for video, audio back-end classifiers built on SSL features, and DenseNet-like image classifiers with hybrid connectivity. Despite this diversity, the underlying objective is consistent: to reconcile feature cues that occur at different spatial or temporal scales while suppressing redundant, artifact-prone, or otherwise uninformative activations through gating [2603.08906][2211.03295][1908.08990][2509.03409][1908.09699].

## 1. Terminology and conceptual scope

The nomenclature is not standardized. In thyroid ultrasound, the paper does **not** define a separate module literally named “MultiConv”; rather, the Multi-Kernel Gated Adapter (MKGA) and ResMKGA instantiate a multi-kernel gated convolution pattern in the decoder [2603.08906]. In MogaNet, the corresponding mechanism is called **multi-order gated aggregation**, housed in the spatial aggregation block \( \mathrm{Moga}(\cdot) \) [2211.03295]. In ConvLSTM-based video modeling, the relevant terms are **multi-kernel approach**, **Inception-like multi-kernel**, and **Network-in-LSTM** [1908.08990]. In HCGNet, the relevant component is the **multi-kernel depthwise convolution** stage inside the SMG module, paired with update and forget gates [1908.09699]. By contrast, the audio deepfake detector explicitly uses **Multi-kernel gated Convolution (MultiConv)** as the name of its back-end classifier block [2509.03409].

This variation in terminology reflects a broader fact: MultiConv is better understood as a **design pattern** than as a single canonical module. Some realizations emphasize spatially varying gates, some apply channel-wise softmax competition between branches, some use GLU-like multiplicative gating after branch fusion, and some embed the mechanism inside recurrent state transitions rather than feed-forward feature hierarchies. The common denominator is the joint use of **multi-receptive-field convolutions** and **adaptive gating**.

## 2. Canonical computational pattern

A general formulation appears in the thyroid ultrasound work, where the pattern is written for \(m\) branches as
\[
y_i = k_i * x,\qquad i=1,\ldots,m,\qquad Y = [y_1;\ldots;y_m],
\]
followed by a projection
\[
X_{\text{ref}} = \phi_{1\times1}(Y),
\]
a context-dependent gate
\[
c = h(X_{\text{high}}, X_{\text{ref}}),\qquad g_i = \phi_{g,i}(W_{g,i}\cdot c + b_{g,i}),
\]
and either branch-wise gated fusion
\[
y_{\text{fused}} = \sum_i g_i \odot y_i
\]
or post-projection gating
\[
X_{\text{gate}} = g \odot X_{\text{ref}},
\]
before the final refinement stage [2603.08906]. This is the clearest explicit abstraction of MultiConv in the cited literature.

The same logic recurs in specialized forms. In MogaNet, the multi-order context \(Y_C\) is built from low-, middle-, and high-order branches, then projected and gated pointwise:
\[
g(U)=\mathrm{SiLU}(W_gU),\qquad a(U)=\mathrm{SiLU}(W_cY_C),\qquad y=g(U)\odot a(U),\qquad Z=X+y
\]
[2211.03295]. In the ConvLSTM setting, the single-kernel input-to-hidden and hidden-to-hidden convolutions of each gate are replaced by aggregated multi-kernel transforms \(W^{(mk)}_{xg} * X_t\) and \(W^{(mk)}_{hg} * H_{t-1}\), optionally preceded by kernel-specific attention masks derived from optical flow [1908.08990]. In the audio detector, MultiConv is realized by splitting the expanded representation into a left content stream and a right convolutional stream, fusing the multi-kernel outputs into \(\tilde Z_r\), and computing
\[
F=\mathrm{Dropout}(\mathrm{Proj}(\tilde Z_r \odot Z_l))
\]
as a GLU-like gate [2509.03409]. In HCGNet, the gated fusion appears as
\[
O_{x,y,c}=f_c\cdot X'_{x,y,c}+v_c,
\]
where \(f\) is a forget-gate vector on reused features and \(v\) is a global context vector produced by update-gated fusion of the multi-kernel branches [1908.09699].

These formulations differ in granularity and parameterization, but they share three structural primitives: **parallel convolutional context extraction**, **learned gating**, and **context-sensitive fusion**.

## 3. Major architectural instantiations

| Setting | Multi-kernel branches | Gating and fusion |
|---|---|---|
| Thyroid ultrasound MKGA/ResMKGA | \(3\times3\) and dilated \(3\times3\) with \(d=2\) | Additive attention gate from \(X_{\text{high}}\) and \(X_{\text{skip,ref}}\); gated skip fused with decoder feature [2603.08906] |
| MogaNet spatial block | DW \(5\times5, d=1\), DW \(5\times5, d=2\), DW \(7\times7, d=3\), with channel split \(1:3:4\) | \(1\times1\) Conv + SiLU gate and context projection; element-wise product and residual addition [2211.03295] |
| ConvLSTM video model | Parallel \(3\times3\), \(5\times5\), optionally \(7\times7\) | Concatenation with interleaving or learned \(1\times1\) mixing; optional kernel-specific attention masks from optical flow [1908.08990] |
| Audio deepfake detector | Parallel 1D convolutions with kernel sets such as \(\{3,7\}\), \(\{11,15\}\), \(\{19,23\}\), \(\{27,31\}\), or four-kernel sets | Fused multi-kernel stream multiplicatively gates the split content stream; stacked across \(M=4\) layers [2509.03409] |
| HCGNet SMG module | Depthwise \(3\times3\) and \(5\times5\), or \(3\times3\) dilated with \(d=2\) approximating \(5\times5\) | Update gate performs per-channel two-branch softmax after spatial attention and global pooling; forget gate decays reused features [1908.09699] |

In the thyroid setting, MultiConv is explicitly decoder-side rather than backbone-side. MKGA refines skip features with complementary receptive fields and then gates them using semantic context from the deeper decoder state \(X_{\text{high}}\). ResMKGA adds residual bottleneck stabilization through squeeze-and-excitation, with
\[
X_{\text{high,enh}} = F_{\text{enc}} + \mathrm{SE}\!\left(\phi_{3\times3}(F_{\text{enc}})\right)
\]
[2603.08906]. This placement is motivated by cross-center domain shift, where segmentation relies more on geometry and malignancy prediction depends more on texture.

In MogaNet, MultiConv is part of the **SMixer** of a modern ConvNet block. It is preceded by the Feature Decomposition module
\[
Z_{fd}=\mathrm{GELU}(Y+\gamma_s\odot(Y-\mathrm{GAP}(Y)))
\]
and followed by gated aggregation. The design is explicitly framed as a remedy for a representation bottleneck in modern ConvNets, particularly the under-encoding of middle-order interactions [2211.03295].

In recurrent video modeling, MultiConv is embedded inside the ConvLSTM transition itself. Rather than using a single convolution for the gate preactivations, each recurrent gate receives a multi-branch transform, optionally deepened by \(1\times1\) bottlenecks and mixing layers. This is why the authors describe the method as a **Network-in-LSTM** [1908.08990].

In the audio model, the module is purely temporal and 1D. Its MultiConv branches operate on frame-wise SSL features from XLS-R after front-end SwiGLU gating and layer aggregation. The module is stacked, and diversity across layers is further promoted by a CKA term in the training objective [2509.03409].

HCGNet places the mechanism inside a two-stage SMG module: hierarchical squeezing first compresses DenseNet-like concatenated inputs, after which multi-kernel depthwise excitation and gated fusion produce a compact global-context update. Here MultiConv is tightly coupled to the network’s **Hybrid Connectivity**, which nests global dense and local residual pathways [1908.09699].

## 4. Empirical evidence across tasks and modalities

The thyroid ultrasound study provides a particularly direct demonstration of MultiConv under domain shift. With a ResNet34 backbone, the unfrozen baseline drops from in-domain Dice \(0.861 \pm 0.130\) to external Dice \(0.590 \pm 0.466\). Adding MKGA raises external Dice to \(0.659 \pm 0.533\), and ResMKGA raises it to \(0.671 \pm 0.553\), reported as significant at \(p < 0.05\) versus the unfrozen baseline. For TI-RADS malignancy prediction, the same CNN baseline attains external AUC \(0.577\), whereas MKGA reaches AUC \(0.642\) and improves diagnostic accuracy from \(0.406\) to \(0.632\) with McNemar \(p < 0.001\) [2603.08906].

In MogaNet, the multi-order gated aggregation block scales from lightweight to very large regimes while remaining competitive with both ConvNet and ViT baselines. MogaNet-T reports \(79.0\%\) top-1 accuracy at \(224^2\) with \(5.2\)M parameters and \(1.10\)G FLOPs, and \(80.0\%\) at \(256^2\) with refined training. At the upper end, MogaNet-XL reports \(87.8\%\) at \(384^2\) with IN-21K pretraining, \(181\)M parameters, and \(102\)G FLOPs. The same design transfers to COCO detection, ADE20K segmentation, pose estimation, and video prediction [2211.03295].

In ConvLSTM-based video recognition, replacing single-kernel recurrent convolutions with MultiConv improves performance on multiple settings. On UCF-101 with a VGG-16 feature extractor, the \(3\times3\times512\) baseline reaches \(71.27\%\) top-1, the \(5\times5\times512\) baseline \(72.20\%\), MultiConv with \(C_3=C_5=256\) reaches \(73.18\%\), and adding stacked \(1\times1\) mixing yields \(74.09\%\). On Sports-1M-20, the corresponding values are \(80.67\%\), \(81.09\%\), and \(81.34\%\). In an I3D-based UCF-101 setting, Inception MultiConv reaches \(88.40\%\), and the end-to-end version reaches \(90.09\%\) [1908.08990].

The audio deepfake detector reports state-of-the-art or competitive error rates on multiple benchmarks. It attains \(0.08\%\) EER on ASVspoof 2019 LA, \(1.43\%\) on ASVspoof 2021 DF, \(2.77\%\) on ASVspoof 2021 LA, and \(4.44\%\) on ITW. The four-kernel configuration \(\{3,7,11,15\}\) with CKA is reported as best for heterogeneous out-of-domain generalization, and removing CKA degrades performance, for example from \(1.43\%\) to \(2.02\%\) on 21DF and from \(5.51\%\) to \(23.69\%\) on DFADD in the cited comparison [2509.03409].

HCGNet provides evidence for MultiConv in dense image classification and transfer. On ImageNet, HCGNet-B reports top-1/top-5 error \(21.5/5.8\) with \(12.9\)M parameters and \(2.0\)G FLOPs, compared with DenseNet-169 at \(23.8/6.9\), \(14.2\)M parameters, and \(3.5\)G FLOPs. On CIFAR-10/100, HCGNet-A2 reaches \(2.29\%\) and \(16.54\%\) error with \(3.1\)M parameters and \(0.5\)G FLOPs, while HCGNet-A3 reaches \(2.14\%\) and \(15.96\%\) with \(11.4\)M parameters and \(2.0\)G FLOPs [1908.09699].

Taken together, these results show that MultiConv is not confined to one task family. It has been used for segmentation, image classification, action recognition, audio spoofing detection, pose estimation, and detection/segmentation transfer, with gains emerging when the target problem contains **heterogeneous local and global cues**.

## 5. Ablations, trade-offs, and failure modes

The thyroid work offers one of the clearest ablation studies on the role of gating. Removing the gate slightly improves external segmentation, with Dice \(0.673\) instead of \(0.659\), but sharply degrades TI-RADS classification, with accuracy \(0.499\) instead of \(0.632\) and AUC \(0.589\) instead of \(0.642\). Removing the multi-kernel block harms both tasks, producing DDTI Dice \(0.629\), AUC \(0.565\), and accuracy \(0.359\). Among kernel choices, \(3\times3\) plus dilated \(3\times3\) with effective \(5\times5\) receptive field is reported as the best balance, whereas \(1\times1+3\times3\) loses diagnostic power and \(3\times3+7\times7\) is unstable [2603.08906].

MogaNet reports a similar dependence on branch design and gating details. In the module ablation table, adding the gating branch raises accuracy from \(76.6\%\) to \(77.3\%\), adding DW \(7\times7\) raises it to \(77.5\%\), adding multi-order DW convolutions raises it to \(78.0\%\), adding FD raises it to \(78.3\%\), and replacing SE/MLP with the CA block yields \(79.0\%\). Removing \(\mathrm{Moga}(\cdot)\), removing \(\mathrm{FD}(\cdot)\), or removing multi-order DWConv each lowers top-1 accuracy, and SiLU in both branches is reported as the best gating activation. The default channel split \(C_l:C_m:C_h=1:3:4\) is also identified as the best among tested splits [2211.03295].

In ConvLSTM, the benefits of MultiConv depend on motion heterogeneity. Mixed channel allocations across \(3\times3\) and \(5\times5\) kernels outperform pure single-kernel settings, and qualitative results show specialization of attention masks: larger kernels attend to faster-moving digits, smaller kernels to slower motion. Yet the paper also notes that when motion speeds are relatively uniform and fit within the receptive field of a small kernel, multi-kernel mixtures may provide limited gains or even underperform a well-matched single kernel [1908.08990].

The audio detector reports that no single kernel configuration universally dominates. Smaller kernels \(\{3,7\}\) are best on ITW and LibriSeVoc, large kernels \(\{19,23\}\) excel on 19LA and HABLA, and the four-kernel set \(\{3,7,11,15\}\) generalizes best to heterogeneous out-of-domain attacks. The model also struggles with neural autoregressive vocoders and certain TTS systems, and Sino-Tibetan datasets remain difficult. Deeper stacks beyond the default \(M=4\) can improve in-domain performance but hurt generalization [2509.03409].

HCGNet identifies additional constraints. Its MultiConv stage uses only two scales, and descriptor-level fusion may underweight fine-grained spatial patterns because the update gate aggregates global descriptors rather than spatially varying fusion maps. The paper also notes the usual depthwise-convolution trade-off: efficiency is improved, but cross-channel mixing becomes weaker and must be supplied by the squeeze path and gating FCs [1908.09699].

These studies collectively show that MultiConv is not a monotone recipe in which “more kernels” or “stronger gates” always improve outcomes. Kernel size, branch count, gating granularity, and the statistics of the target data interact strongly.

## 6. Relation to adjacent methods and likely directions

Several papers explicitly position MultiConv relative to adjacent design families. MogaNet distinguishes its multi-order gated aggregation from Inception-like and SKNet-style branch selection: it constructs a unified multi-order context with parallel depthwise kernels and dilations, then applies a pointwise SiLU gate to the aggregated context rather than branch-wise softmax competition [2211.03295]. HCGNet similarly distinguishes its SMG module from Inception-style concatenation and from SKNet’s direct kernel selection on branch feature maps, emphasizing instead spatial attention, global descriptor extraction, and per-channel two-branch softmax fusion at the descriptor level [1908.09699]. The thyroid study compares MKGA against raw skip fusion, single-kernel conv fusion, SE-only recalibration, and attention-only fusion, arguing that robustness under cross-center shift depends on the combination of complementary receptive fields and semantic gating before decoder fusion [2603.08906].

This suggests that MultiConv occupies an intermediate position between static multi-branch convolution and attention-like dynamic modulation. It preserves the locality and inductive bias of convolutions while introducing data-dependent selection mechanisms that are lighter than full self-attention in several of the cited settings.

The forward directions mentioned in the literature are concrete. In thyroid ultrasound, the single post-projection spatial gate could be replaced by branch-wise or channel-wise gating, and extension to 3D ultrasound would require volumetric MultiConv and 3D gating; neither is explored in the paper [2603.08906]. In ConvLSTM, the attention mechanism is applied only to the input-to-hidden path, with hidden-to-hidden attention reserved for future work [1908.08990]. In the audio model, kernel-set selection remains task-dependent, and the authors’ results imply that tuning receptive-field ensembles to attack families and languages is important [2509.03409].

Across these variants, the enduring contribution of MultiConv is not a single invariant block definition, but a reusable architectural principle: **parallel receptive fields are most effective when paired with an explicit mechanism for deciding what information should pass through them, where, and at what scale**.

Source: https://www.emergentmind.com/topics/multi-kernel-gated-convolution-multiconv