---
title: Haar Wavelet Convolution (HWConv) Overview
url: https://www.emergentmind.com/topics/haar-wavelet-convolution-hwconv
type: topic
---

# Haar Wavelet Convolution (HWConv) Overview

Searching arXiv for recent papers on Haar Wavelet Convolution and related wavelet-convolution modules.
Haar Wavelet Convolution (HWConv) denotes a wavelet-aware CNN operator in which a 2-D Haar wavelet transform decomposes a feature map into \(LL\), \(LH\), \(HL\), and \(HH\) subbands so that frequency-domain energy and spatial details can be processed jointly before inverse reconstruction or downstream fusion. In the available literature, the term appears explicitly in "SWAN: Synergistic Wavelet-Attention Network for Infrared Small Target Detection," where HWConv is the encoder-side feature extractor and is described as a nested Haar-transform pipeline tailored to infrared small target detection; closely related but non-identical references are the wavelet frequency enhancement downsampling (WFED) block in ARFC-WAHNet and the Haar-wavelet-domain Wavelet Compressed Convolution (WCC) operator for \(1\times1\) convolutions [2508.01322; 2505.10595; 2205.12268].

## 1. Terminological scope and family resemblance

Within the cited literature, HWConv is not a single canonical operator. The most direct use of the term is in SWAN, which introduces “Haar Wavelet Convolution (HWConv)” for “a deep, cross-domain fusion of the frequency energy and spatial details of small target” [2508.01322]. ARFC-WAHNet does not introduce a module literally named HWConv, but its WFED module is described as “a fairly direct design reference for an HWConv-like wavelet downsampling/reconstruction block” because it uses fixed Haar decomposition, subband-specific enhancement, inverse reconstruction, and residual pooling fusion [2505.10595]. WCC is also not named HWConv; it is a Haar-wavelet compressed realization of \(1\times1\) convolution, with transform-domain coefficient selection and inverse reconstruction [2205.12268].

| Paper | Module term | Relation to HWConv |
|---|---|---|
| SWAN | HWConv | Direct use of the term |
| ARFC-WAHNet | WFED | HWConv-adjacent downsampling block |
| Wavelet Feature Maps Compression for Image-to-Image CNNs | WCC | Haar-wavelet-domain \(1\times1\) convolution |

This distribution of terminology is important because “Haar Wavelet Convolution” can refer to at least three distinct design patterns. In SWAN it is a nested \( \mathrm{Haar} \rightarrow \mathrm{Conv}_{3\times3} \rightarrow \mathrm{IWT} \) feature extractor. In ARFC-WAHNet it is better understood as a structured downsampling-and-enhancement module rather than a plain learned convolution layer. In WCC it is a compressed-domain point-wise operator rather than a general spatial convolution algebra.

SWAN also positions HWConv against earlier wavelet-CNN integrations such as WaveCNet and WA-CNN, characterizing those earlier integrations as shallow combinations based on parallel branches, concatenation, or attention weighting, whereas its own claim is “deep frequency-spatial coupling” through recursive decomposition of the low-frequency branch and inverse-transform-based progressive fusion [2508.01322].

## 2. Canonical formulation in SWAN

In SWAN, HWConv is introduced to address what the paper identifies as a core weakness of conventional convolution in IRSTD: ordinary convolutions “primarily capture local spatial patterns” and “struggle to distinguish the unique frequency-domain characteristics of small targets from intricate background clutter” [2508.01322]. The paper further states that CNNs prefer high-frequency features, while “infrared imaging small target characteristics tend to favor low-frequency features,” making the \(LL\) branch central to the design.

Architecturally, HWConv is the feature extraction module at the encoder side or early backbone side of SWAN. The network has three major components—HWConv, SSA, and RDCA—and “the input image undergoes a two-level nested fusion with HWConv.” The HWConv outputs form the feature maps \(F_H\) that are then passed to SSA:
\[
F_S^k = MLP\left(SSA\left(MLP\left(WSA(F_H)\right)\right)\right), \quad k=1,2...5
\]
and the SSA-enhanced features are subsequently fused by RDCA [2508.01322].

The HWConv mechanism is described as a staged nested transform. The input tensor is denoted by \(X^{C\times H\times W}\), and the first decomposition is
\[
X^{C\times H\times W} \xrightarrow{\text{Haar}} \left\{F_1^{LL}, F_1^{LH}, F_1^{HL}, F_1^{HH}\right\}.
\]
Only the low-frequency branch is recursively decomposed:
\[
F_k^{LL} \xrightarrow{\text{Haar}} \left\{F_{k+1}^{LL}, F_{k+1}^{LH}, F_{k+1}^{HL}, F_{k+1}^{HH}\right\}.
\]
At each level, the four subbands are processed by a \(3\times3\) convolution:
\[
F_k = \mathrm{Conv}_{3\times3}\left(F_k^{LL}, F_k^{LH}, F_k^{HL}, F_k^{HH}\right).
\]
The paper then describes inverse wavelet reconstruction and progressive additive fusion from deeper to shallower levels. Because the published formula is malformed, the safest summary is the one stated directly in the source: HWConv performs Haar transform first, then \(3\times3\) convolution on the resulting subbands, then inverse wavelet transform and hierarchical fusion [2508.01322].

The two defining architectural ideas are therefore recursive decomposition of \(LL\) alone and progressive reconstruction with addition. The first emphasizes low-frequency semantic or energy structure; the second returns nested information to the current stage scale. This makes HWConv neither a plain convolution with Haar kernels nor a mere wavelet pooling layer. It is a nested DWT–Conv–IWT block whose stated purpose is to fuse “frequency-domain energy” and “spatial-domain local details.”

## 3. HWConv-adjacent downsampling in ARFC-WAHNet

ARFC-WAHNet provides a closely related but explicitly different design. The paper states that it does not introduce a module literally named HWConv, and the relevant component is WFED rather than a generic Haar convolution layer [2505.10595]. WFED is inserted in the encoder and is described as replacing traditional max pooling: “This module utilizes 2-D Haar wavelet transform (2D-Haar-WT) and frequency enhancement downsampling to replace the traditional max pooling operation…”

The WFED pipeline begins with a convolutional preprocessing stage:
\[
\{F_{ll},\,F_{hl},\,F_{lh},\,F_{hh}\} = \mathrm{HWT}(f(F)),
\]
where \(f(\cdot)\) is a convolutional operation and \(\mathrm{HWT}(\cdot)\) is 2D-Haar-WT. The transform “sequentially applies wavelet-domain low-pass filter (LPF) and high-pass filter (HPF) along the horizontal and vertical directions, followed by downsampling by a factor of 2 in each dimension,” yielding \(LL\), \(LH\), \(HL\), and \(HH\) subbands. According to the authors’ stated shape semantics, each subband has “one-fourth the original number of channels” and “half the spatial resolution” [2505.10595].

WFED then separates the processing of high- and low-frequency content. The three detail subbands \(F_{lh}\), \(F_{hl}\), and \(F_{hh}\) are processed jointly by a Laplacian-style high-pass filter in the frequency domain, followed by SE and PA attention:
\[
F_h^E = \mathrm{Cat}\big(\mathrm{SE}(\mathcal{H}(F_{lh/hl/hh})),\mathrm{PA}(\mathcal{H}(F_{lh/hl/hh}))\big).
\]
The low-frequency branch \(F_{ll}\) is processed by a Gaussian low-pass filter, SE, and sigmoid suppression:
\[
F_l^E = \sigma(\mathrm{SE}(\mathcal{L}(F_{ll}))).
\]
The enhanced subbands are then reconstructed by inverse Haar transform:
\[
F^E=\mathrm{IHWT}(\mathrm{Cat}(F_h^E,F_l^E)).
\]
Finally, the reconstructed feature map is fused with a residual max-pooled shortcut:
\[
F'_{\downarrow}(x)=F^E+\mathrm{Maxpool}_{2\times2}(x).
\]

The architectural significance of WFED is that it replaces downsampling by a structured analysis–synthesis mechanism. The paper repeatedly frames it as a method to preserve information during hierarchical reduction, separate low-frequency background structure from high-frequency detail, enhance target-sensitive components, suppress clutter, and reconstruct a stronger downsampled representation. This is HWConv-adjacent, but it is broader than a plain Haar convolution layer because it includes explicit frequency-domain filtering, attention, inverse reconstruction, and residual pooled fusion [2505.10595].

## 4. Compressed-domain Haar convolution in WCC

WCC supplies a different interpretation of Haar-wavelet-based convolution. The paper does not name its method HWConv; it introduces “Wavelet Compressed Convolution (WCC)” as a method for high-resolution activation-map compression integrated with point-wise convolutions [2205.12268]. Conceptually, however, it is close to a Haar-wavelet-domain convolution layer because it applies a Haar transform, compresses coefficients, performs learned \(1\times1\) channel mixing in the Haar domain, and reconstructs with the inverse transform.

The Haar transform in WCC is a fixed, efficient, orthonormal spatial transform applied separately to each activation-map channel. For a single channel \(x\), the one-level transform is defined as a 2-D convolution with stride \(2\) using four \(2\times2\) kernels corresponding to the standard \(LL\), \(LH\), \(HL\), and \(HH\) subbands:
\[
[y_1,y_2,y_3,y_4] = \mathrm{Conv}(W,x).
\]
The inverse transform is implemented by transposed convolution with the same kernel bank:
\[
x = \mathrm{iHWT}(y) = \mathrm{Conv\text{-}transposed}(W,[y_1,y_2,y_3,y_4]).
\]
The method uses a multi-level Haar transform, and “in this work we use 3 levels in all the experiments.” As in SWAN, recursive decomposition is applied only to the low-pass branch [2205.12268].

The defining WCC operator is
\[
\mathrm{WCC}(K_{1\times1},x)=H^\top T^\top K_{1\times1} T\mathbf{H}x.
\]
Here \(H\) is the Haar transform, \(T\) is a top-\(k\) shrinkage operator, \(K_{1\times1}\) is the learned point-wise convolution, \(T^\top\) reinserts retained coefficients into the full coefficient layout by zero-filling omitted entries, and \(H^\top\) is the inverse Haar transform. The key point is that WCC targets \(1\times1\) convolutions only: it does not define a general spatial convolution theorem in Haar space, does not learn wavelet filters, and does not restrict processing to \(LL\) alone. Instead, the retained coefficient vectors across all subbands are jointly processed after shared support selection across channels [2205.12268].

In this formulation, Haar wavelets are used primarily for activation compression and efficient point-wise channel mixing rather than for explicit target enhancement or attention. This marks a major divergence from IRSTD-oriented HWConv designs, even though the transform-domain skeleton—Haar analysis, subband-domain operation, inverse reconstruction—is closely related.

## 5. Empirical characterization

The strongest direct empirical evidence for HWConv comes from SWAN’s ablation studies. On IRSTD-Real, the baseline reports mIoU \(62.88\), nIoU \(68.60\), Pd \(89.10\), Fa \(23.31\), and F1 \(75.70\); adding HWConv alone changes these to mIoU \(68.22\), nIoU \(70.55\), Pd \(92.62\), Fa \(20.33\), and F1 \(77.71\). On NUDT, the baseline reports mIoU \(81.53\), nIoU \(75.81\), Pd \(94.92\), Fa \(9.65\), and F1 \(92.83\); adding HWConv alone changes these to mIoU \(84.60\), nIoU \(85.24\), Pd \(95.18\), Fa \(4.77\), and F1 \(92.29\). The same paper reports that two-level nesting is best overall, and that Haar gives the best overall tradeoff among Symlet, Coiflet, Biorthogonal, and Reverse Biorthogonal on the IRSTD-Real dataset [2508.01322].

| Setting | Quantitative result | Context |
|---|---|---|
| Baseline \(\rightarrow\) +HWConv on IRSTD-Real | mIoU \(62.88 \rightarrow 68.22\), Pd \(89.10 \rightarrow 92.62\), Fa \(23.31 \rightarrow 20.33\) | SWAN ablation |
| Baseline \(\rightarrow\) +HWConv on NUDT | mIoU \(81.53 \rightarrow 84.60\), nIoU \(75.81 \rightarrow 85.24\), Fa \(9.65 \rightarrow 4.77\) | SWAN ablation |
| WFED vs alternatives | \(IoU\) improves by \(2.09\%\), \(3.30\%\), \(5.53\%\); \(P_d\) increases by \(1.13\%\), \(0.32\%\), \(2.36\%\) | SIRST, NUDT-SIRST, IRSTD-1K |

ARFC-WAHNet reports a dedicated WFED ablation comparing MaxPool, AvgPool, DWT, HWT, and WFED. The paper states that “MaxPool performs better than AvgPool for this task, but both are less effective than wavelet-based methods,” that “While both [Haar and Daubechies] yield similar performance, Haar is chosen for its simpler structure and higher computational efficiency,” and that “Among all methods, the proposed WFED achieves the best results on all three datasets.” Quantitatively, the reported gains are “\(IoU\) improves by \(2.09\%\), \(3.30\%\), and \(5.53\%\), while \(P_d\) increases by \(1.13\%\), \(0.32\%\), and \(2.36\%\) on SIRST, NUDT-SIRST, and IRSTD-1K, respectively” [2505.10595].

WCC provides a different empirical argument, centered on compression rather than IRSTD accuracy. On \(10^3\) activation maps from MobileNetV3-small on ImageNet, the paper reports much lower MSE for wavelet compression than for standard quantization at matched effective bit rate: at effective 2-bit, standard quantization MSE is \(0.3327\) while wavelet compression MSE is \(0.00503\); at effective 4-bit, the corresponding values are \(0.03448\) and \(0.00143\). Across detection, segmentation, depth estimation, and super-resolution, the main quantitative message is that aggressive activation quantization causes sharp degradation, whereas WCC with 8-bit wavelet coefficients plus shrinkage degrades performance much more gracefully [2205.12268].

## 6. Misconceptions, implementation ambiguities, and limitations

A frequent misconception is to treat HWConv as a standard learned convolution kernel that merely happens to use Haar filters. The available papers do not support that simplification. In SWAN, HWConv is explicitly a Haar transform followed by \(3\times3\) convolution on subbands, followed by inverse wavelet reconstruction and fusion. In ARFC-WAHNet, the corresponding wavelet block is “not presented as a standard learned convolution kernel that simply happens to use Haar filters,” but as a “fixed wavelet decomposition + frequency-selective enhancement + inverse reconstruction + residual downsampling fusion module.” In WCC, the operator is a Haar-wavelet compressed implementation of \(1\times1\) convolution rather than a general-purpose wavelet convolution operator [2508.01322; 2505.10595; 2205.12268].

A second misconception is that Haar-wavelet modules necessarily emphasize only high-frequency detail. SWAN makes the opposite domain-specific argument for IRSTD, stating that CNNs prefer high-frequency features while infrared small target characteristics tend to favor low-frequency features, and it therefore recursively decomposes only the \(LL\) branch. ARFC-WAHNet uses both directions simultaneously: Laplacian-style enhancement and attention on \(LH\), \(HL\), and \(HH\), but Gaussian filtering, SE, and sigmoid suppression on \(LL\). This suggests that the role of low-frequency structure is task-dependent rather than secondary by definition [2508.01322; 2505.10595].

The literature also leaves several implementation details unresolved. SWAN does not clearly specify subband packing, exact channel dimensions inside HWConv, stride, padding, normalization, or whether its \(3\times3\) convolutions are shared across subbands. ARFC-WAHNet does not provide explicit Haar kernel coefficients such as \([1,1]/\sqrt{2}\) or \([1,-1]/\sqrt{2}\), and it does not state the padding strategy for HWT or IHWT. WCC is more explicit mathematically, but it still targets \(1\times1\) convolution only and is stated to be less beneficial when spatial resolution quickly shrinks to very small maps in standard image-classification pipelines [2508.01322; 2505.10595; 2205.12268].

Finally, the cited ablations indicate that more wavelet recursion is not always better. In SWAN, two-level nesting is optimal, while deeper nesting causes gradual degradation. The paper interprets this as a balance among feature abstraction, cross-modal interaction, and computational burden. A plausible implication is that HWConv behaves best when the recursion depth matches the scale at which low-frequency semantic stabilization remains useful without eroding local target evidence [2508.01322].

Source: https://www.emergentmind.com/topics/haar-wavelet-convolution-hwconv