Wavelet Attention-Like Backbone

• Wavelet attention-like backbones are neural architectures that combine discrete wavelet transforms with attention mechanisms for efficient multi-resolution feature processing.
• They are applied in varied domains such as time-series forecasting, human-object interaction detection, and learned image compression, demonstrating improved cost efficiency and accuracy.
• Empirical studies show these designs reduce computational complexity while preserving local and global structural information compared to traditional attention methods.

Searching arXiv for papers on wavelet-attention backbones and related architectures. A wavelet attention-like backbone is a neural backbone in which wavelet analysis is coupled to attention, attention replacement, or attention-style modulation so that feature processing is carried out in a multi-resolution representation rather than solely in the original spatial, temporal, or channel domain. In the cited literature, this designation covers several related but non-identical constructions: attention computed directly in wavelet coefficient space, wavelet-conditioned channel or spatial reweighting, wavelet-domain token mixing with inverse reconstruction, and wavelet-guided encoder backbones that reduce cost while preserving local and global structure. The family includes multivariate time-series forecasting models such as "WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecasting" (Liang et al., 2024), HOI detection backbones such as "Conceptualizing Multi-scale Wavelet Attention and Ray-based Encoding for Human-Object Interaction Detection" (Pay et al., 15 Jul 2025), learned image compression architectures such as "ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression" (Fu et al., 27 May 2026), and long-sequence Transformer variants such as "WavSpA: Wavelet Space Attention for Boosting Transformers' Long Sequence Learning Ability" (Zhuang et al., 2022).

1. Conceptual scope and defining characteristics

The reported systems share a common premise: wavelet transforms provide joint access to localized time-frequency or space-frequency structure, while attention or attention-like mechanisms decide which scales, bands, regions, or channels should dominate downstream computation. "WaveRoRA" states that the wavelet domain "integrates both time and frequency information" and allows "the analysis of local characteristics of signals at different scales" (Liang et al., 2024). "WavSpA" likewise motivates wavelet space by arguing that wavelets capture "both position and frequency information with linear time complexity" (Zhuang et al., 2022). In vision, the HOI backbone describes its wavelet component as aggregating "discriminative features from the low- and high-order interactions extracted from diverse convolutional filters" (Pay et al., 15 Jul 2025).

The expression attention-like is necessary because the literature is not uniform about what counts as attention. Some systems retain explicit $Q,K,V$ computations in a transformed domain. Others replace standard self-attention with wavelet-domain operators, routed summaries, channel excitation, or scale reweighting. "ChWDTA" keeps windowed spatial self-attention but computes $Q/K/V$ on channel-wise wavelet-transformed features before inverse mapping (Fu et al., 27 May 2026). "WaveNets: Wavelet Channel Attention Networks" generalizes channel attention by replacing Global Average Pooling with wavelet compression (Salman et al., 2022). "Wavelet-Aware Anomaly Detection in Multi-Channel User Logs via Deviation Modulation and Resolution-Adaptive Attention" explicitly notes that its resolution-adaptive module is an SENet-style channel attention over subbands and that there is "No explicit Q,K,V" (Kong et al., 18 Jan 2026). This suggests that the field uses the term to denote a family of wavelet-conditioned importance mechanisms rather than a single canonical attention operator.

2. Mathematical foundations: decomposition, coefficients, and reconstruction

At the core of these backbones is discrete wavelet decomposition. In one-dimensional temporal settings, "WaveRoRA" writes the multivariate input as $X \in \mathbb{R}^{L \times M}$ and uses a $J$-level DWT to produce

$C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$

with forward analysis

$y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$

$y_l^{(j)}(n)=\sum_{s=1}^S g(s)\,y_l^{(j-1)}(2n-s),$

and inverse reconstruction through synthesis filters $h',g'$ and upsampling to recover $\hat y_l^{(0)} \in \mathbb{R}^{L \times M}$ (Liang et al., 2024).

In two-dimensional settings, the decomposition usually yields one low-pass and three high-pass subbands. The HOI backbone defines, for $X_j \in \mathbb{R}^{C \times H \times W}$,

$Q/K/V$0

$Q/K/V$1

$Q/K/V$2

$Q/K/V$3

with inverse reconstruction by upsampling and filtering (Pay et al., 15 Jul 2025). Comparable four-subband layouts appear in WA-CNN, SWAN, MEGANet-W, AWGUNET, SCH, and the deraining WCAM (Xiangyu, 2022, Jing et al., 2 Aug 2025, Tan, 3 Jul 2025, Roy et al., 2024, Xu et al., 2024, Yang et al., 2020).

Wavelet-enhanced models differ from Fourier-only designs because the representation is explicitly multi-resolution and localized. "WavSpA" formulates the pattern as

$Q/K/V$4

thereby inserting forward and inverse wavelet transforms around the attention sublayer while leaving LayerNorm, residuals, and FFN unchanged (Zhuang et al., 2022). "Spatiotemporal Forecasting of Traffic Flow using Wavelet-based Temporal Attention" applies MODWT, attends per scale, and then reconstructs by IMODWT (Jakhmola et al., 2024). Across these formulations, decomposition is not an auxiliary pre-processing step; it is part of the backbone’s differentiable computational graph.

3. Attention and attention-like mechanisms in the wavelet domain

One major class computes attention directly in transformed coordinates. "ChWDTA" first applies a one-level 1D wavelet transform along the channel axis,

$Q/K/V$5

then forms

$Q/K/V$6

performs windowed scaled dot-product attention

$Q/K/V$7

and finally maps back with $Q/K/V$8 (Fu et al., 27 May 2026). "WavSpA" uses the same principle for sequence tokens in multi-resolution coefficient space (Zhuang et al., 2022).

A second class modifies the attention mechanism itself. "WaveRoRA" introduces Rotary Route Attention, in which a small set of routing tokens $Q/K/V$9 first gathers information from $X \in \mathbb{R}^{L \times M}$0 and then redistributes it to $X \in \mathbb{R}^{L \times M}$1, while rotary position embeddings inject relative positional information. Its single-head formulation includes

$X \in \mathbb{R}^{L \times M}$2

$X \in \mathbb{R}^{L \times M}$3

with complexity reduced from $X \in \mathbb{R}^{L \times M}$4 for Softmax self-attention to $X \in \mathbb{R}^{L \times M}$5 when $X \in \mathbb{R}^{L \times M}$6 (Liang et al., 2024).

A third class is only partially self-attentional and is therefore best described as attention-like modulation. The HOI backbone constructs an attention score over the four subbands by generating $X \in \mathbb{R}^{L \times M}$7 from depthwise wavelet filters and applying

$X \in \mathbb{R}^{L \times M}$8

followed by

$X \in \mathbb{R}^{L \times M}$9

(Pay et al., 15 Jul 2025). SWAN computes windowed and shifted self-attention after Haar Wavelet Convolution, then uses Residual Dual-Channel Attention for decoder fusion (Jing et al., 2 Aug 2025). The CERT anomaly-detection model pools over subbands and feeds the descriptors to a two-layer MLP,

$J$0

then reweights each resolution by $J$1 (Kong et al., 18 Jan 2026). "WaveNets" replace the scalar squeeze of SENet with wavelet compression, and WA-CNN computes a spatial attention map only from retained high-frequency bands while preserving the low-frequency structural path (Salman et al., 2022, Xiangyu, 2022).

4. Architectural patterns across application domains

Several recurring integration patterns can be identified. Some backbones are replace-only designs, in which standard attention is swapped for a wavelet-space alternative. Others are hybrid designs, in which a conventional encoder-decoder or CNN-Transformer backbone is preserved but wavelet stages are inserted at downsampling, skip, or entropy-coding locations. This suggests that wavelet attention-like backbones are more a design strategy than a single network template.

Representative paper	Wavelet attention-like mechanism	Reported domain
"WaveRoRA" (Liang et al., 2024)	DWT + WaveEmbedding + RoRA + IDWT	Multivariate time series forecasting
"WavSpA" (Zhuang et al., 2022)	FWT → attention in coefficient space → IWT	Long-sequence Transformer learning
"ChWDTA" (Fu et al., 27 May 2026)	Windowed attention with channel-wise wavelet-domain $J$2	Learned image compression
"SWAN" (Jing et al., 2 Aug 2025)	Haar Wavelet Convolution + Shifted Spatial Attention + RDCA	Infrared small target detection
"MEGANet-W" (Tan, 3 Jul 2025)	Two-level Haar wavelet head + Wavelet Edge Guided Attention	Weak-boundary polyp detection
"MSWT" (Liu et al., 2022)	Multi-scale wavelet branch + FSA + CMA in unified transformer block	Face forgery detection
"W-DSTAGNN" (Jakhmola et al., 2024)	MODWT → per-scale temporal attention → IMODWT	Traffic flow forecasting

In forecasting, the wavelet backbone often reorganizes tokenization. "WaveRoRA" performs InstanceNorm, $J$3-level DWT, wavelet-wise embedding, a transpose to series-wise tokens, stacked encoder layers, wavelet-wise prediction of coefficients, and IDWT with denormalization (Liang et al., 2024). "W-DSTAGNN" decomposes each temporal block by MODWT, attends on each detail and smooth level, reconstructs the attended sequence, and then applies spatial self-attention and graph convolution (Jakhmola et al., 2024).

In vision, there are at least four distinct placements. First, wavelets can replace downsampling or upsampling, as in WA-CNN, WCAM for deraining, and SCH for learned image compression (Xiangyu, 2022, Yang et al., 2020, Xu et al., 2024). Second, they can guide skip-connection recalibration, as in WGCAM in AWGUNET and W-EGA in MEGANet-W (Roy et al., 2024, Tan, 3 Jul 2025). Third, they can supply a parallel frequency stream fused with a spatial stream, as in MSWT (Liu et al., 2022). Fourth, they can operate in the channel domain rather than the spatial domain, as in ChWDTA and ChWP (Fu et al., 27 May 2026).

5. Empirical behavior, efficiency, and ablation trends

The reported empirical record consistently links wavelet attention-like designs to improved multi-scale modeling, although the relevant metric differs by task. "WaveRoRA" reports experiments on eight real-world datasets and states that the model "outperforms existing state-of-the-art models while maintaining lower computational costs" (Liang et al., 2024). Its ablations show that error falls sharply as soon as $J$4 and then plateaus around $J$5–$J$6, that default $J$7 is effective, that default $J$8 is stable, and that replacing RoRA with Softmax SA or linear-attention degrades MSE by approximately $J$9–$C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$0 (Liang et al., 2024).

In HOI detection, the wavelet backbone has approximately $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$1 M parameters, the addition of $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$2 ray layers yields approximately $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$3 M parameters, and the sequence length into the encoder becomes approximately $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$4 rather than $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$5; the reported throughput is approximately $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$6–$C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$7 FPS on a single RTX 8000 (Pay et al., 15 Jul 2025). In learned image compression, "ChWDTA" reports BD-rate reductions of $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$8, $C = \{ y_h^{(1)}, \ldots, y_h^{(J)}, y_l^{(J)} \},$9, and $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$0 on Kodak, CLIC Professional Validation, and Tecnick in the default eight-slice configuration, while the related SCH framework reports reductions of $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$1, $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$2, $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$3, and $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$4 against VTM-23.1 on four datasets (Fu et al., 27 May 2026, Xu et al., 2024).

In classification and sequence modeling, the ablations frequently attribute gains to wavelet locality rather than to mere frequency decomposition. "WavSpA" reports that fixed Daubechies-2 WavSpA with full attention reaches $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$5 mean accuracy on Long Range Arena, versus an approximately $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$6 Transformer baseline, and states that wavelet-space learning significantly outperforms Fourier-space learning (Zhuang et al., 2022). "Multiscale Attention via Wavelet Neural Operators for Vision Transformers" reports that its Multiscale Wavelet Attention has linear complexity in sequence size and improves over AFNO and GFN on several CIFAR and Tiny-ImageNet settings (Nekoozadeh et al., 2023). WA-CNN reports a $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$7 Top-1 gain on CIFAR-10 and a $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$8 gain on CIFAR-100 on MobileNetV2 backbones (Xiangyu, 2022).

Ablations also show that the choice of basis and decomposition depth is task-dependent. "WaveRoRA" reports Symlet3 as best on strongly periodic Traffic and Electricity, while Coiflet3 slightly outperforms on ETTh1 (Liang et al., 2024). SWAN reports that Haar wins over Symlet, Coiflet, and Biorthogonal in mIoU, Fa, and F1, and that two-level nesting is best while deeper nesting degrades due to "over-smoothing / cost" (Jing et al., 2 Aug 2025). Such results indicate that wavelet selection is not interchangeable across tasks.

6. Interpretation, misconceptions, and unresolved issues

A common misconception is that a wavelet attention-like backbone is simply ordinary self-attention preceded by a DWT. The literature does not support that simplification. Some models indeed implement direct attention in wavelet space, but others use routing tokens, channel compression, scale reweighting, or wavelet-conditioned pooling without full token-token attention (Liang et al., 2024, Kong et al., 18 Jan 2026, Salman et al., 2022). Another misconception is that wavelets are used only for frequency filtering. The cited systems repeatedly rely on the fact that wavelets preserve localized structure across scales rather than discarding positional information, which is one reason they are contrasted with Fourier-domain approaches in WavSpA and MWA (Zhuang et al., 2022, Nekoozadeh et al., 2023).

The literature also shows that wavelet and attention can be coupled in incompatible ways. Some designs preserve exact or near-exact reconstruction through IDWT or inverse channel transforms, as in WaveRoRA, ChWDTA, WavSpA, and W-DSTAGNN (Liang et al., 2024, Fu et al., 27 May 2026, Zhuang et al., 2022, Jakhmola et al., 2024). Others do not reconstruct the original signal but instead use wavelet coefficients as side information for gating, fusion, or decoder recalibration, as in MEGANet-W, AWGUNET, and WaveNets (Tan, 3 Jul 2025, Roy et al., 2024, Salman et al., 2022). This suggests that the decisive property is not invertibility alone, but whether the backbone uses multiresolution coefficients as the locus of feature selection.

Open technical questions remain visible in the reported ablations. The optimal number of levels varies: $y_h^{(j)}(n)=\sum_{s=1}^S h(s)\,y_l^{(j-1)}(2n-s),$9 is the default in MWA, $y_l^{(j)}(n)=\sum_{s=1}^S g(s)\,y_l^{(j-1)}(2n-s),$0 is optimal in W-DSTAGNN, $y_l^{(j)}(n)=\sum_{s=1}^S g(s)\,y_l^{(j-1)}(2n-s),$1 is typical in the CERT anomaly detector, and $y_l^{(j)}(n)=\sum_{s=1}^S g(s)\,y_l^{(j-1)}(2n-s),$2 is the default in WaveRoRA (Nekoozadeh et al., 2023, Jakhmola et al., 2024, Kong et al., 18 Jan 2026, Liang et al., 2024). The choice between fixed and adaptive wavelets is similarly unsettled: WavSpA evaluates fixed wavelets, direct parameterization, orthogonal parameterization, and lifting; ChWDTA compares Haar, CDF 9/7, and learned lifting (Zhuang et al., 2022, Fu et al., 27 May 2026). A plausible implication is that the field has converged on wavelet multi-resolution structure as useful, but not yet on a universal wavelet-attention cell.

In aggregate, the documented evidence presents the wavelet attention-like backbone as a broad architectural family defined by three recurring operations: multiresolution decomposition, selective interaction in coefficient space or with coefficient-derived gates, and either reconstruction or fusion back into the main backbone. Across forecasting, detection, compression, segmentation, classification, anomaly detection, and radar recognition, that family is used to couple large-context modeling with locality, to reduce attention cost, or to preserve edge, trend, and periodic information that is difficult to capture from a single domain alone (Liang et al., 2024, Pay et al., 15 Jul 2025, Fu et al., 27 May 2026, Zhuang et al., 2022).