---
title: 'MAFNet: Multi-frequency Adaptive Fusion Network'
url: https://www.emergentmind.com/topics/multi-frequency-adaptive-fusion-network-mafnet
type: topic
---

# MAFNet: Multi-frequency Adaptive Fusion Network

A Multi-frequency Adaptive Fusion Network (MAFNet) is a neural architecture paradigm that decomposes inputs into frequency-aware components, aggregates them via adaptive attention or gating, and fuses information to enhance spatial, spectral, or representational fidelity. Instances of MAFNet address high-speed stereo matching and image deblurring by leveraging frequency-domain filtering, low-rank attention mechanisms, and efficient convolutional backbones. Core to these variants is the explicit handling and fusion of high- and low-frequency representations, improving both accuracy and efficiency compared to spatial-only or conventional attention networks [2502.14209, 2512.04358].

## 1. Core Network Principles and Frequency Decomposition

All MAFNet variants adopt the principle of adaptive fusion of feature subbands—usually dividing information into high-frequency (edges, details) and low-frequency (smooth, coarse features) bands. This separation is performed in the frequency domain, using either learnable low-pass filters, discrete Fourier transforms (FFT/RFFT), or similar operators. The explicit two-band splitting allows the network to address image regions with different statistical properties, such as sharp transitions versus homogeneous textures.

For example, in real-time stereo matching, the Adaptive Frequency-Domain Filtering Attention (AFFA) module performs a real-valued FFT on input feature maps. Radially parameterized soft masks, defined as
$$
M_{\mathrm low}(u,v) = \sigma\bigl(\tau(T_\ell - r(u,v))\bigr),\qquad
M_{\mathrm high}(u,v) = \sigma\bigl(\tau(r(u,v) - T_h)\bigr),
$$
(where $r(u,v)$ is the normalized frequency and $\tau, T_\ell, T_h$ are learnable) are applied in the frequency plane. The resulting masked features undergo inverse FFT, yielding spatial domain representations for low- and high-frequency bands [2512.04358].

Similarly, for image deblurring, the Frequency Domain Information Dynamic Generation Module (FDGM) applies learnable spatially-varying low-pass and high-pass filters via depth-wise convolution, producing adaptive per-row frequency subbands [2502.14209].

## 2. Architecture Design and Feature Fusion

In stereo matching, MAFNet employs a lightweight 2D convolutional encoder (MobileViT), constructs a 4D cost volume at $\frac{1}{4}$ resolution via feature concatenation, and applies AFFA at multiple feature scales. The main computational innovation is the Linformer-based low-rank attention fusion (AFHF), which concatenates the band-filtered cost volumes and applies low-rank attention:
$$
\mathrm{LinAtt}(\mathbf Q, \mathbf K, \mathbf V) = \mathrm{Softmax}\left(\frac{\mathbf Q \mathbf K'^T}{\sqrt d}\right)\mathbf V'
$$
with $\mathbf K' = \mathbf E \mathbf K$, $\mathbf V' = \mathbf F \mathbf V$, reducing attention complexity from $O(N^2)$ to $O(Nk)$ [2512.04358]. This fusion adaptively integrates contextual information across high- and low-frequency domains while enabling real-time inference.

For deblurring, MAFNet adopts a U-shaped encoder–decoder with multi-scale shallow and deep feature paths. Each stage contains cascaded MAFBlocks that jointly process spatial and frequency information. The Gated Fusion Module (GFM) internally re-weights spatial, low-, and high-frequency features via a gating mechanism involving global average and standard deviation pooling, then fuses them through a cross-attention mechanism with output weighting determined by learned softmax coefficients [2502.14209].

## 3. Loss Functions and Optimization Strategies

MAFNet designs for both deblurring and stereo matching employ multi-component loss objectives to ensure robust feature learning:

- In stereo matching, supervision is applied via smooth $L_1$ loss on predicted disparities at both full and reduced resolutions:
  $$
  \mathcal L = \lambda_0\,\mathcal L^{\mathrm{L1}}_{\mathrm{smooth}}(\hat D^0-D^{gt}) + \lambda_1\,\mathcal L^{\mathrm{L1}}_{\mathrm{smooth}}(\hat D^1-D^{gt}).
  $$
  Training uses AdamW optimizer with a one-cycle schedule, batch size 16, and data augmentation via random crops [2512.04358].

- In deblurring, the loss per scale aggregates pixel-wise $L_2$ error, Laplacian error, and frequency domain difference in the FFT domain:
  $$
  L = \sum_{i=1}^4 \left(
      L_c(\hat I_i, \bar I_i) + \delta\,L_e(\hat I_i, \bar I_i) + \lambda\,L_f(\hat I_i, \bar I_i)
  \right)
  $$
  where $L_f$ compares FFTs, $L_e$ captures edge differences via Laplacian, and $L_c$ is the $L_2$-based content loss. Training uses Adam optimizer, cosine annealing learning rate, batch size 32, and spatial augmentations [2502.14209].

## 4. Quantitative Performance and Efficiency

MAFNet achieves competitive or superior results with lower computational demands due to its frequency-aware architectural design. In stereo matching, MAFNet achieves D1-all=1.82% on KITTI 2015 with only 39.4 G FLOPs—outperforming prior 2D-conv methods such as HITNet and AANet+ in both accuracy and efficiency [2512.04358]. The inclusion of both AFFA and AFHF modules provides further improvements, as shown in ablation results.

In deblurring, MAFNet and its larger variant MAFNet-B set new SOTA on GoPro, HIDE, RealBlur-R, and RealBlur-J datasets. For instance, MAFNet-B attains 34.25 dB PSNR and 0.971 SSIM on GoPro, and 31.92 dB/0.949 on HIDE, exceeding comparable models including MPRNet, Restormer, and MR-LPFNet [2502.14209].

| Method          | Dataset      | PSNR   | SSIM   | FLOPs (G) | Params (M) |
|-----------------|-------------|--------|--------|-----------|------------|
| MAFNet          | KITTI'15    | —      | —      | 39.4      | 10.36      |
| MAFNet-B        | GoPro       | 34.25  | 0.971  | —         | —          |
| HITNet          | KITTI'15    | —      | —      | 50.23     | 0.42       |
| MR-VNet         | GoPro       | 34.04  | 0.969  | —         | —          |

Performance gains are consistently attributed to the explicit handling and fusion of frequency-specific information.

## 5. Advantages, Limitations, and Future Directions

The primary advantage of the MAFNet approach is its ability to decouple, adaptively weight, and efficiently fuse frequency-domain information using computationally lightweight filters and low-rank attention, obviating the need for 3D convolutions. This results in models suitable for deployment on resource-constrained (e.g., mobile or embedded) platforms without substantial loss of accuracy.

However, the two-band decomposition is coarse; finer or dynamically learned frequency partitions may offer further improvements in detail preservation and selective enhancement [2512.04358]. Quantization and pruning could further lower runtime cost. Extending adaptive fusion to true multi-scale spatial–frequency representations remains an active area for exploration.

A plausible implication is that the MAFNet paradigm is generalizable: networks incorporating adaptive frequency decomposition and fusion outperform spatial-only and frequency-blind models in vision tasks characterized by simultaneous smooth region and edge detail processing requirements.

## 6. Relationship to Broader Frequency-Aware and Attention Models

MAFNet differentiates itself from conventional channel or spatial attention mechanisms by explicitly modeling frequency composition via learnable or analytic transforms. The Linformer-based fusion used in MAFNet allows global contextual integration with sub-quadratic computational cost, addressing the limitations of traditional self-attention in high-dimensional cost volumes [2512.04358]. In image deblurring, joint spatial-frequency gating and cross-attention improve the learning of complementary features versus approaches that fuse domains post-hoc or with static filters [2502.14209].

This approach is related in spirit to networks employing wavelet attention [2502.04903], where discrete wavelet transforms and frequency-specific attention mechanisms yield improvements for pansharpening and remote sensing tasks. The consistency in adopting explicit frequency band splitting and adaptive band fusion across domains suggests that Multi-frequency Adaptive Fusion Networks are a robust unifying motif in recent vision architectures.

Source: https://www.emergentmind.com/topics/multi-frequency-adaptive-fusion-network-mafnet