---
title: 'FreqDINO: Frequency-Guided Ultrasound Segmentation'
url: https://www.emergentmind.com/topics/freqdino
type: topic
---

# FreqDINO: Frequency-Guided Ultrasound Segmentation

FreqDINO is a frequency-guided segmentation framework designed for generalized, boundary-aware ultrasound image segmentation, combining state-of-the-art visual transformer representations with explicitly frequency-driven mechanisms to enhance boundary localization and structural accuracy in challenging medical imaging scenarios. The method addresses modality-specific degradation, notably speckle noise and boundary artifacts that impair performance when using vision transformers pretrained on natural images. Central to FreqDINO is the integration of multi-scale frequency extraction, boundary feature alignment, and frequency-guided boundary refinement within a unified deep learning architecture [2512.11335].

## 1. Architectural Foundations and Motivations

FreqDINO builds upon the DINOv3 visual transformer, leveraging its strong feature extraction abilities but introducing domain-specific enhancements to improve sensitivity to ultrasound-specific boundary challenges. The motivation is predicated on the observation that models pre-trained on natural images lack effective mechanisms to distinguish high-frequency boundary details from modality-specific noise, resulting in smoothed or imprecise segmentation borders. FreqDINO introduces frequency-guided modules—specifically, Multi-scale Frequency Extraction and Alignment (MFEA), the Frequency-Guided Boundary Refinement (FGBR) module, and a Multi-task Boundary-Guided Decoder (MBGD)—to explicitly enhance boundary perception and enforce structural consistency in the final segmentation [2512.11335].

## 2. Multi-scale Frequency Extraction and Alignment (MFEA)

The MFEA component separates the backbone spatial features into low-frequency structure and multi-scale high-frequency boundary representations to enable frequency-disentangled processing. The process is initiated by applying a Haar wavelet transform to the spatial feature map $\mathcal{F}_{\rm spatial}$ produced by the DINOv3 encoder and adapters. The wavelet decomposition produces four subbands: $\mathcal{F}_{LL}$, $\mathcal{F}_{LH}$, $\mathcal{F}_{HL}$, and $\mathcal{F}_{HH}$. Fine-scale boundary features $\mathcal{F}_{H_f}$ are obtained by concatenating $(LH, HL, HH)$ and reducing with a $1 \times 1$ convolution $\phi_H$, while coarse-scale features $\mathcal{F}_{H_c}$ are generated via further down-up sampling, another Haar transform, and a similar reduction procedure. Both $\mathcal{F}_{H_f}$ and $\mathcal{F}_{H_c}$ are tensors with shape $B \times C' \times H_1 \times W_1$, where $B$ is the batch size, $C'$ the channel width, and $(H_1, W_1)$ the spatial resolution [2512.11335].

## 3. Frequency-Guided Boundary Refinement (FGBR) Module

At the core of FreqDINO is the FGBR module, which exploits frequency-extracted features to enforce boundary sensitivity:

1. **Boundary Prototype Extraction**: The two high-frequency maps $(\mathcal{F}_{H_f}, \mathcal{F}_{H_c})$ are concatenated across channels to form $\mathcal{F}_H \in \mathbb{R}^{B \times 2C' \times H_1 \times W_1}$. A stack of two $1 \times 1$ convolutional layers with ReLU activations is applied (first mapping $2C' \to D_1$ channels, then $D_1 \to 64$), followed by global average pooling across spatial dimensions, yielding a batch of 64-dimensional boundary prototypes $\mathbf{P} \in \mathbb{R}^{B \times 64}$.

2. **Boundary-Guided Feature Refinement**: Enhanced spatial features $\mathcal{F}_{\rm enh}$ (from MFEA) are reshaped for attention as $Q \in \mathbb{R}^{B \times (H_1 W_1) \times C}$ and projected to query vectors. The boundary prototype is linearly projected to obtain key/value tensors for an 8-head scaled dot-product attention. The attention output is reshaped and added (with residual scale $\omega = 0.2$) back to $\mathcal{F}_{\rm enh}$, forming $\mathcal{F}_{\rm refined}$ [2512.11335].

The FGBR module thus fuses frequency-derived boundary statistics with spatial detail, directly influencing learned segmentation boundaries.

## 4. Multi-Task Boundary-Guided Decoder (MBGD) and Integrated Pipeline

$\mathcal{F}_{\rm refined}$ enters the MBGD, which upscales features and computes both semantic segmentation masks and explicit boundary maps:

- The decoder applies four transposed convolution upsampling ("UpBlocks") to produce a high-resolution $\mathcal{F}_{\rm shared}$.
- A $1 \times 1$ convolution produces preliminary boundary logits $\mathcal{M}_{\rm boundary}$, transformed into a soft mask via sigmoid and refined with a $3 \times 3$ convolution for the final boundary output.
- The semantic mask head takes as input the concatenation of $\mathcal{F}_{\rm shared}$ and the boundary prediction, followed by a $1 \times 1$ convolution.

The pipeline sequence is: Input → DINOv3 encoder → MFEA → FGBR → MBGD → semantic & boundary predictions [2512.11335].

## 5. Quantitative Performance and Ablation

Experimental results underscore the contribution of the FGBR module within FreqDINO. On ultrasound segmentation benchmarks:

- The base DINOv3 + adapters yields Dice = 82.35%, HD = 47.59 mm.
- Adding MFEA alone improves to Dice = 84.17%, HD = 44.59 mm.
- Adding FGBR atop MFEA further yields Dice = 85.13% (+0.96), HD = 43.02 mm (–1.57 mm).
- The full FreqDINO (MFEA + FGBR + MBGD) records Dice = 86.52%, HD = 39.63 mm.

This demonstrates that FGBR provides a measurable boost in boundary accuracy and overall segmentation agreement relative to frequency feature extraction alone [2512.11335].

## 6. Comparative and Related Approaches

FreqDINO's FGBR concept is related to the Frequency-Guided Boundary Refinement mechanisms appearing across scientific domains, with notable analogs:

- In axisymmetric droplet simulations, a signal processing approach uses Fourier-domain envelope analysis of curvature to guide mesh refinement, delivering robust and parametric grid adaptation for capturing singularity formation [1909.09553].
- Temporal action detection in video leverages frequency decoupling to suppress low-frequency background and amplifies atomic (high-frequency) segment boundaries, with analogous modules for frequency-guided action boundary localization [2504.00647].

A plausible implication is that the frequency-guided signal processing paradigm is establishing a methodological connection between computational physics, video understanding, and medical image analysis, where boundary localization under noise and class imbalance is critical.

## 7. Implementation Considerations and Reproducibility

Implementation of FreqDINO's FGBR should adhere to the specifications described: minimal prototype extractor (two $1 \times 1$ convolutions, ReLU), standard multi-head attention with 8 heads and $128$-dimension per head, and lightweight residual integration with $\omega=0.2$. The architecture relies on standard PyTorch MultiheadAttention primitives and basic convolutional units. The code for FreqDINO is available at https://github.com/MingLang-FD/FreqDINO [2512.11335].

In summary, FreqDINO combines frequency decomposition, boundary prototype learning, and attention-driven feature refinement to deliver state-of-the-art segmentation, particularly excelling in boundary-sensitive, high-noise imaging contexts characteristic of ultrasound.

Source: https://www.emergentmind.com/topics/freqdino