---
title: Medal S Medical Segmentation Model
url: https://www.emergentmind.com/topics/medal-s
type: topic
---

# Medal S Medical Segmentation Model

Searching arXiv for Medal S and directly related methods to support the encyclopedia entry.
Tool call: arxiv_search(query="2511.13001 OR \"Medal S\" medical segmentation foundation model SAT nnU-Net BiomedParse-V", max_results=10, sort_by="relevance")
Medal S is a medical segmentation foundation model that supports native-resolution spatial and textual prompts within an end-to-end trainable framework. It is designed to address a limitation of text-only methods lacking spatial awareness by achieving channel-wise alignment between volumetric prompts and text embeddings, thereby mitigating inaccuracies from resolution mismatches. By preserving full 3D context, it efficiently processes multiple native-resolution masks in parallel and supports up to 243 classes across CT, MRI, PET, ultrasound, and microscopy modalities in the BiomedSegFM dataset. The model further combines a lightweight 3D convolutional module, dynamic resampling, a two-stage inference strategy, and post-processing to improve memory efficiency, precision, and inference speed [2511.13001].

## 1. Conceptual position and problem setting

Medal S is formulated as a prompt-driven segmentation system in which textual prompts specify semantic targets and spatial prompts provide voxel-space guidance. Its defining claim is that native-resolution spatial prompting and textual prompting are not treated as separate pathways but are harmonized within a single trainable model. This contrasts, in the paper’s framing, with text-only methods lacking spatial awareness and with sequential prompt-based approaches that do not process multiple classes in parallel [2511.13001].

The architecture is intended for multi-class medical segmentation under heterogeneous imaging conditions. The reported scope includes CT, MRI, PET, ultrasound, and microscopy, with support for up to 243 classes in BiomedSegFM. Two inference modes are provided. In a text-only mode, model predictions serve as spatial prompts for self-refinement without human input. In a hybrid mode, manual annotations are incorporated for enhanced flexibility. A plausible implication is that Medal S is positioned simultaneously as a fully automatic system and as an interactive system, depending on how spatial prompts are initialized.

## 2. Architectural composition

Medal S consists of three main modules. The first is an image encoder implemented as a 3D U-Net–style backbone that extracts multi-scale volumetric features and produces a per-voxel feature map $F \in \mathbb{R}^{C \times H \times W \times D}$ via progressive up-sampling and skip connections. The second is a text encoder: a frozen SAT text encoder $\Phi_{\text{text}}$ maps each anatomical prompt $t_j$ to a $d$-dim embedding $z_j \in \mathbb{R}^d$, and a transformer-based query decoder $\Phi_{\text{query}}$ fuses $z_j$ with multi-scale visual features $V$ to produce adapted query embeddings $T \in \mathbb{R}^{N \times C}$, where $N$ is the number of semantic targets. The third is the query decoder plus spatial prompt refinement stage, which integrates native-resolution volumetric prompts $S_p \in \{0,1\}^{N \times H \times W \times D}$ with textual queries $T$ and yields final per-voxel probability maps $P \in [0,1]^{N \times H \times W \times D}$ [2511.13001].

The framework is end-to-end trainable. The image encoder, the query decoder, including the light 3D convolutional module, and prompt-generation data augmentation are trained jointly with a BCE+Dice loss. The model therefore couples semantic target specification, spatial conditioning, and voxel-wise refinement within a single optimization pipeline rather than delegating these stages to separate systems.

## 3. Channel-wise alignment and native-resolution refinement

The central technical mechanism is channel-wise alignment between full-resolution volumetric prompts and adapted text queries. Let $F \in \mathbb{R}^{C \times H \times W \times D}$ denote visual features, $T \in \mathbb{R}^{N \times C}$ the adapted text queries, and $S_p \in \{0,1\}^{N \times H \times W \times D}$ the spatial prompts. Medal S computes spatio-textual aligned features via per-voxel query correlation:

$$
F_a = T^\top \cdot S_p
$$

with $T^\top \in \mathbb{R}^{C \times N}$ and $S_p \in \mathbb{R}^{N \times H \times W \times D}$, yielding $F_a \in \mathbb{R}^{C \times H \times W \times D}$. The model then concatenates $[F;F_a] \in \mathbb{R}^{2C \times H \times W \times D}$ and applies a light-weight 3D convolutional block,

$$
F_r = \mathrm{Conv}_{3D}([F;F_a]),
$$

followed by a per-voxel inner product with queries and sigmoid activation,

$$
P = \sigma(T \cdot F_r),
$$

which yields $P \in \mathbb{R}^{N \times H \times W \times D}$ [2511.13001].

Two implementation choices are decisive. First, Medal S keeps volumetric prompts at native resolution and does not downsample $S_p$, preserving every voxel’s spatial fidelity. Second, all $N$ classes are processed in a single forward pass. The paper attributes to this design a more than 90% inference-time reduction for 24-class segmentation relative to sequential prompting. The lightweight 3D convolutional refinement is described as a single or small stack of $3 \times 3 \times 3$ convolutions inspired by nnU-Net skip connections, operating directly in voxel space while maintaining channel alignment.

## 4. Prompting modes and iterative decoding

Medal S supports two prompting modes at inference. In text-only self-refinement, the initialization is $S_p^{(0)} = 0$, corresponding to empty prompts. The model uses text queries $T$ alone to produce an initial prediction $P^{(1)}$, then feeds $P^{(1)}$ back as a spatial prompt and repeats the $T$–$S_p$ interaction for $T$ iterations. The paper characterizes this as fully automatic and “zero-click” refinement [2511.13001].

In hybrid mode, users supply initial spatial cues at native resolution, including points, scribbles, and boxes. These manual $S_p^{(0)}$ guide the first pass, and subsequent predictions $P$ serve as refined prompts. This combines human correction with text guidance for flexible interactive use. The distinction between the two modes is operational rather than architectural: the same spatio-textual alignment mechanism is reused, but the source of the initial spatial prompt differs.

The iterative query decoder inference procedure includes random masking. For $T$ iterations and $R$ random masking rounds per iteration, the method performs complementary masked and unmasked predictions and averages them to improve robustness. This suggests that prompt refinement is not merely recursive reuse of prior predictions, but a regularized inference procedure intended to stabilize performance under imperfect prompt conditions.

## 5. Data augmentation, resampling, and inference pipeline

The paper introduces dynamic resampling to address target-patch ratio imbalance in medical volumes, where object size can vary substantially relative to a fixed patch size. Voxel spacing $s = [s_x,s_y,s_z]$ is adapted to target spacing $s' = [s_x',s_y',s_z']$ based on the smallest foreground component size $d_i$ and patch size $p_i$:

$$
s_i' =
\begin{cases}
\max\left(t_i,\dfrac{p_i \cdot \alpha \cdot t_i}{d_i}\right) & \text{if } s_i > t_i \\
\min\left(t_i,\dfrac{p_i \cdot \alpha \cdot t_i}{d_i}\right) & \text{otherwise}
\end{cases}
$$

where $t_i$ is a reference spacing, $\alpha$ is a scale factor, and $s_i'$ is clamped to practical bounds. The stated purpose is to ensure that small targets are not lost, reducing false negatives, and that large targets do not dominate, reducing false positives. The implementation uses an efficient CPU-based resampling module borrowed from nnU-Net [2511.13001].

Spatial prompt generation is also synthesized during training. Algorithm 1 generates realistic, noisy prompts $S_p$ and $S_f$ from ground-truth masks $M$ by random block drop/add, channel dropout, and empty-prompt sampling. This places prompt corruption and incompleteness directly within the training distribution.

Inference is organized as a two-stage coarse-to-fine procedure. Stage 1 uses voxel spacing $(1.5,1.5,3.0)$ and patch size $224 \times 224 \times 128$, corresponding to an approximately $336 \times 336 \times 384$ mm field of view, and applies fast sliding-window inference to detect ROI; if no foreground is found, the system falls back to a full high-resolution pass. Stage 2 resamples the ROI to $(1.0,1.0,1.0)$ with patch size $192^3$, enlarges the crop by $1.1$–$1.5\times$ to include context, and imposes the physical-volume constraint

$$
V = \prod s_i \cdot d_i \leq V_{\text{threshold}} \approx (1.8^3)\cdot(c_x \cdot c_y \cdot c_z).
$$

If this constraint is exceeded, $s_i$ is adjusted to satisfy memory $\leq 32$ GB. The Stage 1 output is then used as a spatial prompt for fine segmentation.

Post-processing is class-wise component filtering. For each class $l$, the method thresholds $P_l \geq 0.5$ to obtain a binary mask $M_l$, labels 6-connected components, and computes each component’s size and mean probability. It retains, among the top-3 components by size, those with mean probability within $\tau = 0.1$ of the maximum and greater than $0.86$. If none satisfy this condition, it keeps the largest component, or the second if its size is at least $0.6 \times$ the largest. All other components are removed.

## 6. Optimization, training configuration, and evaluation protocol

The loss function is the sum of a binary cross-entropy term and a Dice term:

$$
\mathcal{L} = \mathcal{L}_{\text{BCE}} + \mathcal{L}_{\text{Dice}}
$$

with

$$
\mathcal{L}_{\text{BCE}} =
-\frac{1}{N \cdot C}\sum_{n,c}
\left[
s_{n,c}\log p_{n,c} + (1-s_{n,c})\log(1-p_{n,c})
\right]
$$

and

$$
\mathcal{L}_{\text{Dice}} =
1 - \frac{2\sum_{n,c} p_{n,c}s_{n,c}}{\sum p^2 + \sum s^2}.
$$

This formulation reflects the dual objective of per-voxel classification and overlap-sensitive segmentation quality [2511.13001].

Two training protocols are reported. The Stage 1 model uses a pre-trained SAT backbone, batch size $4$, patch size $224 \times 224 \times 128$ at spacing $(1.5,1.5,3.0)$, $108.6$k steps, AdamW, learning rate $1\mathrm{e}{-4}$ with cosine decay, $221$M parameters, and $168$ hours on $2 \times$ H100 GPUs. The Stage 2 model uses batch size $8$, patch size $192^3$ at $(1.0,1.0,1.0)$, $91.3$k steps, the same optimizer, and $160$ hours on $4 \times$ H100 GPUs.

The evaluation protocol distinguishes semantic and instance metrics. Semantic performance is measured by Dice Similarity Coefficient (DSC) and Normalized Surface Distance (NSD). Instance performance is measured by F1 at $0.5$ overlap and DSC over true positive instances (DSC TP). The runtime limit is $60$ s per class.

## 7. Reported results, comparative standing, and interpretation

On the validation set, using the five-modality average in the all-data track, Medal S reports DSC $75.44$ versus $69.83$ for SAT, NSD $77.34$ versus $71.06$, F1 $38.24$ versus $24.88$, and DSC TP $65.46$ versus $46.97$ [2511.13001]. The same table lists CAT at DSC $70.73$, NSD $72.60$, F1 $14.45$, and DSC TP $32.34$, while BiomedParse-V is reported at DSC $83.19$, NSD $89.21$, F1 $38.77$, and DSC TP $68.85$.

Modality-specific comparisons against SAT are heterogeneous. For CT, Medal S reports DSC $81.90$ versus $67.80$, NSD $81.61$ versus $67.26$, F1 $39.97$ versus $25.17$, and DSC TP $50.94$ versus $39.54$. For MRI, the corresponding values are DSC $61.95$ versus $56.10$, NSD $70.94$ versus $66.69$, F1 $46.99$ versus $12.28$, and DSC TP $66.41$ versus $27.28$. For microscopy, the reported instance metrics are F1 $33.44$ versus $20.06$ and DSC TP $72.39$ versus $42.43$. PET is an exception in the reported results: SAT is slightly higher in instance metrics, with F1 $42.00$ versus $32.57$ and DSC TP $78.63$ versus $72.11$. Ultrasound is also mixed: SAT is higher in DSC, $85.58$ versus $82.45$, while Medal S is slightly higher in NSD, $79.48$ versus $79.24$.

On the test set in the all-data track, Medal S outperforms SAT by approximately $4$ points in DSC, $58.06$ versus $54.13$, and approximately $6$ points in NSD, $59.11$ versus $52.97$. The paper therefore presents Medal S as superior to SAT in overall multi-class medical segmentation efficiency and accuracy, especially when parallel spatial prompting is compared with sequential prompting.

These results also delimit the model’s comparative standing. A common overgeneralization would be to read Medal S as uniformly dominant across all reported benchmarks. The reported validation averages do not support that reading, since BiomedParse-V has higher average DSC, NSD, F1, and DSC TP, and SAT remains higher on PET F1 and DSC TP and on ultrasound DSC. What the reported evidence does support is a specific claim: Medal S improves substantially over SAT while harmonizing spatial precision with semantic textual guidance and reducing the inference burden associated with sequential prompt-based approaches. The model is reported as being publicly available at `https://github.com/yinghemedical/Medal-S`.

Source: https://www.emergentmind.com/topics/medal-s