---
title: Skeleton Recall Loss in Tubular Segmentation
url: https://www.emergentmind.com/topics/skeleton-recall-loss-srl
type: topic
---

# Skeleton Recall Loss in Tubular Segmentation

Searching arXiv for the cited SRL papers and related topology-aware segmentation work.
Tool call: arxiv_search(query="2404.03010 Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structures", max_results=5)
Tool call: arxiv_search(query="2508.11374 Does the Skeleton-Recall Loss Really Work?", max_results=5)
Skeleton Recall Loss (SRL) is a topology-aware segmentation loss for thin tubular structures such as vessels, nerves, roads, and concrete cracks. It was introduced by Kirchhoff et al. as a resource-efficient alternative to differentiable skeleton-based losses: the method precomputes a tubed skeleton from the ground-truth mask, then adds a recall-style term that rewards high predicted probabilities on that skeleton while retaining a conventional segmentation loss for volumetric overlap [2404.03010]. SRL is therefore positioned at the intersection of connectivity preservation and practical training efficiency. Subsequent work has both extended the broader design space of skeleton-focused supervision and challenged SRL’s optimization behavior and empirical robustness, making it a notable case study in topology-aware learning for curvilinear segmentation [2508.11374] [2505.08525].

## 1. Origins and problem setting

SRL was proposed for segmentation regimes in which thin, elongated, low-contrast structures occupy few pixels or voxels and where connectivity errors are disproportionately harmful. The motivating applications listed for the method include blood vessels, nerves, roads, cracks, the inferior alveolar canal, and the Circle of Willis; in these settings, a small local omission can disconnect a branch even when the volumetric error is modest [2404.03010].

The method was introduced against two established baselines. First, overlap-based losses such as Cross-Entropy and Dice optimize pixel-wise or volumetric agreement, but they do not directly penalize broken centerlines, missing bridges, or incorrect branch splitting and merging. Second, topology-focused losses such as clDice preserve connectivity more explicitly but rely on differentiable skeletonization at training time, which the proposing paper characterizes as expensive in memory and runtime, particularly in 3D and in multi-class settings [2404.03010].

A later reevaluation by Arora et al. framed SRL more narrowly: rather than a full topological comparison between prediction and target, SRL is a recall-like objective defined only on a precomputed tubed skeleton derived from ground truth. That distinction became central to the subsequent criticism of its gradients and error sensitivity [2508.11374].

| Paper | Main contribution | Relation to SRL |
|---|---|---|
| "Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structures" [2404.03010] | Original SRL proposal | Defines tubed skeletonization and the recall term |
| "Dynamic Snake Upsampling Operater and Boundary-Skeleton Weighted Loss for Tubular Structure Segmentation" [2505.08525] | DSU and boundary-skeleton weighting | Closely related skeleton-focused supervision without explicit SRL naming |
| "Does the Skeleton-Recall Loss Really Work?" [2508.11374] | Theoretical and empirical reevaluation | Critiques SRL gradients and reported gains |

## 2. Formal construction

SRL has two components: tubed skeletonization of the target mask and a class-wise recall term computed on that transformed target. In the original formulation, the hard target \(Y\) is first binarized to foreground and background, skeletonized, dilated, and then multiplied by the original labels to recover class information [2404.03010].

For \(K\)-class targets, the preprocessing is:

1. \(Y_{\text{bin}} \leftarrow (Y > 0)\)
2. \(Y_{\text{skel}} \leftarrow \text{skeletonize}(Y_{\text{bin}})\)
3. \(Y_{\text{skel}} \leftarrow \text{dilate}(Y_{\text{skel}})\)
4. \(Y_{\text{mc-skel}} \leftarrow Y_{\text{skel}} \times Y\)

In the original paper, skeletonization is performed with Zhang–Suen thinning in 2D and 3D medial axis thinning in 3D, while dilation uses a diamond kernel of radius \(2\) [2404.03010]. The result is a tubed skeleton: a thin but slightly thickened centerline representation that preserves class labels.

The training loss augments a generic segmentation loss with a skeleton recall term. In the original notation,

$$
\mathcal{L} = \mathcal{L}_{\text{generic}} + w \cdot \mathcal{L}_{\text{SkelRecall}}.
$$

Algorithmically, \(Y_{\text{mc-skel}}\) is one-hot encoded, and for each class \(c\),

$$
L_{\text{mc-skel}[c]} \leftarrow -\frac{\sum \left(Y_{\text{mc-skel}[c]} \times Y_{\text{pred}[c]}\right)}{\sum Y_{\text{mc-skel}[c]}}.
$$

The class losses are averaged to obtain \(\mathcal{L}_{\text{SkelRecall}}\) [2404.03010]. Arora et al. restated the same idea in a compact form:

$$
\mathscr{L}_{SRL} = - \frac{1}{|K|}\sum_{k \in K}
\frac{\sum_{i \in \Omega} s_\theta^{ik} y^{ik}}{\sum_{i \in \Omega} y^{ik}},
$$

where \(y^{ik}\) denotes the tubed-skeleton target and \(s_\theta^{ik}\) the predicted class score or probability at pixel \(i\) for class \(k\) [2508.11374].

Two structural features are notable. First, SRL does not skeletonize predictions online; only the ground truth is transformed. Second, the loss is recall-like rather than overlap-symmetric: it rewards coverage of tubed-skeleton voxels, while precision away from the skeleton is delegated to the generic loss.

## 3. Connectivity rationale and optimization behavior

The intended rationale is straightforward. Since the skeleton encodes the centerline topology of the target, low predicted probability on skeleton voxels corresponds to broken or missing centerline coverage. Penalizing such failures should favor continuous vessels, roads, cracks, or canals, while the generic loss maintains thickness and overall shape [2404.03010].

The tubed skeleton is central to that rationale. By dilating the skeleton with radius \(2\), the supervision is made less brittle to slight centerline offsets: the model need not hit a single-pixel centerline exactly to receive useful gradient. In the original presentation, this tubification is also what makes the method stable enough for multi-class and 3D training [2404.03010].

The reevaluation by Arora et al. focused on what SRL actually supervises during optimization. They derived the gradient

$$
\frac{\partial \mathscr{L}_{SRL}}{\partial s_\theta^{jk}}
=
-\frac{1}{|K|}
\frac{y^{jk}}{\sum_{i \in \Omega} y^{ik}},
$$

which implies a constant negative gradient on tubed-skeleton pixels and zero gradient elsewhere [2508.11374]. Written piecewise,

$$
\frac{\partial \mathscr{L}_{SRL}}{\partial s_\theta^{jk}}
=
\begin{cases}
-\dfrac{1}{|K|}\dfrac{1}{\sum_{i \in \Omega} y^{ik}}, & y^{jk}=1,\\[6pt]
0, & y^{jk}=0.
\end{cases}
$$

On that analysis, SRL does not adapt its gradient to the current prediction quality. A tubed-skeleton true positive with score \(0.99\) and one with score \(0.01\) receive the same SRL gradient; non-skeleton pixels, including false positives, receive none [2508.11374]. This led Arora et al. to argue that SRL functions less like an error-correcting topology loss and more like a fixed bias toward increased foreground probability on tubed-skeleton pixels.

A common misconception is therefore to treat SRL as though it were a symmetric skeleton-overlap loss. It is not. It does not compare predicted and target skeletons directly, and it does not explicitly penalize off-skeleton false positives. The original method relies on the generic loss for those corrections, while the SRL term itself is one-sided recall supervision.

## 4. Reported efficacy, topology metrics, and efficiency

The proposing paper evaluated SRL on five public datasets spanning 2D and 3D, binary and multi-class segmentation: Roads, DRIVE, Cracks, ToothFairy, and TopCoW. Metrics included Dice, clDice, and absolute Betti number errors for \(\beta_0\) and \(\beta_1\), computed on whole volumes rather than random patches in the 3D medical settings [2404.03010].

The reported results positioned SRL as competitive with or better than clDice loss across these benchmarks. On Roads, SRL reached Dice \(79.25\), clDice \(89.06\), \(\beta_0\) error \(4.846\), and \(\beta_1\) error \(83.69\), with the best values reported for Dice, clDice, and \(\beta_0\) error. On DRIVE, it achieved Dice \(80.99\), clDice \(80.83\), \(\beta_0\) error \(38.75\), and \(\beta_1\) error \(21.50\), with the best values reported for clDice and both Betti-number errors. On Cracks, SRL reported Dice \(94.88\) and clDice \(96.04\), both the best in that comparison, while the Betti errors were close to clDice loss. On ToothFairy, SRL reported Dice \(74.42\), clDice \(92.05\), \(\beta_0\) error \(0.540\), and \(\beta_1\) error \(0.0200\), all best or tied-best. On binary TopCoW, SRL reported Dice \(93.72\), clDice \(98.48\), \(\beta_0\) error \(0.500\), and \(\beta_1\) error \(1.586\), again the best values in that comparison [2404.03010].

The same paper emphasized computational efficiency as a defining property. Averaged over four binary datasets, clDice loss was reported to add about \(88\%\) extra training time per epoch and about \(52\%\) extra GPU memory, whereas SRL added about \(8\%\) training time and about \(2\%\) VRAM. In that framing, SRL preserved topology-awareness with more than \(90\%\) reduction in additional computational overhead relative to clDice loss [2404.03010].

The multi-class claim was even stronger. On TopCoW with 13 vessel classes, the paper reported Dice \(86.59\) versus \(85.36\) for the baseline and clDice metric \(94.35\) versus \(93.68\), while clDice loss itself was reported as out of memory on a 40GB NVIDIA A100. SRL, by contrast, was presented as trainable at batch size \(2\), leading the authors to describe it as the first multi-class capable loss function for thin structure segmentation [2404.03010].

## 5. Reassessment, controversy, and limitations

The principal controversy around SRL comes from the 2025 reevaluation by Arora et al., which revisited both theory and experiments using nnU-Net on tubular and non-tubular datasets. Their overall conclusion was that SRL-based segmentation models did not exceed traditional baseline models, and that the original claims were not robustly reproduced [2508.11374].

On the tubular datasets DRIVE, Roads, and Cracks, the reevaluation found at most mixed gains. For DRIVE, vanilla nnU-Net reported DSC \(84.05\), clDice \(87.91\), JSI \(72.53\), FNR \(18.92\), and FPR \(1.06\), while SRL reported DSC \(84.01\), clDice \(87.82\), JSI \(72.46\), FNR \(18.46\), and FPR \(1.70\). For Roads, vanilla reported DSC \(75.56\), clDice \(84.23\), JSI \(61.03\), FNR \(28.37\), and FPR \(1.35\), whereas SRL reported DSC \(75.84\), clDice \(85.28\), JSI \(61.37\), FNR \(23.89\), and FPR \(1.83\). For Cracks, vanilla reported DSC \(76.64\), clDice \(85.67\), JSI \(65.67\), FNR \(20.21\), and FPR \(0.25\), while SRL reported DSC \(76.94\), clDice \(86.21\), JSI \(65.98\), FNR \(17.09\), and FPR \(0.31\) [2508.11374].

The pattern highlighted in that study was consistent: SRL could slightly reduce false negatives or improve centerline-oriented metrics, but often at the cost of higher false positive rate. Across 15 tubular scores summarized in their analysis, SRL was significantly better in 3 metrics and significantly worse in 3 metrics, with all significant degradations occurring in FPR [2508.11374]. On non-tubular datasets such as BoMBR, Drone, and ACDC, the reevaluation was more negative: out of 15 summarized scores, vanilla was significantly better in 7, and SRL was never clearly superior [2508.11374].

The same paper also questioned the value of tubed skeletonization itself. In their ablation, using SRL with or without the tubed skeleton transformation changed DSC, clDice, and JSI on DRIVE and Cracks by at most about \(0.2\)–\(0.3\) points, with negligible and inconsistent changes in FNR and FPR [2508.11374]. This directly challenged the idea that the transformed mask adds substantial additional supervisory structure beyond the original target.

Taken together, these results define the main limitations currently associated with SRL. It depends on ground-truth skeleton quality; it encodes recall more directly than precision; its gradients do not depend on prediction error magnitude; and its benefits appear dataset-dependent rather than universal. A plausible implication is that SRL is best understood as a lightweight connectivity bias, not as a complete topological objective.

## 6. Related formulations and subsequent directions

A closely related development is the boundary-skeleton weighted loss introduced alongside the Dynamic Snake Upsampling operator for tubular segmentation. That paper did not name its loss SRL, but it explicitly situated its formulation in the same context of clDice, skeleton preservation, and continuity of thin curvilinear structures [2505.08525].

Its weighting scheme computes a ground-truth skeleton \(S\) with Zhang–Suen thinning, a boundary set \(E\) with Canny edge detection, and distance fields \(d_s(p)\) and \(d_f(p)\). The resulting weight map

$$
w(p)=
\begin{cases}
\alpha - (\alpha-1)\dfrac{d_f(p)}{d_s(p)+d_f(p)}, & p \in \Omega,\\
1, & \text{otherwise}
\end{cases}
$$

assigns weight near \(\alpha\) at skeleton pixels and weight near \(1\) at boundary pixels, with continuous interpolation in between [2505.08525]. Used inside a weighted Dice loss, this yields a skeleton-focused but boundary-aware objective that, unlike explicit SRL, does not require skeletonization of predictions.

The paper explicitly stated that this boundary-skeleton weighted loss is not a pure Skeleton Recall Loss, because it has no explicit skeleton overlap term, but it is “a weighted segmentation loss where skeleton pixels are heavily emphasized,” and it was presented as strongly correlated with improving skeleton recall [2505.08525]. On DeepCrack, BCE alone reported mIoU \(75.19\), clDice \(89.13\), and Assd \(3.948\); BSWL reported \(75.46\), \(90.04\), and \(3.568\); clDiceLoss alone reported \(74.38\), \(90.55\), and \(3.404\); and clDiceLoss + BSWL reported \(75.78\), \(91.14\), and \(3.194\) [2505.08525].

This later line of work suggests a broader lesson about the SRL family of ideas. Topology preservation in thin-structure segmentation is not only a loss-design problem; it is also an architectural and sampling problem. The same paper paired skeleton-focused supervision with Dynamic Snake Upsampling, a geometry-aware upsampler designed to reconstruct features along serpentine paths rather than fixed square neighborhoods, and reported gains in mIoU, clDice, and Assd on DeepCrack and DRIVE [2505.08525]. A plausible implication is that skeleton-aware supervision is most effective when the network’s feature reconstruction mechanism is also biased toward curvilinear continuity.

In current usage, SRL therefore occupies a specific place in the topology-aware segmentation literature. It remains important because it demonstrated that offline skeleton preprocessing and a simple recall term can dramatically reduce training overhead relative to differentiable skeleton losses, especially in 3D and multi-class regimes [2404.03010]. At the same time, its later critique established that efficiency does not guarantee superior optimization behavior or superior segmentation quality across datasets [2508.11374]. The resulting consensus is not that skeleton-focused losses are unworkable, but that recall-only formulations must be interpreted carefully, balanced with volumetric supervision, and evaluated against strong baselines with metrics that expose both connectivity and false-positive behavior.

Source: https://www.emergentmind.com/topics/skeleton-recall-loss-srl