--- title: 'YOLOv11-KW-TA-FP: Real-time Crack Detection' url: https://www.emergentmind.com/topics/yolov11-kw-ta-fp type: topic --- # YOLOv11-KW-TA-FP: Real-time Crack Detection YOLOv11-KW-TA-FP is a real-time, multi-task concrete crack detection and segmentation model built on the lightweight YOLOv11n backbone. It was proposed to address inefficient manual inspection and the suboptimal performance of existing deep learning models, particularly for small-target crack detection within complex backgrounds. The model combines three modifications—dynamic KernelWarehouse convolution in the backbone, Triple Attention in the feature pyramid, and an FP-IoU loss in the detection head—and adds a parallel mask-prediction branch for crack segmentation. On the Crack-Seg test set, it reports 91.3% precision, 76.6% recall, and 86.4% mAP@50 for detection, while segmentation mAP@50 rises from 65.4% in YOLOv11n to 76.3% [2508.11517]. ## 1. Architectural definition and task scope The model is defined as a real-time concrete crack detection and segmentation system derived from YOLOv11n. Relative to vanilla YOLOv11n, standard convolutions in the backbone are replaced by KWConv modules, each up-sampling operation in the neck is followed by a TA block, and the detection head uses FP-IoU instead of CIoU. A parallel mask-prediction branch is attached at the head for crack segmentation [2508.11517]. Its design target is explicitly multi-task: bounding-box detection and binary crack segmentation are performed within a single architecture. The modifications are placed so that feature extraction, cross-scale fusion, and localization loss are each altered by a dedicated mechanism. This suggests that the system is organized as a coordinated optimization of representation, attention, and regression rather than as a single-module patch over YOLOv11n. All reported experiments use the Crack-Seg dataset with a 7:2:1 split, 200 training epochs, SGD, batch size 16, initial learning rate \(lr_0=0.01\), momentum \(=0.937\), and image size \(640\times 640\) [2508.11517]. ## 2. Backbone modification through dynamic KernelWarehouse convolution The backbone extension embeds Intel’s KernelWarehouse dynamic convolution into each backbone layer. The mechanism is described in three steps: kernel partitioning, cross-layer warehouse sharing, and normalized attention fusion. A standard \(k\times k\) kernel is uniformly split along the channel axis into \(m\) equal units, and a shared warehouse stores \(n\gg m\) such units without linear parameter growth. Layers within a stage reuse the same warehouse \(\mathcal{E}=\{E_j\}_{j=1}^n\), and each layer dynamically assembles its effective kernel from a weighted combination of units [2508.11517]. The normalized attention fusion weights are defined as \[ a_j=\frac{z_j}{\sum_{i=1}^n |z_i|}, \qquad j=1,\dots,n, \] where \(\{z_j\}\) are attention scores produced by a lightweight selector network. The formulation allows negative weights for adversarial interactions and ensures \(\sum_j a_j=1\). Early in training, a temperature \(\tau\) linearly anneals from 1 to 0 over 20 epochs to stabilize mixing. The dynamic convolution output at location \((u,v)\) is \[ Y(u,v)=\sum_{j=1}^n a_j(X)\,[E_j * X](u,v). \] The reported functional effect is richer multi-scale feature representation with negligible parameter overhead. The paper attributes particular benefit to small-crack sensitivity under complex backgrounds, while maintaining a parameter cost similar to standard convolution. In the discussion, the module is further described as mixing hundreds of fine-grained kernel units under a fixed parameter budget and markedly improving small-crack recall [2508.11517]. ## 3. Triple Attention in the neck and the segmentation branch Within the feature pyramid network, each up-sample is followed by a Triple Attention block composed of three parallel branches: channel attention, spatial attention, and long-range attention. For an input feature map \(F\in\mathbb{R}^{C\times H\times W}\), the channel branch computes \[ M_c(F)=\sigma\Bigl(\mathrm{MLP}(\mathrm{AvgPool}(F))+\mathrm{MLP}(\mathrm{MaxPool}(F))\Bigr)\in\mathbb{R}^{C\times1\times1}, \] with an MLP bottleneck of size \(C/r\). This branch re-weights channels to emphasize crack-relevant feature maps [2508.11517]. The spatial branch pools across channels, concatenates the average and max maps, and applies a \(7\times 7\) convolution plus sigmoid: \[ F_{\text{avg}}^s=\mathrm{AvgPool}^c(F), \qquad F_{\max}^s=\mathrm{MaxPool}^c(F), \] \[ M_s(F)=\sigma\bigl(f^{7\times7}([F_{\text{avg}}^s;F_{\max}^s])\bigr)\in\mathbb{R}^{1\times H\times W}. \] The long-range branch views spatial dimensions as a sequence and applies an LSTM-inspired unit: \[ \begin{aligned} f_t &= \sigma(W_f[h_{t-1},x_t]+b_f), \qquad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),\\ \tilde C_t &= \tanh(W_c[h_{t-1},x_t]+b_c), \qquad C_t = f_t\ast C_{t-1}+i_t\ast \tilde C_t,\\ o_t &= \sigma(W_o[h_{t-1},x_t]+b_o), \qquad h_t = o_t\ast \tanh(C_t). \end{aligned} \] This branch is stated to capture spatial dependencies over large receptive fields up to 100 px, effectively linking distant crack segments. The three branches are fused by element-wise sum or gated combination, and the resulting attention map is multiplied back onto \(F\). The stated effect is stronger channel–spatial and long-range interaction modeling, suppression of background clutter, and highlighting of faint micro-cracks [2508.11517]. The segmentation pathway is lightweight. A mask-prediction branch mirrors the detection head’s feature maps and uses a \(1\times1\) convolution to predict a binary crack segmentation mask. To address extreme background/foreground imbalance, it uses weighted cross-entropy: \[ L_{\text{wce}}=-\frac1N\sum_{n=1}^N\sum_{c=1}^2 w_c\,y'_{n,c}\,\log\frac{e^{y_{n,c}}}{\sum_i e^{y_{n,i}}}, \] with higher weight on crack pixels [2508.11517]. ## 4. FP-IoU as the bounding-box regression objective FP-IoU is introduced because standard IoU-based losses such as CIoU apply a monotonic penalty as IoU decreases, which can under-penalize poor-overlap boxes and converge slowly on low-quality samples. The loss integrates two components: a piecewise Focaler IoU mapping and Powerful-IoU v2 geometric penalization [2508.11517]. For Focaler IoU, the base IoU loss \(L_{\mathrm{IoU}}\) is remapped piecewise as \[ L_{\mathrm{IoUfocaler}}= \begin{cases} 0, & L_{\mathrm{IoU}}u, \end{cases} \qquad \mathcal{L}_{\mathrm f}=1-L_{\mathrm{IoUfocaler}}. \] For PIoUv2, letting \(w_{\mathrm{gt}}, h_{\mathrm{gt}}\) denote ground-truth width and height and \(dw_1,dw_2,dh_1,dh_2\) denote edge offsets, the scale-adaptive penalty is \[ p=\tfrac14\Bigl(\tfrac{dw_1}{w_{\mathrm{gt}}}+\tfrac{dw_2}{w_{\mathrm{gt}}}+\tfrac{dh_1}{h_{\mathrm{gt}}}+\tfrac{dh_2}{h_{\mathrm{gt}}}\Bigr), \qquad q=e^{-p}\in(0,1], \] with \[ \mathcal{L}_{\mathrm{PIoU}}=L_{\mathrm{IoU}}+1-e^{-p^2}, \qquad m(x)=3x\,e^{-x^2}, \] \[ \mathcal{L}_{\mathrm{PIoUv2}}=3\,m(\lambda q)\,\mathcal{L}_{\mathrm{PIoU}}. \] The combined FP-IoU loss is \[ \mathcal{L}_{\mathrm{FP-IoU}}= 3\,m(\lambda q)\,\Bigl(\mathcal{L}_{\mathrm f}+1-e^{-p^2}\Bigr). \] The stated consequences relative to CIoU are threefold: non-monotonic attention \(m(\lambda q)\) emphasizes medium-quality boxes, scale-aware penalties \(p\) are applied for slender crack shapes, and stronger gradient signals are maintained when IoU is low. The paper associates these changes with accelerated convergence and improved localization on blurred or tiny cracks [2508.11517]. ## 5. Detection, segmentation, and ablation results The principal test-set results compare YOLOv11-KW-TA-FP with YOLOv11n under the same Crack-Seg protocol. | Model | Detection \(P/R/mAP@50\) | Segmentation mAP@50 | |---|---|---| | YOLOv11n | 87.1 / 73.3 / 79.2 | 65.4 | | YOLOv11-KW-TA-FP | 91.3 / 76.6 / 86.4 | 76.3 | The paper also reports rapid convergence of box, class, DFL, and mask losses, with stable precision, recall, and mAP curves after approximately 25 epochs [2508.11517]. The ablation study isolates the contributions of KWConv, TA, and FP-IoU. Starting from the baseline \(87.1\%\) precision, \(73.3\%\) recall, and \(79.2\%\) mAP@50, adding KWConv yields \(90.3\%\), \(75.1\%\), and \(83.2\%\); adding TA yields \(87.5\%\), \(75.2\%\), and \(83.1\%\); adding FP-IoU yields \(88.2\%\), \(75.1\%\), and \(84.6\%\). Pairwise combinations report \(85.4\%\) mAP@50 for KW+TA, \(85.2\%\) for KW+FP-IoU, and \(85.3\%\) for TA+FP-IoU. The full combination reaches \(91.3\%\) precision, \(76.6\%\) recall, and \(86.4\%\) mAP@50. The report states that all three modules contribute and that their synergy yields a total gain of 7.2 points in mAP@50 over baseline [2508.11517]. ## 6. Robustness, nomenclature, and relation to YOLOv11 Robustness is evaluated under both data scarcity and corrupted training conditions. When the Crack-Seg training set is subsampled to 30%, 50%, 70%, 90%, and 100% of its original size, the reported \((P,R,IoU,Dice)\) values are \((72.6,71.9,74.3,72.1)\), \((74.2,72.3,79.5,76.3)\), \((83.5,73.1,86.5,80.1)\), \((87.3,73.3,87.1,81.8)\), and \((91.3,76.6,87.5,82.1)\), respectively. The paper states that performance plateaus after approximately 70%, which it interprets as evidence that KWConv+TA provides strong generalization from limited data. Under data augmentation with random rotation, flips, scaling, and Gaussian noise \((\sigma=0.1)\), segmentation robustness improves from \(86.8/72.3/83.4/76.5/27.7/16.8\) to \(88.6/73.2/87.3/81.9/26.8/14.3\) across Precision, Recall, IoU, Dice, MDR, and FDR, respectively; IoU and Dice increase by 3.9% and 5.4%, while MDR and FDR decrease by 0.9% and 2.5% [2508.11517]. A recurrent source of confusion is nomenclature. In the YOLOv11 overview, the labels “KW,” “TA,” and “FP” are used in a different sense, referring respectively to C3k2, C2PSA, and SPPF as core YOLOv11 modules within the backbone and neck [2410.17725]. In YOLOv11-KW-TA-FP, by contrast, the same letter groups denote KernelWarehouse convolution, Triple Attention, and FP-IoU loss [2508.11517]. The overlap is terminological rather than architectural identity. A plausible implication is that the model should be read as a YOLOv11n-derived crack-inspection specialization, not as a renaming of the generic YOLOv11 module set. In the report’s concluding characterization, the combined system is a 5.83 M-parameter model running at \(>100\) FPS on RTX 4070Ti while maintaining 91.3% precision, 76.6% recall, and 86.4% mAP@50 for detection, together with improved segmentation metrics. Within the scope of the reported experiments, it is positioned as an efficient solution for automated infrastructure health monitoring and resource-constrained on-site deployment [2508.11517]. Source: https://www.emergentmind.com/topics/yolov11-kw-ta-fp