Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detection (2403.03390v1)

Published 6 Mar 2024 in cs.CV, cs.LG, and eess.IV

Abstract: Effective weed control plays a crucial role in optimizing crop yield and enhancing agricultural product quality. However, the reliance on herbicide application not only poses a critical threat to the environment but also promotes the emergence of resistant weeds. Fortunately, recent advances in precision weed management enabled by ML and DL provide a sustainable alternative. Despite great progress, existing algorithms are mainly developed based on supervised learning approaches, which typically demand large-scale datasets with manual-labeled annotations, which is time-consuming and labor-intensive. As such, label-efficient learning methods, especially semi-supervised learning, have gained increased attention in the broader domain of computer vision and have demonstrated promising performance. These methods aim to utilize a small number of labeled data samples along with a great number of unlabeled samples to develop high-performing models comparable to the supervised learning counterpart trained on a large amount of labeled data samples. In this study, we assess the effectiveness of a semi-supervised learning framework for multi-class weed detection, employing two well-known object detection frameworks, namely FCOS and Faster-RCNN. Specifically, we evaluate a generalized student-teacher framework with an improved pseudo-label generation module to produce reliable pseudo-labels for the unlabeled data. To enhance generalization, an ensemble student network is employed to facilitate the training process. Experimental results show that the proposed approach is able to achieve approximately 76\% and 96\% detection accuracy as the supervised methods with only 10\% of labeled data in CottenWeedDet3 and CottonWeedDet12, respectively. We offer access to the source code, contributing a valuable resource for ongoing semi-supervised learning research in weed detection and beyond.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. Visual features based boosted classification of weeds for real-time selective herbicide sprayer systems. Computers in Industry, 98:23–33, 2018.
  2. Robot for weed species plant-specific management. Journal of Field Robotics, 34(6):1179–1199, 2017.
  3. T. Ben Hassen and H. El Bilali. Impacts of the russia-ukraine war on global food security: towards more sustainable and resilient food systems? Foods, 11(15):2301, 2022.
  4. Convnext based semi-supervised approach with consistency regularization for weeds classification. Expert Systems with Applications, 239:122222, 2024.
  5. Mixmatch: A holistic approach to semi-supervised learning. Advances in neural information processing systems, 32, 2019.
  6. Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934, 2020.
  7. A unified multi-scale deep convolutional neural network for fast object detection. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV 14, pages 354–370. Springer, 2016.
  8. Deep clustering for unsupervised learning of visual features. In Proceedings of the European conference on computer vision (ECCV), pages 132–149, 2018.
  9. Label matching semi-supervised object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14381–14390, 2022a.
  10. Performance evaluation of deep transfer learning on multi-class identification of common weed species in cotton production systems. Computers and Electronics in Agriculture, 198:107091, 2022b.
  11. Learning efficient object detection models with knowledge distillation. Advances in neural information processing systems, 30, 2017.
  12. Semi-supervised learning under class distribution mismatch. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 3569–3576, 2020.
  13. Image-based weed recognition and control: Can it select for crop mimicry? Weed Research, 63(2):77–82, 2023.
  14. Deepcottonweeds (dcw): a novel benchmark of yolo object detectors for weed detection in cotton production systems. In 2022 ASABE Annual International Meeting, page 1. American Society of Agricultural and Biological Engineers, 2022.
  15. Yoloweeds: A novel benchmark of yolo object detectors for multi-class weed detection in cotton production systems. Computers and Electronics in Agriculture, 205:107655, 2023.
  16. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009.
  17. T. DeVries and G. W. Taylor. Improved regularization of convolutional neural networks with cutout. arXiv preprint arXiv:1708.04552, 2017.
  18. Weed detection in soybean crops using convnets. Computers and Electronics in Agriculture, 143:314–324, 2017.
  19. Unsupervised deep learning and semi-automatic data labeling in weed discrimination. Computers and Electronics in Agriculture, 165:104963, 2019.
  20. R. Gerhards and S. Christensen. Real-time weed detection, decision making and patch spraying in maize, sugarbeet, winter wheat and winter barley. Weed research, 43(6):385–392, 2003.
  21. R. Girshick. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pages 1440–1448, 2015.
  22. Safe deep semi-supervised learning for unseen-class unlabeled data. In International Conference on Machine Learning, pages 3897–3906. PMLR, 2020.
  23. A powerful image synthesis and semi-supervised learning pipeline for site-specific weed detection. Computers and Electronics in Agriculture, 190:106423, 2021.
  24. A survey of deep learning-based object detection. IEEE access, 7:128837–128868, 2019.
  25. Covid-19 risks to global food security. Science, 369(6503):500–502, 2020.
  26. H. Law and J. Deng. Cornernet: Detecting objects as paired keypoints. In Proceedings of the European conference on computer vision (ECCV), pages 734–750, 2018.
  27. Rethinking pseudo labels for semi-supervised object detection. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 1314–1322, 2022.
  28. Label-efficient learning in agriculture: A comprehensive review. arXiv preprint arXiv:2305.14691, 2023.
  29. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection. Advances in Neural Information Processing Systems, 33:21002–21012, 2020.
  30. Generalized focal loss v2: Learning reliable localization quality estimation for dense object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11632–11641, 2021.
  31. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, pages 2980–2988, 2017.
  32. Self-supervised learning is more robust to dataset imbalance. arXiv preprint arXiv:2110.05025, 2021a.
  33. Deep learning for generic object detection: A survey. International journal of computer vision, 128:261–318, 2020.
  34. Semi-supervised learning and attention mechanism for weed detection in wheat. Crop Protection, 174:106389, 2023.
  35. Semi-supervised learning methods for weed detection in turf. Pest Management Science, 2024.
  36. Ssd: Single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14, pages 21–37. Springer, 2016.
  37. Unbiased teacher for semi-supervised object detection. arXiv preprint arXiv:2102.09480, 2021b.
  38. Unbiased teacher v2: Semi-supervised object detection for anchor-free and anchor-based detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9819–9828, 2022.
  39. Y. Lu and S. Young. A survey of public datasets for computer vision tasks in precision agriculture. Computers and Electronics in Agriculture, 178:105760, 2020.
  40. Rtmdet: An empirical study of designing real-time object detectors. arXiv preprint arXiv:2212.07784, 2022.
  41. Weed management in cotton (gossypium hirsutum l.) through weed-crop competition: A review. Crop Protection, 95:53–59, 2017.
  42. Verification of color vegetation indices for automated crop imaging applications. Computers and electronics in agriculture, 63(2):282–293, 2008.
  43. Semi-supervised learning for weed and crop segmentation using uav imagery. Frontiers in Plant Science, 13:927368, 2022.
  44. Reducing the risks of herbicide resistance: best management practices and recommendations. Weed science, 60(SP1):31–62, 2012.
  45. E.-C. Oerke. Crop losses to pests. The Journal of Agricultural Science, 144(1):31–43, 2006.
  46. Deep learning vs. traditional computer vision. In Advances in Computer Vision: Proceedings of the 2019 Computer Vision Conference (CVC), Volume 1 1, pages 128–144. Springer, 2020.
  47. Performance evaluation of deep learning object detectors for weed detection for cotton. Smart Agricultural Technology, 3:100126, 2023.
  48. Applications of deep learning in precision weed management: A review. Computers and Electronics in Agriculture, 206:107698, 2023.
  49. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 779–788, 2016.
  50. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28, 2015.
  51. Distilling knowledge from a deep pose regressor network. In Proceedings of the IEEE/CVF international conference on computer vision, pages 263–272, 2019.
  52. Fixmatch: Simplifying semi-supervised learning with consistency and confidence. Advances in neural information processing systems, 33:596–608, 2020a.
  53. A simple semi-supervised learning framework for object detection. arXiv preprint arXiv:2005.04757, 2020b.
  54. Efficientdet: Scalable and efficient object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10781–10790, 2020.
  55. A. Tarvainen and H. Valpola. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. Advances in neural information processing systems, 30, 2017.
  56. J. Terven and D. Cordova-Esparza. A comprehensive review of yolo: From yolov1 to yolov8 and beyond. arXiv preprint arXiv:2304.00501, 2023.
  57. Fcos: Fully convolutional one-stage object detection. In Proceedings of the IEEE/CVF international conference on computer vision, pages 9627–9636, 2019.
  58. A survey on semi-supervised learning. Machine learning, 109(2):373–440, 2020.
  59. A review on weed detection using ground-based machine vision and image processing techniques. Computers and electronics in agriculture, 158:226–240, 2019.
  60. Detectron2. https://github.com/facebookresearch/detectron2, 2019.
  61. Review of weed detection methods based on computer vision. Sensors, 21(11):3647, 2021.
  62. Self-training with noisy student improves imagenet classification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10687–10698, 2020.
  63. End-to-end semi-supervised object detection with soft teacher. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3060–3069, 2021.
  64. Joint unsupervised learning of deep representations and image clusters. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5147–5156, 2016.
  65. Future directions for automated weed management in precision agriculture. In Automation: The future of weed control in cropping systems, pages 249–259. Springer, 2013.
  66. Dino: Detr with improved denoising anchor boxes for end-to-end object detection. arXiv preprint arXiv:2203.03605, 2022.
  67. Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9759–9768, 2020.
  68. Instant-teaching: An end-to-end semi-supervised object detection framework. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4081–4090, 2021a.
  69. Bottom-up object detection by grouping extreme and center points. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 850–859, 2019.
  70. Probabilistic two-stage detection. arXiv preprint arXiv:2103.07461, 2021b.
  71. A comprehensive survey on transfer learning. Proceedings of the IEEE, 109(1):43–76, 2020.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now