Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On-the-Go Tree Detection and Geometric Traits Estimation with Ground Mobile Robots in Fruit Tree Groves (2404.02516v1)

Published 3 Apr 2024 in cs.RO

Abstract: By-tree information gathering is an essential task in precision agriculture achieved by ground mobile sensors, but it can be time- and labor-intensive. In this paper we present an algorithmic framework to perform real-time and on-the-go detection of trees and key geometric characteristics (namely, width and height) with wheeled mobile robots in the field. Our method is based on the fusion of 2D domain-specific data (normalized difference vegetation index [NDVI] acquired via a red-green-near-infrared [RGN] camera) and 3D LiDAR point clouds, via a customized tree landmark association and parameter estimation algorithm. The proposed system features a multi-modal and entropy-based landmark correspondences approach, integrated into an underlying Kalman filter system to recognize the surrounding trees and jointly estimate their spatial and vegetation-based characteristics. Realistic simulated tests are used to evaluate our proposed algorithm's behavior in a variety of settings. Physical experiments in agricultural fields help validate our method's efficacy in acquiring accurate by-tree information on-the-go and in real-time by employing only onboard computational and sensing resources.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. E. M. Perry, R. J. Dezzani, C. F. Seavert, and F. J. Pierce, “Spatial variation in tree characteristics and yield in a pear orchard,” Precision Agriculture, vol. 11, pp. 42–60, 2010.
  2. L. McClymont, I. Goodwin, M. O’Connell, D. Whitfield, et al., “Variation in within-block orchard canopy cover-implications for crop water requirement and irrigation management.,” Acta Horticulturae, no. 889, pp. 233–239, 2011.
  3. A. Coupel-Ledru, B. Pallas, M. Delalande, F. Boudon, E. Carrié, S. Martinez, J.-L. Regnard, and E. Costes, “Multi-scale high-throughput phenotyping of apple architectural and functional traits in orchard reveals genotypic variability under contrasted watering regimes,” Horticulture Research, vol. 6, 2019.
  4. X. Liu, S. W. Chen, G. V. Nardari, C. Qu, F. C. Ojeda, C. J. Taylor, and V. Kumar, “Challenges and opportunities for autonomous micro-uavs in precision agriculture,” IEEE Micro, vol. 42, no. 1, pp. 61–68, 2022.
  5. J. Kim, S. Kim, C. Ju, and H. I. Son, “Unmanned aerial vehicles in agriculture: A review of perspective of platform, control, and applications,” IEEE Access, vol. 7, pp. 105100–105115, 2019.
  6. D. Chatziparaschis and P. Partsinevelos, “Real-time unmanned aerial vehicle surveying using spatial criteria: a simulated study,” Journal of Applied Remote Sensing, vol. 17, no. 1, pp. 014519–014519, 2023.
  7. P. Radoglou-Grammatikis, P. Sarigiannidis, T. Lagkas, and I. Moscholios, “A compilation of uav applications for precision agriculture,” Computer Networks, vol. 172, p. 107148, 2020.
  8. M. Bergerman, S. M. Maeta, J. Zhang, G. M. Freitas, B. Hamner, S. Singh, and G. Kantor, “Robot farmers: Autonomous orchard vehicles help tree fruit production,” IEEE Robotics & Automation Magazine, vol. 22, no. 1, pp. 54–63, 2015.
  9. S. S. H. Hajjaj and K. S. M. Sahari, “Review of agriculture robotics: Practicality and feasibility,” in IEEE Int. Symposium on Robotics and Intelligent Sensors (IRIS), pp. 194–198, 2016.
  10. John Wiley & Sons, Ltd, 2018.
  11. M. Campbell, K. Ye, E. Scudiero, and K. Karydis, “A portable agricultural robot for continuous apparent soil electrical conductivity measurements to improve irrigation practices,” in IEEE Int. Conf. on Automation Science and Engineering (CASE), pp. 2228–2234, 2021.
  12. D. Chatziparaschis, E. Scudiero, and K. Karydis, “Robot-assisted soil apparent electrical conductivity measurements in orchards,” arXiv preprint arXiv:2309.05128, 2023.
  13. E. Scudiero, A. Singh, G. Mahajan, D. Chatziparaschis, K. Karydis, D. Houtz, and T. H. Skaggs, “On-the-go microwave radiometry for high-resolution soil moisture mapping in micro-irrigated orchards.” [Abstract], 2022. ASA, CSSA, SSSA International Annual Meeting.
  14. M. Campbell, A. Dechemi, and K. Karydis, “An integrated actuation-perception framework for robotic leaf retrieval: Detection, localization, and cutting,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 9210–9216, 2022.
  15. A. Dechemi, D. Chatziparaschis, J. Chen, M. Campbell, A. Shamshirgaran, C. Mucchiani, A. Roy-Chowdhury, S. Carpin, and K. Karydis, “Robotic assessment of a crop’s need for watering: Automating a time-consuming task to support sustainable agriculture,” IEEE Robotics & Automation Magazine, vol. 30, no. 4, pp. 52–67, 2023.
  16. X. Kan, T. C. Thayer, S. Carpin, and K. Karydis, “Task planning on stochastic aisle graphs for precision agriculture,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 3287–3294, 2021.
  17. R. M. Palenichka and M. B. Zaremba, “Multiscale isotropic matched filtering for individual tree detection in lidar images,” IEEE Trans. on Geoscience and Remote Sensing, vol. 45, no. 12, pp. 3944–3956, 2007.
  18. J. Li, W. Zhang, W. Diao, Y. Feng, X. Sun, and K. Fu, “Csf-net: Color spectrum fusion network for semantic labeling of airborne laser scanning point cloud,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 339–352, 2022.
  19. J. Vauhkonen, L. T. Ene, S. Gupta, J. C. Heinzel, J. Holmgren, J. Pitkänen, S. Ø. Solberg, Y. Wang, H. Weinacker, K. M. Hauglin, V. T. Lien, P. Packalen, T. Gobakken, B. Koch, E. Næsset, T. Tokola, and M. Maltamo, “Comparative testing of single-tree detection algorithms under different types of forest,” Forestry, vol. 85, pp. 27–40, 2011.
  20. J. Secord and A. Zakhor, “Tree detection in urban regions using aerial lidar and image data,” IEEE Geoscience and Remote Sensing Letters, vol. 4, no. 2, pp. 196–200, 2007.
  21. Y. Wang, X. Yan, H. Bao, Y. Chen, L. Gong, M. Wei, and J. Li, “Detecting occluded and dense trees in urban terrestrial views with a high-quality tree detection dataset,” IEEE Trans. on Geoscience and Remote Sensing, vol. 60, pp. 1–12, 2022.
  22. H. Wan, Z. Fan, X. Yu, M. Kang, P. Wang, and X. Zeng, “A real-time branch detection and reconstruction mechanism for harvesting robot via convolutional neural network and image segmentation,” Computers and Electronics in Agriculture, vol. 192, p. 106609, 2022.
  23. Q. Xie, D. Li, Z. Yu, J. Zhou, and J. Wang, “Detecting trees in street images via deep learning with attention module,” IEEE Trans. on Instrumentation and Measurement, vol. 69, no. 8, pp. 5395–5406, 2020.
  24. A. Gupta, J. Byrne, D. Moloney, S. Watson, and H. Yin, “Tree annotations in lidar data using point densities and convolutional neural networks,” IEEE Trans. on Geoscience and Remote Sensing, vol. 58, no. 2, pp. 971–981, 2020.
  25. W. Zhang, P. Wan, T. Wang, S. Cai, Y. Chen, X. Jin, and G. Yan, “A novel approach for the detection of standing tree stems from plot-level terrestrial laser scanning data,” Remote Sensing, vol. 11, no. 2, 2019.
  26. P. Roy, W. Dong, and V. Isler, “Registering reconstructions of the two sides of fruit tree rows,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 1–9, 2018.
  27. E. Jelavić, D. Jud, P. Egli, and M. Hutter, “Robotic precision harvesting: Mapping, localization, planning and control for a legged tree harvester,” Field Robotics, vol. 2, pp. 1386–1431, 03 2022.
  28. N. Shalal, T. Low, C. McCarthy, and N. Hancock, “Orchard mapping and mobile robot localisation using on-board camera and laser scanner data fusion – part a: Tree detection,” Computers and Electronics in Agriculture, vol. 119, pp. 254–266, 2015.
  29. Z. Yu, B. Zhang, et al., “A camera/ultrasonic sensors based trunk localization system of semi-structured orchards,” in IEEE/ASME Int. Conf. on Advanced Intelligent Mechatronics (AIM), pp. 168–174, 2021.
  30. A. Durand-Petiteville, E. Le Flecher, V. Cadenat, T. Sentenac, and S. Vougioukas, “Tree detection with low-cost three-dimensional sensors for autonomous navigation in orchards,” IEEE Robotics and Automation Letters, vol. 3, no. 4, pp. 3876–3883, 2018.
  31. B. H. Wang, C. Diaz-Ruiz, J. Banfi, and M. Campbell, “Detecting and mapping trees in unstructured environments with a stereo camera and pseudo-lidar,” in IEEE Int. Conf. on Robotics and Automation (ICRA), pp. 14120–14126, 2021.
  32. X. Liu, S. W. Chen, C. Liu, S. S. Shivakumar, J. Das, C. J. Taylor, J. Underwood, and V. Kumar, “Monocular camera based fruit counting and mapping with semantic data association,” IEEE Robotics and Automation Letters, vol. 4, no. 3, pp. 2296–2303, 2019.
  33. S. W. Chen, G. V. Nardari, E. S. Lee, C. Qu, X. Liu, R. A. F. Romero, and V. Kumar, “Sloam: Semantic lidar odometry and mapping for forest inventory,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 612–619, 2020.
  34. Y. Huang, Z. Ren, D. Li, and X. Liu, “Phenotypic techniques and applications in fruit trees: A review,” Plant Methods, vol. 16, 08 2020.
  35. Z. Zhang, “A flexible new technique for camera calibration,” IEEE Trans. on pattern analysis and machine intelligence, vol. 22, no. 11, pp. 1330–1334, 2000.
  36. D. Tsai, S. Worrall, M. Shan, A. Lohr, and E. Nebot, “Optimising the selection of samples for robust lidar camera calibration,” in IEEE Int. Intelligent Transportation Systems Conf., pp. 2631–2638, 2021.
  37. T. Moore and D. Stouch, “A generalized extended kalman filter implementation for the robot operating system,” in Int. Conf. on Intelligent Autonomous Systems (IAS-13), pp. 335–348, Springer, 2016.
  38. M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, A. Y. Ng, et al., “Ros: an open-source robot operating system,” in ICRA workshop on open source software, no. 3.2, p. 5, Kobe, Japan, 2009.
  39. R. B. Rusu, “Semantic 3d object maps for everyday manipulation in human living environments,” KI-Künstliche Intelligenz, vol. 24, pp. 345–348, 2010.
  40. F. Rovira-Más, I. Chatterjee, and V. Sáiz-Rubio, “The role of gnss in the navigation strategies of cost-effective agricultural robots,” Computers and electronics in Agriculture, vol. 112, pp. 172–183, 2015.
  41. M. Pini, G. Marucco, G. Falco, M. Nicola, and W. De Wilde, “Experimental testbed and methodology for the assessment of rtk gnss receivers used in precision agriculture,” IEEE Access, vol. 8, pp. 14690–14703, 2020.
  42. H. Teng, Y. Wang, X. Song, and K. Karydis, “Multimodal Dataset for Localization, Mapping and Crop Monitoring in Citrus Tree Farms,” in Advances in Visual Computing: 18th International Symposium (ISVC), 2023.
  43. B. Bailey, “Helios: A scalable 3d plant and environmental biophysical modeling framework,” Frontiers in Plant Science, vol. 10, 10 2019.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube