Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A real-time, hardware agnostic framework for close-up branch reconstruction using RGB data (2309.11580v2)

Published 20 Sep 2023 in cs.RO

Abstract: Creating accurate 3D models of tree topology is an important task for tree pruning. The 3D model is used to decide which branches to prune and then to execute the pruning cuts. Previous methods for creating 3D tree models have typically relied on point clouds, which are often computationally expensive to process and can suffer from data defects, especially with thin branches. In this paper, we propose a method for actively scanning along a primary tree branch, detecting secondary branches to be pruned, and reconstructing their 3D geometry using just an RGB camera mounted on a robot arm. We experimentally validate that our setup is able to produce primary branch models with 4-5 mm accuracy and secondary branch models with 15 degrees orientation accuracy with respect to the ground truth model. Our framework is real-time and can run up to 10 cm/s with no loss in model accuracy or ability to detect secondary branches.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (18)
  1. A. Zahid, M. S. Mahmud, L. He, P. Heinemann, D. Choi, and J. Schupp, “Technological advancements towards developing a robotic pruner for apple trees: A review,” Computers and Electronics in Agriculture, vol. 189, p. 106383, Oct. 2021.
  2. A. You, N. Parayil, J. G. Krishna, U. Bhattarai, R. Sapkota, D. Ahmed, M. Whiting, M. Karkee, C. M. Grimm, and J. R. Davidson, “Semiautonomous precision pruning of upright fruiting offshoot orchard systems: An integrated approach,” IEEE Robotics & Automation Magazine, pp. 2–11, 2023.
  3. A. You, C. Grimm, A. Silwal, and J. R. Davidson, “Semantics-guided skeletonization of upright fruiting offshoot trees for robotic pruning,” Computers and Electronics in Agriculture, vol. 192, p. 106622, 2022.
  4. M. Karkee and B. Adhikari, “A method for three-dimensional reconstruction of apple trees for automated pruning,” Transactions of the ASABE, vol. 58, no. 3, pp. 565–574, 2015.
  5. S. A. Akbar, N. M. Elfiky, and A. Kak, “A novel framework for modeling dormant apple trees using single depth image for robotic pruning application,” in 2016 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2016, pp. 5136–5142.
  6. A. Bucksch and R. Lindenbergh, “Campino—a skeletonization method for point cloud processing,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 63, no. 1, pp. 115–127, 2008.
  7. T. Botterill, S. Paulin, R. Green, S. Williams, J. Lin, V. Saxton, S. Mills, X. Chen, and S. Corbett-Davies, “A robot system for pruning grape vines,” Journal of Field Robotics, vol. 34, no. 6, pp. 1100–1122, 2017.
  8. Y. Fu, Y. Xia, H. Zhang, M. Fu, Y. Wang, W. Fu, and C. Shen, “Skeleton extraction and pruning point identification of jujube tree for dormant pruning using space colonization algorithm,” Frontiers in Plant Science, vol. 13, p. 1103794, 2023.
  9. H. Cuevas-Velasquez, A.-J. Gallego, and R. B. Fisher, “Segmentation and 3d reconstruction of rose plants from stereoscopic images,” Computers and electronics in agriculture, vol. 171, p. 105296, 2020.
  10. J. Gené-Mola, R. Sanz-Cortiella, J. R. Rosell-Polo, J.-R. Morros, J. Ruiz-Hidalgo, V. Vilaplana, and E. Gregorio, “Fruit detection and 3d location using instance segmentation neural networks and structure-from-motion photogrammetry,” Computers and Electronics in Agriculture, vol. 169, p. 105165, 2020.
  11. X. Liu, S. W. Chen, S. Aditya, N. Sivakumar, S. Dcunha, C. Qu, C. J. Taylor, J. Das, and V. Kumar, “Robust fruit counting: Combining deep learning, tracking, and structure from motion,” in 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS).   IEEE, 2018, pp. 1045–1052.
  12. N. Parayil, A. You, C. Grimm, and J. Davidson, “Follow the leader: a path generator and controller for precision tree scanning with a robotic manipulator,” in Precision agriculture’23.   Wageningen Academic, 2023, pp. 167–174.
  13. D. Rapado-Rincón, E. J. van Henten, and G. Kootstra, “Development and evaluation of automated localisation and reconstruction of all fruits on tomato plants in a greenhouse based on multi-view perception and 3d multi-object tracking,” Biosystems Engineering, vol. 231, pp. 78–91, 2023.
  14. R. Barth, J. Hemming, and E. J. van Henten, “Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation,” Biosystems Engineering, vol. 146, pp. 71–84, 2016.
  15. C. Lehnert, D. Tsai, A. Eriksson, and C. McCool, “3d move to see: Multi-perspective visual servoing towards the next best view within unstructured and occluded environments,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2019, pp. 3890–3897.
  16. A. You, C. Grimm, and J. R. Davidson, “Optical flow-based branch segmentation for complex orchard environments,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 9180–9186.
  17. H. Blum, “A transformation for extracting new descriptions of shape,” Models for the perception of speech and visual form, pp. 362–380, 1967.
  18. A. W. Harley, Z. Fang, and K. Fragkiadaki, “Particle video revisited: Tracking through occlusions using point trajectories,” in ECCV, 2022.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now