Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Evaluating Neural Radiance Fields (NeRFs) for 3D Plant Geometry Reconstruction in Field Conditions (2402.10344v3)

Published 15 Feb 2024 in cs.CV

Abstract: We evaluate different Neural Radiance Fields (NeRFs) techniques for the 3D reconstruction of plants in varied environments, from indoor settings to outdoor fields. Traditional methods usually fail to capture the complex geometric details of plants, which is crucial for phenotyping and breeding studies. We evaluate the reconstruction fidelity of NeRFs in three scenarios with increasing complexity and compare the results with the point cloud obtained using LiDAR as ground truth. In the most realistic field scenario, the NeRF models achieve a 74.6% F1 score after 30 minutes of training on the GPU, highlighting the efficacy of NeRFs for 3D reconstruction in challenging environments. Additionally, we propose an early stopping technique for NeRF training that almost halves the training time while achieving only a reduction of 7.4% in the average F1 score. This optimization process significantly enhances the speed and efficiency of 3D reconstruction using NeRFs. Our findings demonstrate the potential of NeRFs in detailed and realistic 3D plant reconstruction and suggest practical approaches for enhancing the speed and efficiency of NeRFs in the 3D reconstruction process.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Luis Santos Pereira. Water, agriculture and food: challenges and issues. Water Resources Management, 31(10):2985–2999, 2017.
  2. High-throughput 3d modelling of plants for phenotypic analysis. In Proceedings of the 27th conference on image and vision computing New Zealand, pages 301–306, 2012.
  3. Making use of 3d models for plant physiognomic analysis: A review. Remote Sensing, 13(11):2232, 2021a.
  4. NeRF: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM, 65(1):99–106, 2021.
  5. Structure from motion photogrammetric technique. In Developments in Earth surface processes, volume 23, pages 1–24. Elsevier, 2020.
  6. Point-based multi-view stereo network. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1538–1547, 2019.
  7. Fov-NeRF: Foveated neural radiance fields for virtual reality. IEEE Transactions on Visualization and Computer Graphics, 28(11):3854–3864, 2022.
  8. Block-NeRF: Scalable large scene neural view synthesis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8248–8258, 2022.
  9. Venation skeleton-based modeling plant leaf wilting. International Journal of Computer Games Technology, 2009, 2009.
  10. JB Evers. 3D modelling of branching in plants. In Proceedings of the MODSIM2011, 19th International Congress on Modelling and Simulation, 12-16 December 2011, Perth, Australia, pages 982–988, 2011.
  11. 3D reconstruction of plants under outdoor conditions using image-based computer vision. In Recent Trends in Image Processing and Pattern Recognition: Second International Conference, RTIP2R 2018, Solapur, India, December 21–22, 2018, Revised Selected Papers, Part III 2, pages 284–297. Springer, 2019.
  12. MVS-Pheno: a portable and low-cost phenotyping platform for maize shoots using multiview stereo 3d reconstruction. Plant Phenomics, 2020.
  13. 3DPhenoMVS: A low-cost 3d tomato phenotyping pipeline using 3d reconstruction point cloud based on multiview images. Agronomy, 12(8):1865, 2022.
  14. Three-dimensional modeling of weed plants using low-cost photogrammetry. Sensors, 18(4):1077, 2018.
  15. Guoyu Lu. Bird-view 3d reconstruction for crops with repeated textures. In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4263–4270. IEEE, 2023.
  16. Effect on quality of 3d model of plant with change in number and resolution of images used: an investigation. In Advances in Signal and Data Processing: Select Proceedings of ICSDP 2019, pages 377–388. Springer, 2021b.
  17. Joanna Alina Setkowicz. Evaluation of algorithms and tools for 3d modeling of laser scanning data. Master’s thesis, Institutt for bygg, anlegg og transport, 2014.
  18. Embedded, real-time uav control for improved, image-based 3d scene reconstruction. Measurement, 81:264–269, 2016.
  19. Benefits of terrestrial laser scanning for construction qa/qc: a time and cost analysis. Journal of Management in Engineering, 38(2):05022001, 2022.
  20. Structured light-based 3D reconstruction system for plants. Sensors, 15(8):18587–18612, 2015.
  21. Towards a robust framework for NeRF evaluation. arXiv preprint arXiv:2305.18079, 2023.
  22. Analyzing the internals of neural radiance fields. arXiv preprint arXiv:2306.00696, 2023.
  23. SteerNeRF: Accelerating NeRF rendering via smooth viewpoint trajectory. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20701–20711, 2023.
  24. A critical analysis of NeRF-based 3d reconstruction. Remote Sensing, 15(14):3585, 2023.
  25. Few shot photogrametry: A comparison between NeRF and MVS-SfM for the documentation of cultural heritage. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 48:155–162, 2023.
  26. Plant geometry reconstruction from field data using neural radiance fields. In 2nd AAAI Workshop on AI for Agriculture and Food Systems, 2023.
  27. Instant neural graphics primitives with a multiresolution hash encoding. ACM Transactions on Graphics (ToG), 41(4):1–15, 2022.
  28. NeRFStudio: A modular framework for neural radiance field development. In ACM SIGGRAPH 2023 Conference Proceedings, pages 1–12, 2023.
  29. TensoRF: Tensorial radiance fields. In European Conference on Computer Vision, pages 333–350. Springer, 2022.
  30. Mip-nerf 360: Unbounded anti-aliased neural radiance fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5470–5479, 2022.
  31. Tanks and Temples: Benchmarking large-scale scene reconstruction. ACM Transactions on Graphics (ToG), 36(4):1–13, 2017.
  32. Method for registration of 3-d shapes. In Sensor fusion IV: control paradigms and data structures, volume 1611, pages 586–606. Spie, 1992.
  33. Zhengyou Zhang. Iterative point matching for registration of free-form curves and surfaces. International journal of computer vision, 13(2):119–152, 1994.
  34. Iterative most-likely point registration (imlp): A robust algorithm for computing optimal shape alignment. PloS one, 10(3):e0117688, 2015.
  35. NeRF for heritage 3D reconstruction. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 48:1051–1058, 2023.
  36. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004.
  37. Image quality metrics: Psnr vs. ssim. In 2010 20th international conference on pattern recognition, pages 2366–2369. IEEE, 2010.
  38. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 586–595, 2018.
  39. Point-NeRF: Point-based neural radiance fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5438–5448, 2022.
  40. NeRS: Neural reflectance surfaces for sparse-view 3d reconstruction in the wild. Advances in Neural Information Processing Systems, 34:29835–29847, 2021.
  41. Progressively optimized local radiance fields for robust view synthesis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16539–16548, 2023.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now