Papers
Topics
Authors
Recent
2000 character limit reached

Neural Elevation Models for Terrain Mapping and Path Planning (2405.15227v1)

Published 24 May 2024 in cs.RO

Abstract: This work introduces Neural Elevations Models (NEMos), which adapt Neural Radiance Fields to a 2.5D continuous and differentiable terrain model. In contrast to traditional terrain representations such as digital elevation models, NEMos can be readily generated from imagery, a low-cost data source, and provide a lightweight representation of terrain through an implicit continuous and differentiable height field. We propose a novel method for jointly training a height field and radiance field within a NeRF framework, leveraging quantile regression. Additionally, we introduce a path planning algorithm that performs gradient-based optimization of a continuous cost function for minimizing distance, slope changes, and control effort, enabled by differentiability of the height field. We perform experiments on simulated and real-world terrain imagery, demonstrating NEMos ability to generate high-quality reconstructions and produce smoother paths compared to discrete path planning methods. Future work will explore the incorporation of features and semantics into the height field, creating a generalized terrain model.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (16)
  1. M. Ono, B. Rothrock, E. Almeida, A. Ansar, R. Otero, A. Huertas, and M. Heverly, “Data-Driven Surface Traversability Analysis for Mars 2020 Landing Site Selection,” in 2016 IEEE Aerospace Conference.   IEEE, 2016, pp. 1–12.
  2. J. Carsten, A. Rankin, D. Ferguson, and A. Stentz, “Global Path Planning on Board the Mars Exploration Rovers,” in 2007 IEEE Aerospace Conference.   IEEE, 2007, pp. 1–11.
  3. J. L. Schönberger and J.-M. Frahm, “Structure-from-Motion Revisited,” in Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
  4. B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis,” Communications of the ACM, vol. 65, no. 1, pp. 99–106, 2021.
  5. K. Gao, Y. Gao, H. He, D. Lu, L. Xu, and J. Li, “NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review,” arXiv preprint arXiv:2210.00379, 2022.
  6. R. Marí, G. Facciolo, and T. Ehret, “Sat-NeRF: Learning Multi-View Satellite Photogrammetry with Transient Objects and Shadow Modeling using RPC Cameras,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 1311–1321.
  7. Y. Xiangli, L. Xu, X. Pan, N. Zhao, A. Rao, C. Theobalt, B. Dai, and D. Lin, “BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-Scale Scene Rendering,” in European conference on computer vision.   Springer, 2022, pp. 106–122.
  8. M. Tancik, E. Weber, E. Ng, R. Li, B. Yi, T. Wang, A. Kristoffersen, J. Austin, K. Salahi, A. Ahuja, et al., “Nerfstudio: A Modular Framework for Neural Radiance Field Development,” in ACM SIGGRAPH 2023 Conference Proceedings, 2023, pp. 1–12.
  9. R. Koenker and K. F. Hallock, “Quantile Regression,” Journal of economic perspectives, vol. 15, no. 4, pp. 143–156, 2001.
  10. Y. Yang, H. J. Wang, and X. He, “Posterior Inference in Bayesian Quantile Regression with Asymmetric Laplace Likelihood,” International Statistical Review, vol. 84, no. 3, pp. 327–344, 2016.
  11. M. Adamkiewicz, T. Chen, A. Caccavale, R. Gardner, P. Culbertson, J. Bohg, and M. Schwager, “Vision-Only Robot Navigation in a Neural Radiance World,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4606–4613, 2022.
  12. J. Lévine, “On Necessary and Sufficient Conditions for Differential Flatness,” Applicable Algebra in Engineering, Communication and Computing, vol. 22, no. 1, pp. 47–90, 2011.
  13. “Google Earth Studio.” [Online]. Available: https://earth.google.com/studio/
  14. “DroneMapper Sample Data,” https://dronemapper.com/sample˙data/, accessed: March 19, 2024.
  15. T. Müller, A. Evans, C. Schied, and A. Keller, “Instant Neural Graphics Primitives with a Multiresolution Hash Encoding,” ACM transactions on graphics (TOG), vol. 41, no. 4, pp. 1–15, 2022.
  16. D. P. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” arXiv preprint arXiv:1412.6980, 2014.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 2 likes about this paper.