Neural Elevation Models for Terrain Mapping and Path Planning (2405.15227v1)
Abstract: This work introduces Neural Elevations Models (NEMos), which adapt Neural Radiance Fields to a 2.5D continuous and differentiable terrain model. In contrast to traditional terrain representations such as digital elevation models, NEMos can be readily generated from imagery, a low-cost data source, and provide a lightweight representation of terrain through an implicit continuous and differentiable height field. We propose a novel method for jointly training a height field and radiance field within a NeRF framework, leveraging quantile regression. Additionally, we introduce a path planning algorithm that performs gradient-based optimization of a continuous cost function for minimizing distance, slope changes, and control effort, enabled by differentiability of the height field. We perform experiments on simulated and real-world terrain imagery, demonstrating NEMos ability to generate high-quality reconstructions and produce smoother paths compared to discrete path planning methods. Future work will explore the incorporation of features and semantics into the height field, creating a generalized terrain model.
- M. Ono, B. Rothrock, E. Almeida, A. Ansar, R. Otero, A. Huertas, and M. Heverly, “Data-Driven Surface Traversability Analysis for Mars 2020 Landing Site Selection,” in 2016 IEEE Aerospace Conference. IEEE, 2016, pp. 1–12.
- J. Carsten, A. Rankin, D. Ferguson, and A. Stentz, “Global Path Planning on Board the Mars Exploration Rovers,” in 2007 IEEE Aerospace Conference. IEEE, 2007, pp. 1–11.
- J. L. Schönberger and J.-M. Frahm, “Structure-from-Motion Revisited,” in Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
- B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis,” Communications of the ACM, vol. 65, no. 1, pp. 99–106, 2021.
- K. Gao, Y. Gao, H. He, D. Lu, L. Xu, and J. Li, “NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review,” arXiv preprint arXiv:2210.00379, 2022.
- R. Marí, G. Facciolo, and T. Ehret, “Sat-NeRF: Learning Multi-View Satellite Photogrammetry with Transient Objects and Shadow Modeling using RPC Cameras,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 1311–1321.
- Y. Xiangli, L. Xu, X. Pan, N. Zhao, A. Rao, C. Theobalt, B. Dai, and D. Lin, “BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-Scale Scene Rendering,” in European conference on computer vision. Springer, 2022, pp. 106–122.
- M. Tancik, E. Weber, E. Ng, R. Li, B. Yi, T. Wang, A. Kristoffersen, J. Austin, K. Salahi, A. Ahuja, et al., “Nerfstudio: A Modular Framework for Neural Radiance Field Development,” in ACM SIGGRAPH 2023 Conference Proceedings, 2023, pp. 1–12.
- R. Koenker and K. F. Hallock, “Quantile Regression,” Journal of economic perspectives, vol. 15, no. 4, pp. 143–156, 2001.
- Y. Yang, H. J. Wang, and X. He, “Posterior Inference in Bayesian Quantile Regression with Asymmetric Laplace Likelihood,” International Statistical Review, vol. 84, no. 3, pp. 327–344, 2016.
- M. Adamkiewicz, T. Chen, A. Caccavale, R. Gardner, P. Culbertson, J. Bohg, and M. Schwager, “Vision-Only Robot Navigation in a Neural Radiance World,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4606–4613, 2022.
- J. Lévine, “On Necessary and Sufficient Conditions for Differential Flatness,” Applicable Algebra in Engineering, Communication and Computing, vol. 22, no. 1, pp. 47–90, 2011.
- “Google Earth Studio.” [Online]. Available: https://earth.google.com/studio/
- “DroneMapper Sample Data,” https://dronemapper.com/sample˙data/, accessed: March 19, 2024.
- T. Müller, A. Evans, C. Schied, and A. Keller, “Instant Neural Graphics Primitives with a Multiresolution Hash Encoding,” ACM transactions on graphics (TOG), vol. 41, no. 4, pp. 1–15, 2022.
- D. P. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” arXiv preprint arXiv:1412.6980, 2014.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.