Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Self-Supervised Depth Correction of Lidar Measurements from Map Consistency Loss (2303.01123v4)

Published 2 Mar 2023 in cs.RO

Abstract: Depth perception is considered an invaluable source of information in the context of 3D mapping and various robotics applications. However, point cloud maps acquired using consumer-level light detection and ranging sensors (lidars) still suffer from bias related to local surface properties such as measuring beam-to-surface incidence angle, distance, texture, reflectance, or illumination conditions. This fact has recently motivated researchers to exploit traditional filters, as well as the deep learning paradigm, in order to suppress the aforementioned depth sensors error while preserving geometric and map consistency details. Despite the effort, depth correction of lidar measurements is still an open challenge mainly due to the lack of clean 3D data that could be used as ground truth. In this paper, we introduce two novel point cloud map consistency losses, which facilitate self-supervised learning on real data of lidar depth correction models. Specifically, the models exploit multiple point cloud measurements of the same scene from different view-points in order to learn to reduce the bias based on the constructed map consistency signal. Complementary to the removal of the bias from the measurements, we demonstrate that the depth correction models help to reduce localization drift. Additionally, we release a data set that contains point cloud data captured in an indoor corridor environment with precise localization and ground truth mapping information.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (19)
  1. Learning embedding of 3d models with quadric loss. In 30th British Machine Vision Conference (BMVC 2019), pages 1–11. British Machine Vision Association (BMVA), 2019.
  2. E.P Baltsavias. Airborne laser scanning: basic relations and formulas. ISPRS Journal of Photogrammetry and Remote Sensing, 54(2):199–214, 1999.
  3. Ince–gaussian beams. Opt. Lett., 29(2):144–146, Jan 2004.
  4. A method for registration of 3-D shapes. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 14(2):239–256, 1992.
  5. Object modelling by registration of multiple range images. Image and Vision Computing, 10(3):145–155, 1992.
  6. A point set generation network for 3d object reconstruction from a single image. In CVPR, 2017.
  7. Weather influence and classification with automotive lidar sensors. In 2019 IEEE intelligent vehicles symposium (IV), pages 1527–1534. IEEE, 2019.
  8. Unified intrinsic and extrinsic camera and lidar calibration under uncertainties. In 2020 IEEE International Conference on Robotics and Automation (ICRA), pages 6028–6034, May 2020.
  9. Lidar measurement bias estimation via return waveform modelling in a context of 3d mapping. In 2019 International Conference on Robotics and Automation (ICRA), pages 8100–8106, May 2019.
  10. Xiaolu Li and Yu Liang. Remote measurement of surface roughness, surface reflectance, and body reflectance with lidar. Applied Optics, 54(30):8904–8912, 2015.
  11. KITTI-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d. Pattern Analysis and Machine Intelligence (PAMI), 2022.
  12. Normal estimation for pointcloud using gpu based sparse tensor voting. In 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO), pages 91–96. IEEE, 2012.
  13. Modeling lidar waveforms in heterogeneous and discrete canopies. IEEE Transactions on Geoscience and Remote Sensing, 39(9):1943–1958, Sep. 2001.
  14. Comparing ICP variants on real-world data sets. Autonomous Robots, 34(3):133–148, 2013.
  15. Generalized-icp. In Robotics: Science and Systems V, Seattle, USA, June 2009.
  16. Self-supervised deep depth denoising. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1242–1251, 2019.
  17. G. Sun and K.J. Ranson. Modeling lidar returns from forest canopies. IEEE Transactions on Geoscience and Remote Sensing, 38(6):2617–2626, Nov 2000.
  18. Orazio Svelto. Principles of Lasers. Springer, Boston, MA, 5 edition, 2010.
  19. Lidar sampling for large-area forest characterization: A review. Remote Sensing of Environment, 121:196–209, 2012.

Summary

We haven't generated a summary for this paper yet.