Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Improved LiDAR Odometry and Mapping using Deep Semantic Segmentation and Novel Outliers Detection (2403.03111v1)

Published 5 Mar 2024 in cs.CV, cs.AI, and cs.RO

Abstract: Perception is a key element for enabling intelligent autonomous navigation. Understanding the semantics of the surrounding environment and accurate vehicle pose estimation are essential capabilities for autonomous vehicles, including self-driving cars and mobile robots that perform complex tasks. Fast moving platforms like self-driving cars impose a hard challenge for localization and mapping algorithms. In this work, we propose a novel framework for real-time LiDAR odometry and mapping based on LOAM architecture for fast moving platforms. Our framework utilizes semantic information produced by a deep learning model to improve point-to-line and point-to-plane matching between LiDAR scans and build a semantic map of the environment, leading to more accurate motion estimation using LiDAR data. We observe that including semantic information in the matching process introduces a new type of outlier matches to the process, where matching occur between different objects of the same semantic class. To this end, we propose a novel algorithm that explicitly identifies and discards potential outliers in the matching process. In our experiments, we study the effect of improving the matching process on the robustness of LiDAR odometry against high speed motion. Our experimental evaluations on KITTI dataset demonstrate that utilizing semantic information and rejecting outliers significantly enhance the robustness of LiDAR odometry and mapping when there are large gaps between scan acquisition poses, which is typical for fast moving platforms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Low-drift and real-time lidar odometry and mapping. Autonomous Robots 2017, 41, 401–416.
  2. Robust regression. An R and S-Plus companion to applied regression 2002, 91.
  3. Deschaud, J.E. IMLS-SLAM: scan-to-model matching based on 3D data. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2018, pp. 2480–2485.
  4. Study of the Effect of Exploiting 3D Semantic Segmentation in LiDAR Odometry. Applied Sciences 2020, 10, 5657.
  5. Semantickitti: A dataset for semantic scene understanding of lidar sequences. In Proceedings of the Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 9297–9307.
  6. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992, 14, 239–256. https://doi.org/10.1109/34.121791.
  7. Object modeling by registration of multiple range images. In Proceedings of the Proceedings. 1991 IEEE International Conference on Robotics and Automation, 1991, pp. 2724–2729 vol.3. https://doi.org/10.1109/ROBOT.1991.132043.
  8. A volumetric method for building complex models from range images. In Proceedings of the Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 303–312.
  9. Efficient Surfel-Based SLAM using 3D Laser Range Data in Urban Environments. In Proceedings of the Robotics: Science and Systems, 2018, Vol. 2018.
  10. Suma++: Efficient lidar-based semantic slam. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2019, pp. 4530–4537.
  11. SegMap: Segment-based mapping and localization using data-driven descriptors. The International Journal of Robotics Research 2020, 39, 339–355. https://doi.org/10.1177/0278364919863090.
  12. SuMa++: Efficient LiDAR-based Semantic SLAM. In Proceedings of the Proceedings of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2019.
  13. Rangenet++: Fast and accurate lidar semantic segmentation. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2019, pp. 4213–4220.
  14. Integrating Deep Semantic Segmentation Into 3-D Point Cloud Registration. IEEE Robotics and Automation Letters 2018, 3, 2942–2949. https://doi.org/10.1109/LRA.2018.2848308.
  15. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 652–660.
  16. Generalized-icp. In Proceedings of the Robotics: science and systems. Seattle, WA, 2009, Vol. 2, p. 435.
  17. Semantic-assisted 3D normal distributions transform for scan registration in environments with limited structure. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2017, pp. 4064–4069.
  18. The normal distributions transform: A new approach to laser scan matching. In Proceedings of the Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453). IEEE, 2003, Vol. 3, pp. 2743–2748.
  19. Semantic Iterative Closest Point through Expectation-Maximization. In Proceedings of the BMVC, 2018, p. 280.
  20. A Novel Real-time Semantic-Assisted Lidar Odometry and Mapping System. In Proceedings of the 2019 Tenth International Conference on Intelligent Control and Information Processing (ICICIP), 2019, pp. 44–50. https://doi.org/10.1109/ICICIP47338.2019.9012188.
  21. LiDAR odometry and mapping based on semantic information for outdoor environment. Remote Sensing 2021, 13, 2864.
  22. Bentley, J.L. Multidimensional binary search trees used for associative searching. Communications of the ACM 1975, 18, 509–517.
  23. Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2018, pp. 4758–4765.
  24. SLOAM: Semantic Lidar Odometry and Mapping for Forest Inventory. IEEE Robotics and Automation Letters 2020, 5, 612–619. https://doi.org/10.1109/LRA.2019.2963823.
  25. Are we ready for autonomous driving? the kitti vision benchmark suite. In Proceedings of the 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2012, pp. 3354–3361.
  26. Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds. CoRR 2020, abs/2011.01974, [2011.01974].
  27. Using Quaternions for Parametrizing 3-D Rotations in Unconstrained Nonlinear Optimization. In Proceedings of the Vmv. Citeseer, 2001, Vol. 1, pp. 399–406.
  28. Principal component analysis: a review and recent developments. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 2016, 374, 20150202.
  29. Ceres Solver. http://ceres-solver.org.
  30. CARLA: An Open Urban Driving Simulator. In Proceedings of the Proceedings of the 1st Annual Conference on Robot Learning, 2017, pp. 1–16.
  31. AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles. In Proceedings of the Field and Service Robotics, 2017, [arXiv:1705.05065].
  32. Augmented reality meets computer vision: Efficient data generation for urban driving scenes. International Journal of Computer Vision 2018, 126, 961–972.

Summary

We haven't generated a summary for this paper yet.