Papers
Topics
Authors
Recent
Search
2000 character limit reached

Benchmarking Classical and Learning-Based Multibeam Point Cloud Registration

Published 10 May 2024 in cs.CV and cs.RO | (2405.06279v1)

Abstract: Deep learning has shown promising results for multiple 3D point cloud registration datasets. However, in the underwater domain, most registration of multibeam echo-sounder (MBES) point cloud data are still performed using classical methods in the iterative closest point (ICP) family. In this work, we curate and release DotsonEast Dataset, a semi-synthetic MBES registration dataset constructed from an autonomous underwater vehicle in West Antarctica. Using this dataset, we systematically benchmark the performance of 2 classical and 4 learning-based methods. The experimental results show that the learning-based methods work well for coarse alignment, and are better at recovering rough transforms consistently at high overlap (20-50%). In comparison, GICP (a variant of ICP) performs well for fine alignment and is better across all metrics at extremely low overlap (10%). To the best of our knowledge, this is the first work to benchmark both learning-based and classical registration methods on an AUV-based MBES dataset. To facilitate future research, both the code and data are made available online.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. A. G. Graham, A. Wåhlin, K. A. Hogan, F. O. Nitsche, K. J. Heywood, R. L. Totten, J. A. Smith, C.-D. Hillenbrand, L. M. Simkins, J. B. Anderson et al., “Rapid retreat of thwaites glacier in the pre-satellite era,” Nature Geoscience, vol. 15, no. 9, pp. 706–713, 2022.
  2. C. Roman and H. Singh, “A Self-Consistent Bathymetric Mapping Algorithm,” J. Field Robotics, vol. 24, no. 1-2, pp. 23–50, Jan. 2007.
  3. I. Torroba, N. Bore, and J. Folkesson, “Towards autonomous industrial-scale bathymetric surveying,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2019, pp. 6377–6382.
  4. ——, “A comparison of submap registration methods for multibeam bathymetric mapping,” in 2018 IEEE/OES Autonomous Underwater Vehicle Workshop (AUV).   IEEE, 2018, pp. 1–6.
  5. J. Tan, I. Torroba, Y. Xie, and J. Folkesson, “Data-driven loop closure detection in bathymetric point clouds for underwater slam,” in 2023 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2023, pp. 3131–3137.
  6. C. Roman and H. Singh, “Consistency based error evaluation for deep sea bathymetric mapping with robotic vehicles,” in 2006 IEEE International Conference on Robotics and Automation (ICRA), May 2006, pp. 3568–3574.
  7. M. Brossard, S. Bonnabel, and A. Barrau, “A New Approach to 3D ICP Covariance Estimation,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 744–751, Apr. 2020.
  8. L. Van der Maaten and G. Hinton, “Visualizing data using t-sne.” Journal of machine learning research, vol. 9, no. 11, 2008.
  9. Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao, “3d shapenets: A deep representation for volumetric shapes,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1912–1920.
  10. A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the KITTI vision benchmark suite,” in 2012 IEEE Conference on Computer Vision and Pattern Recognition.   IEEE, 2012, pp. 3354–3361.
  11. A. Zeng, S. Song, M. Nießner, M. Fisher, J. Xiao, and T. Funkhouser, “3dmatch: Learning local geometric descriptors from rgb-d reconstructions,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1802–1811.
  12. S. Barkby, S. B. Williams, O. Pizarro, and M. V. Jakuba, “A featureless approach to efficient bathymetric SLAM using distributed particle mapping,” Journal of Field Robotics, vol. 28, no. 1, pp. 19–39, 2011.
  13. Z. J. Yew and G. H. Lee, “Rpm-net: Robust point matching using learned features,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 11 824–11 833.
  14. X. Huang, G. Mei, J. Zhang, and R. Abbas, “A comprehensive survey on point cloud registration,” arXiv preprint arXiv:2103.02690, 2021.
  15. Z. Zhang, Y. Dai, and J. Sun, “Deep learning based point cloud registration: An overview,” Virtual Reality & Intelligent Hardware, vol. 2, no. 3, pp. 222–246, 2020.
  16. P. J. Besl and N. D. McKay, “Method for registration of 3-D shapes,” in Sensor Fusion IV: Control Paradigms and Data Structures, vol. 1611.   Spie, 1992, pp. 586–606.
  17. F. Pomerleau, F. Colas, and R. Siegwart, “A review of point cloud registration algorithms for mobile robotics,” Foundations and Trends® in Robotics, vol. 4, no. 1, pp. 1–104, 2015.
  18. M. A. Fischler and R. C. Bolles, “Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981.
  19. A. E. Johnson and M. Hebert, “Using spin images for efficient object recognition in cluttered 3D scenes,” IEEE Transactions on pattern analysis and machine intelligence, vol. 21, no. 5, pp. 433–449, 1999.
  20. R. B. Rusu, N. Blodow, and M. Beetz, “Fast point feature histograms (FPFH) for 3D registration,” in 2009 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2009, pp. 3212–3217.
  21. F. Tombari, S. Salti, and L. Di Stefano, “Unique signatures of histograms for local surface description,” in Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part III 11.   Springer, 2010, pp. 356–369.
  22. Y. Guo, M. Bennamoun, F. Sohel, M. Lu, J. Wan, and N. M. Kwok, “A comprehensive performance evaluation of 3D local feature descriptors,” International Journal of Computer Vision, vol. 116, pp. 66–89, 2016.
  23. C. Choy, J. Park, and V. Koltun, “Fully convolutional geometric features,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 8958–8966.
  24. C. Choy, J. Gwak, and S. Savarese, “4d spatio-temporal convnets: Minkowski convolutional neural networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 3075–3084.
  25. S. Huang, Z. Gojcic, M. Usvyatsov, A. Wieser, and K. Schindler, “Predator: Registration of 3d point clouds with low overlap,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 4267–4276.
  26. Q.-Y. Zhou, J. Park, and V. Koltun, “Fast Global Registration,” in Computer Vision – ECCV 2016, ser. Lecture Notes in Computer Science, B. Leibe, J. Matas, N. Sebe, and M. Welling, Eds.   Springer International Publishing, pp. 766–782.
  27. H. Yang, J. Shi, and L. Carlone, “Teaser: Fast and certifiable point cloud registration,” IEEE Transactions on Robotics, vol. 37, no. 2, pp. 314–333, 2020.
  28. C. Choy, W. Dong, and V. Koltun, “Deep global registration,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 2514–2523.
  29. X. Bai, Z. Luo, L. Zhou, H. Chen, L. Li, Z. Hu, H. Fu, and C.-L. Tai, “Pointdsc: Robust point cloud registration using deep spatial consistency,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 15 859–15 869.
  30. G. D. Pais, S. Ramalingam, V. M. Govindu, J. C. Nascimento, R. Chellappa, and P. Miraldo, “3dregnet: A deep neural network for 3d point registration,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7193–7203.
  31. A. Palomer, P. Ridao, and D. Ribas, “Multibeam 3D Underwater SLAM with Probabilistic Registration,” Sensors, vol. 16, no. 4, p. 560, Apr. 2016.
  32. M. Hammond, A. Clark, A. Mahajan, S. Sharma, and S. Rock, “Automated point cloud correspondence detection for underwater mapping using AUVs,” in OCEANS 2015 - MTS/IEEE Washington.   Washington, DC: IEEE, Oct. 2015, pp. 1–7.
  33. S. Suresh, P. Sodhi, J. G. Mangelson, D. Wettergreen, and M. Kaess, “Active SLAM using 3D Submap Saliency for Underwater Volumetric Exploration,” in 2020 IEEE International Conference on Robotics and Automation (ICRA).   Paris, France: IEEE, May 2020, pp. 3132–3138.
  34. N. Bore, I. Torroba, and J. Folkesson, “Sparse gaussian process slam, storage and filtering for auv multibeam bathymetry,” in 2018 IEEE/OES Autonomous Underwater Vehicle Workshop (AUV).   IEEE, 2018, pp. 1–6.
  35. I. Torroba, M. Cella, A. Terán, N. Rolleberg, and J. Folkesson, “Online stochastic variational gaussian process mapping for large-scale bathymetric slam in real time,” IEEE Robotics and Automation Letters, 2023.
  36. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE Conference on Computer Vision and Pattern Recognition.   Ieee, 2009, pp. 248–255.
  37. K. Krasnosky, C. Roman, and D. Casagrande, “A bathymetric mapping and SLAM dataset with high-precision ground truth for marine robotics,” The International Journal of Robotics Research, vol. 41, no. 1, pp. 12–19, Jan. 2022.
  38. M. Bernardi, B. Hosking, C. Petrioli, B. J. Bett, D. Jones, V. A. Huvenne, R. Marlow, M. Furlong, S. McPhail, and A. Munafò, “AURORA, a multi-sensor dataset for robotic ocean exploration,” The International Journal of Robotics Research, vol. 41, no. 5, pp. 461–469, 2022.
  39. V. Bichucher, J. M. Walls, P. Ozog, K. A. Skinner, and R. M. Eustice, “Bathymetric factor graph SLAM with sparse point cloud alignment,” in OCEANS 2015 - MTS/IEEE Washington.   IEEE, pp. 1–7. [Online]. Available: http://ieeexplore.ieee.org/document/7404433/
  40. Y. Wang and J. M. Solomon, “Deep closest point: Learning representations for point cloud registration,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 3523–3532.
  41. X. Bai, Z. Luo, L. Zhou, H. Fu, L. Quan, and C.-L. Tai, “D3feat: Joint learning of dense detection and description of 3d local features,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 6359–6367.
  42. A. Segal, D. Haehnel, and S. Thrun, “Generalized-icp.” in Robotics: Science and Systems, vol. 2, no. 4.   Seattle, WA, p. 435.
  43. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
  44. L. N. Smith and N. Topin, “Super-convergence: Very fast training of neural networks using large learning rates,” in Artificial intelligence and machine learning for multi-domain operations applications, vol. 11006.   SPIE, 2019, pp. 369–386.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up