Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Distributed Simultaneous Localisation and Auto-Calibration using Gaussian Belief Propagation (2401.15036v1)

Published 26 Jan 2024 in cs.RO and cs.MA

Abstract: We present a novel scalable, fully distributed, and online method for simultaneous localisation and extrinsic calibration for multi-robot setups. Individual a priori unknown robot poses are probabilistically inferred as robots sense each other while simultaneously calibrating their sensors and markers extrinsic using Gaussian Belief Propagation. In the presented experiments, we show how our method not only yields accurate robot localisation and auto-calibration but also is able to perform under challenging circumstances such as highly noisy measurements, significant communication failures or limited communication range.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. R. Murai, J. Ortiz, S. Saeedi, P. H. Kelly, and A. J. Davison, “A robot web for distributed many-device localisation,” IEEE Transactions on Robotics, 2023.
  2. Y. Shiu and S. Ahmad, “Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB,” IEEE Robotics and Automation Letters, vol. 5, no. 1, pp. 16–29, 1989.
  3. J. Wang, L. Wu, M. Q.-H. Meng, and H. Ren, “Towards simultaneous coordinate calibrations for cooperative multiple robots,” in Proceedings of the IEEE/RSJ Conference on Intelligent Robots and Systems (IROS), 2014.
  4. Q. Ma, Z. Goh, S. Ruan, and G. S. Chirikjian, “Probabilistic approaches to the AXB= YCZ AXB= YCZ calibration problem in multi-robot systems,” Autonomous Robots, vol. 42, pp. 1497–1520, 2018.
  5. S. Gowal, A. Prorok, and A. Martinoli, “Two-phase online calibration for infrared-based inter-robot positioning modules,” in Proceedings of the IEEE/RSJ Conference on Intelligent Robots and Systems (IROS), 2011.
  6. S. Esquivel, F. Woelk, and R. Koch, “Calibration of a Multi-camera Rig from Non-overlapping Views,” in Pattern Recognition. DAGM, 2007, pp. 82–91.
  7. G. Carrera, A. Angeli, and A. J. Davison, “SLAM-based automatic extrinsic calibration of a multi-camera rig,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2011.
  8. Y. Lin, V. Larsson, M. Geppert, Z. Kukelova, M. Pollefeys, and T. Sattler, “Infrastructure-based multi-camera calibration using radial projections,” in Proceedings of the European Conference on Computer Vision (ECCV), 2020.
  9. T. Dang, C. Hoffmann, and C. Stiller, “Continuous stereo self-calibration by camera parameter tracking,” IEEE Transactions on Image Processing, vol. 18, no. 7, pp. 1536–1550, 2009.
  10. L. Heng, G. H. Lee, and M. Pollefeys, “Self-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle,” Autonomous Robots, vol. 39, pp. 259–277, 2015.
  11. E. Dexheimer, P. Peluse, J. Chen, J. Pritts, and M. Kaess, “Information-theoretic online multi-camera extrinsic calibration,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4757–4764, 2022.
  12. E. Miluzzo, N. D. Lane, A. T. Campbell, and R. Olfati-Saber, “CaliBree: A self-calibration system for mobile sensor networks,” in Distributed Computing in Sensor Systems.   Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 314–331.
  13. D. Devarajan, Z. Cheng, and R. J. Radke, “Calibrating distributed camera networks,” Proceedings of the IEEE, vol. 96, no. 10, pp. 1625–1639, 2008.
  14. A. Ihler, J. Fisher, R. Moses, and A. Willsky, “Nonparametric belief propagation for self-calibration in sensor networks,” in Third International Symposium on Information Processing in Sensor Networks, 2004, pp. 225–233.
  15. C. Taylor, A. Rahimi, J. Bachrach, H. Shrobe, and A. Grue, “Simultaneous localization, calibration, and tracking in an ad hoc sensor network,” in 2006 5th International Conference on Information Processing in Sensor Networks, 2006.
  16. S. Choudhary, L. Carlone, C. Nieto, J. Rogers, H. Christensen, and F. Dellaert, “Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models,” International Journal of Robotics Research (IJRR), vol. 36, no. 12, pp. 1286–1311, 2017.
  17. Y. Tian, A. Koppel, A. S. Bedi, and J. P. How, “Asynchronous and parallel distributed pose graph optimization,” IEEE Robotics and Automation Letters, vol. 5, no. 4, pp. 5819–5826, 2020.
  18. Y. Tian, K. Khosoussi, D. M. Rosen, and J. P. How, “Distributed certifiably correct pose-graph optimization,” IEEE Transactions on Robotics (T-RO), vol. 37, no. 6, pp. 2137–2156, 2021.
  19. Y. Tian, Y. Chang, F. H. Arias, C. Nieto-Granda, J. P. How, and L. Carlone, “Kimera-multi: Robust, distributed, dense metric-semantic SLAM for multi-robot systems,” IEEE Transactions on Robotics (T-RO), vol. 38, no. 4, 2022.
  20. A. Papalia, A. Fishberg, B. W. O’Neill, J. P. How, D. M. Rosen, and J. J. Leonard, “Certifiably correct range-aided SLAM,” arXiv preprint arXiv:2302.11614, 2023.
  21. Y. Wang, X. Wen, L. Yin, C. Xu, Y. Cao, and F. Gao, “Certifiably optimal mutual localization with anonymous bearing measurements,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 9374–9381, 2022.
  22. A. Cunningham, M. Paluri, and F. Dellaert, “DDF-SAM: Fully distributed SLAM using constrained factor graphs,” in Proceedings of the IEEE/RSJ Conference on Intelligent Robots and Systems (IROS), 2010.
  23. A. Cunningham, V. Indelman, and F. Dellaert, “DDF-SAM 2.0: Consistent distributed smoothing and mapping,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2013.
  24. D. McGann, K. Lassak, and M. Kaess, “Asynchronous distributed smoothing and mapping via on-manifold consensus ADMM,” arXiv preprint arXiv.2310.12320, 2023.
  25. P. Bänninger, I. Alzugaray, M. Karrer, and M. Chli, “Cross-agent relocalization for decentralized collaborative SLAM,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2023.
  26. J. Pearl, “Reverend Bayes on inference engines: A distributed hierarchical approach,” in Proceedings of the National Conference on Artificial Intelligence (AAAI), 1982.
  27. D. Fourie, J. Leonard, and M. Kaess, “A nonparametric belief solution to the Bayes tree,” in Proceedings of the IEEE/RSJ Conference on Intelligent Robots and Systems (IROS), 2016.
  28. Y. Weiss and W. T. Freeman, “Correctness of belief propagation in Gaussian graphical models of arbitrary topology,” in Neural Information Processing Systems (NIPS), 2000.
  29. A. Patwardhan, R. Murai, and A. J. Davison, “Distributing collaborative multi-robot planning with Gaussian belief propagation,” IEEE Robotics and Automation Letters, vol. 8, no. 2, pp. 552–559, 2023.
  30. J. Ortiz, M. Pupilli, S. Leutenegger, and A. J. Davison, “Bundle adjustment on a graph processor,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2020.
  31. R. Scona, H. Matsuki, and A. Davison, “From scene flow to visual odometry through local and global regularisation in Markov random fields,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4299–4306, 2022.
  32. F. Dellaert and M. Kaess, “Factor Graphs for Robot Perception,” Foundations and Trends in Robotics, vol. 6, no. 1–2, pp. 1–139, 2017.
  33. J. Ortiz, T. Evans, and A. J. Davison, “A visual introduction to Gaussian Belief Propagation,” arXiv preprint arXiv:2107.02308, 2021.
  34. A. J. Davison and J. Ortiz, “FutureMapping 2: Gaussian Belief Propagation for Spatial AI,” arXiv preprint arXiv:1910.14139, 2019.
  35. J. Solà, J. Deray, and D. Atchuthan, “A micro Lie theory for state estimation in robotics,” arXiv:1812.01537, 2018.
  36. K. Y. Leung, Y. Halpern, T. D. Barfoot, and H. H. Liu, “The UTIAS multi-robot cooperative localization and mapping dataset,” International Journal of Robotics Research (IJRR), vol. 30, no. 8, pp. 969–974, 2011.
  37. J. Ortiz, T. Evans, E. Sucar, and A. J. Davison, “Incremental Abstraction in Distributed Probabilistic SLAM Graphs,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2022.
  38. P. Agarwal, G. D. Tipaldi, L. Spinello, C. Stachniss, and W. Burgard, “Robust map optimization using dynamic covariance scaling,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2012.
  39. L. Pineda, T. Fan, M. Monge, S. Venkataraman, P. Sodhi, R. T. Chen, J. Ortiz, D. DeTone, A. Wang, S. Anderson, J. Dong, B. Amos, and M. Mukadam, “Theseus: A Library for Differentiable Nonlinear Optimization,” in Neural Information Processing Systems (NIPS), 2022.
Citations (5)

Summary

  • The paper introduces a fully distributed framework that leverages GBP to perform simultaneous localisation and auto-calibration without sharing calibration parameters.
  • It integrates factor graphs with an adaptive regularisation technique to achieve rapid convergence and robust performance against communication issues and sensor outliers.
  • Experimental evaluations in both simulated and real-world settings validate the method’s high accuracy, scalability, and resilience in dynamic, multi-robot environments.

Introduction

In multi-robot systems, precise robot localisation and extrinsic calibration of sensors and markers are vital to ensure effective and safe robot interactions. Traditionally, research in localisation systems has primarily focused on single-robot setups, inadequate for multi-robot collaborative tasks where relative localisation determines the overall system's accuracy. Moreover, the prerequisite of accurate extrinsic calibration poses significant challenges and costs in practical, large-scale multi-robot settings.

Methodology

The paper introduces a scalable and fully distributed framework for simultaneous localisation and auto-calibration in multi-robot setups using Gaussian Belief Propagation (GBP). Each robot in the system can infer its pose and calibrate the extrinsic parameters of both sensors and markers through probabilistic inferences based on observations from other robots. Uniquely, the approach avoids the sharing of calibration parameters among robots, thus reducing communication overhead and enhancing scalability. Factor graphs represent the complex relationships between variables, and each robot incrementally builds and solves its portion of the graph. An adaptive regularisation technique within GBP is introduced to achieve convergence, addressing the non-linearity and non-convexity of the underpinning optimisation problems.

Evaluation and Results

The method is rigorously evaluated against other state-of-the-art distributed and centralised alternatives in simulated environments with varying robot count, communication constraints, and presence of outliers. The results demonstrate that the method achieves a rapid convergence rate and notable resilience to communication failures and measurement outliers. The accuracy of localisation and calibration remains comparably high, even under artificially induced sensor miscalibrations and limited communication ranges. Real-world experimental validation on the UTIAS MR.CLAM dataset further corroborates the system's practical efficacy.

Conclusion

This work presents a significant step toward self-reliant multi-robot systems capable of operating robustly in real-world situations. The proposed method stands out for its decentralised architecture that gracefully scales with the number of robots while maintaining high accuracy in localisation and calibration. This enables multi-robot collaborations even in challenging and dynamic environments with minimal manual intervention. Additionally, the system's robustness to communication and sensory perturbations positions it as an ideal candidate for further exploration and deployment in diverse multi-robot applications.

Youtube Logo Streamline Icon: https://streamlinehq.com