To Fuse or Not to Fuse: Measuring Consistency in Multi-Sensor Fusion for Aerial Robots
Abstract: Aerial vehicles are no longer limited to flying in open space: recent work has focused on aerial manipulation and up-close inspection. Such applications place stringent requirements on state estimation: the robot must combine state information from many sources, including onboard odometry and global positioning sensors. However, flying close to or in contact with structures is a degenerate case for many sensing modalities, and the robot's state estimation framework must intelligently choose which sensors are currently trustworthy. We evaluate a number of metrics to judge the reliability of sensing modalities in a multi-sensor fusion framework, then introduce a consensus-finding scheme that uses this metric to choose which sensors to fuse or not to fuse. Finally, we show that such a fusion framework is more robust and accurate than fusing all sensors all the time and demonstrate how such metrics can be informative in real-world experiments in indoor-outdoor flight and bridge inspection.
- A. Ollero, M. Tognon, A. Suarez, D. Lee, and A. Franchi, “Past, Present, and Future of Aerial Robotic Manipulators,” IEEE Transactions on Robotics, 2021.
- Y. Sun, Z. Jing, P. Dong, J. Huang, W. Chen, and H. Leung, “A Switchable Unmanned Aerial Manipulator System for Window-Cleaning Robot Installation,” IEEE RAL, 2021.
- D. Tzoumanikas, F. Graule, Q. Yan, D. Shah, M. Popovic, and S. Leutenegger, “Aerial Manipulation Using Hybrid Force and Position NMPC Applied to Aerial Writing,” in Robotics: Science and Systems, 2020.
- P. J. Sanchez-Cuevas, A. Gonzalez-Morgado, N. Cortes, D. B. Gayango, A. E. Jimenez-Cano, A. Ollero, and G. Heredia, “Fully-Actuated Aerial Manipulator for Infrastructure Contact Inspection: Design, Modeling, Localization, and Control,” Sensors, 2020.
- C. Brommer, R. Jung, J. Steinbrener, and S. Weiss, “MaRS: A Modular and Robust Sensor-Fusion Framework,” IEEE RAL, 2021.
- J. Nubert, S. Khattak, and M. Hutter, “Graph-based Multi-sensor Fusion for Consistent Localization of Autonomous Construction Robots,” in IEEE International Conference on Robotics & Automation, 2022.
- C. Brunner and T. Peynot, “Perception Quality Evaluation with Visual and Infrared Cameras in Challenging Environmental Conditions,” in ISER, 2014.
- J. Nubert, E. Walther, S. Khattak, and M. Hutter, “Learning-based Localizability Estimation for Robust LiDAR Localization,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022.
- W. Lee, P. Geneva, C. Chen, and G. Huang, “MINS: Efficient and Robust Multisensor-aided Inertial Navigation System,” arXiv, 2023.
- M. G. Bellemare, I. Danihelka, W. Dabney, S. Mohamed, B. Lakshminarayanan, S. Hoyer, and R. Munos, “The Cramer Distance as a Solution to Biased Wasserstein Gradients,” arXiv, 2017.
- C. Lanegger*, M. Pantic*, R. Bähnemann, R. Siegwart, and L. Ott, “Chasing Millimeters: Design, Navigation and State Estimation for Precise In-flight Marking on Ceilings,” arXiv, 2023.
- C. Forster, L. Carlone, F. Dellaert, and D. Scaramuzza, “On-Manifold Preintegration for Real-Time Visual–Inertial Odometry,” IEEE T-RO, 2016.
- W. Xu and F. Zhang, “Fast-lio: A fast, robust lidar-inertial odometry package by tightly-coupled iterated kalman filter,” IEEE RAL, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.