Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
140 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multi-Agent 3D Map Reconstruction and Change Detection in Microgravity with Free-Flying Robots (2311.02558v4)

Published 5 Nov 2023 in cs.RO and cs.CV

Abstract: Assistive free-flyer robots autonomously caring for future crewed outposts -- such as NASA's Astrobee robots on the International Space Station (ISS) -- must be able to detect day-to-day interior changes to track inventory, detect and diagnose faults, and monitor the outpost status. This work presents a framework for multi-agent cooperative mapping and change detection to enable robotic maintenance of space outposts. One agent is used to reconstruct a 3D model of the environment from sequences of images and corresponding depth information. Another agent is used to periodically scan the environment for inconsistencies against the 3D model. Change detection is validated after completing the surveys using real image and pose data collected by Astrobee robots in a ground testing environment and from microgravity aboard the ISS. This work outlines the objectives, requirements, and algorithmic modules for the multi-agent reconstruction system, including recommendations for its use by assistive free-flyers aboard future microgravity outposts.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Street-View Change Detection with Deconvolutional Networks. Auton. Robot., 42:1301–1322, 2018.
  2. The Ames Stereo Pipeline: NASA’s Open Source Software for Deriving and Processing Terrain Data. Earth Space Sci., 5, 2018.
  3. Jean-Yves Bouguet et al. Pyramidal Implementation of the Affine Lucas-Kanade Feature Tracker: Description of the Algorithm. Intel Corporation, 5(1-10):4, 2001.
  4. Astrobee: A New Tool for ISS Operations. In 2018 SpaceOps Conference, Marseille, France, May 2018. American Institute of Aeronautics and Astronautics. ISBN 978-1-62410-562-3. doi: 10.2514/6.2018-2517.
  5. Astrobee On-Orbit Commissioning. IAF Int. Conf. Space Ops., 16(SpaceOps-2021,9,x1518):1–9, 2021.
  6. Astrobee Free Flyers: Integrated and Tested. Ready for Launch! IAF Int. Astr. Cong., 70:1–9, 2019.
  7. Eliminating Conditionally Independent Sets in Factor Graphs: A Unifying Perspective Based on Smart Factors. In IEEE Int. Conf. Robot. Autom. (ICRA), pages 4290–4297, 2014.
  8. Turgay Celik. Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and K𝐾Kitalic_K-Means Clustering. IEEE Geosci. Remote Sens. Lett., 6(4):772–776, 2009.
  9. Deep Space Gateway Concept: Extending Human Presence into Cislunar Space. IEEE Aerospace Conference Proceedings, 2018-March:1–10, 2018. ISSN 1095323X. doi: 10.1109/AERO.2018.8396541.
  10. Frank Dellaert. Factor Graphs and GTSAM: A Hands-On Introduction. Georgia Institute of Technology, Tech. Rep, 2:4, 2012.
  11. Photogrammetric Computer Vision. Springer, 2016.
  12. Continuous-Time Batch Estimation Using Temporal Basis Functions. In IEEE Int. Conf. Robot. Autom. (ICRA), pages 2088–2095, 2012.
  13. Unified Temporal and Spatial Calibration for Multi-Sensor Systems. In IEEE/RSJ Int. Conf. Intell. Robot. Sys. (IROS), pages 1280–1286, 2013.
  14. Monitoring Changes of 3D Building Elements From Unordered Photo Collections. In IEEE Int. Conf. Comput. Vis. (ICCV), pages 249–256, 2011.
  15. Tanaka Kanji. Detection-By-Localization: Maintenance-Free Change Object Detector. In IEEE Int. Conf. Robot. Autom. (ICRA), pages 4348–4355, 2019.
  16. ETH Autonomous Systems Laboratory. Kalibr. [Online] Available: https://github.com/ethz-asl/kalibr, 2023.
  17. The Gateway as a Building Block for Space Exploration and Development. In IAF Int. Astr. Cong., volume 73, 2022.
  18. A Novel Split and Merge EM Algorithm for Gaussian Mixture Model. In Int. Conf. Nat. Comput., volume 6, pages 479–483. IEEE, 2009.
  19. Self-Supervised Calibration for Robotic Systems. In IEEE Intell. Veh. Symp. (IV), pages 473–480, 2013.
  20. Robust Semantic Mapping and Localization on a Free-Flying Robot in Microgravity. In IEEE Int. Conf. Robot. Autom. (ICRA), pages 4121–4127, 2022.
  21. NASA. Astrobee Robot Software. [Online] Available: https://github.com/nasa/astrobee, 2023a.
  22. NASA. Astrobee Media. [Online] Available: https://github.com/nasa/astrobee_media.git, 2023b.
  23. NASA. ISAAC (Integrated System for Autonomous and Adaptive Caretaking). [Online] Available: https://github.com/nasa/isaac, 2023c.
  24. SPHERES: Development of an ISS Laboratory for Formation Flight and Docking Research. In IEEE Aerosp. Conf. Proc. (AERO), volume 1, pages 59–73, 2002.
  25. Change Detection in 3D Models Based on Camera Images. In Workshop on Planning, Perception and Navigation for Intelligent Vehicles at the IEEE/RSJ Int. Conf. on Intell. Robot. Sys. (IROS), 2017.
  26. Fast Image-Based Geometric Change Detection Given a 3D Model. In IEEE Int. Conf. Robot. Autom. (ICRA), pages 6308–6315, 2018.
  27. 3D Change Detection–Approaches and Applications. ISPRS J. Photogramm, 122:41–56, 2016.
  28. Image Change Detection Algorithms: A Systematic Survey. IEEE Trans. Image Process., 14(3):294–307, 2005.
  29. The Earth Mover’s Distance as a Metric for Image Retrieval. Int. J. Comput. Vis., 40(2):99, 2000.
  30. Unsupervised Change Detection for Space Habitats Using 3D Point Clouds. In AIAA SciTech F., 2024.
  31. Astrobee: A New Platform for Free-Flying Robotics on the International Space Station. In Int. Sympos. Artif. Intell. Robot. Autom. in Space (i-SAIRAS), 2016.
  32. ISAAC: An Integrated System for Autonomous and Adaptive Caretaking. In ISS R&D Conference, 2021.
  33. AstroLoc: An Efficient and Robust Localizer for a Free-flying Robot. In IEEE Int. Conf. Robot. Autom. (ICRA), pages 4106–4112, 2022.
  34. Chris Sweeney. Theia Multiview Geometry Library: Tutorial & Reference. [Online] Available: http://theia-sfm.org, 2023.
  35. Image Based Detection of Geometric Changes in Urban Environments. In IEEE Int. Conf. Comput. Vis. (ICCV), pages 2336–2343. IEEE, 2011.
  36. City-Scale Change Detection in Cadastral 3D Models Using Images. In IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), pages 113–120, 2013.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now