Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Characterizing Satellite Geometry via Accelerated 3D Gaussian Splatting (2401.02588v1)

Published 5 Jan 2024 in cs.CV and cs.AI

Abstract: The accelerating deployment of spacecraft in orbit have generated interest in on-orbit servicing (OOS), inspection of spacecraft, and active debris removal (ADR). Such missions require precise rendezvous and proximity operations in the vicinity of non-cooperative, possible unknown, resident space objects. Safety concerns with manned missions and lag times with ground-based control necessitate complete autonomy. This requires robust characterization of the target's geometry. In this article, we present an approach for mapping geometries of satellites on orbit based on 3D Gaussian Splatting that can run on computing resources available on current spaceflight hardware. We demonstrate model training and 3D rendering performance on a hardware-in-the-loop satellite mock-up under several realistic lighting and motion conditions. Our model is shown to be capable of training on-board and rendering higher quality novel views of an unknown satellite nearly 2 orders of magnitude faster than previous NeRF-based algorithms. Such on-board capabilities are critical to enable downstream machine intelligence tasks necessary for autonomous guidance, navigation, and control tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. M. Oda, “Summary of nasda"s ets-vii robot satellite mission,” Journal of Robotics and Mechatronics, vol. 12, no. 4, pp. 417–424, 2000.
  2. T. M. Davis and D. Melanson, “XSS-10 microsatellite flight demonstration program results,” in Spacecraft Platforms and Infrastructure, vol. 5419, pp. 16–25, SPIE, Aug. 2004.
  3. AFRL, “XSS-11 Micro Satellite,” tech. rep., 2011.
  4. AFRL, “Automated Navigation and Guidance Experiment for Local Space (ANGELS),” tech. rep., 2014.
  5. Intelsat, “MEV-1: A Look Back at the Groundbreaking Journey | Intelsat,” 2020. Section: Blog.
  6. J. Rainbow, “MEV-2 servicer successfully docks to live Intelsat satellite,” 2021.
  7. M. Pyrak and J. Anderson, “Performance of Northrop Grumman’s Mission Extension Vehicle (MEV) RPO imagers at GEO,” in Autonomous Systems: Sensors, Processing and Security for Ground, Air, Sea and Space Vehicles and Infrastructure 2022, vol. 12115, pp. 64–82, SPIE, June 2022.
  8. Sept. 2019. Conference Name: Advanced Maui Optical and Space Surveillance Technologies Conference Pages: 44 ADS Bibcode: 2019amos.confE..44F.
  9. T. Mahendrakar, R. White, M. Wilde, B. Kish, and I. Silver, “Real-time Satellite Component Recognition with YOLO-V5,” in 35th Annual Small Satellite Conference, July 2021.
  10. T. Mahendrakar, M. Wilde, and R. White, “Use of Artificial Intelligence for Feature Recognition and Flightpath Planning Around Non-Cooperative Resident Space Objects,” in ASCEND 2021, American Institute of Aeronautics and Astronautics, 2021. _eprint: https://arc.aiaa.org/doi/pdf/10.2514/6.2021-4123.
  11. J. Cutler, M. Wilde, A. Rivkin, B. Kish, and I. Silver, “Artificial Potential Field Guidance for Capture of Non-Cooperative Target Objects by Chaser Swarms,” in 2022 IEEE Aerospace Conference (AERO), pp. 1–12, Mar. 2022. ISSN: 1095-323X.
  12. T. Mahendrakar, S. Holmberg, A. Ekblad, E. Conti, R. T. White, M. Wilde, and I. Silver, “Autonomous Rendezvous with Non-cooperative Target Objects with Swarm Chasers and Observers,” in 2023 AAS/AIAA Spaceflight Mechanics Meeting, AAS/AIAA, Jan. 2023.
  13. B. Kerbl, G. Kopanas, T. Leimkuehler, and G. Drettakis, “3D Gaussian Splatting for Real-Time Radiance Field Rendering,” ACM Transactions on Graphics, vol. 42, pp. 139:1–139:14, July 2023.
  14. M. Attzs, T. Mahendrakar, M. Meni, R. White, and I. Silver, “Comparison of Tracking-By-Detection Algorithms for Real-Time Satellite Component Tracking,” Small Satellite Conference, Aug. 2023.
  15. H. Viggh, S. Loughran, Y. Rachlin, R. Allen, and J. Ruprecht, “Training Deep Learning Spacecraft Component Detection Algorithms Using Synthetic Image Data,” in 2023 IEEE Aerospace Conference, pp. 1–13, Mar. 2023. ISSN: 1095-323X.
  16. H. A. Dung, B. Chen, and T.-J. Chin, “A Spacecraft Dataset for Detection, Segmentation and Parts Recognition,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), (Nashville, TN, USA), pp. 2012–2019, IEEE, June 2021.
  17. T. Mahendrakar, A. Ekblad, N. Fischer, R. White, M. Wilde, B. Kish, and I. Silver, “Performance Study of YOLOv5 and Faster R-CNN for Autonomous Navigation around Non-Cooperative Targets,” in 2022 IEEE Aerospace Conference (AERO), pp. 1–12, IEEE, 2022.
  18. N. Faraco, M. Maestrini, and P. Di Lizia, “Instance segmentation for feature recognition on noncooperative resident space objects,” Journal of Spacecraft and Rockets, vol. 59, no. 6, pp. 2160–2174, 2022.
  19. T. Mahendrakar, M. N. Attzs, A. L. Tisaranni, J. M. Duarte, R. T. White, and M. Wilde, “Impact of Intra-class Variance on YOLOv5 Model Performance for Autonomous Navigation around Non-Cooperative Targets,” in AIAA SCITECH 2023 Forum, p. 2374, 2023.
  20. M. Kisantal, S. Sharma, T. H. Park, D. Izzo, M. Martens, and S. D’Amico, “Satellite pose estimation challenge: Dataset, competition design, and results,” IEEE Transactions on Aerospace and Electronic Systems, vol. 56, pp. 4083–4098, Oct. 2020.
  21. T. H. Park, M. Märtens, G. Lecuyer, D. Izzo, and S. D’Amico, “SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap,” in 2022 IEEE Aerospace Conference (AERO), pp. 1–15, Mar. 2022. ISSN: 1095-323X.
  22. T. H. Park, S. Sharma, and S. D’Amico, “Towards Robust Learning-Based Pose Estimation of Noncooperative Spacecraft,” Sept. 2019. arXiv:1909.00392 [cs].
  23. S. Sharma and S. D’Amico, “Neural Network-Based Pose Estimation for Noncooperative Spacecraft Rendezvous,” IEEE Transactions on Aerospace and Electronic Systems, vol. 56, pp. 4638–4658, Dec. 2020. Conference Name: IEEE Transactions on Aerospace and Electronic Systems.
  24. A. Lotti, D. Modenini, P. Tortora, M. Saponara, and M. A. Perino, “Deep Learning for Real-Time Satellite Pose Estimation on Tensor Processing Units,” Journal of Spacecraft and Rockets, vol. 60, pp. 1034–1038, May 2023. Publisher: American Institute of Aeronautics and Astronautics.
  25. M. Piazza, M. Maestrini, and P. Di Lizia, “Monocular Relative Pose Estimation Pipeline for Uncooperative Resident Space Objects,” Journal of Aerospace Information Systems, vol. 19, pp. 613–632, Sept. 2022. Publisher: American Institute of Aeronautics and Astronautics.
  26. B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “NeRF: representing scenes as neural radiance fields for view synthesis,” Communications of the ACM, vol. 65, pp. 99–106, Dec. 2021.
  27. K. Schwarz, Y. Liao, M. Niemeyer, and A. Geiger, “Graf: Generative radiance fields for 3d-aware image synthesis,” Advances in Neural Information Processing Systems, vol. 33, pp. 20154–20166, 2020.
  28. A. Mergy, G. Lecuyer, D. Derksen, and D. Izzo, “Vision-based neural scene representations for spacecraft,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2002–2011, 2021.
  29. B. Caruso, T. Mahendrakar, V. M. Nguyen, R. T. White, and T. Steffen, “3D Reconstruction of Non-cooperative Resident Space Objects using Instant NGP-accelerated NeRF and D-NeRF,” June 2023. arXiv:2301.09060 [cs].
  30. T. Müller, A. Evans, C. Schied, and A. Keller, “Instant Neural Graphics Primitives with a Multiresolution Hash Encoding,” ACM Trans. Graph., vol. 41, pp. 102:1–102:15, July 2022. Place: New York, NY, USA Publisher: ACM.
  31. A. Pumarola, E. Corona, G. Pons-Moll, and F. Moreno-Noguer, “D-nerf: Neural radiance fields for dynamic scenes,” CoRR, vol. abs/2011.13961, 2020.
  32. E. Kulu, “DODONA @ Nanosats Database.”
  33. T. H. Park and S. D’Amico, “Rapid Abstraction of Spacecraft 3D Structure from Single 2D Image,” in AIAA SCITECH Forum 2024, 2024.
  34. J. L. Schonberger and J.-M. Frahm, “Structure-From-Motion Revisited,” pp. 4104–4113, 2016.
  35. G. Wu, T. Yi, J. Fang, L. Xie, X. Zhang, W. Wei, W. Liu, Q. Tian, and X. Wang, “4d gaussian splatting for real-time dynamic scene rendering,” 2023.
  36. M. Wilde, B. Kaplinger, T. Go, H. Gutierrez, and D. Kirk, “ORION: A simulation environment for spacecraft formation flight, capture, and orbital robotics,” in 2016 IEEE Aerospace Conference, pp. 1–14, Mar. 2016.
  37. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, pp. 600–612, Apr. 2004.
  38. R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The Unreasonable Effectiveness of Deep Features as a Perceptual Metric,” pp. 586–595, 2018.
  39. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” 3rd International Conference on Learning Representations (ICLR 2015), 2015. Publisher: Computational and Biological Learning Society.
  40. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, “ImageNet Large Scale Visual Recognition Challenge,” International Journal of Computer Vision (IJCV), vol. 115, no. 3, pp. 211–252, 2015.
Citations (5)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now