Papers
Topics
Authors
Recent
Search
2000 character limit reached

Image-based Detection of Segment Misalignment in Multi-mirror Satellites using Transfer Learning

Published 30 Jul 2024 in cs.CV, cs.AI, and eess.IV | (2407.20582v1)

Abstract: In this paper, we introduce a system based on transfer learning for detecting segment misalignment in multimirror satellites, such as future CubeSat designs and the James Webb Space Telescope (JWST), using image-based methods. When a mirror segment becomes misaligned due to various environmental factors, such as space debris, the images can become distorted with a shifted copy of itself called a "ghost image". To detect whether segments are misaligned, we use pre-trained, large-scale image models trained on the Fast Fourier Transform (FFT) of patches of satellite images in grayscale. Multi-mirror designs can use any arbitrary number of mirrors. For our purposes, the tests were performed on simulated CubeSats with 4, 6, and 8 segments. For system design, we took this into account when we want to know when a satellite has a misaligned segment and how many segments are misaligned. The intensity of the ghost image is directly proportional to the number of segments misaligned. Models trained for intensity classification attempted to classify N-1 segments. Across eight classes, binary models were able to achieve a classification accuracy of 98.75%, and models for intensity classification were able to achieve an accuracy of 98.05%.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (29)
  1. Deep learning based prediction of solar surface irradiance with geostationary satellite images. In 2022 17th Annual System of Systems Engineering Conference (SOSE), pages 311–315, 2022.
  2. A study on deep learning approaches for mars weather forecasting. In 2022 5th International Conference on Signal Processing and Information Security (ICSPIS), pages 76–79, 2022.
  3. Exploration of image blur detection methods on globally blur images. In 2022 10th International Conference on Information and Communication Technology (ICoICT), pages 275–280, 2022.
  4. Implementation of blur image to sharp image conversion using laplacian approach. In 2022 3rd International Conference on Smart Electronics and Communication (ICOSEC), pages 339–345, 2022.
  5. Cubesat communication system for maritime needs. In 2020 27th International Conference on Telecommunications (ICT), pages 1–5, 2020.
  6. Blur image detection using laplacian operator and open-cv. In 2016 International Conference System Modeling and Advancement in Research Trends (SMART), pages 63–67, 2016.
  7. Macroscopic wood blurred image analysis to determine the factors of causing blur. In 2020 8th International Conference on Information and Communication Technology (ICoICT), pages 1–5, 2020.
  8. Demonstration of wildfire detection using image classification onboard cubesat. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, pages 5413–5416, 2021.
  9. Analysing of image quality computation models through convolutional neural network. In 2023 2nd International Conference on Vision Towards Emerging Trends in Communication and Networking Technologies (ViTECoN), pages 1–7, 2023.
  10. Deepglobe 2018: A challenge to parse the earth through satellite images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2018.
  11. Artificial intelligence for satellite communication: A review. Intelligent and Converged Networks, 2(3):213–243, 2021.
  12. A fake iris detection method based on fft and quality assessment. In 2008 Chinese Conference on Pattern Recognition, pages 1–4, 2008.
  13. Reduced-reference image quality assessment based on 2-d discrete fft and edge similarity. In 2015 9th Iranian Conference on Machine Vision and Image Processing (MVIP), pages 24–28, 2015.
  14. Transfer learning performance analysis for vgg16 in hurricane damage building classification. In 2021 2nd International Conference on Big Data and Artificial Intelligence and Software Engineering (ICBASE), pages 177–184, 2021.
  15. Mars crater detection based on yolo structure using tir data. In 2022 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), pages 530–533, 2022.
  16. Deep reinforcement learning for dynamic bandwidth allocation in multi-beam satellite systems. In 2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS), pages 955–959, 2021.
  17. No-reference blur assessment in natural images using fourier transform and spatial pyramids. In 2014 IEEE International Conference on Image Processing (ICIP), pages 566–570, 2014.
  18. Detection of ships in satellite imagery using deep neural networks with transfer learning approach. In 2022 4th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), pages 1106–1110, 2022.
  19. Polavarapu and Mamidipaka. Blur image detection and classification using resnet-50. In i-manager’s Journal on Image Processing, pages 37–43, 2022.
  20. Learning based single image blur detection and segmentation. In 2018 25th IEEE International Conference on Image Processing (ICIP), pages 2202–2206, 2018.
  21. Computer vision approach for motion blur image restoration system. In 2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT), pages 1–9, 2023.
  22. Blur detection and deblurring in covid-19 chest x-rays images using generative adversarial networks. In 2022 32nd International Conference on Computer Theory and Applications (ICCTA), pages 64–67, 2022.
  23. Transfer learning in deep neural network for land cover classification. In 2022 25th International Conference on Computer and Information Technology (ICCIT), pages 641–644, 2022.
  24. Transfer learning for visual categorization: A survey. IEEE Transactions on Neural Networks and Learning Systems, 26(5):1019–1034, 2015.
  25. Deep kalman-based trajectory estimation of moving target from satellite images. In 2022 IEEE 10th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), pages 71–75, 2022.
  26. Tomasz Szandała. Convolutional neural network for blur images detection as an alternative for laplacian method. In 2020 IEEE Symposium Series on Computational Intelligence (SSCI), pages 2901–2904, 2020.
  27. Blur image classification based on deep learning. In 2017 IEEE International Conference on Imaging Systems and Techniques (IST), pages 1–6, 2017.
  28. Observation of the mississippi river surface gradients from spire’s gnss-r cubesats. In IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium, pages 4403–4406, 2022.
  29. İbrahim Onuralp Yiğit. Evaluation of transfer learning approach for satellite image classification. In 2020 Innovations in Intelligent Systems and Applications Conference (ASYU), pages 1–5, 2020.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.