Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networks (2311.01483v5)

Published 2 Nov 2023 in cs.LG, cs.AI, and cs.DC

Abstract: Recently, a large number of Low Earth Orbit (LEO) satellites have been launched and deployed successfully in space by commercial companies, such as SpaceX. Due to multimodal sensors equipped by the LEO satellites, they serve not only for communication but also for various machine learning applications, such as space modulation recognition, remote sensing image classification, etc. However, the ground station (GS) may be incapable of downloading such a large volume of raw sensing data for centralized model training due to the limited contact time with LEO satellites (e.g. 5 minutes). Therefore, federated learning (FL) has emerged as the promising solution to address this problem via on-device training. Unfortunately, to enable FL on LEO satellites, we still face three critical challenges that are i) heterogeneous computing and memory capabilities, ii) limited uplink rate, and iii) model staleness. To this end, we propose FedSN as a general FL framework to tackle the above challenges, and fully explore data diversity on LEO satellites. Specifically, we first present a novel sub-structure scheme to enable heterogeneous local model training considering different computing, memory, and communication constraints on LEO satellites. Additionally, we propose a pseudo-synchronous model aggregation strategy to dynamically schedule model aggregation for compensating model staleness. To further demonstrate the effectiveness of the FedSN, we evaluate it using space modulation recognition and remote sensing image classification tasks by leveraging the data from real-world satellite networks. Extensive experimental results demonstrate that FedSN framework achieves higher accuracy, lower computing, and communication overhead than the state-of-the-art benchmarks and the effectiveness of each components in FedSN.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. H. Mark, “Tech Giants Race to Build Orbital Internet,” IEEE Spectr., vol. 55, no. 6, pp. 10–11, 2018.
  2. T. Ahmmed, A. Alidadi, Z. Zhang, A. U. Chaudhry, and H. Yanikomeroglu, “The Digital Divide in Canada and the Role of LEO Satellites in Bridging the Gap,” IEEE Commun. Mag., vol. 60, no. 6, pp. 24–30, 2022.
  3. Q. Chen, W. Meng, S. Han, C. Li, and H.-H. Chen, “Robust Task Scheduling for Delay-aware IoT Applications in Civil Aircraft-augmented SAGIN,” IEEE Trans. Commun., vol. 70, no. 8, pp. 5368–5385, 2022.
  4. J. Wu, S. Su, X. Wang, J. Zhang, and Y. Gao, “Accelerating handover in mobile satellite network,” in Proc. INFOCOM, 2024.
  5. H. Yuan, Z. Chen, Z. Lin, J. Peng, Z. Fang, Y. Zhong, Z. Song, X. Wang, and Y. Gao, “Graph Learning for Multi-satellite based Spectrum Sensing,” in Proc. ICCT, 2023.
  6. B. Aragon, R. Houborg, K. Tu, J. B. Fisher, and M. McCabe, “CubeSats Enable High Spatiotemporal Retrievals of Crop-water Use for Precision Agriculture,” Remote Sens., vol. 10, no. 12, p. 1867, 2018.
  7. I. Franch-Pardo, B. M. Napoletano, F. Rosete-Verges, and L. Billa, “Spatial Analysis and GIS in the Study of COVID-19. A Review,” Sci. Total Environ., vol. 739, p. 140033, 2020.
  8. S. Shukla, D. Macharia, G. J. Husak, M. Landsfeld, C. L. Nakalembe, S. L. Blakeley, E. C. Adams, and J. Way-Henthorne, “Enhancing Access and Usage of Earth Observations in Environmental Decision-making in Eastern and Southern Africa Through Capacity Building,” Front. Sustainable Food Syst., vol. 5, p. 504063, 2021.
  9. Z. Lin, G. Zhu, Y. Deng, X. Chen, Y. Gao, K. Huang, and Y. Fang, “Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks,” IEEE Trans. Mobile Comput., 2024.
  10. K. B. Letaief, Y. Shi, J. Lu, and J. Lu, “Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications,” IEEE J. Sel. Areas Commun., vol. 40, no. 1, pp. 5–36, 2021.
  11. Z. Chen, C. Cai, T. Zheng, J. Luo, J. Xiong, and X. Wang, “Rf-based Human Activity Recognition Using Signal Adapted Convolutional Neural Network,” IEEE Trans. Mobile Comput., vol. 22, no. 1, pp. 487–499, 2021.
  12. S. Lyu, Z. Lin, G. Qu, X. Chen, X. Huang, and P. Li, “Optimal Resource Allocation for U-shaped Parallel Split Learning,” arXiv preprint arXiv:2308.08896, 2023.
  13. Z. Lin, L. Wang, J. Ding, B. Tan, and S. Jin, “Channel Power Gain Estimation For Terahertz Vehicle-to-infrastructure Networks,” IEEE Commun. Lett., vol. 27, no. 1, pp. 155–159, 2022.
  14. J. So, K. Hsieh, B. Arzani, S. Noghabi, S. Avestimehr, and R. Chandra, “Fedspace: An Efficient Federated Learning Framework at Satellites and Ground Stations,” arXiv preprint arXiv:2202.01267, 2022.
  15. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient Learning of Deep Networks from Decentralized Data,” in Proc. AISTATS, 2017.
  16. M. Chen, Z. Yang, W. Saad, C. Yin, H. V. Poor, and S. Cui, “A Joint Learning and Communications Framework for Federated Learning over Wireless Networks,” IEEE Trans. Wireless Commun., vol. 20, no. 1, pp. 269–283, 2020.
  17. K. Yang, T. Jiang, Y. Shi, and Z. Ding, “Federated Learning via Over-the-air Computation,” IEEE Trans. Wireless Commun., vol. 19, no. 3, pp. 2022–2035, 2020.
  18. J. Hu, Z. Chen, T. Zheng, R. Schober, and J. Luo, “HoloFed: Environment-Adaptive Positioning via Multi-band Reconfigurable Holographic Surfaces and Federated Learning,” IEEE J. Sel. Areas Commun., 2023.
  19. J. Xu and H. Wang, “Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-term Perspective,” IEEE Trans. Wireless Commun., vol. 20, no. 2, pp. 1188–1200, 2020.
  20. Z. Lin, G. Qu, W. Wei, X. Chen, and K. K. Leung, “AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networks,” arXiv preprint arXiv:2403.13101, 2024.
  21. M. Handley, “Using Ground Relays for Low-latency Wide-area Routing in Megaconstellations,” in Proc. ACM Workshop HotNets, 2019.
  22. N. Razmi, B. Matthiesen, A. Dekorsy, and P. Popovski, “Ground-assisted Federated Learning in LEO Satellite Constellations,” IEEE Wireless Commun. Lett., vol. 11, no. 4, pp. 717–721, 2022.
  23. L. Wu and J. Zhang, “FedGSM: Efficient Federated Learning for LEO Constellations with Gradient Staleness Mitigation,” arXiv preprint arXiv:2304.08537, 2023.
  24. M. Elmahallawy and T. Luo, “AsyncFLEO: Asynchronous Federated Learning for LEO Satellite Constellations with High-Altitude Platforms,” arXiv preprint arXiv:2212.11522, 2022.
  25. Razmi, Nasrin and Matthiesen, Bho and Dekorsy, Armin and Popovski, Petar, “Scheduling for Ground-Assisted Federated Learning in LEO Satellite Constellations,” in Proc. EUSIPCO, 2022.
  26. “Deep Sub-Nyquist Modulation Recognition Challenge”. Available: http://www.gbsense.net/challenge/.
  27. K. Simonyan and A. Zisserman, “Very Deep Convolutional Networks for Large-scale Image Recognition,” in Proc. ICLR, 2015.
  28. M. F. Haque, H.-Y. Lim, and D.-S. Kang, “Object Detection Based on VGG with ResNet Network,” in Proc. ICEIC, 2019.
  29. A. Tirumala, “Iperf: The TCP/UDP Bandwidth Measurement Tool,” http://dast. nlanr. net/Projects/Iperf/, 1999.
  30. B. Hubert et al., “Linux Advanced Routing & Traffic Control HOWTO,” Netherlabs BV, vol. 1, pp. 99–107, 2002.
  31. S. Duggen, P. Croot, U. Schacht, and L. Hoffmann, “Subduction Zone Volcanic Ash Can Fertilize The Surface Ocean and Stimulate Phytoplankton Growth: Evidence from Biogeochemical Experiments and Satellite Data,” Geophys. Res. Lett., vol. 34, no. 1, 2007.
  32. X. Chen, G. Zhu, Y. Deng, and Y. Fang, “Federated Learning over Multihop Wireless Networks with In-network Aggregation,” IEEE Trans. Wireless Commun., vol. 21, no. 6, pp. 4622–4634, 2022.
  33. C. Xie, S. Koyejo, and I. Gupta, “Asynchronous Federated Optimization,” arXiv preprint arXiv:1903.03934, 2019.
  34. S. Zagoruyko and N. Komodakis, “Wide residual networks,” arXiv preprint arXiv:1605.07146, 2016.
  35. M. Tan and Q. Le, “Efficientnet: Rethinking model scaling for convolutional neural networks,” in Proc. ICML, 2019, pp. 6105–6114.
  36. Z. Lin, G. Qu, X. Chen, and K. Huang, “Split Learning in 6G Edge Networks,” arXiv preprint arXiv:2306.12194, 2023.
  37. Z. Lin, G. Qu, Q. Chen, X. Chen, Z. Chen, and K. Huang, “Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities,” arXiv preprint arXiv:2309.16739, 2023.
  38. E. Diao, J. Ding, and V. Tarokh, “HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients,” in Proc. ICLR, 2021.
  39. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet Classification with Deep Convolutional Neural Networks,” Proc. NIPS, 2012.
  40. P. Helber, B. Bischke, A. Dengel, and D. Borth, “Introducing Eurosat: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification,” in Proc. IGARSS, 2018.
  41. M. Elmahallawy and T. Luo, “FedHAP: Fast Federated Learning for LEO Constellations Using Collaborative HAPs,” in Proc. WCSP, 2022.
Citations (7)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets