Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Nash Soft Actor-Critic LEO Satellite Handover Management Algorithm for Flying Vehicles (2402.00091v1)

Published 31 Jan 2024 in eess.SY, cs.GT, cs.MA, and cs.SY

Abstract: Compared with the terrestrial networks (TN), which can only support limited coverage areas, low-earth orbit (LEO) satellites can provide seamless global coverage and high survivability in case of emergencies. Nevertheless, the swift movement of the LEO satellites poses a challenge: frequent handovers are inevitable, compromising the quality of service (QoS) of users and leading to discontinuous connectivity. Moreover, considering LEO satellite connectivity for different flying vehicles (FVs) when coexisting with ground terminals, an efficient satellite handover decision control and mobility management strategy is required to reduce the number of handovers and allocate resources that align with different users' requirements. In this paper, a novel distributed satellite handover strategy based on Multi-Agent Reinforcement Learning (MARL) and game theory named Nash-SAC has been proposed to solve these problems. From the simulation results, the Nash-SAC-based handover strategy can effectively reduce the handovers by over 16 percent and the blocking rate by over 18 percent, outperforming local benchmarks such as traditional Q-learning. It also greatly improves the network utility used to quantify the performance of the whole system by up to 48 percent and caters to different users requirements, providing reliable and robust connectivity for both FVs and ground terminals.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (18)
  1. A. Baltaci, E. Dinc, M. Ozger, A. Alabbasi, C. Cavdar and D. Schupke, “A Survey of Wireless Networks for Future Aerial Communications (FACOM),” IEEE Communications Surveys & Tutorials, vol. 23, no. 4, pp. 2833-2884, Fourthquarter 2021.
  2. A. Jamalipour and T. Tung, “The Role of Satellites in Global IT: Trends and Implications,” IEEE Pers. Commun., vol. 8, no. 3, pp. 5-11, Jun. 2001.
  3. Y. Su, Y. Liu, Y. Zhou, J. Yuan, H. Cao, and J. Shi, “Broadband LEO satellite communications: Architectures and key technologies,” IEEE Wireless Commun., vol. 26, no. 2, pp. 55–61, Apr. 2019
  4. M. Tayyab, G. P. Koudouridis, X. Gelabert and R. Jäntti, “Signaling Overhead and Power Consumption during Handover in LTE,” in IEEE Wireless Communications and Networking Conference (WCNC), Marrakesh, Morocco, 2019, pp. 1-6.
  5. E. Papapetrou and F. . -N. Pavlidou, “Analytic study of Doppler-based handover management in LEO satellite systems,” IEEE Transactions on Aerospace and Electronic Systems, vol. 41, no. 3, pp. 830-839, July 2005.
  6. Y. Wu, G. Hu, F. Jin and J. Zu, “A Satellite Handover Strategy Based on the Potential Game in LEO Satellite Networks,” IEEE Access, vol. 7, pp. 133641- 133652, 2019.
  7. S. Zhang, L. Guo, W. Mu, J. Wang and Y. Liu, “Multi-objective Satellite Selection Strategy Based on Entropy,” in 13th International Conference on Wireless Communications and Signal Processing (WCSP), Changsha, China, 2021, pp. 1-5.
  8. S. He, T. Wang and S. Wang, “Load-Aware Satellite Handover Strategy Based on Multi-Agent Reinforcement Learning,” in IEEE Global Communications Conference, Taipei, Taiwan, 2020, pp. 1-6.
  9. J. Wang, W. Mu, Y. Liu, L. Guo, S. Zhang and G. Gui, “Deep Reinforcement Learning-based Satellite Handover Scheme for Satellite Communications,” in 2021 13th International Conference on Wireless Communications and Signal Processing (WCSP), Changsha, China, 2021, pp. 1-6.
  10. M. Gkizeli, R. Tafazolli and B. Evans, “Modeling handover in mobile satellite diversity based systems,” in IEEE VTC Fall 2001, Atlantic City, NJ, USA, 2001, pp. 131- 135.
  11. E. Del Re, R. Fantacci and G. Giambene, “Handover queuing strategies with dynamic and fixed channel allocation techniques in low Earth orbit mobile satellite systems,” IEEE Transactions on Communications, vol. 47, no. 1, pp. 89-102, Jan. 1999.
  12. E. Del Re, R. Fantacci and G. Giambene, “Efficient dynamic channel allocation techniques with handover queuing for mobile satellite networks,” IEEE Journal on Selected Areas in Communications, vol. 13, no. 2, pp. 397-405, Feb. 1995.
  13. I. Ali, N. Al-Dhahir, and J. E. Hershey, “Predicting the visibility of LEO satellites,” IEEE Trans. Aerosp. Electron. Syst., vol. 35, no. 4, pp. 1183–1190, 1999.
  14. Y. Wang, X. Qin, Z. Tang, T. Ma, X. Zhang and H. Zhou, “QoS-Centric Handover for Civil Aviation Aircraft Access in Ultra-Dense LEO Satellite Networks,” in IEEE/CIC International Conference on Communications in China (ICCC), Sanshui, Foshan, China, 2022, pp. 1085-1089.
  15. C. Petros, “Soft Actor-Critic for Discrete Action Settings”, ArXiv: abs/1910.07207, 2019.
  16. Diederik P. Kingma and Max Welling, “Auto-Encoding Variational Bayes,” ArXiv: abs/1312.6114, 2013.
  17. S. Liang, H. Wan, T. Qin, J. Li and W. Chen, “Multi-user Computation Offloading for Mobile Edge Computing: A Deep Reinforcement Learning and Game Theory Approach,” in IEEE 20th International Conference on Communication Technology (ICCT), Nanning, China, 2020, pp. 1534-1539.
  18. P. Teymoori and A. Boukerche, “Dynamic Multi-user Computation Offloading for Mobile Edge Computing using Game Theory and Deep Reinforcement Learning,” in IEEE International Conference on Communications, Seoul, Korea, 2022, pp. 1930-1935.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now