Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deep Reinforcement Learning Enhanced Rate-Splitting Multiple Access for Interference Mitigation (2403.05974v2)

Published 9 Mar 2024 in cs.IT, cs.MA, eess.SP, and math.IT

Abstract: This study explores the application of the rate-splitting multiple access (RSMA) technique, vital for interference mitigation in modern communication systems. It investigates the use of precoding methods in RSMA, especially in complex multiple-antenna interference channels, employing deep reinforcement learning. The aim is to optimize precoders and power allocation for common and private data streams involving multiple decision-makers. A multi-agent deep deterministic policy gradient (MADDPG) framework is employed to address this complexity, where decentralized agents collectively learn to optimize actions in a continuous policy space. We also explore the challenges posed by imperfect channel side information at the transmitter. Additionally, decoding order estimation is addressed to determine the optimal decoding sequence for common and private data sequences. Simulation results demonstrate the effectiveness of the proposed RSMA method based on MADDPG, achieving the upper bound in single-antenna scenarios and closely approaching theoretical limits in multi-antenna scenarios. Comparative analysis shows superiority over other techniques such as MADDPG without rate-splitting, maximal ratio transmission (MRT), zero-forcing (ZF), and leakage-based precoding methods. These findings highlight the potential of deep reinforcement learning-driven RSMA in reducing interference and enhancing system performance in communication systems.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. O. N. Irkicatal, M. Yuksel, and E. T. Ceran, “Deep reinforcement learning aided rate-splitting for interference channels,” in IEEE Global Communications Conference, GLOBECOM, pp. 1–7, IEEE, 2023.
  2. W. Jiang, B. Han, M. A. Habibi, and H. D. Schotten, “The road towards 6G: A comprehensive survey,” IEEE Open Journal of the Communications Society, vol. 2, pp. 334–366, 2021.
  3. Y. Lu and X. Zheng, “6G: A survey on technologies, scenarios, challenges, and the related issues,” Journal of Industrial Information Integration, vol. 19, p. 100158, 2020.
  4. M. U. A. Siddiqui, H. Abumarshoud, L. Bariah, S. Muhaidat, M. A. Imran, and L. Mohjazi, “URLLC in beyond 5G and 6G networks: An interference management perspective,” IEEE Access, 2023.
  5. Z. Wei, H. Qu, Y. Wang, X. Yuan, H. Wu, Y. Du, K. Han, N. Zhang, and Z. Feng, “Integrated sensing and communication signals towards 5G-A and 6G: A survey,” IEEE Internet of Things Journal, 2023.
  6. F. Salahdine, T. Han, and N. Zhang, “5G, 6G, and beyond: Recent advances and future challenges,” Annals of Telecommunications, pp. 1–25, 2023.
  7. B. Clerckx, Y. Mao, E. A. Jorswieck, J. Yuan, D. J. Love, E. Erkip, and D. Niyato, “A primer on rate-splitting multiple access: Tutorial, myths, and frequently asked questions,” IEEE Journal on Selected Areas in Communications, 2023.
  8. Z. Lin, M. Lin, T. De Cola, J.-B. Wang, W.-P. Zhu, and J. Cheng, “Supporting IoT with rate-splitting multiple access in satellite and aerial-integrated networks,” IEEE Internet of Things Journal, vol. 8, no. 14, pp. 11123–11134, 2021.
  9. M. Wu, Z. Gao, Y. Huang, Z. Xiao, D. W. K. Ng, and Z. Zhang, “Deep learning-based rate-splitting multiple access for reconfigurable intelligent surface-aided tera-hertz massive MIMO,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 5, pp. 1431–1451, 2023.
  10. O. Dizdar, Y. Mao, Y. Xu, P. Zhu, and B. Clerckx, “Rate-splitting multiple access for enhanced URLLC and eMBB in 6G,” in 2021 17th International Symposium on Wireless Communication Systems (ISWCS), pp. 1–6, IEEE, 2021.
  11. Y. Mao, O. Dizdar, B. Clerckx, R. Schober, P. Popovski, and H. V. Poor, “Rate-splitting multiple access: Fundamentals, survey, and future research trends,” IEEE Communications Surveys & Tutorials, 2022.
  12. X. Li, T. Wang, H. Tong, Z. Yang, Y. Mao, and C. Yin, “Sum-rate maximization for active RIS-aided downlink RSMA system,” arXiv preprint arXiv:2301.12833, 2023.
  13. K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, “Deep reinforcement learning: A brief survey,” IEEE Signal Processing Magazine, vol. 34, no. 6, pp. 26–38, 2017.
  14. H. Dahrouj, R. Alghamdi, H. Alwazani, S. Bahanshal, A. A. Ahmad, A. Faisal, R. Shalabi, R. Alhadrami, A. Subasi, M. T. Al-Nory, et al., “An overview of machine learning-based techniques for solving optimization problems in communications and signal processing,” IEEE Access, vol. 9, pp. 74908–74938, 2021.
  15. T. Han and K. Kobayashi, “A new achievable rate region for the interference channel,” IEEE Transactions on Information Theory, vol. 27, no. 1, pp. 49–60, 1981.
  16. H. Sato, “The capacity of the Gaussian interference channel under strong interference,” IEEE Transactions on Information Theory, vol. 27, no. 6, pp. 786–788, 1981.
  17. R. H. Etkin, D. Tse, and H. Wang, “Gaussian interference channel capacity to within one bit,” IEEE Transactions on Information Theory, vol. 54, no. 12, pp. 5534–5562, 2008.
  18. S. Karmakar and M. K. Varanasi, “The capacity region of the MIMO interference channel and its reciprocity to within a constant gap,” IEEE Transactions on Information Theory, vol. 59, no. 8, pp. 4781–4797, 2013.
  19. M. Rahmani, M. J. Dehghani, P. Xiao, M. Bashar, and M. Debbah, “Multi-agent reinforcement learning-based pilot assignment for cell-free massive MIMO systems,” IEEE Access, vol. 10, pp. 120492–120502, 2022.
  20. H. Lee and J. Jeong, “Multi-agent deep reinforcement learning (MADRL) meets multi-user MIMO systems,” 2021 IEEE Global Communications Conference (GLOBECOM), pp. 1–6, 2021.
  21. H. Lee, M. Girnyk, and J. Jeong, “Deep reinforcement learning approach to MIMO precoding problem: Optimality and robustness,” arXiv preprint arXiv:2006.16646, 2020.
  22. N. Q. Hieu, D. T. Hoang, D. Niyato, and D. I. Kim, “Optimal power allocation for rate splitting communications with deep reinforcement learning,” IEEE Wireless Communications Letters, vol. 10, no. 12, pp. 2820–2823, 2021.
  23. J. Huang, Y. Yang, L. Yin, D. He, and Q. Yan, “Deep reinforcement learning-based power allocation for rate-splitting multiple access in 6G LEO satellite communication system,” IEEE Wireless Communications Letters, vol. 11, no. 10, pp. 2185–2189, 2022.
  24. S. Naser, A. A. Sani, and S. Muhaidat, “Deep reinforcement learning for RSMA-based multi-functional wireless networks,” Authorea Preprints, 2023.
  25. F. B. Mismar, B. L. Evans, and A. Alkhateeb, “Deep reinforcement learning for 5G networks: Joint beamforming, power control, and interference coordination,” IEEE Transactions on Communications, vol. 68, no. 3, pp. 1581–1592, 2019.
  26. M. Vaezi, X. Lin, H. Zhang, W. Saad, and H. V. Poor, “Deep reinforcement learning for interference management in UAV-based 3D networks: Potentials and challenges,” arXiv preprint arXiv:2305.07069, 2023.
  27. M. Diamanti, G. Kapsalis, E. E. Tsiropoulou, and S. Papavassiliou, “Energy-efficient rate-splitting multiple access: A deep reinforcement learning-based framework,” IEEE Open Journal of the Communications Society, 2023.
  28. S. Muy, D. Ron, and J.-R. Lee, “Energy efficiency optimization for SWIPT-based D2D-underlaid cellular networks using multiagent deep reinforcement learning,” IEEE Systems Journal, vol. 16, no. 2, pp. 3130–3138, 2021.
  29. D.-T. Hua, Q. T. Do, N.-N. Dao, T.-V. Nguyen, D. S. Lakew, and S. Cho, “Learning-based reconfigurable intelligent surface-aided rate-splitting multiple access networks,” IEEE Internet of Things Journal, 2023.
  30. C. Huang, R. Mo, and C. Yuen, “Reconfigurable intelligent surface assisted multiuser MISO systems exploiting deep reinforcement learning,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 8, pp. 1839–1850, 2020.
  31. Z. Tang, X. Zhu, H. Zhu, and H. Xu, “Energy efficient optimization algorithm based on reconfigurable intelligent surface and rate splitting multiple access for 6G multicell communication system,” IEEE Internet of Things Journal, 2023.
  32. Y. Mao, B. Clerckx, and V. Li, “Rate-splitting multiple access for cooperative multi-cell networks,” arXiv preprint arXiv:1804.10516, 2018.
  33. R. Lowe, Y. I. Wu, A. Tamar, J. Harb, O. Pieter Abbeel, and I. Mordatch, “Multi-agent actor-critic for mixed cooperative-competitive environments,” Advances in Neural Information Processing Systems, vol. 30, 2017.
  34. T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.
  35. H. Albinsaid, K. Singh, S. Biswas, and C.-P. Li, “Multi-agent reinforcement learning-based distributed dynamic spectrum access,” IEEE Transactions on Cognitive Communications and Networking, vol. 8, no. 2, pp. 1174–1185, 2021.
  36. V. Mnih, K. Kavukcuoglu, D. Silver, et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, no. 7540, pp. 529–533, 2015.
  37. E. A. Jorswieck, E. G. Larsson, and D. Danev, “Complete characterization of the pareto boundary for the MISO interference channel,” IEEE Transactions on Signal Processing, vol. 56, no. 10, pp. 5292–5296, 2008.
  38. M. Sadek, A. Tarighat, and A. H. Sayed, “A leakage-based precoding scheme for downlink multi-user MIMO channels,” IEEE Transactions on Wireless Communications, vol. 6, no. 5, pp. 1711–1721, 2007.
  39. A. Goldsmith, Wireless Communications. Cambridge University Press, 2005.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now