Cell-Free XL-MIMO Meets Multi-Agent Reinforcement Learning: Architectures, Challenges, and Future Directions (2307.02827v2)
Abstract: Cell-free massive multiple-input multiple-output (mMIMO) and extremely large-scale MIMO (XL-MIMO) are regarded as promising innovations for the forthcoming generation of wireless communication systems. Their significant advantages in augmenting the number of degrees of freedom have garnered considerable interest. In this article, we first review the essential opportunities and challenges induced by XL-MIMO systems. We then propose the enhanced paradigm of cell-free XL-MIMO, which incorporates multi-agent reinforcement learning (MARL) to provide a distributed strategy for tackling the problem of high-dimension signal processing and costly energy consumption. Based on the unique near-field characteristics, we propose two categories of the low-complexity design, i.e., antenna selection and power control, to adapt to different cell-free XL-MIMO scenarios and achieve the maximum data rate. For inspiration, several critical future research directions pertaining to green cell-free XL-MIMO systems are presented.
- J. Zhang, E. Björnson, M. Matthaiou, D. W. K. Ng, H. Yang, and D. J. Love, “Prospective multiple antenna technologies for beyond 5G,” IEEE J. Sel. Areas Commun., vol. 38, no. 8, pp. 1637–1660, Aug. 2020.
- M. Matthaiou, O. Yurduseven, H. Q. Ngo, D. Morales-Jimenez, S. L. Cotton, and V. F. Fusco, “The road to 6G: Ten physical layer challenges for communications engineers,” IEEE Commun. Mag., vol. 59, no. 1, pp. 64–69, Jan. 2021.
- H. Iimori, T. Takahashi, K. Ishibashi, G. T. F. de Abreu, D. González G., and O. Gonsa, “Joint activity and channel estimation for extra-large MIMO systems,” IEEE Trans. Wireless Commun., vol. 21, no. 9, pp. 7253–7270, 2022.
- Z. Wang, J. Zhang, H. Du, W. E. I. Sha, B. Ai, D. Niyato, and M. Debbah, “Extremely large-scale MIMO: Fundamentals, challenges, solutions, and future directions,” IEEE Wireless Commun., pp. 1–9, early access, 2023.
- H. Zhang, N. Shlezinger, F. Guidi, D. Dardari, and Y. C. Eldar, “6G wireless communications: From far-field beam steering to near-field beam focusing,” IEEE Commun. Mag., vol. 61, no. 4, pp. 72–77, Apr. 2023.
- C. Huang, S. Hu, G. C. Alexandropoulos, A. Zappone, C. Yuen, R. Zhang, M. D. Renzo, and M. Debbah, “Holographic MIMO surfaces for 6G wireless networks: Opportunities, challenges, and trends,” IEEE Wireless Commun., vol. 27, no. 5, pp. 118–125, July 2020.
- Y. Liu, J. Xu, Z. Wang, X. Mu, and L. Hanzo, “Near-field communications: What will be different?” arXiv:2303.04003, 2023.
- M. Cui, Z. Wu, Y. Lu, X. Wei, and L. Dai, “Near-field MIMO communications for 6G: Fundamentals, challenges, potentials, and future directions,” IEEE Commun. Mag., vol. 61, no. 1, pp. 40–46, 2023.
- S. Hwang, H. Lee, J. Park, and I. Lee, “Decentralized computation offloading with cooperative UAVs: Multi-agent deep reinforcement learning perspective,” IEEE Wireless Commun., vol. 29, no. 4, pp. 24–31, Aug. 2022.
- M. Rahmani, M. J. Dehghani, P. Xiao, M. Bashar, and M. Debbah, “Multi-agent reinforcement learning-based pilot assignment for cell-free massive MIMO systems,” IEEE Access, vol. 10, pp. 120 492–120 502, Nov. 2022.
- Q. Fan, Y. Zhang, Z. Wang, J. Li, P. Zhu, and D. Wang, “MADDPG-based power allocation algorithm for network-assisted full-duplex cell-free mmwave massive MIMO systems with DAC quantization,” in Proc. 2022 WCSP, 2022, pp. 556–561.
- H. Lu and Y. Zeng, “Communicating with extremely large-scale array/surface: Unified modeling and performance analysis,” IEEE Trans. Wireless Commun., vol. 21, no. 6, pp. 4039–4053, June 2022.
- Z. Liu, Z. Liu, J. Zhang, H. Xiao, B. Ai, and D. W. K. Ng, “Uplink power control for extremely large-scale MIMO with multi-agent reinforcement learning and fuzzy logic,” in IEEE INFOCOM 2023 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Hoboken, NJ, USA, 2023, pp. 1–6.
- J. C. Marinello, T. Abrão, A. Amiri, E. de Carvalho, and P. Popovski, “Antenna selection for improving energy efficiency in XL-MIMO systems,” IEEE Trans. Veh. Technol., vol. 69, no. 11, pp. 13 305–13 318, Nov. 2020.
- X. Chai, H. Gao, J. Sun, X. Su, T. Lv, and J. Zeng, “Reinforcement learning based antenna selection in user-centric massive MIMO,” in Proc. IEEE VTC2020-Spring, 2020, pp. 1–6.