Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Network-Assisted Full-Duplex Cell-Free mmWave Networks: Hybrid MIMO Processing and Multi-Agent DRL-Based Power Allocation (2404.00631v1)

Published 31 Mar 2024 in cs.IT, cs.MA, eess.SP, and math.IT

Abstract: This paper investigates the network-assisted full-duplex (NAFD) cell-free millimeter-wave (mmWave) networks, where the distribution of the transmitting access points (T-APs) and receiving access points (R-APs) across distinct geographical locations mitigates cross-link interference, facilitating the attainment of a truly flexible duplex mode. To curtail deployment expenses and power consumption for mmWave band operations, each AP incorporates a hybrid digital-analog structure encompassing precoder/combiner functions. However, this incorporation introduces processing intricacies within channel estimation and precoding/combining design. In this paper, we first present a hybrid multiple-input multiple-output (MIMO) processing framework and derive explicit expressions for both uplink and downlink achievable rates. Then we formulate a power allocation problem to maximize the weighted bidirectional sum rates. To tackle this non-convex problem, we develop a collaborative multi-agent deep reinforcement learning (MADRL) algorithm called multi-agent twin delayed deep deterministic policy gradient (MATD3) for NAFD cell-free mmWave networks. Specifically, given the tightly coupled nature of both uplink and downlink power coefficients in NAFD cell-free mmWave networks, the MATD3 algorithm resolves such coupled conflicts through an interactive learning process between agents and the environment. Finally, the simulation results validate the effectiveness of the proposed channel estimation methods within our hybrid MIMO processing paradigm, and demonstrate that our MATD3 algorithm outperforms both multi-agent deep deterministic policy gradient (MADDPG) and conventional power allocation strategies.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. H. Q. Ngo, A. Ashikhmin, H. Yang, E. G. Larsson, and T. L. Marzetta, “Cell-free massive MIMO versus small cells,” IEEE Trans. Wirel. Commun., vol. 16, no. 3, pp. 1834–1850, Mar. 2017.
  2. J. Kassam, D. Castanheira, A. Silva, R. Dinis, and A. Gameiro, “Distributed hybrid equalization for cooperative millimeter-wave cell-free massive MIMO,” IEEE Trans. Commun., vol. 70, no. 8, pp. 5300–5316, Aug. 2022.
  3. M. Alonzo, S. Buzzi, A. Zappone, and C. D’Elia, “Energy-efficient power control in cell-free and user-centric massive MIMO at millimeter wave,” IEEE Trans. Green Commun. Netw., vol. 3, no. 3, pp. 651–663, Sept. 2019.
  4. G. Femenias and F. Riera-Palou, “Cell-free millimeter-wave massive MIMO systems with limited fronthaul capacity,” IEEE Access, vol. 7, pp. 44 596–44 612, Mar. 2019.
  5. Y. Jin, J. Zhang, S. Jin, and B. Ai, “Channel estimation for cell-free mmwave massive MIMO through deep learning,” IEEE Trans. Veh. Technol., vol. 68, no. 10, pp. 10 325–10 329, Oct. 2019.
  6. U. Demirhan and A. Alkhateeb, “Enabling cell-free massive MIMO systems with wireless millimeter wave fronthaul,” IEEE Trans. Wirel. Commun., vol. 21, no. 11, pp. 9482–9496, Nov. 2022.
  7. J. Wang, B. Wang, J. Fang, and H. Li, “Millimeter wave cell-free massive MIMO systems: Joint beamforming and AP-user association,” IEEE Wireless Commun. Lett., vol. 11, no. 2, pp. 298–302, Feb. 2022.
  8. G. Liu, H. Deng, X. Qian, W. Zhang, and H. Dong, “Joint pilot and data power control for cell-free massive MIMO IoT systems,” IEEE Sens. J., vol. 22, no. 24, pp. 24 647–24 657, Dec. 2022.
  9. R. Jia, K. Xu, X. Xia, Z. Shen, W. Xie, and N. Sha, “Time-sequential cooperative localization for moving sensor in millimeter-wave cell-free massive MIMO system,” IEEE Sens. J., vol. 22, no. 22, pp. 22 008–22 019, Nov. 2022.
  10. T. S. Rappaport, S. Sun, R. Mayzus, H. Zhao, Y. Azar, K. Wang, G. N. Wong, J. K. Schulz, M. Samimi, and F. Gutierrez, “Millimeter wave mobile communications for 5G cellular: It will work!” IEEE Access, vol. 1, pp. 335–349, May. 2013.
  11. S. Sun, T. S. Rappaport, M. Shafi, and H. Tataria, “Analytical framework of hybrid beamforming in multi-cell millimeter-wave systems,” IEEE Trans. Wirel. Commun., vol. 17, no. 11, pp. 7528–7543, Nov. 2018.
  12. R. W. Heath, N. Gonzalez-Prelcic, S. Rangan, W. Roh, and A. M. Sayeed, “An overview of signal processing techniques for millimeter wave MIMO systems,” IEEE J. Sel. Topics Signal Process., vol. 10, no. 3, pp. 436–453, Apr. 2016.
  13. W. Ni, X. Dong, and W.-S. Lu, “Near-optimal hybrid processing for massive MIMO systems via matrix decomposition,” IEEE Trans. Signal Process., vol. 65, no. 15, pp. 3922–3933, Aug. 2017.
  14. A. Sabharwal, P. Schniter, D. Guo, D. W. Bliss, S. Rangarajan, and R. Wichman, “In-band full-duplex wireless: Challenges and opportunities,” IEEE J. Sel. Areas Commun., vol. 32, no. 9, pp. 1637–1652, Sept. 2014.
  15. H. V. Nguyen, V.-D. Nguyen, O. A. Dobre, S. K. Sharma, S. Chatzinotas, B. Ottersten, and O.-S. Shin, “On the spectral and energy efficiencies of full-duplex cell-free massive MIMO,” IEEE J. Sel. Areas Commun., vol. 38, no. 8, pp. 1698–1718, Aug. 2020.
  16. D. Wang, M. Wang, P. Zhu, J. Li, J. Wang, and X. You, “Performance of network-assisted full-duplex for cell-free massive MIMO,” IEEE Trans. Commun., vol. 68, no. 3, pp. 1464–1478, Mar. 2020.
  17. M. Mohammadi, T. T. Vu, H. Q. Ngo, and M. Matthaiou, “Network-assisted full-duplex cell-free massive MIMO: Spectral and energy efficiencies,” IEEE J. Sel. Areas Commun., Jun. 2023.
  18. S. Fukue, G. T. Freitas de Abreu, and K. Ishibashi, “Network-assisted full-duplex millimeter-wave cell-free massive MIMO with localization-aided inter-user channel estimation,” in 2023 International Conference on Information Networking (ICOIN), Bangkok, Thailand, Jan. 2023, pp. 13–18.
  19. X. Xia, P. Zhu, J. Li, D. Wang, Y. Xin, and X. You, “Joint sparse beamforming and power control for a large-scale DAS with network-assisted full duplex,” IEEE Trans. Veh. Technol., vol. 69, no. 7, pp. 7569–7582, Jul. 2020.
  20. J. Li, Q. Lv, P. Zhu, D. Wang, J. Wang, and X. You, “Network-assisted full-duplex distributed massive MIMO systems with beamforming training based CSI estimation,” IEEE Trans. Wireless Commun., vol. 20, no. 4, pp. 2190–2204, 2020.
  21. J. Li, Q. Fan, Y. Zhang, P. Zhu, D. Wang, H. Wu, and X. You, “Network-assisted full-duplex cell-free mmWave massive MIMO systems with DAC quantization and fronthaul compression,” accepted by China Communications, 2023. [Online]. Available: https://arxiv.org/abs/2302.05571
  22. Q. Fan, Y. Zhang, Z. Wang, J. Li, P. Zhu, and D. Wang, “MADDPG-based power allocation algorithm for network-assisted full-duplex cell-free MmWave massive MIMO systems with DAC quantization,” in 14th International Conference on Wireless Communications and Signal Processing (WCSP), Nanjing, China, Nov. 2022, pp. 556–561.
  23. Y. Zhang, D. Wang, Y. Huo, X. Dong, and X. You, “Hybrid beamforming design for mmWave OFDM distributed antenna systems,” Sci. China Inf. Sci., vol. 63, no. 9, pp. 23 011–230 112, Jul. 2020.
  24. M. Biguesh and A. Gershman, “Training-based MIMO channel estimation: a study of estimator tradeoffs and optimal training signals,” IEEE Trans. Signal Process., vol. 54, no. 3, pp. 884–893, Mar. 2006.
  25. S.-E. Hong, “On the effect of shadowing correlation and pilot assignment on hybrid precoding performance for cell-free mmwave massive MIMO UDN system,” ICT Express, vol. 7, no. 1, pp. 60–70, Mar. 2021.
  26. A. Adhikary, E. Al Safadi, M. K. Samimi, R. Wang, G. Caire, T. S. Rappaport, and A. F. Molisch, “Joint spatial division and multiplexing for mm-wave channels,” IEEE J. Sel. Areas Commun., vol. 32, no. 6, pp. 1239–1255, 2014.
  27. S. Park and R. W. Heath, “Spatial channel covariance estimation for the hybrid MIMO architecture: A compressive sensing-based approach,” IEEE Trans. Wirel. Commun., vol. 17, no. 12, pp. 8047–8062, 2018.
  28. I.-s. Kim and J. Choi, “Performance of cell-free MmWave massive MIMO systems with fronthaul compression and DAC quantization,” in 2021 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), Nanjing, China, Mar. 2021, pp. 1–6.
  29. J. Jose, A. Ashikhmin, T. L. Marzetta, and S. Vishwanath, “Pilot contamination and precoding in multi-cell TDD systems,” IEEE Trans. Wirel. Commun., vol. 10, no. 8, pp. 2640–2651, Aug. 2011.
  30. C. Pan, H. Mehrpouyan, Y. Liu, M. Elkashlan, and N. Arumugam, “Joint pilot allocation and robust transmission design for ultra-dense user-centric TDD C-RAN with imperfect CSI,” IEEE Trans. Wirel. Commun., vol. 17, no. 3, pp. 2038–2053, Mar. 2018.
  31. W. Lei, H. Wen, J. Wu, and W. Hou, “MADDPG-based security situational awareness for smart grid with intelligent edge,” Applied Sciences, vol. 11, no. 7, p. 3101, Mar. 2021.
  32. F. Fredj, Y. Al-Eryani, S. Maghsudi, M. Akrout, and E. Hossain, “Distributed beamforming techniques for cell-free wireless networks using deep reinforcement learning,” IEEE Trans. Cogn. Commun. Netw., vol. 8, no. 2, pp. 1186–1201, Jun. 2022.
  33. R. Lowe, Y. Wu, A. Tamar, J. Harb, P. Abbeel, and I. Mordatch, “Multi-agent actor-critic for mixed cooperative-competitive environments,” in Proceedings of the 31st International Conference on Neural Information Processing Systems.   Red Hook, NY, USA: Curran Associates Inc., Dec. 2017, pp. 6382––6393.
  34. J. J. Ackermann, V. Gabler, T. Osa, and M. Sugiyama, “Reducing overestimation bias in multi-agent domains using double centralized critics,” accepted for the Deep RL Workshop at NeurIPS 2019, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:203642167
  35. N. Zhao, Z. Ye, Y. Pei, Y.-C. Liang, and D. Niyato, “Multi-agent deep reinforcement learning for task offloading in UAV-assisted mobile edge computing,” IEEE Trans. Wirel. Commun., vol. 21, no. 9, pp. 6949–6960, Sept. 2022.
  36. M. Fozooni, H. Q. Ngo, M. Matthaiou, S. Jin, and G. C. Alexandropoulos, “Hybrid processing design for multipair massive MIMO relaying with channel spatial correlation,” IEEE Trans. Commun., vol. 67, no. 1, pp. 107–123, Jan. 2019.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now