HPE Transformer: Learning to Optimize Multi-Group Multicast Beamforming Under Nonconvex QoS Constraints (2402.16081v1)
Abstract: This paper studies the quality-of-service (QoS) constrained multi-group multicast beamforming design problem, where each multicast group is composed of a number of users requiring the same content. Due to the nonconvex QoS constraints, this problem is nonconvex and NP-hard. While existing optimization-based iterative algorithms can obtain a suboptimal solution, their iterative nature results in large computational complexity and delay. To facilitate real-time implementations, this paper proposes a deep learning-based approach, which consists of a beamforming structure assisted problem transformation and a customized neural network architecture named hierarchical permutation equivariance (HPE) transformer. The proposed HPE transformer is proved to be permutation equivariant with respect to the users within each multicast group, and also permutation equivariant with respect to different multicast groups. Simulation results demonstrate that the proposed HPE transformer outperforms state-of-the-art optimization-based and deep learning-based approaches for multi-group multicast beamforming design in terms of the total transmit power, the constraint violation, and the computational time. In addition, the proposed HPE transformer achieves pretty good generalization performance on different numbers of users, different numbers of multicast groups, and different signal-to-interference-plus-noise ratio targets.
- Y. Li and Y.-F. Liu, “Learning to optimize QoS-constrained multicast beamforming with HPE transformer,” in Proc. IEEE Global Communications Conference (GLOBECOM), 2023.
- N. D. Sidiropoulos, T. N. Davidson, and Z.-Q. Luo, “Transmit beamforming for physical-layer multicasting,” IEEE Trans. Signal Process., vol. 54, no. 6, pp. 2239–2251, Jun. 2006.
- M. Tao, E. Chen, H. Zhou, and W. Yu, “Content-centric sparse multicast beamforming for cache-enabled cloud RAN,” IEEE Trans. Wireless Commun., vol. 15, no. 9, pp. 6118–6131, Sep. 2016.
- Y. Li, M. Xia, and Y.-C. Wu, “First-order algorithm for content-centric sparse multicast beamforming in large-scale C-RAN,” IEEE Trans. Wireless Commun., vol. 17, no. 9, pp. 5959–5974, Sep. 2018.
- B. Dai, Y.-F. Liu, and W. Yu, “Optimized base-station cache allocation for cloud radio access network with multicast backhaul,” IEEE J. Sel. Areas Commun., vol. 36, no. 8, pp. 1737–1750, Aug. 2018.
- Y. Li, M. Xia, and Y.-C. Wu, “Caching at base stations with multi-cluster multicast wireless backhaul via accelerated first-order algorithms,” IEEE Trans. Wireless Commun., vol. 19, no. 5, pp. 2920–2933, May 2020.
- A. Abdelkader, A. B. Gershman, and N. D. Sidiropoulos, “Multiple-antenna multicasting using channel orthogonalization and local refinement,” IEEE Trans. Signal Process., vol. 58, no. 7, pp. 3922–3927, Jul. 2010.
- I. H. Kim, D. J. Love, and S. Y. Park, “Optimal and successive approaches to signal design for multiple antenna physical layer multicasting,” IEEE Trans. Commun., vol. 59, no. 8, pp. 2316–2327, Aug. 2011.
- S. X. Wu, W.-K. Ma, and A. M.-C. So, “Physical-layer multicasting by stochastic transmit beamforming and Alamouti space-time coding,” IEEE Trans. Signal Process., vol. 61, no. 17, pp. 4230–4245, Sep. 2013.
- C. Lu and Y.-F. Liu, “An efficient global algorithm for single-group multicast beamforming,” IEEE Trans. Signal Process., vol. 65, no. 14, pp. 3761–3774, Jul. 2017.
- E. Karipidis, N. Sidiropoulos, and Z.-Q. Luo, “Quality of service and max-min fair transmit beamforming to multiple cochannel multicast groups,” IEEE Trans. Signal Process., vol. 56, no. 3, pp. 1268–1279, Mar. 2008.
- T.-H. Chang, Z.-Q. Luo, and C.-Y. Chi, “Approximation bounds for semidefinite relaxation of max-min-fair multicast transmit beamforming problem,” IEEE Trans. Signal Process., vol. 56, no. 8, pp. 3932–3943, Aug. 2008.
- D. Christopoulos, S. Chatzinotas, and B. Ottersten, “Weighted fair multicast multigroup beamforming under per-antenna power constraints,” IEEE Trans. Signal Process., vol. 62, no. 19, pp. 5132–5142, Oct. 2014.
- Z. Xiang, M. Tao, and X. Wang, “Coordinated multicast beamforming in multicell networks,” IEEE Trans. Wireless Commun., vol. 12, no. 1, pp. 12–31, Jan. 2013.
- E. Chen, M. Tao, and Y.-F. Liu, “Joint base station clustering and beamforming for non-orthogonal multicast and unicast transmission with backhaul constraints,” IEEE Trans. Wireless Commun., vol. 17, no. 9, pp. 6265–6279, Sep. 2018.
- Y. Li, M. Xia, and Y.-C. Wu, “Energy-efficient precoding for non-orthogonal multicast and unicast transmission via first-order algorithm,” IEEE Trans. Wireless Commun., vol. 18, no. 9, pp. 4590–4604, Sep. 2019.
- Z. Zhang, M. Tao, and Y.-F. Liu, “Learning to beamform in joint multicast and unicast transmission with imperfect CSI,” IEEE Trans. Commun., vol. 71, no. 5, pp. 2711–2723, May 2023.
- Y.-F. Liu, T.-H. Chang, M. Hong, Z. Wu, A. M.-C. So, E. A. Jorswieck, and W. Yu, “A survey of advances in optimization methods for wireless communication system design,” 2024. [Online]. Available: https://arxiv.org/abs/2401.12025
- Z.-Q. Luo, N. D. Sidiropoulos, P. Tseng, and S. Zhang, “Approximation bounds for quadratic optimization with homogeneous quadratic constraints,” SIAM J. Optim., vol. 18, no. 1, pp. 1–28, 2007.
- A. L. Yuille and A. Rangarajan, “The concave-convex procedure,” Neural Comput., vol. 15, no. 4, pp. 915–936, Apr. 2003.
- L.-N. Tran, M. F. Hanif, and M. Juntti, “A conic quadratic programming approach to physical layer multicasting for large-scale antenna arrays,” IEEE Signal Process. Lett., vol. 21, no. 1, pp. 114–117, Jan. 2014.
- D. Christopoulos, S. Chatzinotas, and B. Ottersten, “Multicast multigroup beamforming for per-antenna power constrained large-scale arrays,” in Proc. IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), 2015.
- M. Sadeghi, L. Sanguinetti, R. Couillet, and C. Yuen, “Reducing the computational complexity of multicasting in large-scale antenna systems,” IEEE Trans. Wireless Commun., vol. 16, no. 5, pp. 2963–2975, May 2017.
- E. Chen and M. Tao, “ADMM-based fast algorithm for multi-group multicast beamforming in large-scale wireless systems,” IEEE Trans. Commun., vol. 65, no. 6, pp. 2685–2698, Jun. 2017.
- N. Mohamadi, M. Dong, and S. ShahbazPanahi, “Low-complexity ADMM-based algorithm for robust multi-group multicast beamforming in large-scale systems,” IEEE Trans. Signal Process., vol. 70, pp. 2046–2061, 2022.
- C. Zhang, M. Dong, and B. Liang, “Ultra-low-complexity algorithms with structurally optimal multi-group multicast beamforming in large-scale systems,” IEEE Trans. Signal Process., vol. 71, pp. 1626–1641, 2023.
- H. Sun, X. Chen, Q. Shi, M. Hong, X. Fu, and N. D. Sidiropoulos, “Learning to optimize: Training deep neural networks for interference management,” IEEE Trans. Signal Process., vol. 66, no. 20, pp. 5438–5453, Oct. 2018.
- F. Liang, C. Shen, W. Yu, and F. Wu, “Towards optimal power control via ensembling deep neural networks,” IEEE Trans. Commun., vol. 68, no. 3, pp. 1760–1776, Mar. 2020.
- M. Eisen and A. Ribeiro, “Optimal wireless resource allocation with random edge graph neural networks,” IEEE Trans. Signal Process., vol. 68, pp. 2977–2991, 2020.
- Y. Shen, Y. Shi, J. Zhang, and K. B. Letaief, “Graph neural networks for scalable radio resource management: Architecture design and theoretical analysis,” IEEE J. Sel. Areas Commun., vol. 39, no. 1, pp. 101–115, Jan. 2021.
- J. Guo and C. Yang, “Learning power allocation for multi-cell-multi-user systems with heterogeneous graph neural network,” IEEE Trans. Wireless Commun., vol. 21, no. 2, pp. 884–897, Feb. 2022.
- Y. Wang, Y. Li, Q. Shi, and Y.-C. Wu, “ENGNN: A general edge-update empowered GNN architecture for radio resource management in wireless networks,” IEEE Trans. Wireless Commun., 2023, doi:10.1109/TWC.2023.3325735.
- Z. Zhang, M. Tao, and Y.-F. Liu, “Learning to beamform in multi-group multicast with imperfect CSI,” in Proc. IEEE International Conference on Wireless Communications and Signal Processing (WCSP), 2022.
- L. Xiao, Y. Ding, J. Huang, S. Liu, Y. Tang, and H. Dai, “UAV anti-jamming video transmissions with QoE guarantee: A reinforcement learning-based approach,” IEEE Trans. Commun., vol. 69, no. 9, pp. 5933–5947, Sep. 2021.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” in Proc. Advances in Neural Information Processing Systems, 2017.
- Z. Ye, J. Zhou, Q. Guo, Q. Gan, and Z. Zhang, “Transformer as a graph neural network.” [Online]. Available: https://docs.dgl.ai/en/0.8.x/tutorials/models/4_old_wines/7_transformer.html.
- Y. Li, Z. Chen, Y. Wang, C. Yang, B. Ai, and Y.-C. Wu, “Heterogeneous transformer: A scale adaptable neural network architecture for device activity detection,” IEEE Trans. Wireless Commun., vol. 22, no. 5, pp. 3432–3446, May 2023.
- Y. Li, Z. Chen, G. Liu, Y.-C. Wu, and K.-K. Wong, “Learning to construct nested polar codes: An attention-based set-to-element model,” IEEE Commun. Lett., vol. 25, no. 12, pp. 3898–3902, Dec. 2021.
- M. Dong and Q. Wang, “Multi-group multicast beamforming: Optimal structure and efficient algorithms,” IEEE Trans. Signal Process., vol. 68, pp. 3738–3753, 2020.
- R. Umagami, Y. Ono, Y. Mukuta, and T. Harada, “Hiperformer: Hierarchically permutation-equivariant transformer for time series forecasting,” 2023. [Online]. Available: https://arxiv.org/pdf/2305.08073
- K. G. Murty and S. N. Kabadi, “Some NP-complete problems in quadratic and nonlinear programming,” Math. Program., vol. 39, no. 2, pp. 117–129, 1987.
- A. Chowdhury, G. Verma, C. Rao, A. Swami, and S. Segarra, “Unfolding WMMSE using graph neural networks for efficient power allocation,” IEEE Trans. Wireless Commun., vol. 20, no. 9, pp. 6004–6017, Sep. 2021.
- J. Ba, J. Kiros, and G. E. Hinton, “Layer normalization,” 2016. [Online]. Available: https://arxiv.org/abs/1607.06450.
- E. Busseti, W. M. Moursi, and S. Boyd, “Solution refinement at regular points of conic problems,” Comput. Optim. Appl., vol. 74, no. 3, pp. 627–643, 2019.
- P. L. Donti, D. Rolnick, and J. Z. Kolter, “DC3: A learning method for optimization with hard constraints,” in Proc. International Conference on Learning Representations (ICLR), 2021.
- K. You, M. Long, J. Wang, and M. I. Jordan, “How does learning rate decay help modern neural networks?” 2019. [Online]. Available: https://arxiv.org/abs/1908.01878.
- B. Peng, K.-L. Besser, R. Raghunath, and E. A. Jorswieck, “Approaching globally optimal energy efficiency in interference networks via machine learning,” IEEE Trans. Wireless Commun., vol. 22, no. 12, pp. 9313–9326, Dec. 2023.
- Z. Zhang, C. Niu, P. Cui, J. Pei, B. Zhang, and W. Zhu, “Permutation-equivariant and proximity-aware graph neural networks with stochastic message passing,” IEEE Trans. Knowl. Data Eng., vol. 35, no. 6, pp. 6182–6193, Jun. 2023.
- Y. Li, Y. Tian, and C. Yang, “Energy-efficient coordinated beamforming under minimal data rate constraint of each user,” IEEE Trans. Veh. Technol., vol. 64, no. 6, pp. 2387–2397, Jun. 2015.