Towards Energy-Aware Federated Traffic Prediction for Cellular Networks (2309.10645v1)
Abstract: Cellular traffic prediction is a crucial activity for optimizing networks in fifth-generation (5G) networks and beyond, as accurate forecasting is essential for intelligent network design, resource allocation and anomaly mitigation. Although ML is a promising approach to effectively predict network traffic, the centralization of massive data in a single data center raises issues regarding confidentiality, privacy and data transfer demands. To address these challenges, federated learning (FL) emerges as an appealing ML training framework which offers high accurate predictions through parallel distributed computations. However, the environmental impact of these methods is often overlooked, which calls into question their sustainability. In this paper, we address the trade-off between accuracy and energy consumption in FL by proposing a novel sustainability indicator that allows assessing the feasibility of ML models. Then, we comprehensively evaluate state-of-the-art deep learning (DL) architectures in a federated scenario using real-world measurements from base station (BS) sites in the area of Barcelona, Spain. Our findings indicate that larger ML models achieve marginally improved performance but have a significant environmental impact in terms of carbon footprint, which make them impractical for real-world applications.
- M. Attaran, “The impact of 5G on the evolution of intelligent automation and industry digitization,” Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 5, pp. 5977–5993, May 2023. [Online]. Available: https://doi.org/10.1007/s12652-020-02521-x
- A. Aissioui, A. Ksentini, A. M. Gueroui, and T. Taleb, “On enabling 5g automotive systems using follow me edge-cloud concept,” IEEE Transactions on Vehicular Technology, vol. 67, pp. 5302–5316, 2018.
- S. Dananjayan and G. M. Raj, “5G in healthcare: how fast will be the transformation?” Irish Journal of Medical Science (1971 -), vol. 190, no. 2, pp. 497–501, May 2021. [Online]. Available: https://doi.org/10.1007/s11845-020-02329-w
- V. Perifanis and P. S. Efraimidis, “Federated neural collaborative filtering,” Knowledge-Based Systems, vol. 242, p. 108441, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0950705122001812
- M. Miozzo, Z. Ali, L. Giupponi, and P. Dini, “Distributed and multi-task learning at the edge for energy efficient radio access networks,” IEEE Access, vol. 9, pp. 12 491–12 505, 2021.
- C. Zhang and P. Patras, “Long-term mobile traffic forecasting using deep spatio-temporal neural networks,” in Proceedings of the Eighteenth ACM MobiHoc, 2018, pp. 231–240.
- J. Nan, M. Ai, A. Liu, and X. Duan, “Regional-union based federated learning for wireless traffic prediction in 5g-advanced/6g network,” in 2022 IEEE/CIC International Conference on Communications in China (ICCC Workshops), 2022, pp. 423–427.
- A. Zeng, M. Chen, L. Zhang, and Q. Xu, “Are transformers effective for time series forecasting?” in Proceedings of the AAAI conference on artificial intelligence, vol. 37, no. 9, 2023, pp. 11 121–11 128.
- Y. Zhang and J. Yan, “Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting,” in The Eleventh International Conference on Learning Representations, 2023.
- T. Subramanya and R. Riggio, “Centralized and federated learning for predictive vnf autoscaling in multi-domain 5g networks and beyond,” IEEE TSNM, vol. 18, no. 1, pp. 63–78, 2021.
- N. Piovesan, A. De Domenico, M. Bernabé, D. López-Pérez, H. Baohongqiang, G. Xinli, W. Xie, and M. Debbah, “Forecasting mobile traffic to achieve greener 5g networks: When machine learning is key,” in 2021 IEEE 22nd SPAWC, 2021, pp. 276–280.
- V. Perifanis, N. Pavlidis, R.-A. Koutsiamanis, and P. S. Efraimidis, “Federated learning for 5g base station traffic forecasting,” Computer Networks, vol. 235, p. 109950, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S138912862300395X
- S. Deng, H. Zhao, W. Fang, J. Yin, S. Dustdar, and A. Y. Zomaya, “Edge intelligence: The confluence of edge computing and artificial intelligence,” IEEE Internet of Things Journal, vol. 7, no. 8, pp. 7457–7469, 2020.
- E. Ahvar, A.-C. Orgerie, and A. Lebre, “Estimating energy consumption of cloud, fog, and edge computing infrastructures,” IEEE Transactions on Sustainable Computing, vol. 7, no. 2, pp. 277–288, 2022.
- B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y. Arcas, “Communication-Efficient Learning of Deep Networks from Decentralized Data,” in Proceedings of the 20th AISTATS, vol. 54. PMLR, 20–22 Apr 2017, pp. 1273–1282.
- Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, and J. Zhang, “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,” Proceedings of the IEEE, vol. 107, no. 8, pp. 1738–1762, 2019.
- S. Savazzi, V. Rampa, S. Kianoush, and M. Bennis, “An energy and carbon footprint analysis of distributed and federated learning,” IEEE Transactions on Green Communications and Networking, vol. 7, no. 1, pp. 248–264, 2023.
- C.-J. Wu, R. Raghavendra, U. Gupta, B. Acun, N. Ardalani, K. Maeng, G. Chang, F. Aga, J. Huang, C. Bai, M. Gschwind, A. Gupta, M. Ott, A. Melnikov, and S. Candido, “Sustainable ai: Environmental implications, challenges and opportunities,” in Proceedings of Machine Learning and Systems, vol. 4, 2022, pp. 795–813.
- E. Strubell, A. Ganesh, and A. McCallum, “Energy and policy considerations for deep learning in NLP,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Florence, Italy: Association for Computational Linguistics, Jul. 2019, pp. 3645–3650. [Online]. Available: https://aclanthology.org/P19-1355
- B. Meulemeester and D. Martens, “How sustainable is “common” data science in terms of power consumption?” Sustainable Computing: Informatics and Systems, vol. 38, p. 100864, 2023.
- GSMA, “The mobile economy 2020,” Technical Report, 2020. [Online]. Available: https://www.gsma.com/mobileeconomy/
- J. L. Bejarano-Luque, M. Toril, M. Fernández-Navarro, C. Gijón, and S. Luna-Ramírez, “A deep-learning model for estimating the impact of social events on traffic demand on a cell basis,” IEEE Access, vol. 9, pp. 71 673–71 686, 2021.
- R. K. Gupta, A. Ranjan, M. A. Moid, and R. Misra, “Deep-Learning Based Mobile-Traffic Forecasting for Resource Utilization in 5G Network Slicing,” in Internet of Things and Connected Technologies, ser. Advances in Intelligent Systems and Computing. Cham: Springer International Publishing, 2021, pp. 410–424.
- C. Zhang, S. Dang, B. Shihada, and M.-S. Alouini, “Dual attention-based federated learning for wireless traffic prediction,” in IEEE INFOCOM 2021 - IEEE Conference on Computer Communications, 2021, pp. 1–10.
- G. Barlacchi, M. De Nadai, R. Larcher, A. Casella, C. Chitic, G. Torrisi, F. Antonelli, A. Vespignani, A. Pentland, and B. Lepri, “A multi-source dataset of urban life in the city of Milan and the Province of Trentino,” Scientific Data, vol. 2, no. 1, p. 150055, Oct. 2015. [Online]. Available: https://www.nature.com/articles/sdata201555
- L. Zhang, C. Zhang, and B. Shihada, “Efficient wireless traffic prediction at the edge: A federated meta-learning approach,” IEEE Communications Letters, vol. 26, no. 7, pp. 1573–1577, 2022.
- A. van Wynsberghe, “Sustainable AI: AI for sustainability and the sustainability of AI,” AI and Ethics, vol. 1, no. 3, pp. 213–218, Aug. 2021. [Online]. Available: https://doi.org/10.1007/s43681-021-00043-6
- A. E. Brownlee, J. Adair, S. O. Haraldsson, and J. Jabbo, “Exploring the accuracy – energy trade-off in machine learning,” in 2021 IEEE/ACM International Workshop on Genetic Improvement (GI), 2021, pp. 11–18.
- E. Guerra, F. Wilhelmi, M. Miozzo, and P. Dini, “The cost of training machine learning models over distributed data sources,” IEEE Open Journal of the Communications Society, vol. 4, pp. 1111–1126, 2023.
- R. Schwartz, J. Dodge, N. A. Smith, and O. Etzioni, “Green ai,” Commun. ACM, vol. 63, no. 12, p. 54–63, nov 2020.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. u. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in Neural Information Processing Systems, vol. 30. Curran Associates, Inc., 2017. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf