A Semantic-Aware Multiple Access Scheme for Distributed, Dynamic 6G-Based Applications (2401.06308v2)
Abstract: The emergence of the semantic-aware paradigm presents opportunities for innovative services, especially in the context of 6G-based applications. Although significant progress has been made in semantic extraction techniques, the incorporation of semantic information into resource allocation decision-making is still in its early stages, lacking consideration of the requirements and characteristics of future systems. In response, this paper introduces a novel formulation for the problem of multiple access to the wireless spectrum. It aims to optimize the utilization-fairness trade-off, using the $\alpha$-fairness metric, while accounting for user data correlation by introducing the concepts of self- and assisted throughputs. Initially, the problem is analyzed to identify its optimal solution. Subsequently, a Semantic-Aware Multi-Agent Double and Dueling Deep Q-Learning (SAMA-D3QL) technique is proposed. This method is grounded in Model-free Multi-Agent Deep Reinforcement Learning (MADRL), enabling the user equipment to autonomously make decisions regarding wireless spectrum access based solely on their local individual observations. The efficiency of the proposed technique is evaluated through two scenarios: single-channel and multi-channel. The findings illustrate that, across a spectrum of $\alpha$ values, association matrices, and channels, SAMA-D3QL consistently outperforms alternative approaches. This establishes it as a promising candidate for facilitating the realization of future federated, dynamically evolving applications.
- M. Shokrnezhad, H. Mazandarani, and T. Taleb, “Semantic Revolution from Communications to Orchestration for 6G: Challenges, Possibilities, and Research Directions,” in IEEE Network, 2023, (Under Review).
- H. Yu, M. Shokrnezhad et al., “Towards 6G-Based Metaverse: Supporting Highly-Dynamic Deterministic Multi-User Extended Reality Services,” in IEEE Network. IEEE, 2023.
- A. Kirillov, E. Mintun et al., “Segment Anything,” arXiv preprint arXiv:2304.02643, 2023.
- X. Zhao, W. Ding et al., “Fast Segment Anything,” arXiv preprint arXiv:2306.12156, 2023.
- Y. Lin, C. Wu et al., “Meta-Networking: Beyond the Shannon Limit with Multi-faceted Information, Semantic Communication, IoV, Multi-Faceted Information,” IEEE Network, vol. 37, no. 4, pp. 256–264, 2023.
- C. Chaccour, W. Saad et al., “Less Data, More Knowledge: Building Next Generation Semantic Communication Networks,” arXiv preprint arXiv:2211.14343, 2022.
- P. Zhang, X. Xu et al., “Model Division Multiple Access for Semantic Communications,” Frontiers of Information Technology & Electronic Engineering, pp. 1–12, 2023.
- R. Kassab, A. Destounis et al., “Multi-Agent Deep Stochastic Policy Gradient for Event Based Dynamic Spectrum Access,” in 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications. IEEE, 2020, pp. 1–6.
- H. Xie, Z. Qin et al., “Task-Oriented Multi-User Semantic Communications,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 9, pp. 2584–2597, 2022.
- W. Zhang, K. Bai et al., “Deepma: End-to-end Deep Multiple Access for Wireless Image Transmission in Semantic Communication,” IEEE Transactions on Cognitive Communications and Networking, 2023.
- S. Gronauer and K. Diepold, “Multi-Agent Deep Reinforcement Learning: A Survey,” Artificial Intelligence Review, pp. 1–49, 2022.
- O. Naparstek and K. Cohen, “Deep Multi-User Reinforcement Learning for Distributed Dynamic Spectrum Access,” IEEE Transactions on wireless communications, vol. 18, no. 1, pp. 310–323, 2018.
- M. Sohaib, J. Jeong, and S.-W. Jeon, “Dynamic Multi-Channel Access via Multi-Agent Reinforcement Learning: Throughput and Fairness Guarantees,” IEEE Transactions on Wireless Communications, vol. 21, no. 6, pp. 3994–4008, 2021.
- Z. Guo, Z. Chen et al., “Multi-Agent Reinforcement Learning-Based Distributed Channel Access for Next Generation Wireless Networks,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 5, pp. 1587–1599, 2022.
- T. Rashid, M. Samvelyan et al., “Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning,” The Journal of Machine Learning Research, vol. 21, no. 1, pp. 7234–7284, 2020.
- H. Mazandarani, M. Shokrnezhad, and T. Taleb, “Self-Sustaining Multiple Access with Symmetry-aware Continual Deep Reinforcement Learning for Dynamic Metaverse Applications,” in IEEE Transactions on Mobile Computing (TMC), 2023, (Under Review).
- H. Mazandarani, M. Shokrnezhad, T. Taleb, and R. Li, “Self-Sustaining Multiple Access with Continual Deep Reinforcement Learning for Dynamic Metaverse Applications,” IEEE MetaCom, Kyoto, 2023.
- M. Farhoudi, M. Shokrnezhad, and T. Taleb, “QoS-Aware Service Prediction and Orchestration in Cloud-Network Integrated Beyond 5G,” arXiv preprint arXiv:2309.10185, 2023.
- M. Shokrnezhad, T. Taleb, and P. Dazzi, “Double Deep Q-Learning-based Path Selection and Service Placement for Latency-Sensitive Beyond 5G Applications,” IEEE Transactions on Mobile Computing, pp. 1–14, 2023.
- P. Sunehag, G. Lever et al., “Value-Decomposition Networks for Cooperative Multi-Sgent Learning,” arXiv preprint arXiv:1706.05296, 2017.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.