A Multi-Task Oriented Semantic Communication Framework for Autonomous Vehicles (2403.12997v1)
Abstract: Task-oriented semantic communication is an emerging technology that transmits only the relevant semantics of a message instead of the whole message to achieve a specific task. It reduces latency, compresses the data, and is more robust in low SNR scenarios. This work presents a multi-task-oriented semantic communication framework for connected and autonomous vehicles (CAVs). We propose a convolutional autoencoder (CAE) that performs the semantic encoding of the road traffic signs. These encoded images are then transmitted from one CAV to another CAV through satellite in challenging weather conditions where visibility is impaired. In addition, we propose task-oriented semantic decoders for image reconstruction and classification tasks. Simulation results show that the proposed framework outperforms the conventional schemes, such as QAM-16, regarding the reconstructed image's similarity and the classification's accuracy. In addition, it can save up to 89 % of the bandwidth by sending fewer bits.
- D. Gündüz, Z. Qin, I. E. Aguerri, H. S. Dhillon, Z. Yang, A. Yener, K. K. Wong, and C.-B. Chae, “Beyond transmitting bits: Context, semantics, and task-oriented communications,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 1, pp. 5–41, 2023.
- W. Xu, Y. Zhang, F. Wang, Z. Qin, C. Liu, and P. Zhang, “Semantic communication for the internet of vehicles: A multiuser cooperative approach,” IEEE Vehicular Technology Magazine, vol. 18, no. 1, pp. 100–109, 2023.
- M. Noor-A-Rahim, Z. Liu, H. Lee, M. O. Khyam, J. He, D. Pesch, K. Moessner, W. Saad, and H. V. Poor, “6G for vehicle-to-everything (V2X) communications: Enabling technologies, challenges, and opportunities,” Proceedings of the IEEE, vol. 110, no. 6, pp. 712–734, 2022.
- P. M. de Sant Ana, N. Marchenko, B. Soret, and P. Popovski, “Goal-oriented wireless communication for a remotely controlled autonomous guided vehicle,” IEEE Wireless Communications Letters, vol. 12, no. 4, pp. 605–609, 2023.
- V. Vakkuri and P. Abrahamsson, “The key concepts of ethics of artificial intelligence,” in 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC), 2018, pp. 1–6.
- Z. Lai, H. Li, Q. Wu, Q. Ni, M. Lv, J. Li, J. Wu, J. Liu, and Y. Li, “Futuristic 6G Pervasive On-Demand Services: Integrating Space Edge Computing With Terrestrial Networks,” IEEE Vehicular Technology Magazine, vol. 18, no. 1, pp. 80–90, 2023.
- Z. Jia, M. Sheng, J. Li, D. Niyato, and Z. Han, “LEO-satellite-assisted UAV: Joint trajectory and data collection for internet of remote things in 6G aerial access networks,” IEEE Internet of Things Journal, vol. 8, no. 12, pp. 9814–9826, 2021.
- W. Yu, F. Sohrabi, and T. Jiang, “Role of deep learning in wireless communications,” IEEE BITS the Information Theory Magazine, vol. 2, no. 2, pp. 56–72, 2022.
- C. Zhang, H. Zou, S. Lasaulce, W. Saad, M. Kountouris, and M. Bennis, “Goal-oriented communications for the IoT and application to data compression,” IEEE Internet of Things Magazine, vol. 5, no. 4, pp. 58–63, 2022.
- A. Deb Raha, M. Shirajum Munir, A. Adhikary, Y. Qiao, S.-B. Park, and C. Seon Hong, “An artificial intelligent-driven semantic communication framework for connected autonomous vehicular network,” in 2023 International Conference on Information Networking (ICOIN), 2023, pp. 352–357.
- M. Zhang, Y. Li, Z. Zhang, G. Zhu, and C. Zhong, “Wireless image transmission with semantic and security awareness,” IEEE Wireless Communications Letters, vol. 12, no. 8, pp. 1389–1393, 2023.
- Y. Shi, Y. Zhou, D. Wen, Y. Wu, C. Jiang, and K. B. Letaief, “Task-oriented communications for 6G: Vision, principles, and technologies,” IEEE Wireless Communications, vol. 30, no. 3, pp. 78–85, 2023.
- J. Shao, Y. Mao, and J. Zhang, “Learning task-oriented communication for edge inference: An information bottleneck approach,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 1, pp. 197–211, 2022.
- J. Su, Z. Liu, Y.-a. Xie, K. Ma, H. Du, J. Kang, and D. Niyato, “Semantic Communication-Based Dynamic Resource Allocation in D2D Vehicular Networks,” IEEE Transactions on Vehicular Technology, vol. 72, no. 8, pp. 10 784–10 796, 2023.
- M. A. Ullah, K. Mikhaylov, and H. Alves, “Enabling mMTC in remote areas: LoRaWAN and LEO satellite integration for offshore wind farm monitoring,” IEEE Transactions on Industrial Informatics, vol. 18, no. 6, pp. 3744–3753, 2022.
- J. Ballé, V. Laparra, and E. P. Simoncelli, “Density modeling of images using a generalized normalization transformation,” arXiv, 2016.
- E. Eldeeb, M. Shehab, and H. Alves, “A learning-based fast uplink grant for massive IoT via support vector machines and long short-term memory,” IEEE IoT Journal, vol. 9, no. 5, pp. 3889–3898, 2022.
- Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004.
- “Chinese Traffic Sign Database,” http://www.nlpr.ia.ac.cn/pal/trafficdata/recognition.html, accessed: June 14, 2023.