Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Interplay of Semantic Communication and Knowledge Learning (2402.03339v1)

Published 18 Jan 2024 in cs.CL

Abstract: In the swiftly advancing realm of communication technologies, Semantic Communication (SemCom), which emphasizes knowledge understanding and processing, has emerged as a hot topic. By integrating artificial intelligence technologies, SemCom facilitates a profound understanding, analysis and transmission of communication content. In this chapter, we clarify the means of knowledge learning in SemCom with a particular focus on the utilization of Knowledge Graphs (KGs). Specifically, we first review existing efforts that combine SemCom with knowledge learning. Subsequently, we introduce a KG-enhanced SemCom system, wherein the receiver is carefully calibrated to leverage knowledge from its static knowledge base for ameliorating the decoding performance. Contingent upon this framework, we further explore potential approaches that can empower the system to operate in evolving knowledge base more effectively. Furthermore, we investigate the possibility of integration with LLMs for data augmentation, offering additional perspective into the potential implementation means of SemCom. Extensive numerical results demonstrate that the proposed framework yields superior performance on top of the KG-enhanced decoding and manifests its versatility under different scenarios.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Zhilin Lu, Rongpeng Li and Kun Lu “Semantics-empowered communications: A tutorial-cum-survey” In IEEE Communications Surveys & Tutorials, 2023
  2. Nariman Farsad, Milind Rao and Andrea Goldsmith “Deep learning for joint source-channel coding of text” In IEEE International Conference on Acoustics, Speech and Signal Processing, 2018
  3. Peiwen Jiang, Chao-Kai Wen and Shi Jin “Deep source-channel coding for sentence semantic transmission with HARQ” In IEEE Transactions on Communications 70.8, 2022, pp. 5225–5240
  4. Qingyang Zhou, Rongpeng Li and Zhifeng Zhao “Semantic communication with adaptive universal transformer” In IEEE Wireless Communications Letters 11.3, 2021, pp. 453–457
  5. Qingyang Zhou, Rongpeng Li and Zhifeng Zhao “Adaptive Bit Rate Control in Semantic Communication with Incremental Knowledge-Based HARQ” In IEEE Open Journal of the Communications Society 3, 2022, pp. 1076–1089
  6. Kun Lu, Qingyang Zhou and Rongpeng Li “Rethinking Modern Communication from Semantic Coding to Semantic Communication” In IEEE Wireless Communications 30.1, 2023, pp. 158–164
  7. Kun Lu, Rongpeng Li and Xianfu Chen “Reinforcement learning-powered semantic communication via semantic similarity” In arXiv preprint arXiv:2108.12121, 2021
  8. Zhilin Lu, Rongpeng Li and Ming Lei “Self-critical alternate learning based semantic broadcast communication” In arXiv preprint arXiv:2312.01423, 2023
  9. Eirina Bourtsoulatze, David Burth Kurka and Deniz Gündüz “Deep joint source-channel coding for wireless image transmission” In IEEE Transactions on Cognitive Communications and Networking 5.3, 2019, pp. 567–579
  10. David Burth Kurka and Deniz Gündüz “DeepJSCC-f: Deep joint source-channel coding of images with feedback” In IEEE Journal on Selected Areas in Information Theory 1.1, 2020, pp. 178–193
  11. Mingze Ding, Jiahui Li and Mengyao Ma “SNR-adaptive deep joint source-channel coding for wireless image transmission” In IEEE International Conference on Acoustics, Speech and Signal Processing, 2021
  12. Ke Yang, Sixian Wang and Jincheng Dai “WITT: A wireless image transmission transformer for semantic communications” In IEEE International Conference on Acoustics, Speech and Signal Processing, 2023
  13. Haotian Wu, Yulin Shao and Emre Ozfatura “Transformer-aided wireless image transmission with channel feedback” In arXiv preprint arXiv:2306.09101, 2023
  14. Changwoo Lee, Xiao Hu and Hun-Seok Kim “Deep joint source-channel coding with iterative source error correction” In IEEE International Conference on Acoustics, Speech and Signal Processing, 2023
  15. Siyu Tong, Xiaoxue Yu and Rongpeng Li “Alternate learning based sparse semantic communications for visual transmission” In IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, 2023
  16. “Semantic communication systems for speech transmission” In IEEE Journal on Selected Areas in Communications 39.8, 2021, pp. 2434–2444
  17. Peiwen Jiang, Chao-Kai Wen and Shi Jin “Wireless semantic communications for video conferencing” In IEEE Journal on Selected Areas in Communications 41.1, 2022, pp. 230–244
  18. Alec Radford, Karthik Narasimhan and Tim Salimans “Improving language understanding by generative pre-training”, https://openai.com/research/language-unsupervised, 2018
  19. Alec Radford, Jeffrey Wu and Rewon Child “Language models are unsupervised multitask learners” In OpenAI Blog 1.8, 2019, pp. 9
  20. Tom Brown, Benjamin Mann and Nick Ryder “Language models are few-shot learners” In Advances in Neural Information Processing Systems, 2020
  21. Hugo Touvron, Thibaut Lavril and Gautier Izacard “Llama: Open and efficient foundation language models” In arXiv preprint arXiv:2302.13971, 2023
  22. Hugo Touvron, Louis Martin and Kevin Stone “Llama 2: Open foundation and fine-tuned chat models” In arXiv preprint arXiv:2307.09288, 2023
  23. Salvatore Carta, Alessandro Giuliani and Leonardo Piano “Iterative zero-shot llm prompting for knowledge graph construction” In arXiv preprint arXiv:2307.01128, 2023
  24. Ting Chen, Simon Kornblith and Mohammad Norouzi “A simple framework for contrastive learning of visual representations” In International Conference on Machine Learning, 2020
  25. Antoine Bordes, Nicolas Usunier and Alberto Garcia-Duran “Translating embeddings for modeling multi-relational data” In Advances in Neural Information Processing Systems, 2013
  26. Antoine Bordes, Xavier Glorot and Jason Weston “A semantic matching energy function for learning with multi-relational data: Application to word-sense disambiguation” In Machine Learning 94 Springer, 2014, pp. 233–259
  27. Tim Dettmers, Pasquale Minervini and Pontus Stenetorp “Convolutional 2D knowledge graph embeddings” In Proceedings of the Association for the Advancement of Artifical Intelligence Conference on Artificial Intelligence, 2018
  28. Michael Schlichtkrull, Thomas N Kipf and Peter Bloem “Modeling relational data with graph convolutional networks” In European Semantic Web Conference,, 2018
  29. Shaoxiong Ji, Shirui Pan and Erik Cambria “A survey on knowledge graphs: Representation, acquisition, and applications” In IEEE Transactions on Neural Networks and Learning Systems 33.2, 2021, pp. 494–514
  30. Qiao Lan, Dingzhu Wen and Zezhong Zhang “What is semantic communication? A view on conveying meaning in the era of machine intelligence” In Journal of Communications and Information Networks 6.4, 2021, pp. 336–371
  31. Yining Wang, Mingzhe Chen and Tao Luo “Performance optimization for semantic communications: An attention-based reinforcement learning approach” In IEEE Journal on Selected Areas in Communications 40.9, 2022, pp. 2598–2613
  32. Fuhui Zhou, Yihao Li and Xinyuan Zhang “Cognitive semantic communication systems driven by knowledge graph” In IEEE International Conference on Communications, 2022
  33. Colin Raffel, Noam Shazeer and Adam Roberts “Exploring the limits of transfer learning with a unified text-to-text transformer” In The Journal of Machine Learning Research 21.1, 2020, pp. 5485–5551
  34. Fuhui Zhou, Yihao Li and Ming Xu “Cognitive semantic communication cystems driven by knowledge graph: Principle, implementation, and performance evaluation” In arXiv preprint arXiv:2303.08546, 2023
  35. Shengteng Jiang, Yueling Liu and Yichi Zhang “Reliable semantic communication system enabled by knowledge graph” In Entropy 24.6, 2022, pp. 846
  36. Jingming Liang, Yong Xiao and Yingyu Li “Life-long learning for reasoning-based semantic communication” In IEEE International Conference on Communications Workshops, 2022
  37. “Reasoning on the air: An implicit semantic communication architecture” In IEEE International Conference on Communications Workshops, 2022
  38. “Imitation learning-based implicit semantic-aware communication networks: Multi-layer representation and collaborative reasoning” In IEEE Journal on Selected Areas in Communications 41.3, 2022, pp. 639–658
  39. Ang Li, Xin Wei and Dan Wu “Cross-modal semantic communications” In IEEE Wireless Communications 29.6, 2022, pp. 144–151
  40. Feibo Jiang, Yubo Peng and Li Dong “Large AI model-based semantic communications” In arXiv preprint arXiv:2307.03492, 2023
  41. Bingyan Wang, Rongpeng Li and Jianhang Zhu “Knowledge Enhanced Semantic Communication Receiver” In IEEE Communications Letters, 2023
  42. Ashish Vaswani, Noam Shazeer and Niki Parmar “Attention is all you need” In Advances in Neural Information Processing Systems, 2017
  43. Mostafa Dehghani, Stephan Gouws and Oriol Vinyals “Universal transformers” In arXiv preprint arXiv:1807.03819, 2018
  44. Claire Gardent, Anastasia Shimorina and Shashi Narayan “Creating training corpora for NLG micro-planning” In Annual Meeting of the Association for Computational Linguistics, 2017
  45. Kishore Papineni, Salim Roukos and Todd Ward “BLEU: A method for automatic evaluation of machine translation” In Annual Meeting of the Association for Computational Linguistics, 2002
  46. “Sentence-BERT: Sentence embeddings using siamese BERT-networks” In Conference on Empirical Methods in Natural Language Processing, 2019
  47. Kaiming He, Haoqi Fan and Yuxin Wu “Momentum contrast for unsupervised visual representation learning” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020
  48. Laurens Van der Maaten and Geoffrey Hinton “Visualizing data using t-SNE.” In Journal of Machine Learning Research 9.11, 2008
  49. Andrew Peng, Michael Wu and John Allard “GPT-3.5 Turbo fine-tuning and API updates”, https://openai.com/blog/gpt-3-5-turbo-fine-tuning-and-api-updates, 2023

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com