Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Theory for Semantic Channel Coding With Many-to-one Source (2303.05181v2)

Published 9 Mar 2023 in cs.IT and math.IT

Abstract: As one of the potential key technologies of 6G, semantic communication is still in its infancy and there are many open problems, such as semantic entropy definition and semantic channel coding theory. To address these challenges, we investigate semantic information measures and semantic channel coding theorem. Specifically, we propose a semantic entropy definition as the uncertainty in the semantic interpretation of random variable symbols in the context of knowledge bases, which can be transformed into existing semantic entropy definitions under given conditions. Moreover, different from traditional communications, semantic communications can achieve accurate transmission of semantic information under a non-zero bit error rate. Based on this property, we derive a semantic channel coding theorem for a typical semantic communication with many-to-one source (i.e., multiple source sequences express the same meaning), and prove its achievability and converse based on a generalized Fano's inequality. Finally, numerical results verify the effectiveness of the proposed semantic entropy and semantic channel coding theorem.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. C. E. Shannon, “A mathematical theory of communication,” ACM SIGMOBILE Mobile Comput. Commun. Rev., vol. 5, no. 1, pp. 3–55, 2001.
  2. C. Anthes, R. J. García-Hernández, M. Wiedemann, and D. Kranzlmüller, “State of the art of virtual reality technology,” in IEEE Aerosp. conf., Jun. 2016, pp. 1–19.
  3. A. Voulodimos, N. Doulamis, A. Doulamis, E. Protopapadakis et al., “Deep learning for computer vision: A brief review,” Comput. Intell. Neuroscience, Feb. 2018.
  4. I. F. Akyildiz and H. Guo, “Holographic-type communication: A new challenge for the next decade,” ITU J. Future and Evolving Technologies., Sept. 2022.
  5. K. Niu, J. Dai, and P. Zhang, “Semantic communication for 6G,” Mobile Commun., vol. 45, no. 04, pp. 85–90, Jul. 2021.
  6. P. Zhang, W. Xu, H. Gao, K. Niu, X. Xu, X. Qin, C. Yuan, Z. Qin, H. Zhao, J. Wei et al., “Toward wisdom-evolutionary and primitive-concise 6G: A new paradigm of semantic communication networks,” Eng., vol. 8, pp. 60–73, Nov. 2021.
  7. G. Shi, Y. Xiao, Y. Li, D. Gao, and X. Xie, “Semantic communication network for intelligent connection of all things,” Chin. J. Int. Things, vol. 5, no. 02, pp. 26–36, Apr. 2021.
  8. J. Liu, W. Zhang, and H. V. Poor, “A rate-distortion framework for characterizing semantic information,” in IEEE Int. Symp. Inf. Theory (ISIT), Jul. 2021, pp. 2894–2899.
  9. C.-X. Wang, M. D. Renzo, S. Stanczak, S. Wang, and E. G. Larsson, “Artificial intelligence enabled wireless networking for 5G and beyond: Recent advances and future challenges,” IEEE Wirel. Commun., vol. 27, no. 1, pp. 16–23, Feb. 2020.
  10. W. Hong, C. Yu, J. Chen, and Z. Hao, “Millimeter wave and terahertz technology,” Sci. China: Inf. Sci., vol. 46, no. 8, pp. 1086–1107, 2016.
  11. Y. Zhang, P. Zhang, Q. Wei, H. Zhao, J. Xiong, and J. Zhang, “Semantic communication for agents: Architecture and example,” Sc. China: Inf. Sci., vol. 52, no. 05, pp. 907–921, May. 2022.
  12. W. Xu, Z. Yang, D. W. K. Ng, M. Levorato, Y. C. Eldar, and M. Debbah, “Edge learning for B5G networks with distributed signal processing: Semantic communication, edge computing, and wireless sensing,” IEEE J. Sel. Topics Signal Process., vol. 17, no. 1, pp. 9–39, Jan. 2023.
  13. Q. Lan, D. Wen, Z. Zhang, Q. Zeng, X. Chen, P. Popovski, and K. Huang, “What is semantic communication? A view on conveying meaning in the era of machine intelligence,” J. Commun. Inf. Netw., vol. 6, no. 4, pp. 336–371, Dec. 2021.
  14. C. E. Shannon and W. Weaver, “The mathematical theory of communication,” vol. 34, no. 310, 1950, pp. 312–313.
  15. G. Shi, Y. Xiao, Y. Li, and X. Xie, “From semantic communication to semantic-aware networking: Model, architecture, and open problems,” IEEE Commun. Mag., vol. 59, no. 8, pp. 44–50, Aug. 2021.
  16. E. C. Strinati and S. Barbarossa, “6G networks: Beyond shannon towards semantic and goal-oriented communications,” Comp. Netw., vol. 190, p. 107930, May. 2021.
  17. L. Zhonghao, Z. Guangxu, X. Jie, A. Bo, and C. Shuguang, “Semantic communications for image recovery and classification via deep joint source and channel coding,” Apr. 2023.
  18. Y. Shi, Y. Zhou, D. Wen, Y. Wu, C. Jiang, and K. B. Letaief, “Task-oriented communications for 6g: Vision, principles, and technologies,” IEEE Wireless Communications, vol. 30, no. 3, pp. 78–85, 2023.
  19. H. Xie and Z. Qin, “A lite distributed semantic communication system for internet of things,” IEEE J. Sel. Areas Commun., vol. 39, no. 1, pp. 142–153, Jan. 2021.
  20. J. Shao, Y. Mao, and J. Zhang, “Learning task-oriented communication for edge inference: An information bottleneck approach,” IEEE J. Sel. Areas Commun., vol. 40, no. 1, pp. 197–211, Jan. 2022.
  21. X. Kang, B. Song, J. Guo, Z. Qin, and F. R. Yu, “Task-Oriented image transmission for scene classification in unmanned aerial systems,” IEEE Trans. on Commun., vol. 70, no. 8, pp. 5181–5192, Jun. 2022.
  22. Z. Qin, X. Tao, J. Lu, and G. Y. Li, “Semantic communications: Principles and challenges,” arXiv preprint arXiv:2201.01389, Dec. 2021.
  23. G. Xin and P. Fan, “EXK-SC: A semantic communication model based on information framework expansion and knowledge collision,” Entropy, vol. 24, no. 12, p. 1842, Oct. 2022.
  24. R. Carnap, Y. Bar-Hillel et al., “An outline of a theory of semantic information,” 1952.
  25. L. Floridi, “Outline of a theory of strongly semantic information,” Minds Mach., vol. 14, no. 2, pp. 197–221, May. 2004.
  26. P. Basu, J. Bao, M. Dean, and J. Hendler, “Preserving quality of information by using semantic relationships,” IEEE Int. Conf. Pervasive Comput. Commun. Workshops, pp. 58–63, May. 2012.
  27. A. DE LUCA and S. TERMINI, “A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory,” Inf. Control, vol. 20, pp. 301–312, May. 1972.
  28. X. Liu, W. Jia, W. Liu, and W. Pedrycz, “AFSSE: An interpretable classifier with axiomatic fuzzy set and semantic entropy,” IEEE Trans. Fuzzy Syst., vol. 28, no. 11, pp. 2825–2840, Oct. 2020.
  29. N. J. Venhuizen, M. W. Crocker, and H. Brouwer, “Semantic entropy in language comprehension,” Entropy, vol. 21, no. 12, p. 1159, Nov. 2019.
  30. A. Chattopadhyay, B. D. Haeffele, D. Geman, and R. Vidal, “Quantifying task complexity through generalized information measures,” Sept. 2020.
  31. M. Kountouris and N. Pappas, “Semantics-Empowered communication for networked intelligent systems,” IEEE Commun. Mag., vol. 59, no. 6, pp. 96–102, Jan. 2021.
  32. A. Rényi, “On measures of entropy and information,” in Proc. Berkeley Symp. Math. Statist. Probability, vol. 4, 1961, pp. 547–562.
  33. A. Kolchinsky and D. H. Wolpert, “Semantic information, autonomous agency and non-equilibrium statistical physics,” Interface Focus, vol. 8, no. 6, p. 20180041, 2018.
  34. J. Bao, P. Basu, M. Dean, C. Partridge, A. Swami, W. Leland, and J. A. Hendler, “Towards a theory of semantic communication,” in IEEE Netw. Sci. Workshop, Jun. 2011, pp. 110–117.
  35. B. Güler, A. Yener, and A. Swami, “The semantic communication game,” in IEEE Int. Conf. Commun., May. 2016, pp. 1–6.
  36. “Semantic communication as a signaling game with correlated knowledge bases,” in IEEE Veh. Technol. Conf. (VTC2022-Fall), Jan. 2022.
  37. S. Xie, S. Ma, M. Ding, Y. Shi, M. Tang, and Y. Wu, “Robust information bottleneck for task-oriented communication with digital modulation,” IEEE J. Sel. Areas Commun., pp. 1–15, Jun. 2023.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Shuai Ma (86 papers)
  2. Huayan Qi (1 paper)
  3. Hang Li (277 papers)
  4. Guangming Shi (87 papers)
  5. Yong Liang (32 papers)
  6. Naofal Al-Dhahir (124 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now