Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
90 tokens/sec
Gemini 2.5 Pro Premium
54 tokens/sec
GPT-5 Medium
19 tokens/sec
GPT-5 High Premium
18 tokens/sec
GPT-4o
104 tokens/sec
DeepSeek R1 via Azure Premium
78 tokens/sec
GPT OSS 120B via Groq Premium
475 tokens/sec
Kimi K2 via Groq Premium
225 tokens/sec
2000 character limit reached

Autoencoder-Based Domain Learning for Semantic Communication with Conceptual Spaces (2401.16569v1)

Published 29 Jan 2024 in cs.LG, cs.AI, cs.CL, and eess.IV

Abstract: Communication with the goal of accurately conveying meaning, rather than accurately transmitting symbols, has become an area of growing interest. This paradigm, termed semantic communication, typically leverages modern developments in artificial intelligence and machine learning to improve the efficiency and robustness of communication systems. However, a standard model for capturing and quantifying the details of "meaning" is lacking, with many leading approaches to semantic communication adopting a black-box framework with little understanding of what exactly the model is learning. One solution is to utilize the conceptual spaces framework, which models meaning explicitly in a geometric manner. Though prior work studying semantic communication with conceptual spaces has shown promising results, these previous attempts involve hand-crafting a conceptual space model, severely limiting the scalability and practicality of the approach. In this work, we develop a framework for learning a domain of a conceptual space model using only the raw data with high-level property labels. In experiments using the MNIST and CelebA datasets, we show that the domains learned using the framework maintain semantic similarity relations and possess interpretable dimensions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (17)
  1. Ericsson “Ericsson Mobility Report” Available: https://www.ericsson.com/en/mobility-report, 2023
  2. Xingqin Lin “Artificial Intelligence in 3GPP 5G-Advanced: A Survey”, 2023 arXiv:2305.05092 [cs.NI]
  3. Claude E. Shannon and Warren Weaver “The Mathematical Theory of Communication” Urbana, IL: University of Illinois Press, 1949
  4. “What is Semantic Communication? A View on Conveying Meaning in the Era of Machine Intelligence” In Journal of Communications and Information Networks 6.4, 2021, pp. 336–371
  5. “A Survey on Semantic Communications for Intelligent Wireless Networks” In Wireless Personal Communications 129.1 Springer ScienceBusiness Media LLC, 2022, pp. 569–611
  6. “Engineering Semantic Communication: A Survey” In IEEE Access 11, 2023, pp. 13965–13995
  7. Dylan Wheeler, Erin E. Tripp and Balasubramaniam Natarajan “Semantic Communication With Conceptual Spaces” In IEEE Communications Letters 27.2, 2023, pp. 532–535
  8. “Knowledge-Driven Semantic Communication Enabled by the Geometry of Meaning”, 2023 arXiv:2306.02917 [eess.SP]
  9. Peter Gärdenfors “Conceptual Spaces: The Geometry of Thought” Massachusetts Institute of Technology, 2000
  10. Peter Gärdenfors “The Geometry of Meaning: Semantics Based on Conceptual Spaces” Massachusetts Institute of Technology, 2014
  11. “Task-Oriented Explainable Semantic Communications” In IEEE Transactions on Wireless Communications 22.12, 2023, pp. 9248–9262
  12. “Reasoning over the Air: A Reasoning-based Implicit Semantic-Aware Communication Framework” Conference Name: IEEE Transactions on Wireless Communications In IEEE Transactions on Wireless Communications, 2023, pp. 1–1
  13. Zhijin Qin, Huiqiang Xie and Xiaoming Tao “Mem-DeepSC: A Semantic Communication System with Memory” In ICC 2023 - IEEE International Conference on Communications, 2023, pp. 3854–3859
  14. Tilahun M. Getu, Georges Kaddoum and Mehdi Bennis “Making Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication” In IEEE Access 11, 2023, pp. 45456–45492
  15. Yoshua Bengio, Aaron Courville and Pascal Vincent “Representation Learning: A Review and New Perspectives” In IEEE Transactions on Pattern Analysis and Machine Intelligence 35.8, 2013, pp. 1798–1828
  16. Li Deng “The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]” In IEEE Signal Processing Magazine 29.6, 2012, pp. 141–142
  17. “Deep Learning Face Attributes in the Wild” In Proceedings of International Conference on Computer Vision (ICCV), 2015
Citations (1)

Summary

We haven't generated a summary for this paper yet.

Dice Question Streamline Icon: https://streamlinehq.com

Follow-up Questions

We haven't generated follow-up questions for this paper yet.