Autoencoder-Based Domain Learning for Semantic Communication with Conceptual Spaces (2401.16569v1)
Abstract: Communication with the goal of accurately conveying meaning, rather than accurately transmitting symbols, has become an area of growing interest. This paradigm, termed semantic communication, typically leverages modern developments in artificial intelligence and machine learning to improve the efficiency and robustness of communication systems. However, a standard model for capturing and quantifying the details of "meaning" is lacking, with many leading approaches to semantic communication adopting a black-box framework with little understanding of what exactly the model is learning. One solution is to utilize the conceptual spaces framework, which models meaning explicitly in a geometric manner. Though prior work studying semantic communication with conceptual spaces has shown promising results, these previous attempts involve hand-crafting a conceptual space model, severely limiting the scalability and practicality of the approach. In this work, we develop a framework for learning a domain of a conceptual space model using only the raw data with high-level property labels. In experiments using the MNIST and CelebA datasets, we show that the domains learned using the framework maintain semantic similarity relations and possess interpretable dimensions.
- Ericsson “Ericsson Mobility Report” Available: https://www.ericsson.com/en/mobility-report, 2023
- Xingqin Lin “Artificial Intelligence in 3GPP 5G-Advanced: A Survey”, 2023 arXiv:2305.05092 [cs.NI]
- Claude E. Shannon and Warren Weaver “The Mathematical Theory of Communication” Urbana, IL: University of Illinois Press, 1949
- “What is Semantic Communication? A View on Conveying Meaning in the Era of Machine Intelligence” In Journal of Communications and Information Networks 6.4, 2021, pp. 336–371
- “A Survey on Semantic Communications for Intelligent Wireless Networks” In Wireless Personal Communications 129.1 Springer ScienceBusiness Media LLC, 2022, pp. 569–611
- “Engineering Semantic Communication: A Survey” In IEEE Access 11, 2023, pp. 13965–13995
- Dylan Wheeler, Erin E. Tripp and Balasubramaniam Natarajan “Semantic Communication With Conceptual Spaces” In IEEE Communications Letters 27.2, 2023, pp. 532–535
- “Knowledge-Driven Semantic Communication Enabled by the Geometry of Meaning”, 2023 arXiv:2306.02917 [eess.SP]
- Peter Gärdenfors “Conceptual Spaces: The Geometry of Thought” Massachusetts Institute of Technology, 2000
- Peter Gärdenfors “The Geometry of Meaning: Semantics Based on Conceptual Spaces” Massachusetts Institute of Technology, 2014
- “Task-Oriented Explainable Semantic Communications” In IEEE Transactions on Wireless Communications 22.12, 2023, pp. 9248–9262
- “Reasoning over the Air: A Reasoning-based Implicit Semantic-Aware Communication Framework” Conference Name: IEEE Transactions on Wireless Communications In IEEE Transactions on Wireless Communications, 2023, pp. 1–1
- Zhijin Qin, Huiqiang Xie and Xiaoming Tao “Mem-DeepSC: A Semantic Communication System with Memory” In ICC 2023 - IEEE International Conference on Communications, 2023, pp. 3854–3859
- Tilahun M. Getu, Georges Kaddoum and Mehdi Bennis “Making Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication” In IEEE Access 11, 2023, pp. 45456–45492
- Yoshua Bengio, Aaron Courville and Pascal Vincent “Representation Learning: A Review and New Perspectives” In IEEE Transactions on Pattern Analysis and Machine Intelligence 35.8, 2013, pp. 1798–1828
- Li Deng “The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]” In IEEE Signal Processing Magazine 29.6, 2012, pp. 141–142
- “Deep Learning Face Attributes in the Wild” In Proceedings of International Conference on Computer Vision (ICCV), 2015