Model-Theoretic Logic for Mathematical Theory of Semantic Information and Communication (2401.17556v1)
Abstract: In this paper, we propose an advancement to Tarskian model-theoretic semantics, leading to a unified quantitative theory of semantic information and communication. We start with description of inductive logic and probabilities, which serve as notable tools in development of the proposed theory. Then, we identify two disparate kinds of uncertainty in semantic communication, that of physical and content, present refined interpretations of semantic information measures, and conclude with proposing a new measure for semantic content-information and entropy. Our proposition standardizes semantic information across different universes and systems, hence bringing measurability and comparability into semantic communication. We then proceed with introducing conditional and mutual semantic cont-information measures and point out to their utility in formulating practical and optimizable lossless and lossy semantic compression objectives. Finally, we experimentally demonstrate the value of our theoretical propositions.
- Beyond transmitting bits: Context, semantics, and task-oriented communications. IEEE Journal on Selected Areas in Communications, 41(1):5–41, 2023.
- Joint source-channel coding over additive noise analog channels using mixture of variational autoencoders. IEEE Journal on Selected Areas in Communications, 39(7):2000–2013, 2021.
- Semantic communications for speech recognition. In 2021 IEEE Global Communications Conference (GLOBECOM), pages 1–6, 2021.
- Goal-oriented communications for the iot and application to data compression. IEEE Internet of Things Magazine, 5(4):58–63, 2022.
- The semantic communication game. IEEE Transactions on Cognitive Communications and Networking, 4(4):787–802, 2018.
- Semantic communications: Principles and challenges. ArXiv, abs/2201.01389, 2021.
- Making sense of meaning: A survey on metrics for semantic and goal-oriented communication, 2023.
- Towards a theory of semantic communication. In 2011 IEEE Network Science Workshop, pages 110–117, 2011.
- A theory for semantic channel coding with many-to-one source, 2023.
- Semantic communication protocol: Demystifying deep neural networks via probabilistic logic. In 2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), pages 1–3, 2023.
- Toward semantic communication protocols: A probabilistic logic perspective. IEEE Journal on Selected Areas in Communications, 41(8):2670–2686, 2023.
- Semantic and logical communication-control co-design for correlated dynamical systems. IEEE Internet of Things Journal, pages 1–1, 2023.
- A unified view on semantic information and communication: A probabilistic logic approach. 2022 IEEE International Conference on Communications Workshops (ICC Workshops), pages 705–710, 2022.
- Rudolf Carnap. The continuum of inductive methods. Philosophy, 28(106):272–273, 1953.
- An outline of a theory of semantic information. 1952.
- Risto Hilpinen. On inductive generalization in monadic first-order logic with identity. Studies in logic and the foundations of mathematics, 43:133–154, 1966.
- Risto Hilpinen. Relational hypotheses and inductive inference. Synthese, 23:266–286, 1971.
- Ilkka Niiniluoto. On a k-dimensional system of inductive logic. PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association, 1976:425 – 447, 1976.
- Raimo Tuomela. Inductive generalization in an ordered universe. Studies in logic and the foundations of mathematics, 43:155–174, 1966.
- Theoretical concepts and hypothetico-inductive inference. 1973.
- Jaakko Hintikka. Perspectives on the logical study of language. Logica Universalis, 13:151 – 163, 2019.
- Jaakko Hintikka. Distributive normal forms in first-order logic. Studies in logic and the foundations of mathematics, 40:48–91, 1965.
- Jaakko Hintikka. A two-dimensional continuum of inductive methods*. Studies in logic and the foundations of mathematics, 43:113–132, 1966.
- Risto Hilpinen. Rules of acceptance and inductive logic. 1968.
- Temporal inductive logic reasoning. ArXiv, abs/2206.05051, 2022.
- Tilp: Differentiable learning of temporal logical rules on knowledge graphs. In International Conference on Learning Representations, 2023.
- Teilp: Time prediction over knowledge graphs via logical reasoning. ArXiv, abs/2312.15816, 2023.