Self-adhesivity in lattices of abstract conditional independence models (2402.14053v3)
Abstract: We introduce an algebraic concept of the frame for abstract conditional independence (CI) models, together with basic operations with respect to which such a frame should be closed: copying and marginalization. Three standard examples of such frames are (discrete) probabilistic CI structures, semi-graphoids and structural semi-graphoids. We concentrate on those frames which are closed under the operation of set-theoretical intersection because, for these, the respective families of CI models are lattices. This allows one to apply the results from lattice theory and formal concept analysis to describe such families in terms of implications among CI statements. The central concept of this paper is that of self-adhesivity defined in algebraic terms, which is a combinatorial reflection of the self-adhesivity concept studied earlier in context of polymatroids and information theory. The generalization also leads to a self-adhesivity operator defined on the hyper-level of CI frames. We answer some of the questions related to this approach and raise other open questions. The core of the paper is in computations. The combinatorial approach to computation might overcome some memory and space limitation of software packages based on polyhedral geometry, in particular, if SAT solvers are utilized. We characterize some basic CI families over 4 variables in terms of canonical implications among CI statements. We apply our method in information-theoretical context to the task of entropic region demarcation over 5 variables.
- Garrett Birkhoff. Lattice Theory. Third edition, volume 25 of Colloq. Publ., Am. Math. Soc. Providence: American Mathematical Society, 1995.
- Tobias Boege. The Gaussian conditional independence inference problem. PhD thesis, OvGU Magdeburg, 2022.
- Tobias Boege. Selfadhesivity in Gaussian conditional independence structures. Int. J. Approx. Reasoning, 163:11, 2023. Id/No 109027.
- The geometry of gaussoids. Found. Comput. Math., 19(4):775–812, 2019.
- Janneke H. Bolt. Two generalizations of the semi-graphoid rule of probabilistic independence and more. Int. J. Approx. Reasoning, 161:16, 2023. Id/No 108985.
- Janneke H. Bolt and Linda C. van der Gaag. Generalized rules of probabilistic independence. In Symbolic and Quantitative Approaches to Reasoning with Uncertainty. 16th European conference, ECSQARU 2021, Prague, Czech Republic, September 21–24, 2021. Proceedings, pages 590–602. Cham: Springer, 2021.
- László Csirmaz. Book inequalities. IEEE Trans. Inf. Theory, 60(11):6811–6818, 2014.
- László Csirmaz. One-adhesive polymatroids. Kybernetika, 56(5):886–902, 2020.
- A. Philip Dawid. Conditional independence in statistical theory. J. R. Stat. Soc., Ser. B, 41:1–31, 1979.
- Non-shannon information inequalities in four random variables, 2011. Available on https://arxiv.org/abs/1104.3602v1.
- Satoru Fujishige. Submodular Functions and Optimization. Second edition, volume 58 of Ann. Discrete Math. Amsterdam: Elsevier, 2005.
- Conceptual Exploration. Berlin: Springer, 2016.
- Formal Concept Analysis – Mathematical Foundations. Berlin: Springer, 1999.
- Logical and algorithmic properties of conditional independence and graphical models. Ann. Stat., 21(4):2001–2021, 1993.
- Familles minimales d’implications in-formatives résultant d’un tableau de données binaires. Math. Sci. Hum., 95:5–18, 1986.
- Three counter-examples on semi-graphoids. Comb. Probab. Comput., 17(2):239–257, 2008.
- Conditional information inequalities for entropic and almost entropic points. IEEE Trans. Inf. Theory, 59(11):7149–7167, 2013.
- On Gaussian conditional independence structures. Kybernetika, 43(3):327–342, 2007.
- František Matúš. Abstract functional dependency structures. Theor. Comput. Sci., 81(1):117–126, 1991.
- František Matúš. Ascending and descending conditional independence relations. In Information Theory, Statistical Decision Functions, and Random Processes. Transactions of the 11th Prague Conference, held from August 27-31, 1990 in Prague, Czechoslovakia. Volume B, pages 189–200. Dordrecht: Kluwer Academic Publishers, 1992.
- František Matúš. Conditional independences among four random variables II. Comb. Probab. Comput., 4(4):407–417, 1995.
- František Matúš. Towards classification of semigraphoids. Discrete Math., 277(1-3):115–145, 2004.
- František Matúš. Adhesivity of polymatroids. Discrete Math., 307(21):2464–2477, 2007.
- Conditional independences among four random variables I. Comb. Probab. Comput., 4(3):269–278, 1995.
- James G. Oxley. Matroid Theory. Second edition, volume 21 of Oxf. Grad. Texts Math. Oxford: Oxford University Press, 2011.
- Judea Pearl. Probabilistic Reasoning in Intelligent Systems – Networks of Plausible Inference. San Mateo: Morgan Kaufmann Publishers, 1989.
- Markov properties for mixed graphs. Bernoulli, 20(2):676–696, 2014.
- Milan Studený. Structural semigraphoids. Int. J. Gen. Syst., 22(2):207–217, 1994.
- Milan Studený. Probabilistic Conditional Independence Structures. Inf. Sci. Stat. London: Springer, 2005.
- Milan Studený. Basic facts concerning extreme supermodular functions. Technical Report 2359, Institute of Information Theory and Automation, Prague, December 2016. Also available on https://arxiv.org/abs/1612.06599.
- Milan Studený. Conditional independence structures over four discrete random variables revisited: conditional Ingleton inequalities. IEEE Trans. Inf. Theory, 67(11):7030–7049, 2021.
- Extreme supermodular set functions over five variables. Technical Report 1977, Institute of Information Theory and Automation, Prague, January 2000.
- Core-based criterion for extreme supermodular functions. Discrete Appl. Math., 206:122–151, 2016.
- Simon Vilmin. Algorithms on closure systems and their representations. PhD thesis, Université Clermont Auvergne, 2021.
- Raymond W. Yeung. Information Theory and Network Coding. New York: Springer, 2008.
- A non-Shannon-type conditional inequality of information quantities. IEEE Trans. Inf. Theory, 43(6):1982–1986, 1997.
- On characterization of entropy function via information inequalities. IEEE Trans. Inf. Theory, 44(4):1440–1452, 1998.