A Categorical Treatment of Open Linear Systems (2403.03934v1)
Abstract: An open stochastic system `a la Willems is a system affected two qualitatively different kinds of uncertainty -- one is probabilistic fluctuation, and the other one is nondeterminism caused by lack of information. We give a formalization of open stochastic systems in the language of category theory. A new construction, which we term copartiality, is needed to model the propagating lack of information (which corresponds to varying sigma-algebras). As a concrete example, we discuss extended Gaussian distributions, which combine Gaussian probability with nondeterminism and correspond precisely to Willems' notion of Gaussian linear systems. We describe them both as measure-theoretic and abstract categorical entities, which enables us to rigorously describe a variety of phenomena like noisy physical laws and uninformative priors in Bayesian statistics. The category of extended Gaussian maps can be seen as a mutual generalization of Gaussian probability and linear relations, which connects the literature on categorical probability with ideas from control theory like signal-flow diagrams.
- Categorical quantum mechanics. Handbook of quantum logic and quantum structures, 2:261–325, 2009.
- Props in network theory, 2018. arXiv:1707.08321.
- Categories in control. Theory Appl. Categ., 30:836–881, 2015. arXiv:1405.6881.
- Graphical affine algebra. In 2019 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS), pages 1–12. IEEE, 2019.
- A categorical semantics of signal flow graphs. In CONCUR 2014–Concurrency Theory: 25th International Conference, CONCUR 2014, Rome, Italy, September 2-5, 2014. Proceedings 25, pages 435–450. Springer, 2014.
- Interacting Hopf algebras. Journal of Pure and Applied Algebra, 221(1):144–184, 2017.
- Restriction categories i: categories of partial maps. Theoretical computer science, 270(1-2):223–259, 2002.
- Categorical probability spaces, ergodic decompositions, and transitions to equilibrium, 2024. arXiv:2310.04267.
- Dilations and information flow axioms in categorical probability. Mathematical Structures in Computer Science, 33(10):913–957, 2023.
- De Finetti’s theorem in categorical probability, 2021. arXiv:2105.02639.
- Representable Markov categories and comparison of statistical experiments in categorical probability, 2020. URL: https://arxiv.org/abs/2010.07416.
- Brenan Fong. Causal Theories: A Categorical Perspective on Bayesian Networks (MSc thesis). PhD thesis, University of Oxford, 2012.
- Brendan Fong. Decorated cospans. arXiv preprint arXiv:1502.00872, 2015.
- Brendan Fong. Decorated corelations, 2017. arXiv:1703.09888.
- Infinite products and zero-one laws in categorical probability. Compositionality, 2, August 2020. doi:10.32408/compositionality-2-3.
- T. Fritz. A synthetic approach to Markov kernels, conditional independence and theorems on sufficient statistics. Adv. Math., 370, 2020.
- Hypergraph categories. ArXiv, abs/1806.08304, 2019.
- An invitation to applied category theory: seven sketches in compositionality. Cambridge University Press, 2019.
- A categorical approach to open and interconnected dynamical systems. In Proceedings of the 31st annual ACM/IEEE symposium on Logic in Computer Science, pages 495–504, 2016.
- Bayesian Data Analysis. Chapman and Hall/CRC, 2nd ed. edition, 2004.
- Jakob Nebeling Hedegaard. Gaussian random fields – infinite, improper and intrinsic. Master’s thesis, Aalborg University, 2019.
- Jules Jacobs. Paradoxes of probabilistic programming. In Proc. POPL 2021, 2021.
- A.T. JAMES. The variance information manifold and the functions on it. In Multivariate Analysis–III, pages 157–169. Academic Press, 1973. URL: https://www.sciencedirect.com/science/article/pii/B9780124266537500168, doi:https://doi.org/10.1016/B978-0-12-426653-7.50016-8.
- Olav Kallenberg. Foundations of Modern Probability. Springer, New York, 1997.
- Evidential decision theory via partial markov categories, 2023. arXiv:2301.12989.
- Probability monads with submonads of deterministic states. In Proceedings of the 37th Annual ACM/IEEE Symposium on Logic in Computer Science, pages 1–13, 2022.
- A category-theoretic proof of the ergodic decomposition theorem. Ergodic Theory and Dynamical Systems, page 1–27, 2023. doi:10.1017/etds.2023.6.
- High-level axioms for graphical linear algebra. Science of Computer Programming, 218:102791, 2022. URL: https://www.sciencedirect.com/science/article/pii/S0167642322000247, doi:https://doi.org/10.1016/j.scico.2022.102791.
- Richard Samuelson. GaussianRelations.jl. https://github.com/samuelsonric/GaussianRelations.jl, 2024.
- P. Selinger. A Survey of Graphical Languages for Monoidal Categories, pages 289–355. Springer Berlin Heidelberg, Berlin, Heidelberg, 2011. doi:10.1007/978-3-642-12821-9_4.
- Exact Bayesian inference by symbolic disintegration. In Proc. POPL 2017, 2017.
- Compositional semantics for probabilistic programs with exact conditioning (long version), 2021. URL: https://arxiv.org/abs/2101.11351, arXiv:2101.11351.
- A category for unifying gaussian probability and nondeterminism. In 10th Conference on Algebra and Coalgebra in Computer Science (CALCO 2023). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2023.
- Towards a compositional framework for convex analysis (with applications to probability theory). arXiv preprint arXiv:2312.02291, 2023.
- Dario Stein. GaussianInfer. https://github.com/damast93/GaussianInfer, 2021.
- Graphical quadratic algebra, 2024. arXiv:2403.02284.
- Jan C Willems. The behavioral approach to open and interconnected systems. IEEE control systems magazine, 27(6):46–99, 2007.
- Jan C. Willems. Open stochastic systems. IEEE Transactions on Automatic Control, 58(2):406–421, 2013. doi:10.1109/TAC.2012.2210836.
- No-go theorems for distributive laws. In Proceedings of the 34th Annual ACM/IEEE Symposium on Logic in Computer Science, LICS ’19. IEEE Press, 2019.