Dynamical Reversibility and A New Theory of Causal Emergence based on SVD (2402.15054v6)
Abstract: The theory of causal emergence (CE) with effective information (EI) posits that complex systems can exhibit CE, where macro-dynamics show stronger causal effects than micro-dynamics. A key challenge of this theory is its dependence on coarse-graining method. In this paper, we introduce a fresh concept of approximate dynamical reversibility and establish a novel framework for CE based on this. By applying singular value decomposition(SVD) to Markov dynamics, we find that the essence of CE lies in the presence of redundancy, represented by the irreversible and correlated information pathways. Therefore, CE can be quantified as the potential maximal efficiency increase for dynamical reversibility or information transmission. We also demonstrate a strong correlation between the approximate dynamical reversibility and EI, establishing an equivalence between the SVD and EI maximization frameworks for quantifying CE, supported by theoretical insights and numerical examples from Boolean networks, cellular automata, and complex networks. Importantly, our SVD-based CE framework is independent of specific coarse-graining techniques and effectively captures the fundamental characteristics of the dynamics.
- I. Prigogine and I. Stengers, The end of certainty (Simon and Schuster, 1997).
- M. M. Waldrop, Complexity: The emerging science at the edge of order and chaos (Simon and Schuster, 1993).
- L. D. Landau and E. M. Lifshitz, Statistical Physics, Vol. 5 (Elsevier, 1980).
- E. P. Hoel, L. Albantakis, and G. Tononi, Quantifying causal emergence shows that macro can beat micro, Proceedings of the National Academy of Sciences of the United States of America 110, 19790 (2013).
- E. P. Hoel, When the map is better than the territory, Entropy 19, 10.3390/e19050188 (2017).
- G. Tononi and O. Sporns, Measuring information integration, BMC neuroscience 4, 1 (2003).
- J. Zhang and K. Liu, Neural Information Squeezer for Causal Emergence, Entropy 25, 1 (2023), 2201.10154 .
- J. Faye, Causation, reversibility and the direction of time, in Perspectives on time (Springer, 1997) pp. 237–266.
- M. Bernardo and C. A. Mezzina, Bridging causal consistent and time reversibility: A stochastic process algebraic approach, arXiv preprint arXiv:2205.01420 (2022).
- M. Farr, Causation and time reversal, The British Journal for the Philosophy of Science (2020).
- M. Bernardo and C. A. Mezzina, Bridging causal reversibility and time reversibility: A stochastic process algebraic approach, Logical Methods in Computer Science 19 (2023).
- R. Comolatti and E. Hoel, Causal emergence is widespread across measures of causation, arXiv preprint arXiv:2202.01854 (2022).
- J. Pearl and D. Mackenzie, The book of why: the new science of cause and effect (Basic books, 2018).
- D. W. Stroock, An introduction to Markov processes, Vol. 230 (Springer Science & Business Media, 2013).
- B. Recht, M. Fazel, and P. A. Parrilo, Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization, SIAM review 52, 471 (2010).
- Y. Chi, Y. M. Lu, and Y. Chen, Nonconvex optimization meets low-rank matrix factorization: An overview, IEEE Transactions on Signal Processing 67, 5239 (2019).
- C. Ding and X. He, K-means clustering via principal component analysis, in Proceedings of the twenty-first international conference on Machine learning (2004) p. 29.
- A. Marin and S. Rossi, On the relations between lumpability and reversibility, in 2014 IEEE 22nd International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems (IEEE, 2014) pp. 427–432.
- A. M. Barreto and M. D. Fragoso, Lumping the states of a finite markov chain through stochastic factorization, IFAC Proceedings Volumes 44, 4206 (2011).
- B. Klein and E. Hoel, The emergence of informative higher scales in complex networks, Complexity 2020, 1 (2020).
- E. Seabrook and L. Wiskott, A tutorial on the spectral theory of markov chains, Neural Computation 35, 1713 (2023).
- https://en.wikipedia.org/wiki/matrix_norm.
- T. Hoheisel and E. Paquette, Uniqueness in nuclear norm minimization: Flatness of the nuclear norm sphere and simultaneous polarization, Journal of Optimization Theory and Applications 197, 252 (2023).