Information propagation in Gaussian processes on multilayer networks
Abstract: Complex systems with multiple processes evolving on different temporal scales are naturally described by multilayer networks, where each layer represents a different timescale. In this work, we show how the multilayer structure shapes the generation and propagation of information between layers. We derive a general decomposition of the multilayer probability for continuous stochastic processes described by Fokker-Planck operators. In particular, we focus on Gaussian processes, for which this solution can be obtained analytically. By explicitly computing the mutual information between the layers, we derive the fundamental principles that govern how information is propagated by the topology of the multilayer network. In particular, we unravel how edges between nodes in different layers affect their functional couplings. We find that interactions from fast to slow layers alone do not generate information, leaving the layers statistically independent even if they affect their dynamical evolution. On the other hand, interactions from slow to fast nodes lead to non-zero mutual information, which can then be propagated along specific paths of interactions between layers. We employ our results to study the interplay between information and instability, identifying the critical layers that drive information when pushed to the edge of stability. Our work generalizes previous results obtained in the context of discrete stochastic processes, allowing us to understand how the multilayer nature of complex systems affects their functional structure.
- M. De Domenico, More is different in real-world multilayer networks, Nature Physics 19, 1247–1262 (2023).
- L. V. Schaffer and T. Ideker, Mapping the multiscale structure of biological systems, Cell systems 12, 622 (2021).
- C. J. Honey, E. L. Newman, and A. C. Schapiro, Switching between internal and external modes: A multiscale learning principle, Network Neuroscience 1, 339 (2017).
- F. Avanzini, N. Freitas, and M. Esposito, Circuit theory for chemical reaction networks, Physical Review X 13, 021041 (2023).
- S. Liang, D. M. Busiello, and P. De Los Rios, Emergent thermophoretic behavior in chemical reaction systems, New Journal of Physics 24, 123006 (2022).
- S. E. Cavanagh, L. T. Hunt, and S. W. Kennerley, A diversity of intrinsic timescales underlie neural computations, Frontiers in Neural Circuits 14, 615626 (2020).
- T. Poisot, D. B. Stouffer, and D. Gravel, Beyond species: why ecological interaction networks vary through space and time, Oikos 124, 243 (2015).
- C.-R. Cai, Y.-Y. Nie, and P. Holme, Epidemic criticality in temporal networks, Physical Review Research 6, L022017 (2024).
- D. M. Busiello, D. Gupta, and A. Maritan, Coarse-grained entropy production with multiple reservoirs: Unraveling the role of time scales and detailed balance in biology-inspired systems, Physical Review Research 2, 043257 (2020).
- G. Bianconi, Multilayer networks: structure and function (Oxford university press, 2018).
- A. Aleta and Y. Moreno, Multilayer networks in a nutshell, Annual Review of Condensed Matter Physics 10, 45 (2019).
- G. Nicoletti and D. M. Busiello, Information propagation in multilayer systems with higher-order interactions across timescales, Physical Review X 14, 021007 (2024).
- T. M. Cover, Elements of information theory (John Wiley & Sons, 1999).
- G. Nicoletti and D. M. Busiello, Mutual information disentangles interactions from changing environments, Physical Review Letters 127, 228301 (2021).
- G. Tkačik and W. Bialek, Information processing in living systems, Annual Review of Condensed Matter Physics 7, 89 (2016).
- G. Tkačik, A. M. Walczak, and W. Bialek, Optimizing information flow in small genetic networks, Physical Review E 80, 031920 (2009).
- A.-L. Moor and C. Zechner, Dynamic information transfer in stochastic biochemical networks, Physical Review Research 5, 013032 (2023).
- M. Bauer and W. Bialek, Information bottleneck in molecular sensing, PRX Life 1, 023005 (2023).
- D. M. Busiello, M. Ciarchi, and I. Di Terlizzi, Unraveling active baths through their hidden degrees of freedom, Physical Review Research 6, 013190 (2024).
- L. Dabelow, S. Bo, and R. Eichhorn, Irreversibility in active matter systems: Fluctuation theorem and mutual information, Physical Review X 9, 021009 (2019).
- F. Tostevin and P. R. Ten Wolde, Mutual information between input and output trajectories of biochemical networks, Physical review letters 102, 218101 (2009).
- G. Nicoletti, A. Maritan, and D. M. Busiello, Information-driven transitions in projections of underdamped dynamics, Physical Review E 106, 014118 (2022).
- C. W. Gardiner, Handbook of stochastic methods for physics, chemistry and the natural sciences, 3rd ed., Springer Series in Synergetics (Springer-Verlag, Berlin, 2004).
- S. Bo and A. Celani, Multiple-scale stochastic processes: decimation, averaging and beyond, Physics reports 670, 1 (2017).
- R. M. May, Will a large complex system be stable?, Nature 238, 413 (1972).
- S. Allesina and S. Tang, Stability criteria for complex ecosystems, Nature 483, 205 (2012).
- D. M. Busiello, J. Hidalgo, and A. Maritan, Entropy production in systems with random transition rates close to equilibrium, Physical Review E 96, 062110 (2017).
- T. Tao and V. Vu, Random matrices: the circular law, Communications in Contemporary Mathematics 10, 261 (2008).
- S. Hihi and Y. Bengio, Hierarchical recurrent neural networks for long-term dependencies, Advances in neural information processing systems 8 (1995).
- J. Chung, S. Ahn, and Y. Bengio, Hierarchical multiscale recurrent neural networks, arXiv preprint arXiv:1609.01704 (2016).
- J. Wang and J. Wang, Two-timescale multilayer recurrent neural networks for nonlinear programming, IEEE Transactions on Neural Networks and Learning Systems 33, 37 (2020).
- G. Nicoletti, S. Suweis, and A. Maritan, Scaling and criticality in a phenomenological renormalization group, Physical Review Research 2, 023144 (2020).
- M. C. Morrell, A. J. Sederberg, and I. Nemenman, Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems, Physical review letters 126, 118302 (2021).
- M. C. Morrell, I. Nemenman, and A. Sederberg, Neural criticality from effective latent variables, Elife 12, RP89337 (2024).
- A. Das and A. Levina, Critical neuronal models with relaxed timescale separation, Physical Review X 9, 021062 (2019).
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.