Integrating GNN and Neural ODEs for Estimating Non-Reciprocal Two-Body Interactions in Mixed-Species Collective Motion (2405.16503v2)
Abstract: Analyzing the motion of multiple biological agents, be it cells or individual animals, is pivotal for the understanding of complex collective behaviors. With the advent of advanced microscopy, detailed images of complex tissue formations involving multiple cell types have become more accessible in recent years. However, deciphering the underlying rules that govern cell movements is far from trivial. Here, we present a novel deep learning framework for estimating the underlying equations of motion from observed trajectories, a pivotal step in decoding such complex dynamics. Our framework integrates graph neural networks with neural differential equations, enabling effective prediction of two-body interactions based on the states of the interacting entities. We demonstrate the efficacy of our approach through two numerical experiments. First, we used simulated data from a toy model to tune the hyperparameters. Based on the obtained hyperparameters, we then applied this approach to a more complex model with non-reciprocal forces that mimic the collective dynamics of the cells of slime molds. Our results show that the proposed method can accurately estimate the functional forms of two-body interactions -- even when they are nonreciprocal -- thereby precisely replicating both individual and collective behaviors within these systems.
- Complex networks: Structure and dynamics. Physics Reports, 424(4-5):175–308, February 2006.
- Learning the dynamics of cell–cell interactions in confined cell migration. Proceedings of the National Academy of Sciences of the United States of America, 118(7):e2016602118, February 2021.
- Stochastic nonlinear dynamics of confined cell migration in two-state systems. Nature Physics, 15(6):595–601, June 2019.
- Inferring the dynamics of underdamped stochastic systems. Physical Review Letters, 125(5):058103, July 2020.
- Scale-free correlations in starling flocks. Proceedings of the National Academy of Sciences of the United States of America, 107:11865–11870, June 2010.
- Data-driven discovery of coordinates and governing equations. Proceedings of the National Academy of Sciences of the United States of America, 116(45):22445–22451, November 2019.
- Intrinsically motivated collective motion. Proceedings of the National Academy of Sciences, 116:15362–15367, 2019.
- Collective motion of self-propelled particles interacting without cohesion. Physical Review E, 77(4):046113, 2008.
- Neural ordinary differential equations. Advances in neural information processing systems, 31, 2018.
- Physics of microswimmers - single particle motion and collective behavior: A review. Reports on Progress in Physics, 78, May 2015.
- From local collective behavior to global migratory patterns in white storks. Science, 360(6391):911–914, 2018.
- Tissue self-organization based on collective cell migration by contact activation of locomotion and chemotaxis. Proceedings of the National Academy of Sciences of the United States of America, 116(10):4291–4296, March 2019.
- Deep attention networks reveal the rules of collective motion in zebrafish. PLoS Computational Biology, 15(9):e1007354, September 2019.
- Tetsuya Hiraiwa. Dynamic self-organization of idealized migrating cells by contact communication. Physical Review Letters, 125(26):268104, 2020.
- Inferring the structure and dynamics of interactions in schooling fish. Proceedings of the National Academy of Sciences, 108:18720–18725, 2011.
- Neural sdes as infinite-dimensional gans. International Conference on Machine Learning, 2021.
- Crowd behavior analysis: A review where physics meets biology. Neurocomputing, 177:342–362, 2016.
- Effective mechanical potential of cell–cell interaction explains three-dimensional morphologies during early embryogenesis. PLoS Computational Biology, 19(8):e1011306, August 2023.
- Scalable gradients for stochastic differential equations. International Conference on Artificial Intelligence and Statistics, 2020.
- Modeling chemotaxis of microswimmers: From individual to collective behavior. In K. Lindenberg, R. Metzler, and G. Oshanin, editors, Chemical Kinetics: Beyond the Textbook,, pages 493–516. World Scientific Publishing Europe, London, United Kingdom, 2019.
- Gautam I. Menon. Active matter. In J. Murali Krishnan, Abhijit P. Deshpande, and P. B. Sunil Kumar, editors, Rheology of Complex Fluids, pages 193–218. Springer New York, New York, NY, 2010.
- Mykola Novik. torch-optimizer – collection of optimization algorithms for pytorch., January 2020.
- Torchdyn: implicit models and neural numerical methods in pytorch. In Neural Information Processing Systems, Workshop on Physical Reasoning and Inductive Biases for the Real World, volume 2, 2021.
- Discovering dynamic laws from observations: The case of self-propelled, interacting colloids, April 2022.
- Novel type of phase transition in a system of self-driven particles. Physical Review Letters, 75(6):1226–1229, August 1995.
- Collective motion. Physics Reports, 517(3-4):71–140, 2012.
- Deep graph library: A graph-centric, highly-performant package for graph neural networks. arXiv:1909.01315, August 2019.
- Large batch optimization for deep learning: Training bert in 76 minutes. In International Conference on Learning Representations, 2019.