2000 character limit reached
Learning Locally Interacting Discrete Dynamical Systems: Towards Data-Efficient and Scalable Prediction (2404.06460v2)
Published 9 Apr 2024 in eess.SY, cs.LG, and cs.SY
Abstract: Locally interacting dynamical systems, such as epidemic spread, rumor propagation through crowd, and forest fire, exhibit complex global dynamics originated from local, relatively simple, and often stochastic interactions between dynamic elements. Their temporal evolution is often driven by transitions between a finite number of discrete states. Despite significant advancements in predictive modeling through deep learning, such interactions among many elements have rarely explored as a specific domain for predictive modeling. We present Attentive Recurrent Neural Cellular Automata (AR-NCA), to effectively discover unknown local state transition rules by associating the temporal information between neighboring cells in a permutation-invariant manner. AR-NCA exhibits the superior generalizability across various system configurations (i.e., spatial distribution of states), data efficiency and robustness in extremely data-limited scenarios even in the presence of stochastic interactions, and scalability through spatial dimension-independent prediction.
- Interaction networks for learning about objects, relations and physics. Advances in neural information processing systems, 29, 2016.
- Agent-based modeling of host–pathogen systems: The successes and challenges. Information sciences, 179(10):1379–1389, 2009.
- A deterministic critical forest fire model. Physics Letters A, 149(4):207–210, 1990.
- Keith C Clarke. Cellular automata and agent-based models. Handbook of regional science, pages 1217–1233, 2014.
- Unsupervised learning for physical interaction through video prediction. Advances in neural information processing systems, 29, 2016.
- Simvp: Simpler yet better video prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3170–3180, 2022.
- A data-driven understanding of covid-19 dynamics using sequential genetic algorithm based probabilistic cellular automata. Applied Soft Computing, 96:106692, 2020.
- William Gilpin. Cellular automata as convolutional neural networks. Physical Review E, 100(3):032402, 2019.
- Learning graph cellular automata. Advances in Neural Information Processing Systems, 34:20983–20994, 2021.
- Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
- Forecasting evolution of clusters in game agents with hebbian learning. In 2023 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2023.
- A model for predicting forest fire spreading using cellular automata. Ecological Modelling, 99(1):87–97, 1997.
- A rumor transmission model with various contact interactions. Journal of theoretical biology, 253(1):55–60, 2008.
- Grin: Generative relation and intention network for multi-agent trajectory prediction. Advances in Neural Information Processing Systems, 34:27107–27118, 2021.
- Multi-agent game abstraction via graph attention neural network. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 7211–7218, 2020.
- Agent-based modeling and simulation. In Proceedings of the 2009 winter simulation conference (WSC), pages 86–98. IEEE, 2009.
- Growing neural cellular automata. Distill, 5(2):e23, 2020.
- Multi-agent graph-attention communication and teaming. In AAMAS, pages 964–973, 2021.
- Dynca: Real-time dynamic texture synthesis using neural cellular automata. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20742–20751, 2023.
- Variational neural cellular automata. arXiv preprint arXiv:2201.12360, 2022.
- Richard C Rothermel. A mathematical model for predicting fire spread in wildland fuels, volume 115. Intermountain Forest & Range Experiment Station, Forest Service, US …, 1972.
- Learning to simulate complex physics with graph networks. In International conference on machine learning, pages 8459–8468. PMLR, 2020.
- Social learning in multi agent multi armed bandits. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 3(3):1–35, 2019.
- Hiroki Sayama. Pycx: a python-based simulation code repository for complex systems education. Complex Adaptive Systems Modeling, 1(1):1–10, 2013.
- Convolutional lstm network: A machine learning approach for precipitation nowcasting. Advances in neural information processing systems, 28, 2015.
- Attention-based neural cellular automata. Advances in Neural Information Processing Systems, 35:8174–8186, 2022.
- Netlogo: A simple environment for modeling complexity. In International conference on complex systems, volume 21, pages 16–21. Citeseer, 2004.
- Giuseppe A Trunfio. Predicting wildfire spreading through a hexagonal cellular automata model. In International Conference on Cellular Automata, pages 385–394. Springer, 2004.
- Social network rumors spread model based on cellular automata. In 2014 10th International Conference on Mobile Ad-hoc and Sensor Networks, pages 236–242. IEEE, 2014.
- Imaginator: Conditional spatio-temporal gan for video generation. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1160–1169, 2020.
- Predrnn: Recurrent neural networks for predictive learning using spatiotemporal lstms. Advances in neural information processing systems, 30, 2017.
- Predrnn++: Towards a resolution of the deep-in-time dilemma in spatiotemporal predictive learning. In International Conference on Machine Learning, pages 5123–5132. PMLR, 2018.
- The cellular automaton model of investment behavior in the stock market. Physica A: Statistical Mechanics and its Applications, 325(3-4):507–516, 2003.
- Modeling epidemics using cellular automata. Applied mathematics and computation, 186(1):193–202, 2007.
- End-to-end learning of driving models from large-scale video datasets. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2174–2182, 2017.
- Neural dynamics on complex networks. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pages 892–902, 2020.