Papers
Topics
Authors
Recent
Search
2000 character limit reached

Locally adaptive cellular automata for goal-oriented self-organization

Published 12 Jun 2023 in cs.NE, nlin.AO, and nlin.CG | (2306.07067v1)

Abstract: The essential ingredient for studying the phenomena of emergence is the ability to generate and manipulate emergent systems that span large scales. Cellular automata are the model class particularly known for their effective scalability but are also typically constrained by fixed local rules. In this paper, we propose a new model class of adaptive cellular automata that allows for the generation of scalable and expressive models. We show how to implement computation-effective adaptation by coupling the update rule of the cellular automaton with itself and the system state in a localized way. To demonstrate the applications of this approach, we implement two different emergent models: a self-organizing Ising model and two types of plastic neural networks, a rate and spiking model. With the Ising model, we show how coupling local/global temperatures to local/global measurements can tune the model to stay in the vicinity of the critical temperature. With the neural models, we reproduce a classical balanced state in large recurrent neuronal networks with excitatory and inhibitory neurons and various plasticity mechanisms. Our study opens multiple directions for studying collective behavior and emergence.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Self-organized criticality: An explanation of the 1/f noise. Physical review letters, 59(4):381.
  2. Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Journal of Computational Neuroscience, 8.
  3. Chan, B. W.-C. (2020). Lenia and expanded universe. In ALIFE 2020: The 2020 Conference on Artificial Life, pages 221–229. MIT Press.
  4. Cellular automata. Modelling of Physical.
  5. Synapse-type-specific competitive hebbian learning forms functional recurrent networks. bioRxiv.
  6. Simple models including energy and spike constraints reproduce complex activity patterns and metabolic disruptions. PLOS Computational Biology, 16(12):1–22.
  7. Evolving spiking neuron cellular automata and networks to emulate in vitro neuronal activity. CoRR, abs/2110.08242.
  8. Spike-threshold adaptation predicted by membrane potential dynamics in vivo. PLOS Computational Biology, 10(4):1–11.
  9. Towards simulations of long-term behavior of neural networks: Modeling synaptic plasticity of connections within and between human brain regions. Neurocomputing, 416:38–44.
  10. Recurrent connectivity structure controls the emergence of co-tuned excitation and inhibition. bioRxiv.
  11. Gilpin, W. (2019). Cellular automata as convolutional neural networks. Physical Review E, 100(3):032402.
  12. Hebb, D. O. (1949). The first stage of perception: growth of the assembly. The Organization of Behavior, 4(60):78–60.
  13. Neural cellular automata manifold. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10020–10028.
  14. Adaptation supports short-term memory in a visual change detection task. PLOS Computational Biology, 17(9):1–22.
  15. Adaptive spike threshold enables robust and temporally precise neuronal encoding. PLOS Computational Biology, 12(6):1–25.
  16. Ising, E. (1924). Beitrag zur theorie des ferro-und paramagnetismus. PhD thesis, Grefe & Tiedemann Hamburg.
  17. Cell assembly sequences arising from spike threshold adaptation keep track of time in the hippocampus. Journal of Neuroscience, 31(8):2828–2834.
  18. Langton, C. G. (1986). Studying artificial life with cellular automata. Physica D: Nonlinear Phenomena, 22(1-3):120–149.
  19. Probabilistic cellular automata. Emergence, Complexity, Computation, 27.
  20. McCabe, J. (2010). Cyclic symmetric multi-scale turing patterns. In Proceedings of Bridges 2010: Mathematics, Music, Art, Architecture, Culture, pages 387–390.
  21. Formation and computational implications of assemblies in neural circuits. The Journal of Physiology.
  22. Growing neural cellular automata. Distill. https://distill.pub/2020/growing-ca.
  23. Onsager, L. (1944). Crystal statistics. i. a two-dimensional model with an order-disorder transition. Physical Review, 65(3-4):117.
  24. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, pages 8024–8035. Curran Associates, Inc.
  25. Top-down models in biology: explanation and control of complex living systems above the molecular level. Journal of The Royal Society Interface, 13(124):20160555.
  26. A single neural cellular automaton for body-brain co-evolution. In Proceedings of the Genetic and Evolutionary Computation Conference Companion, GECCO ’22, page 148–151, New York, NY, USA. Association for Computing Machinery.
  27. Rampe, J. (2021). Multi-scale turing patterns. https://softologyblog.wordpress.com/2011/07/05/multi-scale-turing-patterns/.
  28. Self-classifying mnist digits. Distill. https://distill.pub/2020/selforg/mnist.
  29. Slackermanz (2021). Understanding multiple neighborhood cellular automata. https://slackermanz.com/understanding-multiple-neighborhood-cellular-automata/.
  30. Brian 2, an intuitive and efficient neural simulator. Elife, 8:e47314.
  31. Toffoli, T. (1984). Cellular automata as an alternative to (rather than an approximation of) differential equations in modeling physics. Physica D: Nonlinear Phenomena, 10(1-2):117–127.
  32. Turing, A. (1952). The chemical basis for morphogenesis. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 237(641):37–72.
  33. Towards self-organized control: Using neural cellular automata to robustly control a cart-pole agent. arXiv preprint arXiv:2106.15240.
  34. Vichniac, G. Y. (1984). Simulating physics with cellular automata. Physica D: Nonlinear Phenomena, 10(1-2):96–116.
  35. Inhibitory plasticity balances excitation and inhibition in sensory pathways and memory networks. Science, 334(6062):1569–1573.
  36. von Neumann, J. (1966). The theory of self-reproducing automata, burks aw (ed). urbana and london.
  37. Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical journal, 12(1):1—24.
  38. Wolfram, S. (1984). Cellular automata as models of complexity. Nature, 311(5985):419–424.
  39. Topology-dependent coalescence controls scaling exponents in finite networks. arXiv preprint arXiv:2211.06296.
  40. Self-organization toward criticality by synaptic plasticity. Frontiers in Physics, 9:103.
Citations (1)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.