Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Emergence and maintenance of modularity in neural networks with Hebbian and anti-Hebbian inhibitory STDP (2405.18587v3)

Published 28 May 2024 in q-bio.NC and nlin.AO

Abstract: The modular and hierarchical organization of the brain is believed to support the coexistence of segregated (specialization) and integrated (binding) information processes. A relevant question is yet to understand how such architecture naturally emerges and is sustained over time, given the plastic nature of the brain's wiring. Following evidences that the sensory cortices organize into assemblies under selective stimuli, it has been shown that stable neuronal assemblies can emerge due to targeted stimulation, embedding various forms of synaptic plasticity in presence of homeostatic and/or control mechanisms. Here, we show that simple spike-timing-dependent plasticity (STDP) rules, based only on pre- and post-synaptic spike times, can also lead to the stable encoding of memories in the absence of any control mechanism. We develop a model of spiking neurons, trained by stimuli targeting different subpopulations. The model satisfies some biologically plausible features: (i) it contains excitatory and inhibitory neurons with Hebbian and anti-Hebbian STDP; (ii) neither the neuronal activity nor the synaptic weights are frozen after the learning phase. Instead, the neurons are allowed to fire spontaneously while synaptic plasticity remains active. We find that only the combination of two inhibitory STDP subpopulations allows for the formation of stable modules in the network, with each subpopulation playing a distinctive role. The Hebbian subpopulation controls for the firing activity, while the anti-Hebbian neurons promote pattern selectivity. After the learning phase, the network settles into an asynchronous irregular resting-state. This post-learning activity is associated with spontaneous memory recalls which turn out to be fundamental for the long-term consolidation of the learned memories.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (99)
  1. Analysis of connectivity in the cat cerebral cortex. Journal of Neuroscience. 1995;15(2):1463–1483.
  2. Anatomical connectivity defines the organization of clusters of cortical areas in the macaque and the cat. Philosophical Transactions of the Royal Society of London Series B: Biological Sciences. 2000;355(1393):91–110.
  3. Modular and hierarchically modular organization of brain networks. Frontiers in neuroscience. 2010;4:200.
  4. Exploring brain function from anatomical connectivity. Frontiers in neuroscience. 2011;5:83.
  5. Rich club organization supports a diverse set of functional network configurations. Neuroimage. 2014;96:174–182.
  6. Sporns O. Network attributes for segregation and integration in the human brain. Current opinion in neurobiology. 2013;23(2):162–171.
  7. Cortical hubs form a module for multisensory integration on top of the hierarchy of cortical networks. Frontiers in neuroinformatics. 2010; p. 1.
  8. Functional complexity emerging from anatomical constraints in the brain: the significance of network modularity and rich-clubs. Scientific reports. 2016;6(1):38424.
  9. Modular topology emerges from plasticity in a minimalistic excitable network model. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2017;27(4):047406.
  10. Self-organization of multiple spatial and context memories in the hippocampus. Neuroscience & Biobehavioral Reviews. 2012;36(7):1609–1625.
  11. Characterizing the complexity of brain and mind networks. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2011;369(1952):3730–3747.
  12. Russo E, Treves A. Cortical free-association dynamics: Distinct phases of a latching network. Physical Review E. 2012;85(5):051920.
  13. Bliss TV, Collingridge GL. A synaptic model of memory: long-term potentiation in the hippocampus. Nature. 1993;361(6407):31–39.
  14. Malenka RC, Bear MF. LTP and LTD: an embarrassment of riches. Neuron. 2004;44(1):5–21.
  15. McGaugh JL. Memory–a century of consolidation. Science. 2000;287(5451):248–251.
  16. Steriade M. Impact of network activities on neuronal properties in corticothalamic systems. Journal of neurophysiology. 2001;86(1):1–39.
  17. Gu Y, Gong P. The dynamics of memory retrieval in hierarchical networks. Journal of computational neuroscience. 2016;40(3):247–268.
  18. Stickgold R. Sleep-dependent memory consolidation. Nature. 2005;437(7063):1272–1278.
  19. Theta-modulation drives the emergence of connectivity patterns underlying replay in a network model of place cells. Elife. 2018;7:e37388.
  20. Amit DJ, Brunel N. Global spontaneous activity and local structured (learned) delay period activity in cortex. Cerebral Cortex. 1997;7:237–252.
  21. A dynamic attractor network model of memory formation, reinforcement and forgetting. PLOS Computational Biology. 2023;19(12):e1011727.
  22. Brunel N, Wang XJ. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. Journal of computational neuroscience. 2001;11:63–85.
  23. Synaptic theory of working memory. Science. 2008;319(5869):1543–1546.
  24. Van Vreeswijk C, Sompolinsky H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science. 1996;274(5293):1724–1726.
  25. Brunel N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Journal of computational neuroscience. 2000;8:183–208.
  26. Vogels TP, Abbott LF. Signal propagation and logic gating in networks of integrate-and-fire neurons. Journal of neuroscience. 2005;25(46):10786–10795.
  27. Destexhe A. Self-sustained asynchronous irregular states and up–down states in thalamic, cortical and thalamocortical networks of nonlinear integrate-and-fire neurons. Journal of computational neuroscience. 2009;27:493–506.
  28. The asynchronous state in cortical circuits. science. 2010;327(5965):587–590.
  29. Sjöström J, Gerstner W. Spike-timing dependent plasticity. Scholarpedia. 2010;5(2):1362. doi:10.4249/scholarpedia.1362.
  30. Constrained brain volume in an efficient coding model explains the fraction of excitatory and inhibitory neurons in sensory cortices. PLOS Computational Biology. 2022;18(1):e1009642.
  31. Softky WR, Koch C. The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. Journal of neuroscience. 1993;13(1):334–350.
  32. Ermentrout GB, Kopell N. Parabolic bursting in an excitable system coupled with a slow oscillation. SIAM journal on applied mathematics. 1986;46(2):233–253.
  33. Petilla terminology: nomenclature of features of GABAergic interneurons of the cerebral cortex. Nature Reviews Neuroscience. 2008;9(7):557–568.
  34. Regulation of circuit organization and function through inhibitory synaptic plasticity. Trends in Neurosciences. 2022;45(12):884–898.
  35. Anti-Hebbian long-term potentiation in the hippocampal feedback inhibitory circuit. Science. 2007;315(5816):1262–1266.
  36. Hebbian LTP in feed-forward inhibitory interneurons and the temporal fidelity of input discrimination. Nature neuroscience. 2005;8(7):916–924.
  37. Maass W. On the computational power of winner-take-all. Neural computation. 2000;12(11):2519–2535.
  38. Neuronal dynamics: From single neurons to networks and models of cognition. Cambridge University Press; 2014.
  39. Inhibitory Synaptogenesis in Mouse Somatosensory Cortex. Cerebral Cortex. 1997;7(7):619–634.
  40. Rubinski A, Ziv N. Remodeling and tenacity of inhibitory synapses: relationships with network activity and neighboring excitatory synapses. PLoS Computational Biology. 2015;11(11):e1004632.
  41. PV plasticity sustained through D1/5 dopamine signaling required for long-term memory consolidation. Nature Neuroscience. 2016;19(3):454–466.
  42. Inhibitory connectivity defines the realm of excitatory plasticity. Nature neuroscience. 2018;21(10):1463–1470.
  43. McGaugh JL. The amygdala modulates the consolidation of memories of emotionally arousing experiences. Annu Rev Neurosci. 2004;27:1–28.
  44. Mixed selectivity morphs population codes in prefrontal cortex. Nature neuroscience. 2017;20(12):1770–1779.
  45. The importance of mixed selectivity in complex cognitive tasks. Nature. 2013;497(7451):585–590.
  46. Inhibitory neurons control the consolidation of neural assemblies via adaptation to selective stimuli. Scientific Reports. 2023;13(1):6949.
  47. Plasticity of inhibition. Neuron. 2012;75(6):951–962.
  48. Hebbian and anti-Hebbian spike-timing-dependent plasticity of human cortico-cortical connections. Journal of Neuroscience. 2013;33(23):9725–9733.
  49. Local origin of field potentials in visual cortex. Neuron. 2009;61(1):35–41.
  50. Synaptic wiring motifs in posterior parietal cortex support decision-making. Nature. 2024; p. 1–7.
  51. Activation of specific interneurons improves V1 feature selectivity and visual perception. Nature. 2012;488(7411):379–383.
  52. Asynchronous and coherent dynamics in balanced excitatory-inhibitory spiking networks. Frontiers in systems neuroscience. 2021;15:752261.
  53. An exploratory computational analysis in mice brain networks of widespread epileptic seizure onset locations along with potential strategies for effective intervention and propagation control. Frontiers in Computational Neuroscience. 2024;18:1360009.
  54. Equalizing excitation–inhibition ratios across visual cortical neurons. Nature. 2014;511(7511):596–600.
  55. Turrigiano GG, Nelson SB. Homeostatic plasticity in the developing nervous system. Nature reviews neuroscience. 2004;5(2):97–107.
  56. Fell J, Axmacher N. The role of phase synchronization in memory processes. Nature reviews neuroscience. 2011;12(2):105–118.
  57. Földiak P. Forming sparse representations by local anti-Hebbian learning. Biological cybernetics. 1990;64(2):165–170.
  58. Excitatory and inhibitory STDP jointly tune feedforward neural circuits to selectively propagate correlated spiking activity. Frontiers in computational neuroscience. 2014;8:53.
  59. Luz Y, Shamir M. Balancing feed-forward excitation and inhibition via Hebbian inhibitory synaptic plasticity. PLoS computational biology. 2012;8(1):e1002334.
  60. Buzsaki G, Draguhn A. Neuronal oscillations in cortical networks. science. 2004;304(5679):1926–1929.
  61. Fries P. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends in cognitive sciences. 2005;9(10):474–480.
  62. Resting brain activity varies with dream recall frequency between subjects. Neuropsychopharmacology. 2014;39(7):1594–1602.
  63. Recalling and forgetting dreams: theta and alpha oscillations during sleep predict subsequent dream recall. Journal of Neuroscience. 2011;31(18):6674–6683.
  64. Up and down states during slow oscillations in slow-wave sleep and different levels of anesthesia. Frontiers in systems neuroscience. 2021;15:609645.
  65. No difference between slow oscillation up-and down-state cueing for memory consolidation during sleep. Journal of Sleep Research. 2022;31(6):e13562.
  66. Dudai Y. The restless engram: consolidations never end. Annual review of neuroscience. 2012;35:227–247.
  67. Squire LR, Alvarez P. Retrograde amnesia and memory consolidation: a neurobiological perspective. Current opinion in neurobiology. 1995;5(2):169–177.
  68. Rolls ET, Deco G. The noisy brain: stochastic dynamics as a principle of brain function. 2010;.
  69. Dynamic and selective engrams emerge with memory consolidation. Nature Neuroscience. 2024; p. 1–12.
  70. Inhibitory engrams in perception and memory. Proceedings of the National Academy of Sciences. 2017;114(26):6666–6674.
  71. Giorgi C, Marinelli S. Roles and transcriptional responses of inhibitory neurons in learning and memory. Frontiers in Molecular Neuroscience. 2021;14:689952.
  72. Hopfield JJ. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences. 1982;79(8):2554–2558.
  73. Nonlinear mixed selectivity supports reliable neural computation. PLoS computational biology. 2020;16(2):e1007544.
  74. Van Den Heuvel MP, Sporns O. Rich-club organization of the human connectome. Journal of Neuroscience. 2011;31(44):15775–15786.
  75. Kaas JH. Topographic maps are fundamental to sensory processing. Brain research bulletin. 1997;44(2):107–112.
  76. Kaas JH, Collins CE. The organization of sensory cortex. Current opinion in neurobiology. 2001;11(4):498–504.
  77. Mountcastle VB. Modality and topographic properties of single neurons of cat’s somatic sensory cortex. Journal of neurophysiology. 1957;20(4):408–434.
  78. Douglas RJ, Martin KA. Mapping the matrix: the ways of neocortex. Neuron. 2007;56(2):226–238.
  79. The subcellular organization of neocortical excitatory connections. Nature. 2009;457(7233):1142–1145.
  80. Long-range and local circuits for top-down modulation of visual cortex processing. Science. 2014;345(6197):660–665.
  81. The long and short of GABAergic neurons. Current opinion in neurobiology. 2013;23(2):179–186.
  82. Abeles M. Corticonics: Neural circuits of the cerebral cortex. Cambridge University Press; 1991.
  83. Exact neural mass model for synaptic-based working memory. PLOS Computational Biology. 2020;16(12):e1008533.
  84. Herrmann CS. Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Experimental brain research. 2001;137:346–353.
  85. Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. Journal of Neuroscience. 1996;16(13):4240–4249.
  86. Bi Gq, Poo Mm. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. Journal of neuroscience. 1998;18(24):10464–10472.
  87. Biologically plausible models of homeostasis and STDP: stability and learning in spiking neural networks. In: The 2013 international joint conference on neural networks (IJCNN). IEEE; 2013. p. 1–8.
  88. Decay happens: the role of active forgetting in memory. Trends in cognitive sciences. 2013;17(3):111–120.
  89. Wixted JT. The psychology and neuroscience of forgetting. Annu Rev Psychol. 2004;55:235–269.
  90. A hebbian form of long-term potentiation dependent on mGluR1a in hippocampal inhibitory interneurons. Proceedings of the National Academy of Sciences. 2001;98(16):9401–9406.
  91. Inhibitory plasticity balances excitation and inhibition in sensory pathways and memory networks. Science. 2011;334(6062):1569–1573.
  92. Plumbley MD. Efficient information transfer and anti-Hebbian neural networks. Neural Networks. 1993;6(6):823–833.
  93. Soft-bound synaptic plasticity increases storage capacity. PLoS computational biology. 2012;8(12):e1002836.
  94. Jin Y, Li P. AP-STDP: A novel self-organizing mechanism for efficient reservoir computing. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEE; 2016. p. 1158–1165.
  95. Gilson M, Fukai T. Stability versus neuronal specialization for STDP: long-tail weight distributions solve the dilemma. PloS one. 2011;6(10):e25339.
  96. Kuramoto Y. Chemical oscillations, waves, and turbulence. Courier Corporation; 2003.
  97. Hansel D, Mato G. Existence and stability of persistent states in large neuronal networks. Physical Review Letters. 2001;86(18):4175.
  98. Intrinsic dynamics in neuronal networks. I. Theory. Journal of neurophysiology. 2000;83(2):808–827.
  99. Brunel N, Latham PE. Firing rate of the noisy quadratic integrate-and-fire neuron. Neural computation. 2003;15(10):2281–2306.

Summary

We haven't generated a summary for this paper yet.