Grid-SD2E: A General Grid-Feedback in a System for Cognitive Learning (2304.01844v3)
Abstract: Comprehending how the brain interacts with the external world through generated neural data is crucial for determining its working mechanism, treating brain diseases, and understanding intelligence. Although many theoretical models have been proposed, they have thus far been difficult to integrate and develop. In this study, we were inspired in part by grid cells in creating a more general and robust grid module and constructing an interactive and self-reinforcing cognitive system together with Bayesian reasoning, an approach called space-division and exploration-exploitation with grid-feedback (Grid-SD2E). Here, a grid module can be used as an interaction medium between the outside world and a system, as well as a self-reinforcement medium within the system. The space-division and exploration-exploitation (SD2E) receives the 0/1 signals of a grid through its space-division (SD) module. The system described in this paper is also a theoretical model derived from experiments conducted by other researchers and our experience on neural decoding. Herein, we analyse the rationality of the system based on the existing theories in both neuroscience and cognitive science, and attempt to propose special and general rules to explain the different interactions between people and between people and the external world. What's more, based on this framework, the smallest computing unit is extracted, which is analogous to a single neuron in the brain.
- N. Wiener. Cybernetics: or the Control and Communication in the Animal and the Machine. Peking University Press, 2020.
- A.M. Turing. Computing machinery and intelligence. Mind, 59(236):433–460, 1950.
- J.V. Neumann. The Computer and the Brain. Yale University Press, 2012.
- MATLAB for neuroscientists: an introduction to scientific computing in MATLAB. Academic Press, 2014.
- Deep learning approaches for neural decoding: from cnns to lstms and spikes to fmri. Briefings in Bioinformatics, 22(2):1577–1591, 2021.
- A. Clark. Surfing Uncertainty: Prediction, Action, and the Embodied Mind. OUP USA, 2016.
- Action and behavior: a free-energy formulation. Biological Cybernetics, 102(3):227–260, 2010.
- Answering schrödinger’s question: A free-energy formulation. Physics of Life Reviews, 24:1–16, 2018.
- J. Hawkins and S. Blakeslee. On Intelligence: How a New Understanding of the Brain will Lead to the Creation of Truly Intelligent Machines. Times Books, 2004.
- A framework for intelligence and cortical function based on grid cells in the neocortex. Frontiers in Neural Circuits, 12:DOI=10.3389/fncir.2018.00121, 2019.
- J. Hawkins. A Thousand Brains: A New Theory of Intelligence. Basic Books, 2021.
- Gödel’s Proof: Revised Edition. NYU Press, 2001.
- D.R. Hofstadter. Gödel, Escher, Bach: An Eternal Golden Braid. Basic Books, 1999.
- D.R. Hofstadter. I Am a Strange Loop. Basic Books, 2007.
- D.R. Hofstadter and E. Sander. Surfaces and Essences: Analogy as the Fuel and Fire of Thinking. Basic Books, 2013.
- Deep Learning: Adaptive Computation and Machine Learning series. The MIT Press, 2016.
- Deep learning for AI. Communications of the ACM, 64(7):58–65, 2021.
- Reinforcement Learning: An Introduction (second edition). A Bradford Book, 2018.
- R.S. Sutton. The quest for a common model of the intelligent decision maker. arXiv preprint arXiv:2202.13252v2, 2022.
- Neural decoding for macaque’s finger position: Convolutional space model. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(3):543–551, 2019.
- Neural decoding for location of macaque’s moving finger using generative adversarial networks. In IEEE International Conference of Intelligent Robotic and Control Engineering, pages 213–217. IEEE, 2018.
- Weakly supervised learning in neural encoding for the position of the moving finger of a macaque. Cognitive Computation, 12(5):1083–1096, 2020.
- ViF-SD2E: A robust weakly-supervised method for neural decoding. arXiv preprint arXiv:2112.01261v3, 2021–2022.
- The graphical brain: Belief propagation and active inference. Network Neuroscience, 1(4):381–414, 2017.
- Active inference: A process theory. Neural Computation, 29(1):1–49, 2017.
- H. Attias. Planning by probabilistic inference. Proc. of the 9th Int. Workshop on Artificial Intelligence and Statistics, 2003.
- M. Botvinick and M. Toussaint. Planning as inference. Trends in Cognitive Sciences, 16(10):485–488, 2012.
- Active inference on discrete state-spaces: A synthesis. Journal of Mathematical Psychology, 99:102447, 2020.
- Active inference in robotics and artificial agents: Survey and challenges. arXiv preprint arXiv:2112.01871, 2021.
- Microstructure of a spatial map in the entorhinal cortex. Nature, 436(7052):801–806, 2005.
- Ratslam: a hippocampal model for simultaneous localization and mapping. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA ’04. 2004, pages 403–408. IEEE, 2004.
- Neuroslam: a brain-inspired slam system for 3d environments. Biological Cybernetics, 113:515–545, 2019.
- Grid cells and cortical representation. Nature Reviews Neuroscience, 15:466–481, 2014.
- j. O’Keefe and J. Dostrovsky. The hippocampus as a spatial map. preliminary evidence from unit activity in the freely-moving rat. Brain Research, 34(1):171–175, 1971.
- Head-direction cells recorded from the postsubiculum in freely moving rats. i. description and quantitative analysis. Journal of Neuroscience, 10(2):420–435, 1990.
- Boundary vector cells in the subiculum of the hippocampal formation. Journal of Neuroscience, 29(31):9771–9777, 2009.
- Experience-dependent rescaling of entorhinal grids. Nature Neuroscience, 10:682–684, 2007.
- The entorhinal grid map is discretized. Nature, 492:72–78, 2012.
- Shearing-induced asymmetry in entorhinal grid cells. Nature, 518:207–212, 2015.
- L.M. Giocomo. Spatial representation: Maps of fragmented space. Current Biology, 25(9):R362–R363, 2015.
- Locally ordered representation of 3d space in the entorhinal cortex. Nature, 596:404–409, 2021.
- Irregular distribution of grid cell firing fields in rats exploring a 3d volumetric space. Nature Neuroscience, 24:1567–1573, 2021.
- J. Hohwy. The self-evidencing brain. Noûs, 50(2):259–285, 2014.
- E.T. Jaynes. Information theory and statistical mechanics. Physical Review Series II, 106(4):620–630, 1957.
- J. Schmidhuber. Curious model-building control systems. In Proc. International Joint Conference on Neural Networks, 2:1458–1463, 1991.
- J. Schmidhuber. Formal theory of creativity, fun, and intrinsic motivation (1990-2010). IEEE Transactions on Autonomous Mental Development, 2(3):230–247, 2010.
- Planning to be surprised: optimal bayesian exploration in dynamic environments. Proceedings of the 4th international conference on Artificial general intelligence, pages 41–51, 2011.
- D.J. MacKay. Free-energy minimisation algorithm for decoding and cryptoanalysis. Electronics Letters, 31:445–447, 1995.
- Minimum message length and kolmogorov complexity. The Computer Journal, 42(4):270–283, 1999.
- E. Schrödinger. What is life? Cambridge University Press, 1944.
- K. Gödel. Über formal unentscheidbare sätze der principia mathematica und verwandter systeme i. Monatshefte für Mathematik, 38(1):173–198, 1931.
- J. Pearl. Causality: Models, Reasoning and Inference. Cambridge University Pressence, 2009.
- J. Pearl and D. Mackenzie. The Book of Why: The New Science of Cause and Effect. Basic Books, 2018.
- Y. Liu. Integrated human-machine intelligence: beyond artificial intelligence. Tsing Hua University Press, 2021.
- D. Ha and J. Schmidhuber. World models. arXiv preprint arXiv:1803.10122v4, 2018.
- World model learning and inference. Neural Networks, 144:573–590, 2021.
- Y. LeCun. A path towards autonomous machine intelligence. https://openreview.net/pdf?id=BZ5a1r-kVsf, 2022.
- P. Wang and B. Goertzel. Introduction: Aspects of artificial general intelligence. in Advance of Artificial General Intelligence, pages 1–16, 2007.
- Catalyzing next-generation artificial intelligence through neuroai. nature communications, 14(1597), 2023.
- F. Chollet. On the measure of intelligence. arXiv preprint arXiv:1911.01547, 2019.
- G. Hinton. The forward-forward algorithm: Some preliminary investigations. arXiv preprint arXiv:2212.13345v1, 2022.
- D.Y Li. Cognitive physics—the enlightenment by schrödinger, turing, and wiener and beyond. Intelligent computing, 2, 2023.
- Consciousness in artificial intelligence: Insights from the science of consciousness. arXiv preprint arXiv:2308.08708v3, 2023.
- From the phenomenology to the mechanisms of consciousness: Integrated information theory 3.0. PLOS Computational Biology, 2014.
- G. Tononi and C. Koch. Consciousness: here, there and everywhere? Philosophical Transactions of the Royal Society B: Biological Sciences, 2015.
- L. Albantakis and G. Tononi. What we are is more than what we do. arXiv preprint arXiv:2102.04219v1, 2021.
- M. Michel and H. Lau. On the dangers of conflating strong and weak versions of a theory of consciousness. Philosophy and the Mind Sciences, 2020.
- The strength of weak integrated information theory. Trends in Cognitive Sciences, 26(8):646–655, 2022.
- Bostrom N. Anthropic Bias : Observation Selection Effects in Science and Philosophy. Psychology Press, 2002.
- G. Marcus and E Davis. Insights for ai from the human mind. Communications of the ACM, 64(1):38–41, 2021.
- Lenat D. and G. Marcus. Getting from generative ai to trustworthy ai: What llms might learn from cyc. arXiv preprint arXiv:2308.04445v1, 2023.
- L.N. Hoang. La formule du savoir: Une philosophie unifiée du savoir fondée sur le théorème de Bayes. XXX, 2018.
- D. Marr and S. Ullman. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. The MIT Press, 2010.
- T. Hatch and H. Gardner. Finding Cognition in the Classroom: an Expanded View of Human Intelligence. New York: Press Syndicate of the University of Cambridge, 1993.
- E. Hutchins. Cognition in the Wild. MIT Press, 1995.
- G.F. Marcus. The Algebraic Mind: Integrating Connectionism and Cognitive Science (Learning, Development, and Conceptual Change). The MIT Press, 2003.
- M. Mitchell. Artificial Intelligence: A Guide for Thinking Humans. Pelican, 2019.
- Neural decoding for location of macaque’s moving finger using generative adversarial networks. In IEEE International Conference of Intelligent Robotic and Control Engineering, pages 213–-217. IEEE, 2018.
- ViF-SD2E: A robust weakly-supervised method for neural decoding. arXiv preprint arXiv:2112.01261v3, 2021–2022. vs. (Final Version). J.Y. Feng, Y. Luo, S. Song, and H. Hu. ViF-SD2E: A robust weakly-supervised framework for neural decoding. Under review, 2023.
- Grid-SD2E: A General Grid-Feedback in a System for Cognitive Learning. arXiv preprint arXiv:2304.01844v3, 2023–2024. Under review, 2023.
- From a symmetry discovered in neural decoding to an algorithm board. Under review, 2024.
Collections
Sign up for free to add this paper to one or more collections.