Influence of the Geometry of the world model on Curiosity Based Exploration (2304.00188v2)
Abstract: In human spatial awareness, 3-D projective geometry structures information integration and action planning through perspective taking within an internal representation space. The way different perspectives are related and transform a world model defines a specific perception and imagination scheme. In mathematics, such collection of transformations corresponds to a 'group', whose 'actions' characterize the geometry of a space. Imbuing world models with a group structure may capture different agents' spatial awareness and affordance schemes. We used group action as a special class of policies for perspective-dependent control. We explored how such geometric structure impacts agents' behavior, comparing how the Euclidean versus projective groups act on epistemic value in active inference, drive curiosity, and exploration behaviors. We formally demonstrate and simulate how the groups induce distinct behaviors in a simple search task. The projective group's nonlinear magnification of information transformed epistemic value according to the choice of frame, generating behaviors of approach toward an object of interest. The projective group structure within the agent's world model contains the Projective Consciousness Model, which is know to capture key features of consciousness. On the other hand, the Euclidean group had no effect on epistemic value : no action was better than the initial idle state. In structuring a priori an agent's internal representation, we show how geometry can play a key role in information integration and action planning.
- Cognitive navigation based on nonuniform gabor space sampling, unsupervised growing networks, and reinforcement learning. IEEE Transactions on Neural Networks, 15(3):639–652, 2004. doi: 10.1109/TNN.2004.826221.
- Learning first-order symbolic representations for planning from the structure of the state space. arXiv preprint arXiv:1909.05546, 2019.
- Geometric deep learning: Grids, groups, graphs, geodesics, and gauges, 2021. URL https://arxiv.org/abs/2104.13478.
- Geometric deep learning: progress, applications and challenges. Science China Information Sciences, 65(2):126101, 2022.
- Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing). Wiley-Interscience, USA, 2006. ISBN 0471241954.
- Rl-iac: An exploration policy for online saliency learning on an autonomous mobile robot. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4877–4884, 2016. doi: 10.1109/IROS.2016.7759716.
- Active inference on discrete state-spaces: A synthesis. Journal of Mathematical Psychology, 99:102447, 2020. ISSN 0022-2496. doi: https://doi.org/10.1016/j.jmp.2020.102447. URL https://www.sciencedirect.com/science/article/pii/S0022249620300857.
- What is consciousness, and could machines have it? Science, 358(6362):486–492, 2017.
- Morris L. Eaton. Multivariate statistics: A vector space approach. Lecture Notes-Monograph Series, 53:i–512, 2007. ISSN 07492170. URL http://www.jstor.org/stable/20461449.
- A bayesian framework for active artificial perception. IEEE transactions on cybernetics, 43(2):699–711, 2013.
- A free energy principle for the brain. Journal of Physiology-Paris, 100(1):70–87, 2006. ISSN 0928-4257. doi: https://doi.org/10.1016/j.jphysparis.2006.10.001. URL https://www.sciencedirect.com/science/article/pii/S092842570600060X. Theoretical and Computational Neuroscience: Understanding Brain Functions.
- Active inference and epistemic value. Cognitive Neuroscience, 6(4):187–214, 2015. ISSN 17588936. doi: 10.1080/17588928.2015.1020053.
- A concise introduction to models and methods for automated planning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 8(1):1–141, 2013.
- Geometric deep learning and equivariant neural networks. arXiv preprint arXiv:2105.13926, 2021.
- Inductive biases for deep learning of higher-level cognition. Proceedings of the Royal Society A, 478(2266):20210068, 2022.
- Geometric entropic exploration. arXiv preprint arXiv:2101.02055, 2021.
- Intrinsically motivated model learning for developing curious robots. Artificial Intelligence, 247:170–186, 2017.
- Planning and acting in partially observable stochastic domains. Artificial intelligence, 101(1-2):99–134, 1998.
- The mathematical structure of integrated information theory. Frontiers in Applied Mathematics and Statistics, 6, 2021. ISSN 2297-4687. doi: 10.3389/fams.2020.602973. URL https://www.frontiersin.org/article/10.3389/fams.2020.602973.
- Neural correlates of consciousness: progress and problems. Nature Reviews Neuroscience, 2016.
- Serge Lang. Algebra, volume 211. Springer Science & Business Media, 2012.
- Geometric optimization for 3d pose estimation of quadratic surfaces. In Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004., volume 1, pages 131–135. IEEE, 2004.
- Conscious processing and the global neuronal workspace hypothesis. Neuron, 105(5):776–798, 2020. ISSN 0896-6273. doi: https://doi.org/10.1016/j.neuron.2020.01.026. URL https://www.sciencedirect.com/science/article/pii/S0896627320300520.
- Intelligent robotic system for autonomous exploration and active slam in unknown environments. In 2017 IEEE/SICE International Symposium on System Integration (SII), pages 651–656. IEEE, 2017.
- Exploratory state representation learning. Frontiers in Robotics and AI, 9, 2022.
- The integrated information theory of consciousness: a case of mistaken identity. Behavioral and Brain Sciences, 45, 2022.
- Ecological active vision: four bioinspired principles to integrate bottom–up and adaptive top–down attention tested with a simple camera-arm robot. IEEE transactions on autonomous mental development, 7(1):3–25, 2014.
- Towards active event recognition. In Twenty-Third International Joint Conference on Artificial Intelligence, pages 2495–2501, 2013.
- Proactive intention recognition for joint human-robot search and rescue missions through monte-carlo planning in pomdp environments. In Miguel A. Salichs, Shuzhi Sam Ge, Emilia Ivanova Barakova, John-John Cabibihan, Alan R. Wagner, Álvaro Castro-González, and Hongsheng He, editors, Social Robotics, pages 332–343, Cham, 2019. Springer International Publishing. ISBN 978-3-030-35888-4.
- Intrinsic motivation systems for autonomous mental development. IEEE transactions on evolutionary computation, 11(2):265–286, 2007.
- Autonomous exploration and mapping system using heterogeneous uavs and ugvs in gps-denied environments. IEEE Transactions on Vehicular Technology, 68(2):1339–1350, 2019.
- Modeling the subjective perspective of consciousness and its role in the control of behaviours. Journal of Theoretical Biology, 534:110957, 2022. ISSN 0022-5193. doi: https://doi.org/10.1016/j.jtbi.2021.110957. URL https://www.sciencedirect.com/science/article/pii/S0022519321003763.
- Combining the Projective Consciousness Model and Virtual Humans for immersive psychological research: a proof-of-concept simulating a ToM assessment. ACM Transactions on Interactive Intelligent Systems, 2023.
- A mathematical model of embodied consciousness. Journal of theoretical biology, 428:106–131, 2017.
- The moon illusion explained by the projective consciousness model. Journal of Theoretical Biology, 507:110455, 2020.
- Planning to explore via self-supervised world models. In International Conference on Machine Learning, pages 8583–8592. PMLR, 2020.
- On non-linear operators for geometric deep learning. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 10984–10995. Curran Associates, Inc., 2022. URL https://proceedings.neurips.cc/paper_files/paper/2022/file/474815daf1d4096ff78b7e4fdd2086a5-Paper-Conference.pdf.
- Bio-inspired model learning visual goals and attention skills through contingencies and intrinsic motivations. IEEE Transactions on Cognitive and Developmental Systems, 10(2):326–344, 2017.
- Towards the idea of molecular brains. International Journal of Molecular Sciences, 22(21), 2021. ISSN 1422-0067. doi: 10.3390/ijms222111868. URL https://www.mdpi.com/1422-0067/22/21/11868.
- Evolution of ribosomal protein network architectures. Scientific Reports, 11(1):625, January 2021. ISSN 2045-2322. doi: 10.1038/s41598-020-80194-4. URL https://doi.org/10.1038/s41598-020-80194-4.
- The projective consciousness model and phenomenal selfhood. Frontiers in Psychology, 9:2571, 2018.
- Pre-reflective self-consciousness & projective geometry. Review of Philosophy and Psychology, 13(2):365–396, 2022.
- Graph-based topological exploration planning in large-scale 3d environments. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 12730–12736, 2021. doi: 10.1109/ICRA48506.2021.9561830.
Sponsored by Paperpile, the PDF & BibTeX manager trusted by top AI labs.
Get 30 days freePaper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.