Active Exploration based on Information Gain by Particle Filter for Efficient Spatial Concept Formation (2211.10934v2)
Abstract: Autonomous robots need to learn the categories of various places by exploring their environments and interacting with users. However, preparing training datasets with linguistic instructions from users is time-consuming and labor-intensive. Moreover, effective exploration is essential for appropriate concept formation and rapid environmental coverage. To address this issue, we propose an active inference method, referred to as spatial concept formation with information gain-based active exploration (SpCoAE) that combines sequential Bayesian inference using particle filters and information gain-based destination determination in a probabilistic generative model. This study interprets the robot's action as a selection of destinations to ask the user, `What kind of place is this?' in the context of active inference. This study provides insights into the technical aspects of the proposed method, including active perception and exploration by the robot, and how the method can enable mobile robots to learn spatial concepts through active exploration. Our experiment demonstrated the effectiveness of the SpCoAE in efficiently determining a destination for learning appropriate spatial concepts in home environments.
- Kostavelis I, Gasteratos A. Semantic mapping for mobile robotics tasks: A survey. Robotics and Autonomous Systems. 2015;66:86–103. Available from: http://dx.doi.org/10.1016/j.robot.2014.12.006.
- Friston KJ. Active Inference : A Process Theory. Neural Computation. 2017;49:1–49.
- Park SM, Kim YG. Visual language navigation: a survey and open challenges. Artificial Intelligence Review 2022. 2022 mar;:1–63Available from: https://link.springer.com/article/10.1007/s10462-022-10174-9.
- Cangelosi A, Schlesinger M. Developmental Robotics: From Babies to Robots. Intelligent Robotics and Autonomous Agents Series. MIT Press. 2015. Available from: https://books.google.co.jp/books?id=AbKPoAEACAAJ.
- Ha D, Schmidhuber J. World models. 2018. Tech Rep. 1803.10122. Available from: https://worldmodels.github.io.
- Friston KJ. The free-energy principle: a unified brain theory? Nature reviews neuroscience. 2010;11(2):127.
- Tolman EC. Cognitive maps in rats and men. Psychological Review. 1948;55(4):189–208.
- O’keefe J, Nadel L. The Hippocampus as a Cognitive Map. Vol. 27. Cambridge University Press. 1978.
- Yamauchi B. Frontier-based Exploration Using Multiple Robots. In: Agents. 1998. p. 47–53. Available from: http://doi.acm.org/10.1145/280765.280773.
- Placed JA, Castellanos JA. Fast Autonomous Robotic Exploration Using the Underlying Graph Structure. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS). Section IV. 2021. p. 6649–6656.
- Asgharivaskasi A, Atanasov N. Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Exploration. IEEE Transactions on Robotics. 2023;2112.04063. Available from: https://doi.org/10.1109/TRO.2023.3245986.
- Horii T, Nagai Y. Active Inference Through Energy Minimization in Multimodal Affective Human–Robot Interaction. Frontiers in Robotics and AI. 2021 nov;8:361.
- Rao RPN, Ballard DH. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience. 1999 jan;2(1):79–87. Available from: https://pubmed.ncbi.nlm.nih.gov/10195184/.
- Murphy KP. Machine learning: a probabilistic perspective. Cambridge, MA: MIT Press. 2012.
- Sethuraman J. A constructive definition of Dirichlet priors. Statistica Sinica. 1994;4:639–650.
- Ishwaran H, James LF. Gibbs sampling methods for stick-breaking priors. Journal of the American Statistical Association. 2001;96(453):161–173.
- Liu JS. Metropolized independent sampling with comparisons to rejection sampling and importance sampling. Statistics and Computing. 1996;6(2):113–119. Available from: http://130.203.136.95/viewdoc/summary?doi=10.1.1.31.6718.
- Inamura T, Mizuchi Y. SIGVerse: A Cloud-Based VR Platform for Research on Multimodal Human-Robot Interaction. Frontiers in Robotics and AI. 2021 may;8:158.
- Levine S. Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review. arXiv preprint arXiv:180500909. 2018;.