Papers
Topics
Authors
Recent
2000 character limit reached

Online Learning and Planning in Cognitive Hierarchies (2310.12386v1)

Published 18 Oct 2023 in cs.AI and cs.RO

Abstract: Complex robot behaviour typically requires the integration of multiple robotic and AI techniques and components. Integrating such disparate components into a coherent system, while also ensuring global properties and behaviours, is a significant challenge for cognitive robotics. Using a formal framework to model the interactions between components can be an important step in dealing with this challenge. In this paper we extend an existing formal framework [Clark et al., 2016] to model complex integrated reasoning behaviours of robotic systems; from symbolic planning through to online learning of policies and transition systems. Furthermore the new framework allows for a more flexible modelling of the interactions between different reasoning components.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (15)
  1. Engineering of Mind: An Introduction to the Science of Intelligent Systems. Wiley-Interscience, 2001.
  2. E. Amir and B. Engelhardt. Factored planning. In IJCAI, pages 929–935. Morgan Kaufmann, 2003.
  3. A hybrid approach to intricate motion, manipulation and task planning. I. J. Robotics Res., 28(1):104–126, 2009.
  4. A framework for integrating symbolic and sub-symbolic representations. In 25th Joint Conference on Artificial Intelligence (IJCAI -16), 2016.
  5. Thomas G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. J. Artif. Intell. Res., 13:227–303, 2000.
  6. Ffrob: An efficient heuristic for task and motion planning. In H. Levent Akin, Nancy M. Amato, Volkan Isler, and A. Frank van der Stappen, editors, Algorithmic Foundations of Robotics XI - Selected Contributions of the Eleventh International Workshop on the Algorithmic Foundations of Robotics, WAFR 2014, 3-5 August 2014, Boğaziçi University, İstanbul, Turkey, volume 107 of Springer Tracts in Advanced Robotics, pages 179–195. Springer, 2014.
  7. Potassco: The Potsdam answer set solving collection. AICOM, 24, 2011. potassco.sourceforge.net/.
  8. Michael Gelfond. Answer sets. In F. van Harmelen, V. Lifschitz, and B. Porter, editors, Handbook of Knowledge Representation, pages 285–316. Elsevier, 2008.
  9. Perceptual context in cognitive hierarchies. CoRR, abs/1801.02270, 2018.
  10. Leslie Pack Kaelbling. Hierarchical learning in stochastic domains: Preliminary results. In Machine Learning, Proceedings of the Tenth International Conference, University of Massachusetts, Amherst, MA, USA, June 27-29, 1993, pages 167–173. Morgan Kaufmann, 1993.
  11. Complexity analysis of real-time reinforcement learning. In Richard Fikes and Wendy G. Lehnert, editors, Proceedings of the 11th National Conference on Artificial Intelligence. Washington, DC, USA, July 11-15, 1993., pages 99–107. AAAI Press / The MIT Press, 1993.
  12. Handey: A robot system that recognizes, plans, and manipulates. In Proceedings of the 1987 IEEE International Conference on Robotics and Automation, Raleigh, North Carolina, USA, March 31 - April 3, 1987, pages 843–849. IEEE, 1987.
  13. ROS: an open-source Robot Operating System, 2009.
  14. Composability in cognitive hierarchies. In Byeong Ho Kang and Quan Bai, editors, AI 2016: Advances in Artificial Intelligence - 29th Australasian Joint Conference, Hobart, TAS, Australia, December 5-8, 2016, Proceedings, volume 9992 of Lecture Notes in Computer Science, pages 42–55. Springer, 2016.
  15. Christopher J. C. H. Watkins and Peter Dayan. Q-learning. Machine Learning, 8(3):279–292, May 1992.

Summary

We haven't generated a summary for this paper yet.

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.