Papers
Topics
Authors
Recent
Search
2000 character limit reached

Language, Environment, and Robotic Navigation

Published 3 Apr 2024 in cs.CL | (2404.03049v1)

Abstract: This paper explores the integration of linguistic inputs within robotic navigation systems, drawing upon the symbol interdependency hypothesis to bridge the divide between symbolic and embodied cognition. It examines previous work incorporating language and semantics into Neural Network (NN) and Simultaneous Localization and Mapping (SLAM) approaches, highlighting how these integrations have advanced the field. By contrasting abstract symbol manipulation with sensory-motor grounding, we propose a unified framework where language functions both as an abstract communicative system and as a grounded representation of perceptual experiences. Our review of cognitive models of distributional semantics and their application to autonomous agents underscores the transformative potential of language-integrated systems.

Authors (1)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. Noor Abdul Khaleq Zghair and Ahmed S. Al-Araji. A one decade survey of autonomous mobile robot systems. International Journal of Electrical and Computer Engineering (IJECE), 11(6):4891, December 2021.
  2. A survey of visual navigation: From geometry to embodied AI. Engineering Applications of Artificial Intelligence, 114:105036, September 2022.
  3. Semantic Information for Robot Navigation: A Survey. Applied Sciences, 10(2):497, January 2020. Number: 2 Publisher: Multidisciplinary Digital Publishing Institute.
  4. A comparative study of A-star algorithms for search and rescue in perfect maze. In 2011 International Conference on Electric Information and Control Engineering, pages 24–27, April 2011.
  5. Path planning in construction sites: performance evaluation of the Dijkstra, A*, and GA search algorithms. Advanced Engineering Informatics, 16(4):291–303, October 2002.
  6. Learning robotic navigation from experience: principles, methods and recent results. Philosophical Transactions of the Royal Society B: Biological Sciences, 378(1869):20210447, January 2023.
  7. MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigation, March 2021. arXiv:2103.11374 [cs].
  8. Probabilistic data association for semantic SLAM. In 2017 IEEE International Conference on Robotics and Automation (ICRA), pages 1722–1729, May 2017.
  9. Semantic representation for navigation in large-scale environments. In 2015 IEEE International Conference on Robotics and Automation (ICRA), pages 1106–1111, Seattle, WA, USA, May 2015. IEEE.
  10. Grounded Language Learning in a Simulated 3D World, June 2017. arXiv:1706.06551 [cs, stat].
  11. Grounding and Distinguishing Conceptual Vocabulary Through Similarity Learning in Embodied Simulations, May 2023. arXiv:2305.13668 [cs].
  12. Interactive Language: Talking to Robots in Real Time, October 2022. arXiv:2210.06407 [cs].
  13. Meta-Reinforcement Learning via Language Instructions, September 2022. arXiv:2209.04924 [cs].
  14. From Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction Following, February 2019. arXiv:1902.07742 [cs, stat].
  15. Learning Semantic Maps from Natural Language Descriptions. In Robotics: Science and Systems IX. Robotics: Science and Systems Foundation, June 2013.
  16. Navigating to Objects in the Real World, December 2022. arXiv:2212.00922 [cs].
  17. Knowledge engineering: principles and methods. Data Knowl Eng 25(1-2):161-197. Data & Knowledge Engineering, 25:161–197, March 1998.
  18. Nicola Guarino. Formal Ontology in Information Systems: Proceedings of the First International Conference (FOIS’98), June 6-8, Trento, Italy. IOS Press, 1998. Google-Books-ID: Wf5p3_fUxacC.
  19. Sachithra Madhawa Hemachandra. Learning semantic maps from natural language. Thesis, Massachusetts Institute of Technology, 2015. Accepted: 2015-07-17T19:12:02Z.
  20. Learning spatially semantic representations for cognitive robot navigation. Robotics and Autonomous Systems, 61(12):1460–1475, December 2013.
  21. Semantic Mapping for Mobile Robots in Indoor Scenes: A Survey. Information, 12(2):92, February 2021. Number: 2 Publisher: Multidisciplinary Digital Publishing Institute.
  22. A Semantic Classification Approach for Indoor Robot Navigation. Electronics, 11(13):2063, January 2022. Number: 13 Publisher: Multidisciplinary Digital Publishing Institute.
  23. Semantic Navigation Using Building Information on Construction Sites, April 2021. arXiv:2104.10296 [cs].
  24. An Instance Theory of Semantic Memory. Computational Brain & Behavior, 1(2):119–136, June 2018.
  25. Max M. Louwerse. Symbol Interdependency in Symbolic and Embodied Cognition. Topics in Cognitive Science, 3(2):273–302, April 2011.
  26. Improve the efficiency of deep reinforcement learning through semantic exploration guided by natural language, September 2023. arXiv:2309.11753 [cs].
  27. Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotation. In Proceedings of the 5th Conference on Robot Learning, pages 1303–1315. PMLR, January 2022. ISSN: 2640-3498.
  28. Language-Conditioned Imitation Learning with Base Skill Priors under Unstructured Data, February 2024. arXiv:2305.19075 [cs].
  29. PixL2R: Guiding Reinforcement Learning Using Natural Language by Mapping Pixels to Rewards. In Proceedings of the 2020 Conference on Robot Learning, pages 485–497. PMLR, October 2021. ISSN: 2640-3498.
  30. Zipfian Environments for Reinforcement Learning. In Proceedings of The 1st Conference on Lifelong Learning Agents, pages 406–429. PMLR, November 2022. ISSN: 2640-3498.
  31. Language Encodes Geographical Information. Cognitive Science, 33(1):51–73, 2009. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1551-6709.2008.01003.x.
  32. Representing Spatial Structure Through Maps and Language: Lord of the Rings Encodes the Spatial Structure of Middle Earth. Cognitive Science, 36(8):1556–1569, 2012. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/cogs.12000.
  33. Reconstructing maps from text. Cognitive Systems Research, 70:101–108, December 2021.
  34. Johnathan E. Avery. Representation and Retrieval in Semantic Memory. PhD thesis, Indiana University-Bloomington, 2023.
  35. Symbols and embodiment: Debates on meaning and cognition. Oxford University Press, March 2012.
  36. Stevan Harnad. The Symbol Grounding Problem. Physica D: Nonlinear Phenomena, 42(1-3):335–346, 1990.
  37. Brain Signatures of Meaning Access in Action Word Recognition. Journal of cognitive neuroscience, 17:884–92, July 2005.
  38. Transformer-based vision-language alignment for robot navigation and question answering. Information Fusion, 108:102351, August 2024.
  39. Visual Language Maps for Robot Navigation, March 2023. arXiv:2210.05714 [cs].

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up