Papers
Topics
Authors
Recent
Search
2000 character limit reached

Motion Planning on Visual Manifolds

Published 8 Oct 2022 in cs.RO, cs.AI, cs.GR, and cs.NE | (2210.04047v2)

Abstract: In this thesis, we propose an alternative characterization of the notion of Configuration Space, which we call Visual Configuration Space (VCS). This new characterization allows an embodied agent (e.g., a robot) to discover its own body structure and plan obstacle-free motions in its peripersonal space using a set of its own images in random poses. Here, we do not assume any knowledge of geometry of the agent, obstacles or the environment. We demonstrate the usefulness of VCS in (a) building and working with geometry-free models for robot motion planning, (b) explaining how a human baby might learn to reach objects in its peripersonal space through motor babbling, and (c) automatically generating natural looking head motion animations for digital avatars in virtual environments. This work is based on the formalism of manifolds and manifold learning using the agent's images and hence we call it Motion Planning on Visual Manifolds.

Authors (1)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. “Motor development” In Handbook of child psychology, 2006
  2. Angelo Arleo, Fabrizio Smeraldi and Wulfram Gerstner “Cognitive navigation based on nonuniform Gabor space sampling, unsupervised growing networks, and reinforcement learning” In Neural Networks, IEEE Transactions on 15.3 IEEE, 2004, pp. 639–652
  3. “Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering” In Advances in neural information processing systems, 2004, pp. 177–184
  4. “Random projection in dimensionality reduction: applications to image and text data” In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, 2001, pp. 245–250 ACM
  5. “Using motor babbling and Hebb rules for modeling the development of reaching with obstacles and grasping” In International Conference on Cognitive Systems, 2008, pp. 1–8
  6. “Principles of Robot Motion: Theory, Algorithms, and Implementations” In Principles of Robot Motion: Theory, Algorithms, and Implementations Cambridge, MA: MIT Press, 2005
  7. Zachary Danziger and Ferdinando A Mussa-Ivaldi “The influence of visual motion on motor learning” In The Journal of Neuroscience 32.29 Soc Neuroscience, 2012, pp. 9859–9869
  8. Sanjoy Dasgupta “Experiments with random projection” In Proceedings of the Sixteenth conference on Uncertainty in artificial intelligence, 2000, pp. 143–151 Morgan Kaufmann Publishers Inc.
  9. “Joint Manifolds for Data Fusion”, 2009
  10. A. Egges, R. Visser and N. Magnenat-Thalmann “Example-Based Idle Motion Synthesis in a Real-Time Application” In Proc. CapTech Workshop on Modelling and Motion Capture Techniques for Virtual Environments, Zermatt, Switzerland, 2004, pp. 13–19
  11. “Sampling-based robot motion planning: A review” In IEEE Access 2 IEEE, 2014, pp. 56–77
  12. Joseph F Engelberger “Robotics in practice: management and applications of industrial robots” Kogan Page, 1980
  13. “The brain’s concepts: The role of the sensory-motor system in conceptual knowledge” In Cognitive neuropsychology 22.3-4, 2005, pp. 455–479
  14. “Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis” In Annual review of neuroscience 35 Annual Reviews, 2012, pp. 485–508
  15. Ali Ghodsi “Dimensionality Reduction: A short tutorial” In University of Waterloo University of Waterloo, Ontario, Canada, 2006
  16. Rick Grush “Self, World and Space: The Meaning and Mechanisms of Ego-and Allocentric Spatial Representation” In Brain and Mind 1.1, 2000, pp. 59–92
  17. “Visual attention by saliency leads cross-modal body representation” In Development and Learning, 2008. ICDL 2008. 7th IEEE International Conference on, 2008, pp. 157–162 IEEE
  18. Matej Hoffmann “Minimally cognitive robotics: body schema, forward models, and sensorimotor contingencies in a quadruped machine” In Contemporary Sensorimotor Theory Springer, 2014, pp. 209–233
  19. “Body schema in robotics: a review” In Autonomous Mental Development, IEEE Transactions on 2.4 IEEE, 2010, pp. 304–324
  20. Harold Hotelling “Analysis of a Complex of Statistical Variables into Principal Components” In Journal of educational psychology 24.6 Warwick & York, 1933, pp. 417
  21. Daniel P. Huttenlocher, Gregory A. Klanderman and William J Rucklidge “Comparing images using the Hausdorff distance” In Pattern Analysis and Machine Intelligence, IEEE Transactions on 15.9 IEEE, 1993, pp. 850–863
  22. Ian T Jolliffe “Principal Component Analysis and Factor Analysis” In Principal component analysis Springer, 1986, pp. 115–128
  23. “Action planning affects spatial localization” In Common mechanisms in perception and action: Attention and performance XIX, 2002, pp. 158–176
  24. Nandakishore Kambhatla and Todd K Leen “Dimension reduction by local principal component analysis” In Neural Computation 9.7, 1997, pp. 1493–1516
  25. “Sampling-based algorithms for optimal motion planning” In The international journal of robotics research 30.7 Sage Publications Sage UK: London, England, 2011, pp. 846–894
  26. “Probabilistic roadmaps for path planning in high-dimensional configuration spaces” In Robotics and Automation, IEEE Transactions on 12.4 IEEE, 1996, pp. 566–580
  27. Mitsuo Kawato “Feedback-error-learning neural network for supervised motor learning” In Advanced neural computers 6.3, 1990, pp. 365–372
  28. Moslem Kazemi, Kamal Gupta and Mehran Mehrandezh “Path-planning for visual servoing: a review and issues” In Visual Servoing via Advanced Numerical Methods, 2010, pp. 189–207
  29. “Automated extraction and parameterization of motions in large data sets” In ACM Transactions on Graphics 23.3, 2004
  30. L. Kovar, M. Gleicher and F. Pighin “Motion graphs” In ACM Transactions on Graphics 21.3, 2002, pp. 473–482
  31. “Adaptive robot body learning and estimation through predictive coding” In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 4083–4090 IEEE
  32. Pablo Lanillos, Emmanuel Dean-Leon and Gordon Cheng “Enactive Self: a study of engineering perspectives to obtain the sensorimotor self through enaction” In IEEE International Conference on Developmental Learning and Epigenetic Robotics, 2017
  33. Steven M LaValle “Rapidly-exploring random trees: A new tool for path planning” Citeseer, 1998
  34. Jehee Lee and Kang Hoon Lee “Precomputing Avatar Behavior From Human Motion Data” In Proceedings of Eurographics/ACM SIGGRAPH Symposium on Computer Animation, 2004 The Eurographics Association
  35. “Nonlinear Dimensionality Reduction” In Nonlinear Dimensionality Reduction Springer, 2007
  36. Mark H Lee “Intrinsic activitity: from motor babbling to play” In Development and Learning (ICDL), 2011 IEEE International Conference on 2, 2011, pp. 1–6 IEEE
  37. Tomas Lozano-Perez “Spatial planning: A configuration space approach” In IEEE transactions on computers IEEE, 1983, pp. 108–120
  38. Ruben Martinez-Cantin, Manuel Lopes and Luis Montesano “Body schema acquisition through active learning” In Robotics and Automation (ICRA), 2010 IEEE International Conference on, 2010, pp. 1860–1866 IEEE
  39. James McCann and Nancy S. Pollard “Responsive Characters from Motion Fragments” In ACM Transactions on Graphics (SIGGRAPH 2007) 26.3, 2007
  40. Audrey L Meer “Keeping the arm in the limelight: Advanced visual control of arm movements in neonates” In European Journal of Paediatric Neurology 1.4 Elsevier, 1997, pp. 103–108
  41. J. Modayil “Discovering sensor space: Constructing spatial embeddings that explain sensor correlations” In Development and Learning (ICDL), 2010 IEEE 9th International Conference on, 2010, pp. 120–125
  42. “Autonomous development of a grounded object ontology by a learning robot” In Proceedings of the National Conference on Artificial Intelligence 22:2, 2007, pp. 1095
  43. Thomas B. Moeslund, Adrian Hilton and Volker Kruger “A survey of advances in vision-based human motion capture and analysis” In Computer Vision and Image Understanding 104.2-3, 2006, pp. 90–126
  44. Ferdinando A Mussa-Ivaldi “Geometrical principles in motor control” In The handbook of brain theory and neural networks, 1995, pp. 434–438
  45. “Online learning of vision-based robot control during autonomous operation” In New Development in Robot Vision Springer, 2015, pp. 137–156
  46. Erkki Oja “Simplified neuron model as a principal component analyzer” In Journal of mathematical biology 15.3, 1982, pp. 267–273
  47. L. Olsson, C. Nehaniv and D. Polani “From unknown sensors and actuators to actions grounded in sensorimotor perceptions” In Connection Science 18:2 TaylorFrancis Ltd, 2006, pp. 121–144
  48. D. Philipona, J. Kevin O’Regan and J.-P. Nadal “Is There Something Out There? Inferring Space from Sensorimotor Dependencies” In Neural Computing 15:9, 2003, pp. 2029–2049
  49. “Perception of the structure of the physical world using unknown multimodal sensors and effectors” In Advances in neural information processing systems 16, 2003
  50. “Map Learning with Uninterpreted Sensors and Effectors” In Artificial Intelligence 92, 1997, pp. 169–229
  51. Henri Poincaré “L’espace et la geometrie” transl. W. J. Greenstreet, 1905 In Science and Hypothesis, 1895, pp. 60–71
  52. Wolfgang Prinz “Perception and action planning” In European journal of cognitive psychology 9.2, 1997, pp. 129–154
  53. “Online probabilistic topological mapping” In The International Journal of Robotics Research 30.6, 2011, pp. 755–771
  54. “Learning Inverse Models in High Dimensions with Goal Babbling and Reward-Weighted Averaging” In Workshop on Advances in Machine Learning for Sensorimotor Control, NIPS-13, 2013
  55. Matthias Rolf, Jochen J Steil and Michael Gienger “Goal babbling permits direct learning of inverse kinematics” In Autonomous Mental Development, IEEE Transactions on 2.3, 2010, pp. 216–229
  56. Guido Schillaci, Verena V Hafner and Bruno Lara “Exploration behaviors, body representations, and simulation processes for the development of cognition in artificial agents” In Frontiers in Robotics and AI 3 Frontiers, 2016, pp. 39
  57. Mathias Schmerling, Guido Schillaci and Verena V Hafner “Goal-directed learning of hand-eye coordination in a humanoid robot” In Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 2015 Joint IEEE International Conference on, 2015, pp. 168–175 IEEE
  58. “Learning Geometrically-Constrained Hidden Markov Models for Robot Navigation: Bridging the Topological-Geometrical Gap” In Journal of Artificial Intelligence Research 16, 2002, pp. 167–207
  59. “Good Features to Track” In 1994 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), 1994, pp. 593 –600
  60. Hyun Joon Shin and Hyun Seok Oh “Fat Graphs: Constructing an interactive character with continuous controls” In Eurographics/ ACM SIGGRAPH Symposium on Computer Animation, 2006, pp. 291–298
  61. Olivier Sigaud, Camille Salaün and Vincent Padois “On-line regression algorithms for learning mechanical models of robots: a survey” In Robotics and Autonomous Systems 59.12, 2011, pp. 1115–1129
  62. J. Stober, L. Fishgold and B. Kuipers “Sensor map discovery for developing robots” In AAAI Fall Symposium on Manifold Learning and Its Applications, 2009
  63. Jürgen Sturm “Approaches to Probabilistic Model Learning for Mobile Manipulation Robots” Springer, 2013
  64. Joshua B Tenenbaum, Vin De Silva and John C Langford “A global geometric framework for nonlinear dimensionality reduction” In Science 290.5500 American Association for the Advancement of Science, 2000, pp. 2319–2323
  65. E. Thelen “Motor development as foundation and future of developmental psychology” In International Journal of Behavioral Development 24.4, 2000, pp. 385–397
  66. Esther Thelen “Rhythmical stereotypies in normal human infants” In Animal behaviour 27 Elsevier, 1979, pp. 699–715
  67. Adrien Treuille, Yongjoon Lee and Zoran Popovic “Near-optimal Character Animation with Continuous Control” In ACM Transactions on Graphics (SIGGRAPH 2007) 26.3, 2007
  68. C. Von Hofsten “An action perspective on motor development” In Trends in cognitive sciences 8.6 Elsevier, 2004, pp. 266–272
  69. Daniel M Wolpert and Zoubin Ghahramani “Computational principles of movement neuroscience” In nature neuroscience 3, 2000, pp. 1212–1217
  70. J. Yang, F. Li and J. Wang “A better scaled local tangent space alignment algorithm” In Neural Networks, 2005. IJCNN’05. Proceedings. 2005 IEEE International Joint Conference on 2, 2005, pp. 1006–1011
  71. “Incremental adaptation of a robot body schema based on touch events” In Proc. of 8th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EPIROB 2018), 2018 IEEE

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free