Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Sim2Real Neural Controllers for Physics-based Robotic Deployment of Deformable Linear Objects (2303.02574v3)

Published 5 Mar 2023 in cs.RO and physics.app-ph

Abstract: Deformable linear objects (DLOs), such as rods, cables, and ropes, play important roles in daily life. However, manipulation of DLOs is challenging as large geometrically nonlinear deformations may occur during the manipulation process. This problem is made even more difficult as the different deformation modes (e.g., stretching, bending, and twisting) may result in elastic instabilities during manipulation. In this paper, we formulate a physics-guided data-driven method to solve a challenging manipulation task -- accurately deploying a DLO (an elastic rod) onto a rigid substrate along various prescribed patterns. Our framework combines machine learning, scaling analysis, and physical simulations to develop a physics-based neural controller for deployment. We explore the complex interplay between the gravitational and elastic energies of the manipulated DLO and obtain a control method for DLO deployment that is robust against friction and material properties. Out of the numerous geometrical and material properties of the rod and substrate, we show that only three non-dimensional parameters are needed to describe the deployment process with physical analysis. Therefore, the essence of the controlling law for the manipulation task can be constructed with a low-dimensional model, drastically increasing the computation speed. The effectiveness of our optimal control scheme is shown through a comprehensive robotic case study comparing against a heuristic control method for deploying rods for a wide variety of patterns. In addition to this, we also showcase the practicality of our control scheme by having a robot accomplish challenging high-level tasks such as mimicking human handwriting, cable placement, and tying knots.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. ACM Transactions on graphics (TOG) 29(4): 1–10.
  2. In: ACM SIGGRAPH 2008 papers. pp. 1–12.
  3. Buckham B, Driscoll FR and Nahon M (2004) Development of a finite element cable model for use in low-tension dynamics simulation. J. Appl. Mech. 71(4): 476–485.
  4. Journal of Applied Mechanics 88(5).
  5. IEEE Robotics and Automation Letters 8(8): 4863–4870.
  6. arXiv .
  7. ACM Transactions on Graphics (TOG) 37(6): 1–10.
  8. Crowell RH and Fox RH (2012) Introduction to knot theory, volume 57. Springer Science & Business Media.
  9. In: 2018 IEEE international conference on robotics and automation (ICRA). IEEE, pp. 4437–4444.
  10. Geblinger N, Ismach A and Joselevich E (2008) Self-organized nanotube serpentines. Nature nanotechnology 3(4): 195–200.
  11. In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids). IEEE, pp. 965–971.
  12. IEEE Robotics and Automation Letters 3(3): 2160–2165.
  13. Proceedings of the National Academy of Sciences 111(41): 14663–14668.
  14. Physical review letters 115(16): 168101.
  15. Autonomous Robots 43(8): 2183–2207.
  16. Graphical Models 71(4): 153–167.
  17. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots. IEEE, pp. 53–58.
  18. Lattanzi D and Miller G (2017) Review of robotic infrastructure inspection systems. Journal of Infrastructure Systems 23(3): 04017004.
  19. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, pp. 4402–4407.
  20. IEEE Robotics and Automation Letters 7(1): 573–580.
  21. Lv N, Liu J and Jia Y (2022) Dynamic modeling and control of deformable linear objects for single-arm and dual-arm robot manipulations. IEEE Transactions on Robotics .
  22. Macklin M, Müller M and Chentanez N (2016) Xpbd: position-based simulation of compliant constrained dynamics. In: Proceedings of the 9th International Conference on Motion in Games. pp. 49–54.
  23. ACM Transactions on Graphics (TOG) 33(4): 1–12.
  24. In: 2010 IEEE International Conference on Robotics and Automation. IEEE, pp. 2308–2315.
  25. Matas J, James S and Davison AJ (2018) Sim-to-real reinforcement learning for deformable object manipulation. In: Conference on Robot Learning. PMLR, pp. 734–743.
  26. The International Journal of Robotics Research 39(8): 957–982.
  27. The International Journal of Robotics Research 31(2): 249–267.
  28. Mitrano P, McConachie D and Berenson D (2021) Learning where to trust unreliable models in an unstructured world for deformable object manipulation. Science Robotics 6(54): eabd8170.
  29. Journal of Visual Communication and Image Representation 18(2): 109–118.
  30. In: 2017 IEEE international conference on robotics and automation (ICRA). IEEE, pp. 2146–2153.
  31. Pan K, Phani AS and Green S (2020) Periodic folding of a falling viscoelastic sheet. Physical Review E 101(1): 013002.
  32. Pignat E and Calinon S (2017) Learning adaptive dressing assistance from human demonstration. Robotics and Autonomous Systems 93: 61–75.
  33. Saha M and Isto P (2007) Manipulation planning for deformable linear objects. IEEE Transactions on Robotics 23(6): 1141–1150.
  34. The International Journal of Robotics Research 37(7): 688–716.
  35. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, pp. 4111–4117.
  36. In: 2016 IEEE international conference on robotics and automation (ICRA). IEEE, pp. 4178–4185.
  37. Servin M and Lacoursiere C (2008) Rigid body cable for virtual environments. IEEE Transactions on Visualization and Computer Graphics 14(4): 783–796.
  38. The International Journal of Robotics Research 40(12-14): 1385–1401.
  39. Surgical endoscopy 24(2): 377–382.
  40. Sucan IA, Moll M and Kavraki LE (2012) The open motion planning library. IEEE Robotics & Automation Magazine 19(4): 72–82.
  41. Procedia Manufacturing 1: 308–319.
  42. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 9411–9418.
  43. Takizawa M, Kudoh S and Suehiro T (2015) Method for placing a rope in a target shape and its application to a clove hitch. In: 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, pp. 646–651.
  44. Tang T, Wang C and Tomizuka M (2018) A framework for manipulating deformable linear objects by coherent point drift. IEEE Robotics and Automation Letters 3(4): 3426–3433.
  45. Teo WE and Ramakrishna S (2006) A review on electrospinning design and nanofibre assemblies. Nanotechnology 17(14): R89.
  46. Terzopoulos D and Qin H (1994) Dynamic nurbs with geometric constraints for interactive sculpting. ACM Transactions on Graphics (TOG) 13(2): 103–136.
  47. Timoshenko SP and Gere JM (2009) Theory of elastic stability. Courier Corporation.
  48. Tong D, Borum A and Jawed MK (2021) Automated stability testing of elastic rods with helical centerlines using a robotic system. IEEE Robotics and Automation Letters 7(2): 1126–1133.
  49. Journal of Applied Mechanics 90(4): 041008.
  50. Extreme Mechanics Letters 58: 101924.
  51. Wakamatsu H, Arai E and Hirai S (2006) Knotting/unknotting manipulation of deformable linear objects. The International Journal of Robotics Research 25(4): 371–395.
  52. arXiv preprint arXiv:1905.04411 .
  53. Whitcomb LL (2000) Underwater robotics: Out of the research laboratory and into the field. In: Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065), volume 1. IEEE, pp. 709–716.
  54. IEEE robotics and automation letters 5(2): 2372–2379.
  55. Science Robotics 6(54): eabd8803.
  56. IEEE Transactions on Robotics .
  57. In: 2017 IEEE international conference on robotics and automation (ICRA). IEEE, pp. 6044–6051.
  58. IEEE Robotics and Automation Letters 5(1): 16–23.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Dezhong Tong (10 papers)
  2. Andrew Choi (9 papers)
  3. Longhui Qin (2 papers)
  4. Weicheng Huang (17 papers)
  5. Jungseock Joo (21 papers)
  6. M. Khalid Jawed (15 papers)
Citations (7)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube