Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

APEX: Ambidextrous Dual-Arm Robotic Manipulation Using Collision-Free Generative Diffusion Models (2404.02284v1)

Published 2 Apr 2024 in cs.RO

Abstract: Dexterous manipulation, particularly adept coordinating and grasping, constitutes a fundamental and indispensable capability for robots, facilitating the emulation of human-like behaviors. Integrating this capability into robots empowers them to supplement and even supplant humans in undertaking increasingly intricate tasks in both daily life and industrial settings. Unfortunately, contemporary methodologies encounter serious challenges in devising manipulation trajectories owing to the intricacies of tasks, the expansive robotic manipulation space, and dynamic obstacles. We propose a novel approach, APEX, to address all these difficulties by introducing a collision-free latent diffusion model for both robotic motion planning and manipulation. Firstly, we simplify the complexity of real-life ambidextrous dual-arm robotic manipulation tasks by abstracting them as aligning two vectors. Secondly, we devise latent diffusion models to produce a variety of robotic manipulation trajectories. Furthermore, we integrate obstacle information utilizing a classifier-guidance technique, thereby guaranteeing both the feasibility and safety of the generated manipulation trajectories. Lastly, we validate our proposed algorithm through extensive experiments conducted on the hardware platform of ambidextrous dual-arm robots. Our algorithm consistently generates successful and seamless trajectories across diverse tasks, surpassing conventional robotic motion planning algorithms. These results carry significant implications for the future design of diffusion robots, enhancing their capability to tackle more intricate robotic manipulation tasks with increased efficiency and safety. Complete video demonstrations of our experiments can be found in https://sites.google.com/view/apex-dual-arm/home.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. M. Abbas et al., “A systematic review on cooperative dual-arm manipulators: modeling, planning, control, and vision strategies,” International Journal of Intelligent Robotics and Applications, vol. 7, no. 4, p. 683–707, Jul. 2023.
  2. X. Zhao et al., “A dual-arm robot cooperation framework based on a nonlinear model predictive cooperative control,” IEEE/ASME Transactions on Mechatronics, pp. 1–13, 2023.
  3. A. Dastider and M. Lin, “Damon: Dynamic amorphous obstacle navigation using topological manifold learning and variational autoencoding,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023, pp. 251–258.
  4. Y. He, M. Wu, and S. Liu, “A distributed optimal control framework for multi-robot cooperative manipulation in dynamic environments,” Journal of Intelligent and Robotic Systems, vol. 105, no. 1, Apr. 2022. [Online]. Available: http://dx.doi.org/10.1007/s10846-022-01621-4
  5. C. Zhou et al., “Topp-mpc-based dual-arm dynamic collaborative manipulation for multi-object nonprehensile transportation,” in 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 999–1005.
  6. W. Shi et al., “Obstacle avoidance path planning for the dual-arm robot based on an improved rrt algorithm,” Applied Sciences, vol. 12, no. 8, 2022.
  7. N. Vahrenkamp et al., “Humanoid motion planning for dual-arm manipulation and re-grasping tasks,” in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2009, pp. 2464–2470.
  8. L. Liu et al., “A collaborative control method of dual-arm robots based on deep reinforcement learning,” Applied Sciences, vol. 11, no. 4, 2021.
  9. M. Alles and E. Aljalbout, “Learning to centralize dual-arm assembly,” Frontiers in Robotics and AI, vol. 9, p. 830007, 2022.
  10. F. Xie et al., “Deep imitation learning for bimanual robotic manipulation,” in Advances in Neural Information Processing Systems, H. Larochelle et al., Eds., vol. 33.   Curran Associates, Inc., 2020, pp. 2327–2337.
  11. H. Kim, Y. Ohmura, and Y. Kuniyoshi, “Goal-conditioned dual-action imitation learning for dexterous dual-arm robot manipulation,” IEEE Transactions on Robotics, pp. 1–20, 2024.
  12. ——, “Transformer-based deep imitation learning for dual-arm robot manipulation,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 8965–8972.
  13. F.-A. Croitoru et al., “Diffusion models in vision: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 9, pp. 10 850–10 869, 2023.
  14. J. Ho et al., “Video diffusion models,” in Advances in Neural Information Processing Systems, vol. 35.   Curran Associates, Inc., 2022, pp. 8633–8646.
  15. P. Dhariwal and A. Nichol, “Diffusion models beat gans on image synthesis,” in Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, Eds., vol. 34.   Curran Associates, Inc., 2021, pp. 8780–8794.
  16. J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in neural information processing systems, vol. 33, pp. 6840–6851, 2020.
  17. R. Rombach et al., “High-resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 10 684–10 695.
  18. O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18.   Springer, 2015, pp. 234–241.
  19. I. Kapelyukh, V. Vosylius, and E. Johns, “Dall-e-bot: Introducing web-scale diffusion models to robotics,” IEEE Robotics and Automation Letters, vol. 8, no. 7, pp. 3956–3963, 2023.
  20. T. Power et al., “Sampling constrained trajectories using composable diffusion models,” in IROS 2023 Workshop on Differentiable Probabilistic Robotics: Emerging Perspectives on Robot Learning, 2023.
  21. M. Janner et al., “Planning with diffusion for flexible behavior synthesis,” in International Conference on Machine Learning, 2022.
  22. J. Carvalho et al., “Motion planning diffusion: Learning and planning of robot motions with diffusion models,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023, pp. 1916–1923.
  23. T. Yoneda et al., “To the noise and back: Diffusion for shared autonomy,” in Robotics: Science and Systems XIX, Daegu, Republic of Korea, July 10-14, 2023, 2023.
  24. Z. Sun et al., “Bifa-yolo: A novel yolo-based method for arbitrary-oriented ship detection in high-resolution sar images,” Remote Sensing, vol. 13, no. 21, 2021.
  25. C. Chi et al., “Diffusion policy: Visuomotor policy learning via action diffusion,” ArXiv, vol. abs/2303.04137, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:257378658
  26. M. Reuss et al., “Goal conditioned imitation learning using score-based diffusion policies,” in Robotics: Science and Systems, 2023.
  27. J. Ho and T. Salimans, “Classifier-free diffusion guidance,” arXiv preprint arXiv:2207.12598, 2022.
  28. A. H. Khan et al., “Obstacle Avoidance and Tracking Control of Redundant Robotic Manipulator: An RNN-Based Metaheuristic Approach,” IEEE Transactions on Industrial Informatics, vol. 16, no. 7, pp. 4670–4680, 2020.
  29. O. Adiyatov and H. A. Varol, “A novel rrt*-based algorithm for motion planning in dynamic environments,” in 2017 IEEE International Conference on Mechatronics and Automation, 2017, pp. 1416–1421.
  30. M. Mukadam, X. Yan, and B. Boots, “Gaussian process motion planning,” in 2016 IEEE International Conference on Robotics and Automation (ICRA), 2016, pp. 9–15.
  31. M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “Gans trained by a two time-scale update rule converge to a local nash equilibrium,” in Proceedings of the 31st International Conference on Neural Information Processing Systems, ser. NIPS’17.   Red Hook, NY, USA: Curran Associates Inc., 2017, p. 6629–6640.
  32. Y. Zhao et al., “Intelligent control of multilegged robot smooth motion: A review,” IEEE Access, vol. 11, pp. 86 645–86 685, 2023.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Apan Dastider (9 papers)
  2. Hao Fang (88 papers)
  3. Mingjie Lin (14 papers)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now