Robust Pushing: Exploiting Quasi-static Belief Dynamics and Contact-informed Optimization (2404.02795v2)
Abstract: Non-prehensile manipulation such as pushing is typically subject to uncertain, non-smooth dynamics. However, modeling the uncertainty of the dynamics typically results in intractable belief dynamics, making data-efficient planning under uncertainty difficult. This article focuses on the problem of efficiently generating robust open-loop pushing plans. First, we investigate how the belief over object configurations propagates through quasi-static contact dynamics. We exploit the simplified dynamics to predict the variance of the object configuration without sampling from a perturbation distribution. In a sampling-based trajectory optimization algorithm, the gain of the variance is constrained in order to enforce robustness of the plan. Second, we propose an informed trajectory sampling mechanism for drawing robot trajectories that are likely to make contact with the object. This sampling mechanism is shown to significantly improve chances of finding robust solutions, especially when making-and-breaking contacts is required. We demonstrate that the proposed approach is able to synthesize bi-manual pushing trajectories, resulting in successful long-horizon pushing maneuvers without exteroceptive feedback such as vision or tactile feedback. We furthermore deploy the proposed approach in a model-predictive control scheme, demonstrating additional robustness against unmodeled perturbations.
- The International Journal of Robotics Research 39(1): 3–20. 10.1177/0278364919887447. URL https://doi.org/10.1177/0278364919887447.
- IEEE Transactions on signal processing 50(2): 174–188.
- Aydinoglu A and Posa M (2022) Real-time multi-contact model predictive control via admm. In: International Conference on Robotics and Automation (ICRA). p. 3414–3421.
- IEEE Transactions on Robotics 38(3): 1735–1754. 10.1109/TRO.2021.3120931.
- In: Conference on Robot Learning (CoRL). pp. 750–759.
- In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 8262–8268. 10.1109/IROS51168.2021.9636346.
- In: 2021 IEEE International Conference on Robotics and Automation (ICRA). pp. 6520–6526. 10.1109/ICRA48506.2021.9560766.
- URL https://arxiv.org/abs/2107.05616.
- Cover TM and Thomas JA (2005) Differential Entropy, chapter 8. John Wiley & Sons, Ltd. ISBN 9780471748823, pp. 243–259. https://doi.org/10.1002/047174882X.ch8. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/047174882X.ch8.
- Dogar M and Srinivasa S (2011) A framework for push-grasping in clutter. In: Hugh Durrant-Whyte NR and Abbeel P (eds.) Proceedings of Robotics: Science and Systems (RSS ’11). MIT Press, pp. 65–73.
- Erdmann M and Mason M (1988) An exploration of sensorless manipulation. IEEE Journal on Robotics and Automation 4(4): 369–379. 10.1109/56.800.
- Ha JS, Driess D and Toussaint M (2020) A probabilistic framework for constrained manipulations and task and motion planning under uncertainty. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). pp. 6745–6751. 10.1109/ICRA40945.2020.9196840.
- In: 2023 IEEE International Conference on Robotics and Automation (ICRA). pp. 5977–5984. 10.1109/ICRA48891.2023.10160216.
- Hansen N (2016) The CMA evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772 .
- Hogan FR and Rodriguez A (2020) Reactive planar non-prehensile manipulation with hybrid model predictive control. The International Journal of Robotics Research 39(7): 755–773.
- Hogan N (1984) Impedance control: An approach to manipulation. In: 1984 American Control Conference. pp. 304–313. 10.23919/ACC.1984.4788393.
- arXiv preprint arXiv:2212.00541 .
- International Conference on Robotics and Automation (ICRA) .
- Jankowski J, Racca M and Calinon S (2022) From Key Positions to Optimal Basis Functions for Probabilistic Adaptive Control. IEEE Robotics and Automation Letters 7(2): 3242–3249.
- Kappen HJ (2015) Adaptive importance sampling for control and inference. Journal of Statistical Physics 162: 1244–1266. URL https://api.semanticscholar.org/CorpusID:6382641.
- Koval MC, Pollard NS and Srinivasa SS (2016) Pre- and post-contact policy decomposition for planar contact manipulation under uncertainty. The International Journal of Robotics Research 35(1-3): 244–264. 10.1177/0278364915594474. URL https://doi.org/10.1177/0278364915594474.
- The International Journal of Robotics Research 15: 533 – 556. URL https://api.semanticscholar.org/CorpusID:13041894.
- In: 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids). pp. 31–38. 10.1109/HUMANOIDS.2017.8239534.
- Mason MT (2001) Mechanics of Robotic Manipulation. MIT Press.
- Migimatsu T and Bohg J (2020) Object-centric task and motion planning in dynamic environments. IEEE Robotics and Automation Letters 5(2): 844–851. 10.1109/LRA.2020.2965875.
- Frontiers in Robotics and AI 9. 10.3389/frobt.2022.799893. URL https://www.frontiersin.org/articles/10.3389/frobt.2022.799893.
- Okamoto K, Goldshtein M and Tsiotras P (2018) Optimal covariance control for stochastic systems under chance constraints. IEEE Control Systems Letters 2(2): 266–271. 10.1109/LCSYS.2018.2826038.
- Pang T (2021) A convex quasistatic time-stepping scheme for rigid multibody systems with contact and friction. 2021 IEEE International Conference on Robotics and Automation (ICRA) : 6614–6620URL https://api.semanticscholar.org/CorpusID:228095227.
- IEEE Transactions on Robotics 39(6): 4691–4711. 10.1109/TRO.2023.3300230.
- Science Robotics 6(54): eabi4667. 10.1126/scirobotics.abi4667. URL https://www.science.org/doi/abs/10.1126/scirobotics.abi4667.
- In: Bach F and Blei D (eds.) Proceedings of the 32nd International Conference on Machine Learning, Proceedings of Machine Learning Research, volume 37. Lille, France: PMLR, pp. 1889–1897. URL https://proceedings.mlr.press/v37/schulman15.html.
- Shirai Y, Jha DK and Raghunathan AU (2023) Covariance steering for uncertain contact-rich systems. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). pp. 7923–7929. 10.1109/ICRA48891.2023.10160249.
- Todorov E, Erez T and Tassa Y (2012) Mujoco: A physics engine for model-based control. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 5026–5033. 10.1109/IROS.2012.6386109.
- Toussaint M, Ha JS and Driess D (2020) Describing physics for physical reasoning: Force-based sequential manipulation planning. IEEE Robotics and Automation Letters 5(4): 6209–6216. 10.1109/LRA.2020.3010462.
- 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) : 13753–13760URL https://api.semanticscholar.org/CorpusID:247362576.