Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Robust Pushing: Exploiting Quasi-static Belief Dynamics and Contact-informed Optimization (2404.02795v2)

Published 3 Apr 2024 in cs.RO

Abstract: Non-prehensile manipulation such as pushing is typically subject to uncertain, non-smooth dynamics. However, modeling the uncertainty of the dynamics typically results in intractable belief dynamics, making data-efficient planning under uncertainty difficult. This article focuses on the problem of efficiently generating robust open-loop pushing plans. First, we investigate how the belief over object configurations propagates through quasi-static contact dynamics. We exploit the simplified dynamics to predict the variance of the object configuration without sampling from a perturbation distribution. In a sampling-based trajectory optimization algorithm, the gain of the variance is constrained in order to enforce robustness of the plan. Second, we propose an informed trajectory sampling mechanism for drawing robot trajectories that are likely to make contact with the object. This sampling mechanism is shown to significantly improve chances of finding robust solutions, especially when making-and-breaking contacts is required. We demonstrate that the proposed approach is able to synthesize bi-manual pushing trajectories, resulting in successful long-horizon pushing maneuvers without exteroceptive feedback such as vision or tactile feedback. We furthermore deploy the proposed approach in a model-predictive control scheme, demonstrating additional robustness against unmodeled perturbations.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. The International Journal of Robotics Research 39(1): 3–20. 10.1177/0278364919887447. URL https://doi.org/10.1177/0278364919887447.
  2. IEEE Transactions on signal processing 50(2): 174–188.
  3. Aydinoglu A and Posa M (2022) Real-time multi-contact model predictive control via admm. In: International Conference on Robotics and Automation (ICRA). p. 3414–3421.
  4. IEEE Transactions on Robotics 38(3): 1735–1754. 10.1109/TRO.2021.3120931.
  5. In: Conference on Robot Learning (CoRL). pp. 750–759.
  6. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 8262–8268. 10.1109/IROS51168.2021.9636346.
  7. In: 2021 IEEE International Conference on Robotics and Automation (ICRA). pp. 6520–6526. 10.1109/ICRA48506.2021.9560766.
  8. URL https://arxiv.org/abs/2107.05616.
  9. Cover TM and Thomas JA (2005) Differential Entropy, chapter 8. John Wiley & Sons, Ltd. ISBN 9780471748823, pp. 243–259. https://doi.org/10.1002/047174882X.ch8. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/047174882X.ch8.
  10. Dogar M and Srinivasa S (2011) A framework for push-grasping in clutter. In: Hugh Durrant-Whyte NR and Abbeel P (eds.) Proceedings of Robotics: Science and Systems (RSS ’11). MIT Press, pp. 65–73.
  11. Erdmann M and Mason M (1988) An exploration of sensorless manipulation. IEEE Journal on Robotics and Automation 4(4): 369–379. 10.1109/56.800.
  12. Ha JS, Driess D and Toussaint M (2020) A probabilistic framework for constrained manipulations and task and motion planning under uncertainty. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). pp. 6745–6751. 10.1109/ICRA40945.2020.9196840.
  13. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). pp. 5977–5984. 10.1109/ICRA48891.2023.10160216.
  14. Hansen N (2016) The CMA evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772 .
  15. Hogan FR and Rodriguez A (2020) Reactive planar non-prehensile manipulation with hybrid model predictive control. The International Journal of Robotics Research 39(7): 755–773.
  16. Hogan N (1984) Impedance control: An approach to manipulation. In: 1984 American Control Conference. pp. 304–313. 10.23919/ACC.1984.4788393.
  17. arXiv preprint arXiv:2212.00541 .
  18. International Conference on Robotics and Automation (ICRA) .
  19. Jankowski J, Racca M and Calinon S (2022) From Key Positions to Optimal Basis Functions for Probabilistic Adaptive Control. IEEE Robotics and Automation Letters 7(2): 3242–3249.
  20. Kappen HJ (2015) Adaptive importance sampling for control and inference. Journal of Statistical Physics 162: 1244–1266. URL https://api.semanticscholar.org/CorpusID:6382641.
  21. Koval MC, Pollard NS and Srinivasa SS (2016) Pre- and post-contact policy decomposition for planar contact manipulation under uncertainty. The International Journal of Robotics Research 35(1-3): 244–264. 10.1177/0278364915594474. URL https://doi.org/10.1177/0278364915594474.
  22. The International Journal of Robotics Research 15: 533 – 556. URL https://api.semanticscholar.org/CorpusID:13041894.
  23. In: 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids). pp. 31–38. 10.1109/HUMANOIDS.2017.8239534.
  24. Mason MT (2001) Mechanics of Robotic Manipulation. MIT Press.
  25. Migimatsu T and Bohg J (2020) Object-centric task and motion planning in dynamic environments. IEEE Robotics and Automation Letters 5(2): 844–851. 10.1109/LRA.2020.2965875.
  26. Frontiers in Robotics and AI 9. 10.3389/frobt.2022.799893. URL https://www.frontiersin.org/articles/10.3389/frobt.2022.799893.
  27. Okamoto K, Goldshtein M and Tsiotras P (2018) Optimal covariance control for stochastic systems under chance constraints. IEEE Control Systems Letters 2(2): 266–271. 10.1109/LCSYS.2018.2826038.
  28. Pang T (2021) A convex quasistatic time-stepping scheme for rigid multibody systems with contact and friction. 2021 IEEE International Conference on Robotics and Automation (ICRA) : 6614–6620URL https://api.semanticscholar.org/CorpusID:228095227.
  29. IEEE Transactions on Robotics 39(6): 4691–4711. 10.1109/TRO.2023.3300230.
  30. Science Robotics 6(54): eabi4667. 10.1126/scirobotics.abi4667. URL https://www.science.org/doi/abs/10.1126/scirobotics.abi4667.
  31. In: Bach F and Blei D (eds.) Proceedings of the 32nd International Conference on Machine Learning, Proceedings of Machine Learning Research, volume 37. Lille, France: PMLR, pp. 1889–1897. URL https://proceedings.mlr.press/v37/schulman15.html.
  32. Shirai Y, Jha DK and Raghunathan AU (2023) Covariance steering for uncertain contact-rich systems. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). pp. 7923–7929. 10.1109/ICRA48891.2023.10160249.
  33. Todorov E, Erez T and Tassa Y (2012) Mujoco: A physics engine for model-based control. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 5026–5033. 10.1109/IROS.2012.6386109.
  34. Toussaint M, Ha JS and Driess D (2020) Describing physics for physical reasoning: Force-based sequential manipulation planning. IEEE Robotics and Automation Letters 5(4): 6209–6216. 10.1109/LRA.2020.3010462.
  35. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) : 13753–13760URL https://api.semanticscholar.org/CorpusID:247362576.
Citations (1)

Summary

  • The paper introduces a two-stage approach that predicts and controls belief over an object’s configuration to enable robust non-prehensile manipulation.
  • It employs a quasi-static variance prediction model, reducing reliance on costly sampling methods during the trajectory planning process.
  • It integrates contact-informed trajectory sampling within a stochastic optimization framework to improve pushing performance in uncertain environments.

Essay on "Planning for Robust Open-loop Pushing: Exploiting Quasi-static Belief Dynamics and Contact-informed Optimization"

The paper by Jankowski et al. investigates the intricate problem of generating robust open-loop pushing plans for robotic manipulation under uncertainty. The research focuses on non-prehensile manipulation methods, particularly pushing, which commonly involve uncertain and non-linear dynamics that are challenging to model accurately. Traditional approaches often rely on frequently updated feedback loops to manage such uncertainties. In contrast, this paper focuses on generating open-loop control trajectories by explicitly modeling uncertainty in the contact dynamics, allowing for robust execution without continual sensory feedback.

The cornerstone of this research is the two-stage contribution: the prediction and subsequent control of the belief over an object's configuration to achieve robust manipulation. By leveraging quasi-static models of contact dynamics, the authors attain predictions of the variance in object configurations without resorting to computationally expensive sampling methods. This approach integrates novel methods for predicting the gain in variance to constrain solutions within a sampling-based trajectory optimization framework, contributing to an enhanced ability to find robust manipulation plans.

A pivotal aspect of this work is the development of an informed trajectory sampling mechanism, which prioritizes robot trajectories that are predisposed to induce contact with the object. This mechanism is especially useful in scenarios requiring dynamic contact switching, enhancing the chances of deriving successful manipulation solutions. The methodology demonstrates significant improvements in generating bi-manual pushing trajectories capable of executing long-horizon maneuvers without relying on direct feedback from exteroceptive sensors like cameras or tactile arrays.

The paper offers detailed insights into variance prediction within the context of stochastic contact dynamics, advancing methods for predicting the variance through quasi-static approximations. This deterministic computation of variance contributes to the efficiency of planning algorithms as it circumvents the need for sampling-based perturbation assessments. The authors integrate this predictive capability within a via-point-based stochastic trajectory optimization framework (VP-STO), thereby enhancing its robustness by constraining solutions with predicted variance dynamics.

Experimental validation highlights the efficacy of the proposed approach in synthesizing manipulation behaviors that withstand variations in dynamic effects like friction, while maintaining operation in environments with uncertain initial conditions and model inaccuracies. A notable achievement is the algorithm's capability to maintain high performance in the absence of predefined manipulation primitives, thus pioneering an evolution beyond classical model-dependent strategies in contact-rich manipulation planning.

The paper's results have both practical and theoretical implications for the advancement of autonomous robotic operation in complex environments. Practically, the adoption of robust open-loop control could facilitate deployments in scenarios where sensory feedback is unreliable or delayed. Theoretically, this work lays a foundation for further exploration into the integration of stochastic control principles with contact dynamics, possibly extending to more dynamic and fast-paced manipulation tasks in future research.

As robotic systems continue to infiltrate unstructured environments, methodologies that optimize for robustness under uncertainty will likely grow in relevance and demand. This research provides an articulate framework for approaching such challenges, yielding robust manipulation trajectories driven by an insightful understanding of belief dynamics through contact. Future research could explore integrating this approach within broader autonomous systems, potentially enhancing adaptability and performance across diverse applications.

Youtube Logo Streamline Icon: https://streamlinehq.com