Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Control (2405.18214v1)

Published 28 May 2024 in cs.RO

Abstract: In this paper, we consider the problem of non-prehensile manipulation using grasped objects. This problem is a superset of many common manipulation skills including instances of tool-use (e.g., grasped spatula flipping a burger) and assembly (e.g., screwdriver tightening a screw). Here, we present an algorithmic approach for non-prehensile manipulation leveraging a gripper with highly compliant and high-resolution tactile sensors. Our approach solves for robot actions that drive object poses and forces to desired values while obeying the complex dynamics induced by the sensors as well as the constraints imposed by static equilibrium, object kinematics, and frictional contact. Our method is able to produce a variety of manipulation skills and is amenable to gradient-based optimization by exploiting differentiability within contact modes (e.g., specifications of sticking or sliding contacts). We evaluate 4 variants of controllers that attempt to realize these plans and demonstrate a number of complex skills including non-prehensile planar sliding and pivoting on a variety of object geometries. The perception and controls capabilities that drive these skills are the building blocks towards dexterous and reactive autonomy in unstructured environments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Matthew T Mason. Toward robotic manipulation. Annual Review of Control, Robotics, and Autonomous Systems, 1:1–28, 2018.
  2. Soft-bubble: A highly compliant dense geometry tactile sensor for robot manipulation. In 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft), pages 597–604. IEEE, 2019.
  3. Gelsight: High-resolution robot tactile sensors for estimating geometry and force. Sensors, 17(12):2762, 2017.
  4. Gelslim3. 0: High-resolution measurement of shape, force and slip in a compact tactile-sensing finger. arXiv preprint arXiv:2103.12269, 2021.
  5. Implementing tactile behaviors using fingervision. In 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), pages 241–248. IEEE, 2017.
  6. Digit: A novel design for a low-cost compact high-resolution tactile sensor with application to in-hand manipulation. IEEE Robotics and Automation Letters, 5(3):3838–3845, 2020.
  7. Alberto Rodriguez. The unstable queen: Uncertainty, mechanics, and tactile feedback. Science Robotics, 6(54):eabi4667, 2021.
  8. Tac2pose: Tactile object pose estimation from the first touch. The International Journal of Robotics Research, 42(13):1185–1209, 2023.
  9. Tactile pose estimation and policy learning for unknown object manipulation. arXiv preprint arXiv:2203.10685, 2022.
  10. Fast model-based contact patch and pose estimation for highly deformable dense-geometry tactile sensors. IEEE Robotics and Automation Letters, 5(2):1811–1818, 2019.
  11. Visuotactile 6d pose estimation of an in-hand object using vision and tactile sensor data. IEEE Robotics and Automation Letters, 7(2):2148–2155, 2022.
  12. Using collocated vision and tactile sensors for visual servoing and localization. IEEE Robotics and Automation Letters, 7(2):3427–3434, 2022.
  13. Localizing external contact using proprioceptive sensors: The contact particle filter. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 5062–5069. IEEE, 2016.
  14. Multiscope: Disambiguating in-hand object poses with proprioception and tactile feedback. arXiv preprint arXiv:2305.14204, 2023.
  15. Extrinsic contact sensing with relative-motion tracking from distributed tactile measurements. In 2021 IEEE international conference on robotics and automation (ICRA), pages 11262–11268. IEEE, 2021.
  16. Active extrinsic contact sensing: Application to general peg-in-hole insertion. In 2022 International Conference on Robotics and Automation (ICRA), pages 10241–10247. IEEE, 2022.
  17. Neural contact fields: Tracking extrinsic contact with tactile sensing. In 2023 IEEE International Conference on Robotics and Automation (ICRA), pages 12576–12582. IEEE, 2023.
  18. Planning for multi-stage forceful manipulation. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 6556–6562. IEEE, 2021.
  19. Simultaneous tactile estimation and control of extrinsic contact. arXiv preprint arXiv:2303.03385, 2023.
  20. Manipulation via membranes: High-resolution and highly deformable tactile sensing and control. In Conference on Robot Learning, pages 1850–1859. PMLR, 2023.
  21. Velocity level approximation of pressure field contact patches. IEEE Robotics and Automation Letters, 7(4):11593–11600, 2022.
  22. Seed: Series elastic end effectors in 6d for visuotactile tool use. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4684–4691. IEEE, 2022.
  23. A direct method for trajectory optimization of rigid bodies through contact. The International Journal of Robotics Research, 33(1):69–81, 2014.
  24. Variational contact-implicit trajectory optimization. In Robotics Research: The 18th International Symposium ISRR, pages 985–1000. Springer, 2020.
  25. Contact-invariant optimization for hand manipulation. In Proceedings of the ACM SIGGRAPH/Eurographics symposium on computer animation, pages 137–144, 2012.
  26. A global quasi-dynamic model for contact-trajectory optimization in manipulation. 2020.
  27. Planar in-hand manipulation via motion cones. The International Journal of Robotics Research, 39(2-3):163–182, 2020.
  28. Fast planning for 3d any-pose-reorienting using pivoting. In 2018 IEEE International Conference on Robotics and Automation (ICRA), pages 1631–1638. IEEE, 2018.
  29. Tactile dexterity: Manipulation primitives with tactile feedback. In 2020 IEEE international conference on robotics and automation (ICRA), pages 8863–8869. IEEE, 2020.
  30. Enhancing dexterity in robotic manipulation via hierarchical contact exploration. IEEE Robotics and Automation Letters, 9(1):390–397, 2023.
  31. Extrinsic dexterity: In-hand manipulation with external forces. In 2014 IEEE International Conference on Robotics and Automation (ICRA), pages 1578–1585. IEEE, 2014.
  32. Stable prehensile pushing: In-hand manipulation with alternating sticking contacts. In 2018 IEEE International Conference on Robotics and Automation (ICRA), pages 254–261. IEEE, 2018.
  33. Manipulation with shared grasping. arXiv preprint arXiv:2006.02996, 2020.
  34. Robust pivoting: Exploiting frictional stability using bilevel optimization. In 2022 International Conference on Robotics and Automation (ICRA), pages 992–998. IEEE, 2022.
  35. Manipulation of unknown objects via contact configuration regulation. In 2022 International Conference on Robotics and Automation (ICRA), pages 2693–2699. IEEE, 2022.
  36. Object manipulation through contact configuration regulation: multiple and intermittent contacts. In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 8735–8743. IEEE, 2023.
  37. Tactile tool manipulation. arXiv preprint arXiv:2301.06698, 2023.
  38. Optnet: Differentiable optimization as a layer in neural networks. In International Conference on Machine Learning, pages 136–145. PMLR, 2017.
  39. Differentiable convex optimization layers. Advances in neural information processing systems, 32, 2019.
  40. Information theoretic mpc for model-based reinforcement learning. In 2017 IEEE International Conference on Robotics and Automation (ICRA), pages 1714–1721. IEEE, 2017.
  41. Sample-efficient cross-entropy method for real-time planning. In Conference on Robot Learning 2020, 2020.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets