Papers
Topics
Authors
Recent
Search
2000 character limit reached

Perception, Control and Hardware for In-Hand Slip-Aware Object Manipulation with Parallel Grippers

Published 25 Oct 2024 in cs.RO, cs.SY, and eess.SY | (2410.19660v1)

Abstract: Dexterous in-hand manipulation offers significant potential to enhance robotic manipulator capabilities. This paper presents a comprehensive study on custom sensors and parallel gripper hardware specifically designed for in-hand slippage control. The gripper features rapid closed-loop, low-level force control, and is equipped with sensors capable of independently measuring contact forces and sliding velocities. Our system can quickly estimate essential object properties during pick-up using only in-hand sensing, without relying on prior object information. We introduce four distinct slippage controllers: gravity-assisted trajectory following for both rotational and linear slippage, a hinge controller that maintains the object's orientation while the gripper rotates, and a slip-avoidance controller. The system is mounted on a robot arm and validated through extensive experiments involving a diverse range of objects, demonstrating its novel capabilities.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Arslan Waltersson G and Karayiannidis Y (2024) Planar friction modeling with lugre dynamics and limit surfaces. IEEE Transactions on Robotics 40: 3166–3180. 10.1109/TRO.2024.3410455.
  2. Bi T, Sferrazza C and D’Andrea R (2021) Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulation. URL https://arxiv.org/abs/2101.02680.
  3. Chavan-Dafle N, Holladay R and Rodriguez A (2020) Planar in-hand manipulation via motion cones. The International Journal of Robotics Research 39(2-3): 163–182. 10.1177/0278364919880257. URL https://doi.org/10.1177/0278364919880257.
  4. In: 2015 IEEE International Conference on Automation Science and Engineering (CASE). pp. 1249–1255. 10.1109/CoASE.2015.7294269.
  5. IEEE Sensors Journal 18(22): 9049–9064. 10.1109/JSEN.2018.2868340.
  6. IEEE Robotics and Automation Letters 6(2): 1614–1621. 10.1109/LRA.2021.3058931.
  7. Sensors 18(4). 10.3390/s18040948. URL https://www.mdpi.com/1424-8220/18/4/948.
  8. In: 2009 International Conference on Advanced Robotics. pp. 1–6.
  9. Costanzo M, De Maria G and Natale C (2023) Detecting and controlling slip through estimation and control of the sliding velocity. Applied Sciences 13(2). 10.3390/app13020921. URL https://www.mdpi.com/2076-3417/13/2/921.
  10. Sensors 19(4). 10.3390/s19040966. URL https://www.mdpi.com/1424-8220/19/4/966.
  11. In: 2014 IEEE International Conference on Robotics and Automation (ICRA). pp. 1578–1585. 10.1109/ICRA.2014.6907062.
  12. IEEE Transactions on Robotics 26(1): 1–20. 10.1109/TRO.2009.2033627.
  13. IEEE/ASME Transactions on Mechatronics 20(1): 263–274. 10.1109/TMECH.2014.2321680.
  14. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). pp. 3883–3889. 10.1109/ICRA.2015.7139740.
  15. De Maria G, Natale C and Pirozzi S (2012) Force/tactile sensor for robotic applications. Sensors and Actuators A: Physical 175: 60–72. https://doi.org/10.1016/j.sna.2011.12.042. URL https://www.sciencedirect.com/science/article/pii/S0924424711007564.
  16. Gloumakov Y, Huh TM and Stuart HS (2024) Fast in-hand slip control on unfeatured objects with programmable tactile sensing. IEEE Robotics and Automation Letters 9(7): 6059–6066. 10.1109/LRA.2024.3400148.
  17. Goyal S, Ruina A and Papadopoulos J (1989) Limit surface and moment function descriptions of planar sliding. In: 1989 IEEE International Conference on Robotics and Automation. IEEE Computer Society, pp. 794–795.
  18. Goyal S, Ruina A and Papadopoulos J (1991) Planar sliding with dry friction part 1. limit surface and moment function. Wear 143(2): 307–330.
  19. Hertz H (1896) On the contact of solids—on the contact of rigid elastic solids and on hardness. Miscellaneous papers : 146–183.
  20. Holladay A, Paolini R and Mason MT (2015) A general framework for open-loop pivoting. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). pp. 3675–3681. 10.1109/ICRA.2015.7139709.
  21. Hou Y, Jia Z and Mason MT (2018) Fast planning for 3d any-pose-reorienting using pivoting. In: 2018 IEEE International Conference on Robotics and Automation (ICRA). pp. 1631–1638. 10.1109/ICRA.2018.8462834.
  22. Howe R and Cutkosky M (1989) Sensing skin acceleration for slip and texture perception. In: Proceedings, 1989 International Conference on Robotics and Automation. pp. 145–150 vol.1. 10.1109/ROBOT.1989.99981.
  23. IEEE Robotics and Automation Letters 5(2): 2562–2569. 10.1109/LRA.2020.2972881.
  24. Höver R and Harders M (2010) Measuring and incorporating slip in data-driven haptic rendering. In: 2010 IEEE Haptics Symposium. pp. 175–182. 10.1109/HAPTIC.2010.5444658.
  25. Johnson MK and Adelson EH (2009) Retrographic sensing for the measurement of surface texture and shape. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1070–1077. 10.1109/CVPR.2009.5206534.
  26. IEEE Computer Graphics and Applications 25(1): 68–75. 10.1109/MCG.2005.27.
  27. Kappassov Z, Corrales JA and Perdereau V (2015) Tactile sensing in dexterous robot hands — review. Robotics and Autonomous Systems 74: 195–220. https://doi.org/10.1016/j.robot.2015.07.015. URL https://www.sciencedirect.com/science/article/pii/S0921889015001621.
  28. Sensors and Actuators A: Physical 270: 195–204. https://doi.org/10.1016/j.sna.2017.12.058. URL https://www.sciencedirect.com/science/article/pii/S0924424717313419.
  29. IEEE Robotics and Automation Letters 6(2): 2838–2845. 10.1109/LRA.2021.3062585.
  30. Piga N and Natale L (2023) Adaptive tactile force control in a parallel gripper with low positioning resolution. IEEE Robotics and Automation Letters PP: 1–8. 10.1109/LRA.2023.3297061.
  31. Sani HN and Meek SG (2011) Characterizing the performance of an optical slip sensor for grip control in a prosthesis. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 1927–1932. 10.1109/IROS.2011.6095181.
  32. Journal of Open Source Software 7(74): 4232. 10.21105/joss.04232. URL https://doi.org/10.21105/joss.04232.
  33. Stribeck R (1902) Die wesentlichen eigenschaften der gleit-und rollenlager [the key qualities of sliding and roller bearings]. Z. Vereines Seutscher Ing. 46: 1432–1437. URL https://cir.nii.ac.jp/crid/1572824500551324032.
  34. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 5636–5641. 10.1109/IROS.2015.7354177.
  35. In: 2016 IEEE International Conference on Robotics and Automation (ICRA). pp. 399–406. 10.1109/ICRA.2016.7487159.
  36. URL https://arxiv.org/abs/2101.11812.
  37. In: 2016 IEEE Information Technology, Networking, Electronic and Automation Control Conference. pp. 696–700. 10.1109/ITNEC.2016.7560450.
  38. Wang Y, Chen J and Mei D (2019) Flexible tactile sensor array for slippage and grooved surface recognition in sliding movement. Micromachines 10(9). 10.3390/mi10090579. URL https://www.mdpi.com/2072-666X/10/9/579.
  39. Soft Robotics 5. 10.1089/soro.2017.0052.
  40. Cham: Springer International Publishing. ISBN 978-3-319-03017-3, pp. 405–429. 10.1007/978-3-319-03017-3_19. URL https://doi.org/10.1007/978-3-319-03017-3_19.
  41. Xydas N and Kao I (1999) Modeling of contact mechanics and friction limit surfaces for soft fingers in robotics, with experimental results. The International Journal of Robotics Research 18(9): 941–950.
  42. Micromachines 13(10). 10.3390/mi13101724. URL https://www.mdpi.com/2072-666X/13/10/1724.
  43. Yousef H, Boukallel M and Althoefer K (2011) Tactile sensing for dexterous in-hand manipulation in robotics—a review. Sensors and Actuators A: Physical 167(2): 171–187. https://doi.org/10.1016/j.sna.2011.02.038. URL https://www.sciencedirect.com/science/article/pii/S0924424711001105. Solid-State Sensors, Actuators and Microsystems Workshop.
  44. Yuan W, Dong S and Adelson EH (2017) Gelsight: High-resolution robot tactile sensors for estimating geometry and force. Sensors 17(12). 10.3390/s17122762. URL https://www.mdpi.com/1424-8220/17/12/2762.
  45. In: 2010 International Conference on Modelling, Identification and Control, ICMIC 2010, volume 9. pp. 710 – 716.
  46. In: 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO). pp. 1855–1860. 10.1109/ROBIO55434.2022.10011873.
  47. Åström KJ and Canudas-de Wit C (2008) Revisiting the LuGre friction model. IEEE Control Systems Magazine 28(6): 101–114. 10.1109/MCS.2008.929425.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.