Perception, Control and Hardware for In-Hand Slip-Aware Object Manipulation with Parallel Grippers
Abstract: Dexterous in-hand manipulation offers significant potential to enhance robotic manipulator capabilities. This paper presents a comprehensive study on custom sensors and parallel gripper hardware specifically designed for in-hand slippage control. The gripper features rapid closed-loop, low-level force control, and is equipped with sensors capable of independently measuring contact forces and sliding velocities. Our system can quickly estimate essential object properties during pick-up using only in-hand sensing, without relying on prior object information. We introduce four distinct slippage controllers: gravity-assisted trajectory following for both rotational and linear slippage, a hinge controller that maintains the object's orientation while the gripper rotates, and a slip-avoidance controller. The system is mounted on a robot arm and validated through extensive experiments involving a diverse range of objects, demonstrating its novel capabilities.
- Arslan Waltersson G and Karayiannidis Y (2024) Planar friction modeling with lugre dynamics and limit surfaces. IEEE Transactions on Robotics 40: 3166–3180. 10.1109/TRO.2024.3410455.
- Bi T, Sferrazza C and D’Andrea R (2021) Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulation. URL https://arxiv.org/abs/2101.02680.
- Chavan-Dafle N, Holladay R and Rodriguez A (2020) Planar in-hand manipulation via motion cones. The International Journal of Robotics Research 39(2-3): 163–182. 10.1177/0278364919880257. URL https://doi.org/10.1177/0278364919880257.
- In: 2015 IEEE International Conference on Automation Science and Engineering (CASE). pp. 1249–1255. 10.1109/CoASE.2015.7294269.
- IEEE Sensors Journal 18(22): 9049–9064. 10.1109/JSEN.2018.2868340.
- IEEE Robotics and Automation Letters 6(2): 1614–1621. 10.1109/LRA.2021.3058931.
- Sensors 18(4). 10.3390/s18040948. URL https://www.mdpi.com/1424-8220/18/4/948.
- In: 2009 International Conference on Advanced Robotics. pp. 1–6.
- Costanzo M, De Maria G and Natale C (2023) Detecting and controlling slip through estimation and control of the sliding velocity. Applied Sciences 13(2). 10.3390/app13020921. URL https://www.mdpi.com/2076-3417/13/2/921.
- Sensors 19(4). 10.3390/s19040966. URL https://www.mdpi.com/1424-8220/19/4/966.
- In: 2014 IEEE International Conference on Robotics and Automation (ICRA). pp. 1578–1585. 10.1109/ICRA.2014.6907062.
- IEEE Transactions on Robotics 26(1): 1–20. 10.1109/TRO.2009.2033627.
- IEEE/ASME Transactions on Mechatronics 20(1): 263–274. 10.1109/TMECH.2014.2321680.
- In: 2015 IEEE International Conference on Robotics and Automation (ICRA). pp. 3883–3889. 10.1109/ICRA.2015.7139740.
- De Maria G, Natale C and Pirozzi S (2012) Force/tactile sensor for robotic applications. Sensors and Actuators A: Physical 175: 60–72. https://doi.org/10.1016/j.sna.2011.12.042. URL https://www.sciencedirect.com/science/article/pii/S0924424711007564.
- Gloumakov Y, Huh TM and Stuart HS (2024) Fast in-hand slip control on unfeatured objects with programmable tactile sensing. IEEE Robotics and Automation Letters 9(7): 6059–6066. 10.1109/LRA.2024.3400148.
- Goyal S, Ruina A and Papadopoulos J (1989) Limit surface and moment function descriptions of planar sliding. In: 1989 IEEE International Conference on Robotics and Automation. IEEE Computer Society, pp. 794–795.
- Goyal S, Ruina A and Papadopoulos J (1991) Planar sliding with dry friction part 1. limit surface and moment function. Wear 143(2): 307–330.
- Hertz H (1896) On the contact of solids—on the contact of rigid elastic solids and on hardness. Miscellaneous papers : 146–183.
- Holladay A, Paolini R and Mason MT (2015) A general framework for open-loop pivoting. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). pp. 3675–3681. 10.1109/ICRA.2015.7139709.
- Hou Y, Jia Z and Mason MT (2018) Fast planning for 3d any-pose-reorienting using pivoting. In: 2018 IEEE International Conference on Robotics and Automation (ICRA). pp. 1631–1638. 10.1109/ICRA.2018.8462834.
- Howe R and Cutkosky M (1989) Sensing skin acceleration for slip and texture perception. In: Proceedings, 1989 International Conference on Robotics and Automation. pp. 145–150 vol.1. 10.1109/ROBOT.1989.99981.
- IEEE Robotics and Automation Letters 5(2): 2562–2569. 10.1109/LRA.2020.2972881.
- Höver R and Harders M (2010) Measuring and incorporating slip in data-driven haptic rendering. In: 2010 IEEE Haptics Symposium. pp. 175–182. 10.1109/HAPTIC.2010.5444658.
- Johnson MK and Adelson EH (2009) Retrographic sensing for the measurement of surface texture and shape. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1070–1077. 10.1109/CVPR.2009.5206534.
- IEEE Computer Graphics and Applications 25(1): 68–75. 10.1109/MCG.2005.27.
- Kappassov Z, Corrales JA and Perdereau V (2015) Tactile sensing in dexterous robot hands — review. Robotics and Autonomous Systems 74: 195–220. https://doi.org/10.1016/j.robot.2015.07.015. URL https://www.sciencedirect.com/science/article/pii/S0921889015001621.
- Sensors and Actuators A: Physical 270: 195–204. https://doi.org/10.1016/j.sna.2017.12.058. URL https://www.sciencedirect.com/science/article/pii/S0924424717313419.
- IEEE Robotics and Automation Letters 6(2): 2838–2845. 10.1109/LRA.2021.3062585.
- Piga N and Natale L (2023) Adaptive tactile force control in a parallel gripper with low positioning resolution. IEEE Robotics and Automation Letters PP: 1–8. 10.1109/LRA.2023.3297061.
- Sani HN and Meek SG (2011) Characterizing the performance of an optical slip sensor for grip control in a prosthesis. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 1927–1932. 10.1109/IROS.2011.6095181.
- Journal of Open Source Software 7(74): 4232. 10.21105/joss.04232. URL https://doi.org/10.21105/joss.04232.
- Stribeck R (1902) Die wesentlichen eigenschaften der gleit-und rollenlager [the key qualities of sliding and roller bearings]. Z. Vereines Seutscher Ing. 46: 1432–1437. URL https://cir.nii.ac.jp/crid/1572824500551324032.
- In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 5636–5641. 10.1109/IROS.2015.7354177.
- In: 2016 IEEE International Conference on Robotics and Automation (ICRA). pp. 399–406. 10.1109/ICRA.2016.7487159.
- URL https://arxiv.org/abs/2101.11812.
- In: 2016 IEEE Information Technology, Networking, Electronic and Automation Control Conference. pp. 696–700. 10.1109/ITNEC.2016.7560450.
- Wang Y, Chen J and Mei D (2019) Flexible tactile sensor array for slippage and grooved surface recognition in sliding movement. Micromachines 10(9). 10.3390/mi10090579. URL https://www.mdpi.com/2072-666X/10/9/579.
- Soft Robotics 5. 10.1089/soro.2017.0052.
- Cham: Springer International Publishing. ISBN 978-3-319-03017-3, pp. 405–429. 10.1007/978-3-319-03017-3_19. URL https://doi.org/10.1007/978-3-319-03017-3_19.
- Xydas N and Kao I (1999) Modeling of contact mechanics and friction limit surfaces for soft fingers in robotics, with experimental results. The International Journal of Robotics Research 18(9): 941–950.
- Micromachines 13(10). 10.3390/mi13101724. URL https://www.mdpi.com/2072-666X/13/10/1724.
- Yousef H, Boukallel M and Althoefer K (2011) Tactile sensing for dexterous in-hand manipulation in robotics—a review. Sensors and Actuators A: Physical 167(2): 171–187. https://doi.org/10.1016/j.sna.2011.02.038. URL https://www.sciencedirect.com/science/article/pii/S0924424711001105. Solid-State Sensors, Actuators and Microsystems Workshop.
- Yuan W, Dong S and Adelson EH (2017) Gelsight: High-resolution robot tactile sensors for estimating geometry and force. Sensors 17(12). 10.3390/s17122762. URL https://www.mdpi.com/1424-8220/17/12/2762.
- In: 2010 International Conference on Modelling, Identification and Control, ICMIC 2010, volume 9. pp. 710 – 716.
- In: 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO). pp. 1855–1860. 10.1109/ROBIO55434.2022.10011873.
- Åström KJ and Canudas-de Wit C (2008) Revisiting the LuGre friction model. IEEE Control Systems Magazine 28(6): 101–114. 10.1109/MCS.2008.929425.
Paper Prompts
Sign up for free to create and run prompts on this paper.