Papers
Topics
Authors
Recent
2000 character limit reached

Soft Finger Grasp Force and Contact State Estimation from Tactile Sensors (2410.19684v1)

Published 25 Oct 2024 in cs.RO

Abstract: Soft robotic fingers can improve adaptability in grasping and manipulation, compensating for geometric variation in object or environmental contact, but today lack force capacity and fine dexterity. Integrated tactile sensors can provide grasp and task information which can improve dexterity,but should ideally not require object-specific training. The total force vector exerted by a finger provides general information to the internal grasp forces (e.g. for grasp stability) and, when summed over fingers, an estimate of the external force acting on the grasped object (e.g. for task-level control). In this study, we investigate the efficacy of estimating finger force from integrated soft sensors and use it to estimate contact states. We use a neural network for force regression, collecting labelled data with a force/torque sensor and a range of test objects. Subsequently, we apply this model in a plug-in task scenario and demonstrate its validity in estimating contact states.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. J. Shintake, V. Cacucciolo, D. Floreano, and H. Shea, “Soft robotic grippers,” Advanced Materials, vol. 30, no. 29, p. 1707035, 2018.
  2. A. Billard and D. Kragic, “Trends and challenges in robot manipulation,” Science, vol. 364, no. 6446, p. eaat8414, Jun. 2019.
  3. R. M. Hartisch and K. Haninger, “Compliant finray-effect gripper for high-speed robotic assembly of electrical components,” arXiv preprint arXiv:2301.08431, 2023.
  4. I. H. Taylor, S. Dong, and A. Rodriguez, “GelSlim 3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Finger,” in 2022 International Conference on Robotics and Automation (ICRA), May 2022, pp. 10 781–10 787.
  5. S. Liu, F. Wang, Z. Liu, W. Zhang, Y. Tian, and D. Zhang, “A Two-Finger Soft-Robotic Gripper With Enveloping and Pinching Grasping Modes,” IEEE/ASME Transactions on Mechatronics, vol. 26, no. 1, pp. 146–155, Feb. 2021.
  6. W. Park, S. Seo, J. Oh, and J. Bae, “A sensorized hybrid gripper to evaluate a grasping quality based on a largest minimum wrench,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 3243–3250, 2020.
  7. M. Li, A. Pal, A. Aghakhani, A. Pena-Francesch, and M. Sitti, “Soft actuators for real-world applications,” Nature Reviews Materials, vol. 7, no. 3, pp. 235–249, Nov. 2021.
  8. C. J. Stabile, D. J. Levine, G. M. Iyer, C. Majidi, and K. T. Turner, “The role of stiffness in versatile robotic grasping,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4733–4740, 2022.
  9. H. Jang, V. Petrichenko, J. Bae, and K. Haninger, “Soft finger dynamic stability and slip by coulomb friction and bulk stiffness,” arXiv preprint arXiv:2310.04846, 2023.
  10. O. Azami, K. Ishibashi, M. Komagata, and K. Yamamoto, “Development of hydraulically-driven soft hand for handling heavy vegetables and its experimental evaluation,” in 2023 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2023, pp. 2577–2583.
  11. C. B. Teeple, T. N. Koutros, M. A. Graule, and R. J. Wood, “Multi-segment soft robotic fingers enable robust precision grasping,” The International Journal of Robotics Research, vol. 39, no. 14, pp. 1647–1667, 2020.
  12. S. Tian, F. Ebert, D. Jayaraman, M. Mudigonda, C. Finn, R. Calandra, and S. Levine, “Manipulation by feel: Touch-based control with deep predictive models,” in 2019 International Conference on Robotics and Automation (ICRA).   IEEE, 2019, pp. 818–824.
  13. Z. Xu and Y. She, “LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping,” Mar. 2024.
  14. M. Li, Y. Bekiroglu, D. Kragic, and A. Billard, “Learning of grasp adaptation through experience and tactile sensing,” in 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sep. 2014, pp. 3339–3346.
  15. S. Kim, D. K. Jha, D. Romeres, P. Patre, and A. Rodriguez, “Simultaneous Tactile Estimation and Control of Extrinsic Contact,” Mar. 2023.
  16. D. De Barrie, M. Pandya, H. Pandya, M. Hanheide, and K. Elgeneidy, “A deep learning method for vision based force prediction of a soft fin ray gripper using simulation data,” Frontiers in Robotics and AI, vol. 8, p. 631371, 2021.
  17. H. J. T. Suh, N. Kuppuswamy, T. Pang, P. Mitiguy, A. Alspach, and R. Tedrake, “SEED: Series Elastic End Effectors in 6D for Visuotactile Tool Use,” Nov. 2021.
  18. L. Massari, E. Schena, C. Massaroni, P. Saccomandi, A. Menciassi, E. Sinibaldi, and C. M. Oddo, “A machine-learning-based approach to solve both contact location and force in soft material tactile sensors,” Soft robotics, vol. 7, no. 4, pp. 409–420, 2020.
  19. H. Dong, C. Qiu, D. K. Prasad, Y. Pan, J. Dai, and I.-M. Chen, “Enabling grasp action: Generalized quality evaluation of grasp stability via contact stiffness from contact mechanics insight,” Mechanism and Machine Theory, vol. 134, pp. 625–644, 2019.
  20. J. Pankert and M. Hutter, “Learning Contact-Based State Estimation for Assembly Tasks,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023).   IEEE, 2023.
  21. K. Haninger, M. Radke, R. Hartisch, and J. Krüger, “Contact information flow and design of compliance,” in 2022 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).   IEEE, 2022, pp. 1601–1607.
  22. F. R. Hogan, J. Ballester, S. Dong, and A. Rodriguez, “Tactile Dexterity: Manipulation Primitives with Tactile Feedback,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), May 2020, pp. 8863–8869.
  23. M. B. Villalonga, A. Rodriguez, B. Lim, E. Valls, and T. Sechopoulos, “Tactile object pose estimation from the first touch with geometric contact rendering,” in Conference on Robot Learning.   PMLR, 2021, pp. 1015–1029.
  24. T. G. Thuruthel, B. Shih, C. Laschi, and M. T. Tolley, “Soft robot perception using embedded soft sensors and recurrent neural networks,” Science Robotics, vol. 4, no. 26, p. eaav1488, Jan. 2019.
  25. X. Huang, W. Guo, S. Liu, Y. Li, Y. Qiu, H. Fang, G. Yang, K. Zhu, Z. Yin, Z. Li, and H. Wu, “Flexible Mechanical Metamaterials Enabled Electronic Skin for Real-Time Detection of Unstable Grasping in Robotic Manipulation,” Advanced Functional Materials, vol. 32, no. 23, p. 2109109, Jun. 2022.
  26. Z. Zhang, J. Dequidt, and C. Duriez, “Vision-based sensing of external forces acting on soft robots using finite element method,” IEEE Robotics and Automation Letters, vol. 3, no. 3, pp. 1529–1536, 2018.
  27. M. A. Roa and R. Suárez, “Grasp quality measures: Review and performance,” Autonomous Robots, vol. 38, no. 1, pp. 65–88, Jan. 2015.
  28. N. Chavan-Dafle, R. Holladay, and A. Rodriguez, “In-Hand Manipulation via Motion Cones,” Feb. 2019.
  29. P. Polygerinos, Z. Wang, J. T. Overvelde, K. C. Galloway, R. J. Wood, K. Bertoldi, and C. J. Walsh, “Modeling of soft fiber-reinforced bending actuators,” IEEE Transactions on Robotics, vol. 31, no. 3, pp. 778–789, 2015.
  30. H. Böse and E. Fuß, “Novel dielectric elastomer sensors for compression load detection,” in Electroactive Polymer Actuators and Devices (EAPAD) 2014, vol. 9056.   SPIE, 2014, pp. 232–244.
  31. B. O’Brien, T. Gisby, and I. A. Anderson, “Stretch sensors for human body motion,” in Electroactive Polymer Actuators and Devices (EAPAD) 2014, vol. 9056.   SPIE, 2014, pp. 254–262.
  32. L. Buitinck, G. Louppe, M. Blondel, F. Pedregosa, A. Mueller, O. Grisel, V. Niculae, P. Prettenhofer, A. Gramfort, J. Grobler, R. Layton, J. VanderPlas, A. Joly, B. Holt, and G. Varoquaux, “API design for machine learning software: experiences from the scikit-learn project,” in ECML PKDD Workshop: Languages for Data Mining and Machine Learning, 2013, pp. 108–122.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up