Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Gripping (2307.04011v1)

Published 8 Jul 2023 in cs.RO and cs.LG

Abstract: The ability to detect slip, particularly incipient slip, enables robotic systems to take corrective measures to prevent a grasped object from being dropped. Therefore, slip detection can enhance the overall security of robotic gripping. However, accurately detecting incipient slip remains a significant challenge. In this paper, we propose a novel learning-based approach to detect incipient slip using the PapillArray (Contactile, Australia) tactile sensor. The resulting model is highly effective in identifying patterns associated with incipient slip, achieving a detection success rate of 95.6% when tested with an offline dataset. Furthermore, we introduce several data augmentation methods to enhance the robustness of our model. When transferring the trained model to a robotic gripping environment distinct from where the training data was collected, our model maintained robust performance, with a success rate of 96.8%, providing timely feedback for stabilizing several practical gripping tasks. Our project website: https://sites.google.com/view/incipient-slip-detection.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. R. S. Johansson and G. Westling, “Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects,” Experimental Brain Research, vol. 56, pp. 550–564, 1984.
  2. A.-S. Augurelle, A. M. Smith, T. Lejeune, and J.-L. Thonnard, “Importance of cutaneous feedback in maintaining a secure grip during manipulation of hand-held objects,” Journal of Neurophysiology, vol. 89, no. 2, pp. 665–671, 2003.
  3. A. B. Vallbo, R. S. Johansson, et al., “Properties of cutaneous mechanoreceptors in the human hand related to touch sensation,” Hum Neurobiol, vol. 3, no. 1, pp. 3–14, 1984.
  4. W. Chen, H. Khamis, I. Birznieks, N. F. Lepora, and S. J. Redmond, “Tactile sensors for friction estimation and incipient slip detection—toward dexterous robotic manipulation: A review,” IEEE Sensors Journal, vol. 18, no. 22, pp. 9049–9064, 2018.
  5. B. P. Delhaye, E. Jarocka, A. Barrea, J.-L. Thonnard, B. Edin, and P. Lefevre, “High-resolution imaging of skin deformation shows that afferents from human fingertips signal slip onset,” Elife, vol. 10, p. e64679, 2021.
  6. H. Khamis, B. Xia, and S. J. Redmond, “Real-time friction estimation for grip force control,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 1608–1614, IEEE, 2021.
  7. J. W. James, N. Pestell, and N. F. Lepora, “Slip detection with a biomimetic tactile sensor,” IEEE Robotics and Automation Letters, vol. 3, no. 4, pp. 3340–3346, 2018.
  8. M. Schöpfer, C. Schürmann, M. Pardowitz, and H. Ritter, “Using a piezo-resistive tactile sensor for detection of incipient slippage,” in ISR 2010 (41st International Symposium on Robotics) and ROBOTIK 2010 (6th German Conference on Robotics), pp. 1–7, VDE, 2010.
  9. S. du Bois de Dunilac, D. Córdova Bulens, P. Lefèvre, S. J. Redmond, and B. P. Delhaye, “Biomechanics of the finger pad in response to torsion,” Journal of the Royal Society Interface, vol. 20, no. 201, p. 20220809, 2023.
  10. B. Delhaye, P. Lefevre, and J.-L. Thonnard, “Dynamics of fingertip contact during the onset of tangential slip,” Journal of The Royal Society Interface, vol. 11, no. 100, p. 20140698, 2014.
  11. Z. Su, K. Hausman, Y. Chebotar, A. Molchanov, G. E. Loeb, G. S. Sukhatme, and S. Schaal, “Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor,” in 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 297–303, IEEE, 2015.
  12. J. W. James, S. J. Redmond, and N. F. Lepora, “A biomimetic tactile fingerprint induces incipient slip,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 9833–9839, IEEE, 2020.
  13. P. M. Ulloa, D. C. Bulens, and S. J. Redmond, “Incipient slip detection for rectilinear movements using the papillarray tactile sensor,” in 2022 IEEE Sensors, pp. 1–4, 2022.
  14. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” tech. rep., California Univ San Diego La Jolla Inst for Cognitive Science, 1985.
  15. B. E. Boser, I. M. Guyon, and V. N. Vapnik, “A training algorithm for optimal margin classifiers,” in Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152, 1992.
  16. C. Chorley, C. Melhuish, T. Pipe, and J. Rossiter, “Development of a tactile sensor based on biologically inspired edge encoding,” in 2009 International Conference on Advanced Robotics, pp. 1–6, IEEE, 2009.
  17. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, 1998.
  18. W. Yuan, S. Dong, and E. H. Adelson, “Gelsight: High-resolution robot tactile sensors for estimating geometry and force,” Sensors, vol. 17, no. 12, p. 2762, 2017.
  19. W. Yuan, R. Li, M. A. Srinivasan, and E. H. Adelson, “Measurement of shear and slip with a gelsight tactile sensor,” in 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 304–311, IEEE, 2015.
  20. S. Dong, D. Ma, E. Donlon, and A. Rodriguez, “Maintaining grasps within slipping bounds by monitoring incipient slip,” in 2019 International Conference on Robotics and Automation (ICRA), pp. 3818–3824, IEEE, 2019.
  21. H. Khamis, B. Xia, and S. J. Redmond, “A novel optical 3d force and displacement sensor–towards instrumenting the papillarray tactile sensor,” Sensors and Actuators A: Physical, vol. 291, pp. 174–187, 2019.
  22. H. Khamis, R. I. Albero, M. Salerno, A. S. Idil, A. Loizou, and S. J. Redmond, “Papillarray: An incipient slip sensor for dexterous robotic or prosthetic manipulation–design and prototype validation,” Sensors and Actuators A: Physical, vol. 270, pp. 195–204, 2018.
  23. R. S. Johansson and A. B. Vallbo, “Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin.,” The Journal of Physiology, vol. 286, no. 1, pp. 283–300, 1979.
  24. J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” arXiv preprint arXiv:1412.3555, 2014.
  25. X. Glorot, A. Bordes, and Y. Bengio, “Deep sparse rectifier neural networks,” in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, pp. 315–323, JMLR Workshop and Conference Proceedings, 2011.
  26. S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International Conference on Machine Learning, pp. 448–456, PMLR, 2015.
  27. M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, A. Y. Ng, et al., “Ros: an open-source robot operating system,” in ICRA workshop on open source software, vol. 3, p. 5, Kobe, Japan, 2009.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now