GelLink: A Compact Multi-phalanx Finger with Vision-based Tactile Sensing and Proprioception (2403.14887v2)
Abstract: Compared to fully-actuated robotic end-effectors, underactuated ones are generally more adaptive, robust, and cost-effective. However, state estimation for underactuated hands is usually more challenging. Vision-based tactile sensors, like Gelsight, can mitigate this issue by providing high-resolution tactile sensing and accurate proprioceptive sensing. As such, we present GelLink, a compact, underactuated, linkage-driven robotic finger with low-cost, high-resolution vision-based tactile sensing and proprioceptive sensing capabilities. In order to reduce the amount of embedded hardware, i.e. the cameras and motors, we optimize the linkage transmission with a planar linkage mechanism simulator and develop a planar reflection simulator to simplify the tactile sensing hardware. As a result, GelLink only requires one motor to actuate the three phalanges, and one camera to capture tactile signals along the entire finger. Overall, GelLink is a compact robotic finger that shows adaptability and robustness when performing grasping tasks. The integration of vision-based tactile sensors can significantly enhance the capabilities of underactuated fingers and potentially broaden their future usage.
- C.-H. Xiong, W.-R. Chen, B.-Y. Sun, M.-J. Liu, S.-G. Yue, and W.-B. Chen, “Design and implementation of an anthropomorphic hand for replicating human grasping functions,” IEEE Transactions on Robotics, vol. 32, no. 3, pp. 652–671, 2016.
- F. Hundhausen, J. Starke, and T. Asfour, “A soft humanoid hand with in-finger visual perception,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2020, pp. 8722–8728.
- S. Puhlmann, J. Harris, and O. Brock, “Rbo hand 3: A platform for soft dexterous manipulation,” IEEE Transactions on Robotics, vol. 38, no. 6, pp. 3434–3449, 2022.
- J. Martin and M. Grossard, “Design of a fully modular and backdrivable dexterous hand,” The International Journal of Robotics Research, vol. 33, no. 5, pp. 783–798, 2014.
- U. Kim, D. Jung, H. Jeong, J. Park, H.-M. Jung, J. Cheong, H. R. Choi, H. Do, and C. Park, “Integrated linkage-driven dexterous anthropomorphic robotic hand,” Nature communications, vol. 12, no. 1, p. 7177, 2021.
- C. Gosselin, F. Pelletier, and T. Laliberte, “An anthropomorphic underactuated robotic hand with 15 dofs and a single actuator,” in 2008 IEEE International Conference on Robotics and Automation. IEEE, 2008, pp. 749–754.
- M. G. Catalano, G. Grioli, E. Farnioli, A. Serio, C. Piazza, and A. Bicchi, “Adaptive synergies for the design and control of the pisa/iit softhand,” The International Journal of Robotics Research, vol. 33, no. 5, pp. 768–782, 2014.
- Y. She, S. Q. Liu, P. Yu, and E. Adelson, “Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing,” in 2020 ieee international conference on robotics and automation (icra). IEEE, 2020, pp. 10 075–10 081.
- A. J. Spiers, M. V. Liarokapis, B. Calli, and A. M. Dollar, “Single-grasp object classification and feature extraction with simple robot hands and tactile sensors,” IEEE transactions on haptics, vol. 9, no. 2, pp. 207–220, 2016.
- S. J. Yoon, M. Choi, B. Jeong, and Y.-L. Park, “Elongatable gripper fingers with integrated stretchable tactile sensors for underactuated grasping and dexterous manipulation,” IEEE Transactions on Robotics, vol. 38, no. 4, pp. 2179–2193, 2022.
- Z. Lu, H. Guo, W. Zhang, and H. Yu, “Gtac-gripper: A reconfigurable under-actuated four-fingered robotic gripper with tactile sensing,” IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 7232–7239, 2022.
- S. Wang, Y. She, B. Romero, and E. Adelson, “Gelsight wedge: Measuring high-resolution 3d contact geometry with a compact robot finger,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 6468–6475.
- W. Yuan, S. Dong, and E. H. Adelson, “Gelsight: High-resolution robot tactile sensors for estimating geometry and force,” Sensors, vol. 17, no. 12, p. 2762, 2017.
- I. H. Taylor, S. Dong, and A. Rodriguez, “Gelslim 3.0: High-resolution measurement of shape, force and slip in a compact tactile-sensing finger,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 10 781–10 787.
- W. K. Do and M. Kennedy, “Densetact: Optical tactile sensor for dense shape reconstruction,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 6188–6194.
- H. Sun, K. J. Kuchenbecker, and G. Martius, “A soft thumb-sized vision-based sensor with accurate all-round force perception,” Nature Machine Intelligence, vol. 4, no. 2, pp. 135–145, 2022.
- A. Padmanabha, F. Ebert, S. Tian, R. Calandra, C. Finn, and S. Levine, “Omnitact: A multi-directional high-resolution touch sensor,” in 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2020, pp. 618–624.
- M. H. Tippur and E. H. Adelson, “Gelsight360: An omnidirectional camera-based tactile sensor for dexterous robotic manipulation,” in 2023 IEEE International Conference on Soft Robotics (RoboSoft). IEEE, 2023, pp. 1–8.
- M. Lambeta, P.-W. Chou, S. Tian, B. Yang, B. Maloon, V. R. Most, D. Stroud, R. Santos, A. Byagowi, G. Kammerer, et al., “Digit: A novel design for a low-cost compact high-resolution tactile sensor with application to in-hand manipulation,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 3838–3845, 2020.
- J. Zhao and E. Adelson, “Gelsight svelte: A human finger-shaped single-camera tactile robot finger with large sensing coverage and proprioceptive sensing,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2023.
- A. Wilson, S. Wang, B. Romero, and E. Adelson, “Design of a fully actuated robotic hand with multiple gelsight tactile sensors,” arXiv preprint arXiv:2002.02474, 2020.
- S. Q. Liu, L. Z. Yañez, and E. H. Adelson, “Gelsight endoflex: A soft endoskeleton hand with continuous high-resolution tactile sensing,” in 2023 IEEE International Conference on Soft Robotics (RoboSoft). IEEE, 2023, pp. 1–6.
- E. Donlon, S. Dong, M. Liu, J. Li, E. Adelson, and A. Rodriguez, “Gelslim: A high-resolution, compact, robust, and calibrated tactile-sensing finger,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2018, pp. 1927–1934.
- Z. Li, F. Miao, Z. Yang, and H. Wang, “An anthropometric study for the anthropomorphic design of tomato-harvesting robots,” Computers and Electronics in Agriculture, vol. 163, p. 104881, 2019.
- “Mechanism python library,” https://github.com/gabemorris12/mechanism, accessed: 2023-08-05.
- S. S. Balli and S. Chand, “Transmission angle in mechanisms (triangle in mech),” Mechanism and Machine Theory, vol. 37, no. 2, pp. 175–195, 2002.
- D. C. Tao, “Applied linkage synthesis,” (No Title), pp. 7–12, 1964.
- U. Ramer, “An iterative procedure for the polygonal approximation of plane curves,” Computer graphics and image processing, vol. 1, no. 3, pp. 244–256, 1972.
- S. Q. Liu, Y. Ma, and E. H. Adelson, “Gelsight baby fin ray: A compact, compliant, flexible finger with high-resolution tactile sensing,” in 2023 IEEE International Conference on Soft Robotics (RoboSoft). IEEE, 2023, pp. 1–8.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.