CushSense: Soft, Stretchable, and Comfortable Tactile-Sensing Skin for Physical Human-Robot Interaction (2405.03155v1)
Abstract: Whole-arm tactile feedback is crucial for robots to ensure safe physical interaction with their surroundings. This paper introduces CushSense, a fabric-based soft and stretchable tactile-sensing skin designed for physical human-robot interaction (pHRI) tasks such as robotic caregiving. Using stretchable fabric and hyper-elastic polymer, CushSense identifies contacts by monitoring capacitive changes due to skin deformation. CushSense is cost-effective ($\sim$US\$7 per taxel) and easy to fabricate. We detail the sensor design and fabrication process and perform characterization, highlighting its high sensing accuracy (relative error of 0.58%) and durability (0.054% accuracy drop after 1000 interactions). We also present a user study underscoring its perceived safety and comfort for the assistive task of limb manipulation. We open source all sensor-related resources on https://emprise.cs.cornell.edu/cushsense.
- S. Abdi, I. Kitsara, M. S. Hawley, and L. de Witte, “Emerging technologies and their potential for generating new assistive technologies,” Assistive Technology, vol. 33, no. sup1, pp. 17–26, 2021.
- P. M. Grice, M. D. Killpack, A. Jain, S. Vaish, J. Hawke, and C. C. Kemp, “Whole-arm tactile sensing for beneficial and acceptable contact during robotic assistance,” in 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR), pp. 1–8, IEEE, 2013.
- A. Jain, M. D. Killpack, A. Edsinger, and C. C. Kemp, “Reaching in clutter with whole-arm tactile sensing,” The International Journal of Robotics Research, vol. 32, no. 4, pp. 458–482, 2013.
- P. Mittendorfer, E. Yoshida, and G. Cheng, “Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot,” Advanced Robotics, vol. 29, no. 1, pp. 51–67, 2015.
- T. Bhattacharjee, A. Jain, S. Vaish, M. D. Killpack, and C. C. Kemp, “Tactile sensing over articulated joints with stretchable sensors,” in 2013 World Haptics Conference (WHC), pp. 103–108, IEEE, 2013.
- G. Cheng, E. Dean-Leon, F. Bergner, J. R. G. Olvera, Q. Leboutet, and P. Mittendorfer, “A comprehensive realization of robot skin: Sensors, sensing, control, and applications,” Proceedings of the IEEE, vol. 107, no. 10, pp. 2034–2051, 2019.
- Y. Zhou, J. Zhao, P. Lu, Z. Wang, and B. He, “Tacsuit: A wearable large-area, bioinspired multi-modal tactile skin for collaborative robots,” IEEE Transactions on Industrial Electronics, 2023.
- Z. Si, T. C. Yu, K. Morozov, J. McCann, and W. Yuan, “Robotsweater: Scalable, generalizable, and customizable machine-knitted tactile skins for robots,” arXiv preprint arXiv:2303.02858, 2023.
- W. Bottcher, P. Machado, N. Lama, and T. M. McGinnity, “Object recognition for robotics from tactile time series data utilising different neural network architectures,” in 2021 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, IEEE, 2021.
- D. Guo, F. Sun, B. Fang, C. Yang, and N. Xi, “Robotic grasping using visual and tactile sensing,” Information Sciences, vol. 417, pp. 274–286, 2017.
- X. A. Wu, T. M. Huh, A. Sabin, S. A. Suresh, and M. R. Cutkosky, “Tactile sensing and terrain-based gait control for small legged robots,” IEEE Transactions on Robotics, vol. 36, no. 1, pp. 15–27, 2019.
- A. Goncalves, N. Kuppuswamy, A. Beaulieu, A. Uttamchandani, K. M. Tsui, and A. Alspach, “Punyo-1: Soft tactile-sensing upper-body robot for large object manipulation and physical human interaction,” in 2022 IEEE 5th International Conference on Soft Robotics (RoboSoft), pp. 844–851, IEEE, 2022.
- L. Jamone, L. Natale, G. Metta, and G. Sandini, “Highly sensitive soft tactile sensors for an anthropomorphic robotic hand,” IEEE sensors Journal, vol. 15, no. 8, pp. 4226–4233, 2015.
- T. Paulino, P. Ribeiro, M. Neto, S. Cardoso, A. Schmitz, J. Santos-Victor, A. Bernardino, and L. Jamone, “Low-cost 3-axis soft tactile sensors for the human-friendly robot vizzy,” in 2017 IEEE international conference on robotics and automation (ICRA), pp. 966–971, IEEE, 2017.
- E. Donlon, S. Dong, M. Liu, J. Li, E. Adelson, and A. Rodriguez, “Gelslim: A high-resolution, compact, robust, and calibrated tactile-sensing finger,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1927–1934, IEEE, 2018.
- Y. Yan, Z. Hu, Z. Yang, W. Yuan, C. Song, J. Pan, and Y. Shen, “Soft magnetic skin for super-resolution tactile sensing with force self-decoupling,” Science Robotics, vol. 6, no. 51, p. eabc8801, 2021.
- T. Hellebrekers, O. Kroemer, and C. Majidi, “Soft magnetic skin for continuous deformation sensing,” Advanced Intelligent Systems, vol. 1, no. 4, p. 1900025, 2019.
- R. Bhirangi, T. Hellebrekers, C. Majidi, and A. Gupta, “Reskin: versatile, replaceable, lasting tactile skins,” arXiv preprint arXiv:2111.00071, 2021.
- W. Yuan, S. Dong, and E. H. Adelson, “Gelsight: High-resolution robot tactile sensors for estimating geometry and force,” Sensors, vol. 17, no. 12, p. 2762, 2017.
- M. Lambeta, P.-W. Chou, S. Tian, B. Yang, B. Maloon, V. R. Most, D. Stroud, R. Santos, A. Byagowi, G. Kammerer, et al., “Digit: A novel design for a low-cost compact high-resolution tactile sensor with application to in-hand manipulation,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 3838–3845, 2020.
- N. Kuppuswamy, A. Alspach, A. Uttamchandani, S. Creasey, T. Ikeda, and R. Tedrake, “Soft-bubble grippers for robust and perceptive manipulation,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 9917–9924, IEEE, 2020.
- G. Zhang, Y. Du, Y. Zhang, and M. Y. Wang, “A tactile sensing foot for single robot leg stabilization,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 14076–14082, IEEE, 2021.
- D. P. Cotton, I. M. Graz, and S. P. Lacour, “A multifunctional capacitive sensor for stretchable electronic skins,” IEEE Sensors Journal, vol. 9, no. 12, pp. 2008–2009, 2009.
- Z. Ji, H. Zhu, H. Liu, T. Chen, and L. Sun, “A flexible capacitive tactile sensor for robot skin,” in 2016 International Conference on Advanced Robotics and Mechatronics (ICARM), pp. 207–212, 2016.
- T.-H.-L. Le, A. Maslyczyk, J.-P. Roberge, and V. Duchaine, “A highly sensitive multimodal capacitive tactile sensor,” in 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 407–412, 2017.
- W. Xiong, H. Feng, H. Liwang, D. Li, W. Yao, D. Duolikun, Y. Zhou, and Y. Huang, “Multifunctional tactile feedbacks towards compliant robot manipulations via 3d-shaped electronic skin,” IEEE Sensors Journal, vol. 22, no. 9, pp. 9046–9056, 2022.
- J. A. Fishel and G. E. Loeb, “Sensing tactile microvibrations with the biotac — comparison with human sensitivity,” in 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1122–1127, 2012.
- D. M. Vogt, Y.-L. Park, and R. J. Wood, “Design and characterization of a soft multi-axis force sensor using embedded microfluidic channels,” IEEE Sensors Journal, vol. 13, no. 10, pp. 4056–4064, 2013.
- T. Kim and Y.-L. Park, “A soft three-axis load cell using liquid-filled three-dimensional microchannels in a highly deformable elastomer,” IEEE robotics and automation letters, vol. 3, no. 2, pp. 881–887, 2018.
- X. Shi, C.-H. Cheng, Y. Zheng, and P. K. A. Wai, “An egain-based flexible piezoresistive shear and normal force sensor with hysteresis analysis in normal force direction,” Journal of Micromechanics and Microengineering, vol. 26, no. 10, p. 105020, 2016.
- M. Inaba, Y. Hoshino, K. Nagasaka, T. Ninomiya, S. Kagami, and H. Inoue, “A full-body tactile sensor suit using electrically conductive fabric and strings,” in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS’96, vol. 2, pp. 450–457, IEEE, 1996.
- R. Kageyama, S. Kagami, M. Inaba, and H. Inoue, “Development of soft and distributed tactile sensors and the application to a humanoid robot,” in IEEE SMC’99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028), vol. 2, pp. 981–986 vol.2, 1999.
- T. Mukai, M. Onishi, T. Odashima, S. Hirano, and Z. Luo, “Development of the tactile sensor system of a human-interactive robot “ri-man”,” IEEE Transactions on robotics, vol. 24, no. 2, pp. 505–512, 2008.
- T. Yoshikai, H. Fukushima, M. Hayashi, and M. Inaba, “Development of soft stretchable knit sensor for humanoids’ whole-body tactile sensibility,” in 2009 9th IEEE-RAS International Conference on Humanoid Robots, pp. 624–631, IEEE, 2009.
- J. Wade, T. Bhattacharjee, R. D. Williams, and C. C. Kemp, “A force and thermal sensing skin for robots in human environments,” Robotics and Autonomous Systems, vol. 96, pp. 1–14, 2017.
- Y. Luo, Y. Li, P. Sharma, W. Shou, K. Wu, M. Foshey, B. Li, T. Palacios, A. Torralba, and W. Matusik, “Learning human–environment interactions using conformal tactile textiles,” Nature Electronics, vol. 4, no. 3, pp. 193–201, 2021.
- Z. Ye, G. Pang, K. Xu, Z. Hou, H. Lv, Y. Shen, and G. Yang, “Soft robot skin with conformal adaptability for on-body tactile perception of collaborative robots,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 5127–5134, 2022.
- P. Mittendorfer and G. Cheng, “Humanoid multimodal tactile-sensing modules,” IEEE Transactions on robotics, vol. 27, no. 3, pp. 401–410, 2011.
- J. Ulmen and M. Cutkosky, “A robust, low-cost and low-noise artificial skin for human-friendly robots,” in 2010 IEEE International conference on robotics and automation, pp. 4836–4841, IEEE, 2010.
- P. Maiolino, M. Maggiali, G. Cannata, G. Metta, and L. Natale, “A flexible and robust large scale capacitive tactile system for robots,” IEEE Sensors Journal, vol. 13, no. 10, pp. 3910–3917, 2013.
- D. Hughes, J. Lammie, and N. Correll, “A robotic skin for collision avoidance and affective touch recognition,” IEEE Robotics and Automation Letters, vol. 3, no. 3, pp. 1386–1393, 2018.
- A. Alspach, J. Kim, and K. Yamane, “Design of a soft upper body robot for physical human-robot interaction,” in 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 290–296, IEEE, 2015.
- T. Kim, J. Park, S. J. Yoon, H.-W. Park, Y.-L. Park, et al., “Design of a lightweight inflatable sensing sleeve for increased adaptability and safety of legged robots,” in 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft), pp. 257–264, IEEE, 2019.
- L. Van Duong and V. A. Ho, “Large-scale vision-based tactile sensing for robot links: Design, modeling, and evaluation,” IEEE Transactions on Robotics, vol. 37, no. 2, pp. 390–403, 2021.
- Q. K. Luu, N. H. Nguyen, et al., “Simulation, learning, and application of vision-based tactile sensing at large scale,” IEEE Transactions on Robotics, 2023.
- “CushSense website.” https://emprise.cs.cornell.edu/cushsense.
- “Stretch scuba neoprene.” https://www.joann.com/stretch-scuba-neoprene-black/17687195.html.
- K. Chow and C. C. Kemp, “Robotic repositioning of human limbs via model predictive control,” in 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 473–480, 2016.
- R. Madan, R. K. Jenamani, V. T. Nguyen, A. Moustafa, X. Hu, K. Dimitropoulou, and T. Bhattacharjee, “Sparcs: Structuring physically assistive robotics for caregiving with stakeholders-in-the-loop,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 641–648, IEEE, 2022.