Standardization of Cloth Objects and its Relevance in Robotic Manipulation (2403.04608v1)
Abstract: The field of robotics faces inherent challenges in manipulating deformable objects, particularly in understanding and standardising fabric properties like elasticity, stiffness, and friction. While the significance of these properties is evident in the realm of cloth manipulation, accurately categorising and comprehending them in real-world applications remains elusive. This study sets out to address two primary objectives: (1) to provide a framework suitable for robotics applications to characterise cloth objects, and (2) to study how these properties influence robotic manipulation tasks. Our preliminary results validate the framework's ability to characterise cloth properties and compare cloth sets, and reveal the influence that different properties have on the outcome of five manipulation primitives. We believe that, in general, results on the manipulation of clothes should be reported along with a better description of the garments used in the evaluation. This paper proposes a set of these measures.
- J. Zhu, A. Cherubini, C. Dune, D. Navarro-Alarcon, F. Alambeigi, D. Berenson, F. Ficuciello, K. Harada, J. Kober, X. Li et al., “Challenges and outlook in robotic manipulation of deformable objects,” IEEE Robotics & Automation Magazine, vol. 29, no. 3, pp. 67–77, 2022.
- V. E. Arriola-Rios, P. Guler, F. Ficuciello, D. Kragic, B. Siciliano, and J. L. Wyatt, “Modeling of deformable objects for robotic manipulation: A tutorial and review,” Frontiers in Robotics and AI, vol. 7, p. 82, 2020.
- P. Jiménez and C. Torras, “Perception of cloth in assistive robotic manipulation tasks,” Natural Computing, vol. 19, pp. 409–431, 2020.
- I. Garcia-Camacho, M. Lippi, M. C. Welle, H. Yin, R. Antonova, A. Varava, J. Borras, C. Torras, A. Marino, G. Alenya, and D. Kragic, “Benchmarking bimanual cloth manipulation,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 1111–1118, 2020.
- V. Petrík and V. Kyrki, “Feedback-based fabric strip folding,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2019, pp. 773–778.
- A. Longhini, M. Moletta, A. Reichlin, M. C. Welle, D. Held, Z. Erickson, and D. Kragic, “Edo-net: Learning elastic properties of deformable objects from graph dynamics,” in IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 3875–3881.
- A. Verleysen, T. Holvoet, R. Proesmans, C. Den Haese, and F. wyffels, “Simpler learning of robotic manipulation of clothing by utilizing diy smart textile technology,” Applied science, vol. 10, no. 12, p. 10, 2020.
- S. Grishanov, “Structure and properties of textile materials,” in Handbook of textile and industrial dyeing. Elsevier, 2011, pp. 28–63.
- Z. Liu, P. Luo, S. Qiu, X. Wang, and X. Tang, “Deepfashion: Powering robust clothes recognition and retrieval with rich annotations,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 1096–1104.
- H. Bertiche, M. Madadi, and S. Escalera, “Cloth3d: clothed 3d humans,” in European Conference on Computer Vision. Springer, 2020, pp. 344–359.
- A. Longhini, M. C. Welle, I. Mitsioni, and D. Kragic, “Textile taxonomy and classification using pulling and twisting,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021, pp. 7564–7571.
- S. Kawabata, “The standardisation and analysis of hand evaluation,” 2nd Ed. Textile Machinery Society of Japan, 1980.
- P. Giorgio Minazio, “Fast–fabric assurance by simple testing,” International Journal of Clothing Science and Technology, vol. 7, no. 2/3, pp. 43–48, 1995.
- I. Garcia-Camacho, J. Borràs, B. Calli, A. Norton, and G. Alenyà, “Household cloth object set: Fostering benchmarking in deformable object manipulation,” IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 5866–5873, 2022.
- O. Gustavsson, T. Ziegler, M. Welle, J. Bütepage, A. Varava, and D. Kragic, “Cloth manipulation based on category classification and landmark detection,” in International Journal of Advanced Robotic Systems, 2022.
- I. Garcia-Camacho, J. Borràs, and G. Alenyà, “Knowledge representation to enable high-level planning in cloth manipulation tasks,” in Proc. of the 2022 ICAPS Workshop on Knowledge Engineering for Planning and Scheduling, 2022, pp. 1–9.
- J. Borràs, G. Alenyà, and C. Torras, “A grasping-centered analysis for cloth manipulation,” IEEE Transactions on Robotics, vol. 36, no. 3, pp. 924–936, 2020.
- Y. Avigal, L. Berscheid, T. Asfour, T. Kröger, and K. Goldberg, “Speedfolding: Learning efficient bimanual folding of garments,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp. 1–8.
- H. Ha and S. Song, “Flingbot: The unreasonable effectiveness of dynamic manipulation for cloth unfolding,” in Conference on Robotic Learning (CoRL), 2021.
- N. Fahantidis, K. Paraschidis, V. Petridis, Z. Doulgeri, L. Petrou, and G. Hasapis, “Robot handling of flat textile materials,” IEEE Robot. Autom. Mag., vol. 4, no. 1, pp. 34–41, 1997.
- Y. Li, Y. Wang, Y. Yue, D. Xu, M. Case, S.-F. Chang, E. Grinspun, and P. K. Allen, “Model-driven feedforward prediction for manipulation of deformable objects,” IEEE Trans. Autom. Sci. Eng., vol. 15, no. 4, pp. 1621–1638, 2018.
- S. Tirumala, T. Weng, D. Seita, O. Kroemer, Z. Temel, and D. Held, “Learning to singulate layers of cloth using tactile feedback,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2022, pp. 7773–7780.
- W. Yuan, Y. Mo, S. Wang, and E. H. Adelson, “Active clothing material perception using tactile sensing and deep learning,” in 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 4842–4849.
- T. Kabaya and M. Kakikura, “Service robot for housekeeping: Clothing handling,” Journal of Robotics and Mechatronics, vol. 10, pp. 252–257, 1998.
- M. Shibata, T. Ota, Y. Endo, and S. Hirai, “Handling of hemmed fabrics by a single-armed robot,” in IEEE Int. Conf. on Automation Science and Engineering, 2008, pp. 882–887.
- B. Calli, A. Singh, A. Walsman, S. Srinivasa, P. Abbeel, and A. M. Dollar, “The ycb object and model set: Towards common benchmarks for manipulation research,” in Advanced Robotics (ICAR), 2015 Int. Conf. on, 2015, pp. 510–517.
- A. B. Clark, L. Cramphorn-Neal, M. Rachowiecki, and A. Gregg-Smith, “Household clothing set and benchmarks for characterising end-effector cloth manipulation,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 9211–9217.
- P. F. T., “The “handle” of cloth as a measurable quality,” Journal of the textile institute, vol. 21, pp. T377–T416, 1930.
- C. G. E., “The measurement of fabric drape,” Journal of the textile institute, vol. 59, pp. 253–260, 1968.
- A. A. Mercier, “Coefficient of friction of fabrics,” Bureau of Standards Journal of Research, pp. 243–246, 1930.
- ASTM, “Astm d76/d76m-21 standard specification for tensile testing machines for textiles,” in Book of Standards, vol. 07.01, p. 7.
- A. Longhini, M. Moletta, A. Reichlin, M. C. Welle, A. Kravberg, Y. Wang, D. Held, Z. Erickson, and D. Kragic, “Elastic context: Encoding elasticity for data-driven models of textiles,” in 2023 IEEE International Conference on Robotics and Automation (ICRA 2023), 2023, pp. 1764–1770.
- Y. Qiu, J. Zhu, C. Della Santina, M. Gienger, and J. Kober, “Robotic fabric flattening with wrinkle direction detection,” arXiv preprint arXiv:2303.04909, 2023.
- A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y. Lo et al., “Segment anything,” arXiv preprint arXiv:2304.02643, 2023.