2000 character limit reached
Autonomous Quilt Spreading for Caregiving Robots
Published 24 May 2024 in cs.RO and cs.AI | (2405.15373v1)
Abstract: In this work, we propose a novel strategy to ensure infants, who inadvertently displace their quilts during sleep, are promptly and accurately re-covered. Our approach is formulated into two subsequent steps: interference resolution and quilt spreading. By leveraging the DWPose human skeletal detection and the Segment Anything instance segmentation models, the proposed method can accurately recognize the states of the infant and the quilt over her, which involves addressing the interferences resulted from an infant's limbs laid on part of the quilt. Building upon prior research, the EM*D deep learning model is employed to forecast quilt state transitions before and after quilt spreading actions. To improve the sensitivity of the network in distinguishing state variation of the handled quilt, we introduce an enhanced loss function that translates the voxelized quilt state into a more representative one. Both simulation and real-world experiments validate the efficacy of our method, in spreading and recover a quilt over an infant.
- B. Efe, G. Kremer, and M. Kurt, “Age and gender based workload constraint for assembly line worker assignment and balancing problem in a textile firm,” 2018.
- H. Lin, F. Guo, F. Wang et al., “Picking up a soft 3d object by ”feeling” the grip,” International Journal of Robotics Research, vol. 34, no. 11, pp. 1361–1384, 2015.
- N. CHENTANEZ, U. C. BERKELEY, and R. ALTEROVITZ, “Interactive simulation of gical needle insertion and steering,” vol. 10, 2009.
- J. Stria, D. Prusa, V. Hlavac et al., “Garment perception and its folding using a dual-arm robot,” in 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2014.
- P. Jiménez and C. Torras, “Perception of cloth in assistive robotic manipulation tasks,” Natural Computing, vol. 19, no. 4, 2020.
- C. Bersch, B. Pitzer, and S. Kammel, “Bimanual robotic cloth manipulation for laundry folding,” in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2011, San Francisco, CA, USA, September 25-30. IEEE, 2011.
- H. Seki, “Clothes folding task by tool-using robot,” 2007.
- A. Ramisa, G. Alenya, F. Moreno-Noguer et al., “Using depth and appearance features for informed robot grasping of highly wrinkled clothes,” in Proceedings - IEEE International Conference on Robotics and Automation, 2013, pp. 1703–1708.
- K. Saxena and T. Shibata, “Garment recognition and grasping point detection for clothing assistance task using deep learning,” in 2019 IEEE/SICE International Symposium on System Integration (SII), 2019, pp. 632–637.
- L. Twardon and H. Ritter, “Learning to put on a knit cap in a head-centric policy space,” IEEE Robotics and Automation Letters, vol. 3, no. 2, pp. 764–771, 2018.
- K. Sun, G. Aragon-Camarasa, S. Rogers, and J. Siebert, “Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening,” in Proceedings - IEEE International Conference on Robotics and Automation, 2015.
- J. Qian, T. Weng, L. Zhang, B. Okorn, and D. Held, “Cloth region segmentation for robust grasp selection,” in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2020, pp. 9553–9560.
- Y. Deng, M. Sun, C. Sweeney et al., “Learning dense correspondence via 3d-guided cycle consistency,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 1175–1184.
- S. Tirumala, T. Weng, D. Seita et al., “Learning to singulate layers of cloth using tactile feedback,” arXiv preprint arXiv:2207.11196, 2022.
- J. Borràs, G. Alenya, and C. Torras, “A grasping-centered analysis for cloth manipulation,” 2019.
- S. Arnold and K. Yamazaki, “Fast and flexible multi-step cloth manipulation planning using an encode-manipulate-decode network (em*d net),” Frontiers in Neurorobotics, vol. 13, 2019.
- R. Hoque et al., “Visuospatial foresight for multi-step, multi-task fabric manipulation,” in Proc. Robotics: Science and Systems XVI, 2020.
- J. Puthuveetil, A. Shahbazian, A. Pepe et al., “Bodies uncovered: Segmenting 3d scans by high-resolution body and cloth capture,” arXiv preprint arXiv:2110.04479, 2021.
- D. Seita et al., “Deep transfer learning of pick points on fabric for robot bed-making,” in Robotics Research. ISRR 2019, T. Asfour, E. Yoshida, J. Park, H. Christensen, and O. Khatib, Eds., 2022.
- Y. Wu, W. Yan, T. Kurutach, L. Pinto, and P. Abbeel, “Learning to manipulate deformable objects without demonstrations,” in Proc. Robotics Science and Systems XVI, 2020.
- J. Matas, S. James, and A. J. Davison, “Sim-to-real reinforcement learning for deformable object manipulation,” in Proc. Conf: Robot Learn., 2018, pp. 734–743.
- R. Hoque, D. Seita, A. Balakrishna et al., “Visuospatial foresight for physical sequential fabric manipulation,” Auton Robot.
- Y. Tsurumine, Y. Cui, E. Uchibe et al., “Deep reinforcement learning with smooth policy update: Application to robotic cloth manipulation,” Robotics and Autonomous Systems, vol. 112, 2018.
- T. Tamei, T. Matsubara, A. Rai, and T. Shibata, “Reinforcement learning of clothing assistance with a dual-arm robot,” in 2011 11th IEEE-RAS International Conference on Humanoid Robots, 2011, pp. 733–738.
- Y. Wang, Z. Sun, Z. Erickson, and D. Held, “One policy to dress them all: Learning to dress people with diverse poses and garments,” 2023.
- X. Lin, Y. Wang, J. Olkin, and D. Held, “Softgym: Benchmarking deep reinforcement learning for deformable object manipulation,” in Proc. Conf. Robot Learn, 2020.
- Z. Erickson, V. Gangaram, A. Kapusta, C. Liu, and C. Kemp, “Assistive gym: A physics simulation framework for assistive robotics,” in Proc. IEEE Int. Conf. Robot. Automat., 2020, pp. 10 169–10 176.
- D. Navarro-Alarcon and Y. H. Liu, “Uncalibrated vision-based deformation control of compliant objects with online estimation of the jacobian matrix,” in IEEE/RSJ International Conference on Intelligent Robots & Systems. IEEE, 2013.
- A. Kirillov, E. Mintun, N. Ravi et al., “Segment anything,” arXiv preprint arXiv:2304.02643, 2023.
- Z. Yang, A. Zeng, C. Yuan et al., “Effective whole-body pose estimation with two-stages distillation,” arXiv preprint arXiv:2307.15880, 2023.
- K. He, G. Gkioxari, P. Dollár et al., “Mask r-cnn,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 2961–2969.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
