Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

RABBIT: A Robot-Assisted Bed Bathing System with Multimodal Perception and Integrated Compliance (2401.15159v1)

Published 26 Jan 2024 in cs.RO

Abstract: This paper introduces RABBIT, a novel robot-assisted bed bathing system designed to address the growing need for assistive technologies in personal hygiene tasks. It combines multimodal perception and dual (software and hardware) compliance to perform safe and comfortable physical human-robot interaction. Using RGB and thermal imaging to segment dry, soapy, and wet skin regions accurately, RABBIT can effectively execute washing, rinsing, and drying tasks in line with expert caregiving practices. Our system includes custom-designed motion primitives inspired by human caregiving techniques, and a novel compliant end-effector called Scrubby, optimized for gentle and effective interactions. We conducted a user study with 12 participants, including one participant with severe mobility limitations, demonstrating the system's effectiveness and perceived comfort. Supplementary material and videos can be found on our website https://emprise.cs.cornell.edu/rabbit.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. Emerging technologies and their potential for generating new assistive technologies. Assistive Technology 33, sup1 (2021), 17–26.
  2. MyHealth Alberta. 2024. Caregiving: How to Give a Bed Bath. https://myhealth.alberta.ca/Health/Pages/conditions.aspx?hwid=abp9705&lang=en-ca (Accessed: 3rd January, 2024).
  3. Hybrid parallel compliance allows robots to operate with sensorimotor delays and low control frequencies. Frontiers in Robotics and AI 8 (2021), 645748.
  4. Compliant actuation in new robotic applications. In NCTAM06–7th National Congress on Theoretical and Applied Mechanics.
  5. CareChannel. 2019. How to give a Bed Bath in the Home - Tips for Caregivers. https://www.youtube.com/watch?v=HRfFdgch968
  6. Ergonomic and safety risk factors in home health care: Exploration and assessment of alternative interventions. Work 42, 3 (2012), 341–353.
  7. Musculoskeletal discomfort, physical demand, and caregiving activities in informal caregivers. Journal of Applied Gerontology 34, 6 (2015), 734–760.
  8. An atlas of physical human–robot interaction. Mechanism and Machine Theory 43, 3 (2008), 253–270. https://doi.org/10.1016/j.mechmachtheory.2007.03.003
  9. Real-time end-effector motion behavior planning approach using on-line point-cloud data towards a user adaptive assistive bath robot. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 5031–5036. https://doi.org/10.1109/IROS.2017.8206387
  10. Lindsey Downey and Hilary Lloyd. 2008. Bed bathing patients in hospital. Nursing standard 22, 34 (2008), 35–40.
  11. Disability in activities of daily living: patterns of change and a hierarchy of disability. American journal of public health 87, 3 (1997), 378–383.
  12. Multidimensional capacitive sensing for robot-assisted dressing and bathing. In 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR). IEEE, 224–231.
  13. CGFNet: cross-guided fusion network for RGB-thermal semantic segmentation. The Visual Computer 38 (2022). Issue 9. https://doi.org/10.1007/s00371-022-02559-2
  14. Alyssa L Goldenhart and Hassan Nagy. 2022. Assisting patients with personal hygiene. In StatPearls [Internet]. Statpearls Publishing.
  15. Robust semantic segmentation based on RGB-thermal in variable lighting scenes. Measurement 186 (2021), 110176. https://doi.org/10.1016/j.measurement.2021.110176
  16. MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 5108–5115. https://doi.org/10.1109/IROS.2017.ha2017
  17. Compliant actuator designs. IEEE Robotics & Automation Magazine 3, 16 (2009), 81–94.
  18. Soft Tactile Contour Following for Robot-Assisted Wiping and Bathing. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 7797–7802. https://doi.org/10.1109/IROS47612.2022.9982071
  19. Glass Segmentation With RGB-Thermal Image Pairs. IEEE Transactions on Image Processing 32 (2023), 1911–1926. https://doi.org/10.1109/tip.2023.3256762
  20. An unobtrusive measurement method for assessing physiological response in physical human–robot interaction. IEEE Transactions on Human-Machine Systems 47, 4 (2017), 474–485.
  21. Robotic Perception of Transparent Objects: A Review. arXiv preprint arXiv:2304.00157 (2023).
  22. Variable compliance and geometry regulation of Soft-Bubble grippers with active pressure control. In 2021 IEEE 4th International Conference on Soft Robotics (RoboSoft). IEEE, 169–175.
  23. Spatial-based skin detection using discriminative skin-presence features. Pattern Recognition Letters 41 (2014), 3–13.
  24. O. Khatib. 1987. A unified approach for motion and force control of robot manipulators: The operational space formulation. IEEE Journal on Robotics and Automation 3, 1 (1987), 43–53. https://doi.org/10.1109/JRA.1987.1087068
  25. Wet area and puddle detection for Advanced Driver Assistance Systems (ADAS) using a stereo camera. International Journal of Control, Automation and Systems 14 (2016), 263–271.
  26. Model-Free Friction Observers for Flexible Joint Robots With Torque Measurements. IEEE Transactions on Robotics 35, 6 (2019), 1508–1515. https://doi.org/10.1109/TRO.2019.2926496
  27. Towards an assistive robot that autonomously performs bed baths for patient hygiene. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. 319–324. https://doi.org/10.1109/IROS.2010.5649101
  28. S Komada and K Ohnishi. 1988. Robust force and compliance control of robotic manipulator. In Proceedings. 14 Annual Conference of Industrial Electronics Society, Vol. 1. IEEE, 20–25.
  29. EmPRISE Lab. 2024. RABBIT website. https://emprise.cs.cornell.edu/rabbit (Accessed: 3rd January, 2024).
  30. DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor With Application to In-Hand Manipulation. IEEE Robotics and Automation Letters 5, 3 (jul 2020), 3838–3845. https://doi.org/10.1109/lra.2020.2977257
  31. Characterization of a Meso-Scale Wearable Robot for Bathing Assistance. In 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 2146–2152.
  32. Simultaneously-collected multimodal lying pose dataset: Towards in-bed human pose monitoring under adverse vision conditions. arXiv preprint arXiv:2008.08735 (2020).
  33. Simultaneously-collected multimodal lying pose dataset: Enabling in-bed human pose monitoring. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 1 (2022), 1106–1118.
  34. Sim-to-real reinforcement learning for deformable object manipulation. In Conference on Robot Learning. PMLR, 734–743.
  35. G. McGunnigle. 2010. Detecting wet surfaces using near infrared lighting. J. Opt. Soc. Am. A 27, 5 (May 2010), 1137–1144. https://doi.org/10.1364/JOSAA.27.001137
  36. Clinical skills: bed bathing and personal hygiene needs of patients. British journal of nursing 16, 6 (2007), 356–358.
  37. Gill A Pratt and Matthew M Williamson. 1995. Series elastic actuators. In Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots, Vol. 1. IEEE, 399–406.
  38. Decreasing human body temperature in the United States since the Industrial Revolution. eLife 9 (jan 2020), e49555. https://doi.org/10.7554/eLife.49555
  39. Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey. The International Journal of Robotics Research 37, 7 (2018), 688–716.
  40. Frerk Saxen and Ayoub Al-Hamadi. 2014. Color-based skin segmentation: An evaluation of the state of the art. In 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 4467–4471.
  41. opencv/cvat: v1.1.0. https://doi.org/10.5281/zenodo.4009388
  42. Bharath Ram Shetty and Marcelo H Ang. 1996. Active compliance control of a PUMA 560 robot. In Proceedings of IEEE International Conference on Robotics and Automation, Vol. 4. IEEE, 3720–3725.
  43. Wetness and Color from a Single Multispectral Image. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 321–329. https://doi.org/10.1109/CVPR.2017.42
  44. Bruno Siciliano and Luigi Villani. 1999. Robot force control. Springer Science & Business Media.
  45. Sheila A Sorrentino and Leighann Remmert. 2016. Mosby’s Textbook for Nursing Assistants-E-Book. Elsevier Health Sciences.
  46. A Hybrid Combining Hard and Soft Robots. Soft Robotics 1, 1 (2014), 70–74. https://doi.org/10.1089/soro.2013.0002 arXiv:https://doi.org/10.1089/soro.2013.0002
  47. RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes. IEEE Robotics and Automation Letters 4, 3 (2019), 2576–2583. https://doi.org/10.1109/LRA.2019.2904733
  48. Milos Vasic and Aude Billard. 2013. Safety issues in human-robot interactions. In 2013 IEEE International Conference on Robotics and Automation. 197–204. https://doi.org/10.1109/ICRA.2013.6630576
  49. Null-space impedance control for physical human-robot interaction. In Romansy 19–Robot Design, Dynamics and Control: Proceedings of the 19th CISM-Iftomm Symposium. Springer, 193–200.
  50. Clinical Presentation and Staging of Melanoma. In: Ward WH, Farma JM, editors. Cutaneous Melanoma: Etiology and Therapy. Brisbane (AU): Codon Publications. https://www.ncbi.nlm.nih.gov/books/NBK481857/table/chapter6.t1/doi:10.15586/codon.cutaneousmelanoma.2017.ch6
  51. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. arXiv:2105.15203 [cs.CV]
  52. Assistance system for bedridden patients to reduce the burden of nursing care (first report — Development of a multifunctional electric wheelchair, portable bath, lift, and mobile robot with portable toilet). In 2010 IEEE/SICE International Symposium on System Integration. 132–139. https://doi.org/10.1109/SII.2010.5708314
  53. CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers. arXiv:2203.04838 [cs.CV]
  54. Multispectral Fusion Transformer Network for RGB-Thermal Urban Scene Semantic Segmentation. IEEE Geoscience and Remote Sensing Letters 19 (2022), 1–5. https://doi.org/10.1109/LGRS.2022.3179721
  55. Challenges and outlook in robotic manipulation of deformable objects. IEEE Robotics & Automation Magazine 29, 3 (2022), 67–77.
  56. I-Support: A robotic platform of an assistive bathing robot for the elderly population. Robotics and Autonomous Systems 126 (2020), 103451.
  57. Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot. CoRR abs/1711.01775 (2017). arXiv:1711.01775 http://arxiv.org/abs/1711.01775
Citations (9)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now