Papers
Topics
Authors
Recent
Search
2000 character limit reached

TacMMs: Tactile Mobile Manipulators for Warehouse Automation

Published 29 Jun 2023 in cs.RO | (2306.16783v1)

Abstract: Multi-robot platforms are playing an increasingly important role in warehouse automation for efficient goods transport. This paper proposes a novel customization of a multi-robot system, called Tactile Mobile Manipulators (TacMMs). Each TacMM integrates a soft optical tactile sensor and a mobile robot with a load-lifting mechanism, enabling cooperative transportation in tasks requiring coordinated physical interaction. More specifically, we mount the TacTip (biomimetic optical tactile sensor) on the Distributed Organisation and Transport System (DOTS) mobile robot. The tactile information then helps the mobile robots adjust the relative robot-object pose, thereby increasing the efficiency of load-lifting tasks. This study compares the performance of using two TacMMs with tactile perception with traditional vision-based pose adjustment for load-lifting. The results show that the average success rate of the TacMMs (66%) is improved over a purely visual-based method (34%), with a larger improvement when the mass of the load was non-uniformly distributed. Although this initial study considers two TacMMs, we expect the benefits of tactile perception to extend to multiple mobile robots. Website: https://sites.google.com/view/tacmms

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. L. Custodio and R. Machado, “Flexible automated warehouse: a literature review and an innovative framework,” The International Journal of Advanced Manufacturing Technology, vol. 106, no. 1, pp. 533–558, 2020.
  2. I. F. Vis, “Survey of research in the design and control of automated guided vehicle systems,” European Journal of Operational Research, vol. 170, no. 3, pp. 677–709, 2006.
  3. J.-Y. Wang, J.-S. Zhao, F.-L. Chu, and Z.-J. Feng, “Innovative design of the lifting mechanisms for forklift trucks,” Mechanism and Machine Theory, vol. 45, no. 12, pp. 1892–1896, 2010.
  4. C. Schou, R. S. Andersen, D. Chrysostomou, S. Bøgh, and O. Madsen, “Skill-based instruction of collaborative robots in industrial settings,” Robotics and Computer-Integrated Manufacturing, vol. 53, pp. 72–80, 2018.
  5. S. Liu, D. Sun, and C. Zhu, “A dynamic priority based path planning for cooperation of multiple mobile robots in formation forming,” Robotics and Computer-Integrated Manufacturing, vol. 30, no. 6, pp. 589–596, 2014.
  6. F. Basile, F. Caccavale, P. Chiacchio, J. Coppola, and C. Curatella, “Task-oriented motion planning for multi-arm robotic systems,” Robotics and Computer-Integrated Manufacturing, vol. 28, no. 5, pp. 569–582, 2012.
  7. E. Tuci, M. H. Alkilabi, and O. Akanyeti, “Cooperative object transport in multi-robot systems: A review of the state-of-the-art,” Frontiers in Robotics and AI, vol. 5, p. 59, 2018.
  8. L. Adouane and N. Le Fort-Piat, “Hybrid behavioral control architecture for the cooperation of minimalist mobile robots,” in ICRA’04, International Conference On Robotics And Automation, 2004.
  9. O. Khatib, K. Yokoi, O. Brock, K. Chang, and A. Casal, “Robots in human environments: Basic autonomous capabilities,” The International Journal of Robotics Research, vol. 18, no. 7, pp. 684–696, 1999.
  10. M. Matak and T. Hermans, “Planning visual-tactile precision grasps via complementary use of vision and touch,” IEEE Robotics and Automation Letters, 2022.
  11. B. Ward-Cherrier, N. Pestell, L. Cramphorn, B. Winstone, M. E. Giannaccini, J. Rossiter, and N. F. Lepora, “The tactip family: Soft optical tactile sensors with 3d-printed biomimetic morphologies,” Soft robotics, vol. 5, no. 2, pp. 216–227, 2018.
  12. N. F. Lepora, “Soft biomimetic optical tactile sensing with the tactip: A review,” IEEE Sensors Journal, vol. 21, no. 19, pp. 21 131–21 143, 2021.
  13. S. Jones, E. Milner, M. Sooriyabandara, and S. Hauert, “Dots: An open testbed for industrial swarm robotic solutions,” arXiv preprint arXiv:2203.13809, 2022.
  14. B. Hichri, J.-C. Fauroux, L. Adouane, I. Doroftei, and Y. Mezouar, “Design of cooperative mobile robots for co-manipulation and transportation tasks,” Robotics and computer-integrated manufacturing, vol. 57, pp. 412–421, 2019.
  15. Y. Hirata and K. Kosuge, “Coordinated motion control of multiple robots without position information of each robot,” in Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No. 00CH37187), vol. 1.   IEEE, 2000, pp. 346–351.
  16. Y. Kume, Y. Hirata, Z.-D. Wang, and K. Kosuge, “Decentralized control of multiple mobile manipulators handling a single object in coordination,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3.   IEEE, 2002, pp. 2758–2763.
  17. B. Hichri, L. Adouane, J.-C. Fauroux, Y. Mezouar, and I. Doroftei, “Cooperative mobile robot control architecture for lifting and transportation of any shape payload,” in Distributed Autonomous Robotic Systems.   Springer, 2016, pp. 177–191.
  18. G. Du, K. Wang, S. Lian, and K. Zhao, “Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review,” Artificial Intelligence Review, vol. 54, no. 3, pp. 1677–1734, 2021.
  19. Y. Yang and Q.-X. Cao, “Monocular vision based 6d object localization for service robot’s intelligent grasping,” Computers & Mathematics with Applications, vol. 64, no. 5, pp. 1235–1241, 2012.
  20. F. Guangrui and W. Geng, “Vision-based autonomous docking and re-charging system for mobile robot in warehouse environment,” in 2017 2nd International Conference on Robotics and Automation Engineering (ICRAE).   IEEE, 2017, pp. 79–83.
  21. Q. Li, C. Schürmann, R. Haschke, and H. J. Ritter, “A control framework for tactile servoing.” in Robotics: Science and systems, 2013.
  22. N. F. Lepora and J. Lloyd, “Pose-based tactile servoing: Controlled soft touch using deep learning,” IEEE Robotics and Automation Magazine, vol. 28, no. 4, pp. 43–55, 2021.
  23. W. Yuan, C. Zhu, A. Owens, M. A. Srinivasan, and E. H. Adelson, “Shape-independent hardness estimation using deep learning and a gelsight tactile sensor,” in 2017 IEEE International Conference on Robotics and Automation (ICRA), 2017, pp. 951–958.
  24. S. Suresh, Z. Si, J. G. Mangelson, W. Yuan, and M. Kaess, “Shapemap 3-d: Efficient shape mapping through dense touch and vision,” in 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 7073–7080.
  25. N. F. Lepora, A. Church, C. De Kerckhove, R. Hadsell, and J. Lloyd, “From pixels to percepts: Highly robust edge perception and contour following using deep learning and an optical biomimetic tactile sensor,” IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 2101–2107, 2019.
  26. N. F. Lepora and J. Lloyd, “Optimal deep learning for robot touch: Training accurate pose models of 3d surfaces and edges,” IEEE Robotics and Automation Magazine, vol. 27, no. 2, pp. 66–77, 2020.
  27. J. Lloyd and N. F. Lepora, “Goal-driven robotic pushing using tactile and proprioceptive feedback,” IEEE Transactions on Robotics, vol. 38, no. 2, pp. 1201–1212, 2021.
  28. A. Marzinotto, M. Colledanchise, C. Smith, and P. Ögren, “Towards a unified behavior trees framework for robot control,” in 2014 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2014, pp. 5420–5427.
Citations (9)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up