Probabilistic Slide-support Manipulation Planning in Clutter (2306.12649v1)
Abstract: To safely and efficiently extract an object from the clutter, this paper presents a bimanual manipulation planner in which one hand of the robot is used to slide the target object out of the clutter while the other hand is used to support the surrounding objects to prevent the clutter from collapsing. Our method uses a neural network to predict the physical phenomena of the clutter when the target object is moved. We generate the most efficient action based on the Monte Carlo tree search.The grasping and sliding actions are planned to minimize the number of motion sequences to pick the target object. In addition, the object to be supported is determined to minimize the position change of surrounding objects. Experiments with a real bimanual robot confirmed that the robot could retrieve the target object, reducing the total number of motion sequences and improving safety.
- Y. Deng, X. Guo, Y. Wei, K. Lu, B. Fang, D. Guo, H. Liu, and F. Sun, “Deep reinforcement learning for robotic pushing and picking in cluttered environment,” In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 619-–626, 2019.
- K. Xu, H. Yu, Q. Lai, Y. Wang, and R. Xiong, “Efficient learning of goal-oriented push-grasping synergy in clutter,” IEEE Robotics and Automation Letters, vol. 6(4).pp. 6337–6344, 2021.
- H. Zhang, X. Lan, X. Zhou, Z. Tian, Y. Zhang, and N. Zheng, “Visual manipulation relationship network for autonomous robotics,” In 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids), pp. 118-–125, 2018.
- H. Zhang, X. Lan, S. Bai, L. Wan, C. Yang, and N. Zheng, “A multi-task convolutional neural network for autonomous robotic grasping in object stacking scenes,” In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 6435–6442, 2019.
- C. Nam, S. H. Cheong, J. Lee, D. H. Kim, and C. Kim, “ Fast and resilient manipulation planning for object retrieval in cluttered and confined environments,” IEEE Transactions on Robotics, vol. 37(5).pp. 1539-–1552, 2021.
- J. K. Li, D. Hsu, and W. S. Lee, “Act to see and see to act: Pomdp planning for objects search in clutter,” In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5701–-5707, 2016.
- Y. Xiao, S. Katt, A. Ten Pas, S. Chen, and C. Amato, “Online planning for target object search in clutter under partial observability,” In 2019 International Conference on Robotics and Automation (ICRA), pp. 8241–-8247, 2019.
- J. Ahn, C. Kim, and C. Nam, “ Coordination of two robotic manipulators for object retrieval in clutter,” In 2022 International Conference on Robotics and Automation (ICRA), pp. 1039-–1045, 2022.
- S. Panda, A. Hafez, and C.V. Jawahar, “Learning support order for manipulation in clutter,” In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 809–-815, 2013.
- R. Kartmann, F. Paus, M. Grotz, and T. Asfour, “Extraction of physically plausible support relations to predict and validate manipulation action effects,” IEEE Robotics and Automation Letters, vol. 3(4).pp. 3991–-3998, 2018.
- T. Motoda, D. Petit, W. Wan, and K. Harada, “Bimanual shelf picking planner based on collapse prediction,” In 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE), pp. 510–-515, 2021.
- L. Berscheid, P. Meißner, and T. Kröger, “Robot learning of shifting objects for grasping in cluttered environment,” In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 612-–618, 2019.
- B. Huang, S. D. Han, J. Yu, and A. Boularias, “Visual foresight trees for object retrieval from clutter with nonprehensile rearrangement,” IEEE Robotics and Automation Letters, vol. 7(1).pp. 231–-238, 2022.
- A. Zeng, S. Song, S. Welker, J. Lee, A. Rodriguez, and T. Funkhouser, “Learning synergies between pushing and grasping with selfsupervised deep reinforcement learning,” In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4238–-4245, 2018.
- B. Tang, M. Corsaro, G. Konidaris, S. Nikolaidis, and S. Tellex, “Learning collaborative pushing and grasping policies in dense clutter,” In 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 6177–-6184, 2021.
- K. Wada, S. James, and A. J. Davison, “Safepicking: Learning safe object extraction via object-level mapping,” In 2022 International Conference on Robotics and Automation (ICRA), pp. 10202–10208, 2022.
- C. B. Browne, E.Powley, D. Whitehouse, S. M. Lucas, P. I. Cowling, P. Rohlfshagen, S. Tavener, D. Perez, S. Samothrakis, and S. Colton, “A survey of monte carlo tree search methods,” IEEE Transactions on Computational Intelligence and AI in Games, vol.4(1).pp. 1–-43, 2012.
- L. P. Kaelbling, M. L. Littman, and A. R. Cassandra, “Planning and acting in partially observable stochastic domains,” Artif. Intell, vol. 101(1-2) pp. 99-–134, 1998.
- Y. Domae, H. Okuda, Y. Taguchi, K. Sumi, and T. Hirai, “Fast graspability evaluation on single depth maps for bin picking with general grippers,” In 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 1997-–2004, 2014.
- T. Rabbani, F.A. Heuvel, and G. Vosselman, “Segmentation of point clouds using smoothness constraint,” International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2006.
- D. Silver and J. Veness, “Monte-Carlo Planning in Large POMDPs,” Advances in Neural Information Processing Systems, vol.23, 2010.
- L. Kocsis and C. Szepesvári, “Bandit based monte-carlo planning,” In Proceedings of the 17th European Conference on Machine Learning, ECML’06, pp. 282–293, 2006.
- D. Kingma and J. Ba, “Adam: A method for stochastic optimization, ” arXiv:1412.6980, 2014.