LIVE: Lidar Informed Visual Search for Multiple Objects with Multiple Robots (2310.04572v1)
Abstract: This paper introduces LIVE: Lidar Informed Visual Search focused on the problem of multi-robot (MR) planning and execution for robust visual detection of multiple objects. We perform extensive real-world experiments with a two-robot team in an indoor apartment setting. LIVE acts as a perception module that detects unmapped obstacles, or Short Term Features (STFs), in Lidar observations. STFs are filtered, resulting in regions to be visually inspected by modifying plans online. Lidar Coverage Path Planning (CPP) is employed for generating highly efficient global plans for heterogeneous robot teams. Finally, we present a data model and a demonstration dataset, which can be found by visiting our project website https://sites.google.com/view/live-iros2023/home.
- Unitree-A1. https://www.unitree.com/products/a1/.
- Continuous area sweeping: A task definition and initial approach. In ICAR’05. Proceedings., 12th International Conference on Advanced Robotics, 2005., pages 316–323. IEEE, 2005.
- A multi-robot system for continuous area sweeping tasks. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006., pages 1724–1729. IEEE, 2006.
- Active visual object search in unknown environments using uncertain semantics. IEEE Transactions on Robotics, 29(4):986–1002, 2013.
- Ruzena Bajcsy. Active perception. Proceedings of the IEEE, 76(8):966–1005, 1988.
- Resilient multi-sensor exploration of multifarious environments with a team of aerial robots. In Robotics: Science and Systems (RSS), 2022.
- Depth camera based indoor mobile robot localization and navigation. In 2012 IEEE International Conference on Robotics and Automation, pages 1697–1702. IEEE, 2012.
- Episodic non-markov localization. Robotics and Autonomous Systems, 87:162–176, 2017.
- Information-theoretic mapping using cauchy-schwarz quadratic mutual information. In 2015 IEEE International Conference on Robotics and Automation (ICRA), pages 4791–4798. IEEE, 2015.
- Principles of robot motion: theory, algorithms, and implementations. MIT press, 2005.
- Daniel S Drew. Multi-agent systems for search and rescue applications. Current Robotics Reports, 2(2):189–200, 2021.
- Coverage control in multi-robot systems via graph neural networks. In 2022 International Conference on Robotics and Automation (ICRA), page 8787–8793. IEEE Press, 2022. doi: 10.1109/ICRA46639.2022.9811854. URL https://doi.org/10.1109/ICRA46639.2022.9811854.
- Sub-1.5 time-optimal multi-robot path planning on grids in polynomial time. In Robotics: Science and Systems (RSS), 2022.
- Multi-agent active search: A reinforcement learning approach. IEEE Robotics and Automation Letters, 7(2):754–761, 2021.
- Active object tracking using context estimation: handling occlusions and detecting missing targets. Applied Intelligence, pages 1–12, 2022.
- Concerts: Coverage competency-based target search for heterogeneous robot teams. Applied Sciences, 12(17), 2022. ISSN 2076-3417. URL https://www.mdpi.com/2076-3417/12/17/8649.
- Robofleet: Secure Open Source Communication and Management for Fleets of Autonomous Robots . In Intelligent Robots and Systems (IROS), IEEE/RSJ International Conference on, pages 406–412, 2021. doi: 10.1109/IROS51168.2021.9635830.
- Robotic operating system. URL https://www.ros.org.
- A comprehensive review of coverage path planning in robotics using classical and heuristic algorithms. IEEE Access, 2021.
- Development of human support robot as the research platform of a domestic mobile manipulator. ROBOMECH journal, 6(1):1–15, 2019.
- Sensor planning in 3d object search: its formulation and complexity. In The 4th International Symposium on Artificial Intelligence and Mathematics, Florida, USA, 1996.