Adaptive Robotic Information Gathering via Non-Stationary Gaussian Processes (2306.01263v3)
Abstract: Robotic Information Gathering (RIG) is a foundational research topic that answers how a robot (team) collects informative data to efficiently build an accurate model of an unknown target function under robot embodiment constraints. RIG has many applications, including but not limited to autonomous exploration and mapping, 3D reconstruction or inspection, search and rescue, and environmental monitoring. A RIG system relies on a probabilistic model's prediction uncertainty to identify critical areas for informative data collection. Gaussian Processes (GPs) with stationary kernels have been widely adopted for spatial modeling. However, real-world spatial data is typically non-stationary -- different locations do not have the same degree of variability. As a result, the prediction uncertainty does not accurately reveal prediction error, limiting the success of RIG algorithms. We propose a family of non-stationary kernels named Attentive Kernel (AK), which is simple, robust, and can extend any existing kernel to a non-stationary one. We evaluate the new kernel in elevation mapping tasks, where AK provides better accuracy and uncertainty quantification over the commonly used stationary kernels and the leading non-stationary kernels. The improved uncertainty quantification guides the downstream informative planner to collect more valuable data around the high-error area, further increasing prediction accuracy. A field experiment demonstrates that the proposed method can guide an Autonomous Surface Vehicle (ASV) to prioritize data collection in locations with significant spatial variations, enabling the model to characterize salient environmental features.
- Abraham I and Murphey TD (2019) Active learning of dynamics for data-driven control using Koopman operators. IEEE Transactions on Robotics 35(5): 1071–1083.
- Aloimonos J, Weiss I and Bandyopadhyay A (1988) Active vision. International journal of computer vision 1(4): 333–356.
- Autonomous Robots (AURO) 43(7): 1827–1853.
- IEEE Transactions on Robotics (T-RO) 30(5): 1078–1090.
- Atkinson AC (1996) The usefulness of optimum experimental designs. Journal of the Royal Statistical Society: Series B (Methodological) 58(1): 59–76.
- Current Robotics Reports : 1–12.
- In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 1816–1822.
- Bajcsy R (1988) Active perception. Proceedings of the IEEE 76(8): 966–1005.
- Bajcsy R, Aloimonos Y and Tsotsos JK (2018) Revisiting active perception. Autonomous Robots 42(2): 177–196.
- The International Journal of Robotics Research (IJRR) 38(2-3): 316–337.
- Binney J, Krause A and Sukhatme GS (2013) Optimizing waypoints for monitoring spatiotemporal phenomena. The International Journal of Robotics Research (IJRR) 32(8): 873–888.
- In: 2016 IEEE international conference on robotics and automation (ICRA). IEEE, pp. 1462–1468.
- Autonomous Robots 42(2): 291–306.
- In: Proceedings of Robotics: Science and Systems. Corvalis, Oregon, USA, pp. 1–10. 10.15607/RSS.2020.XVI.041.
- Borghi G and Caglioti V (1998) Minimum uncertainty explorations in the self-localization of mobile robots. IEEE Transactions on Robotics and Automation 14(6): 902–911.
- Bry A and Roy N (2011) Rapidly-exploring random belief trees for motion planning under uncertainty. In: 2011 IEEE international conference on robotics and automation. IEEE, pp. 723–730.
- Bui TD, Yan J and Turner RE (2017) A unifying framework for Gaussian process pseudo-point approximations using power expectation propagation. The Journal of Machine Learning Research (JMLR) 18(1): 3649–3720.
- Buisson-Fenet M, Solowjow F and Trimpe S (2020) Actively learning Gaussian process dynamics. In: Learning for Dynamics and Control (L4DC). pp. 5–15.
- The International Journal of Robotics Research 40(2-3): 558–573.
- In: International Joint Conference on Neural Networks (IJCNN). pp. 3338–3345.
- In: Proceedings of Robotics: Science and Systems. pp. 1–9.
- Cao N, Low KH and Dolan JM (2013) Multi-robot informative path planning for active sensing of environmental phenomena: A tale of two algorithms. In: International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS). pp. 7–14.
- In: Conference on Learning for Dynamics and Control (L4DC), volume 120. pp. 490–499.
- In: 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 1476–1483.
- Chaplot DS, Parisotto E and Salakhutdinov R (2018) Active Neural Localization. In: International Conference on Learning Representations. pp. 1–15.
- In: Proceedings of Robotics: Science and Systems. pp. 1–10.
- In: IEEE International Conference on Robotics and Automation (ICRA). pp. 4791–4798.
- Chen W, Khardon R and Liu L (2022) AK: Attentive Kernel for Information Gathering. In: Proceedings of Robotics: Science and Systems. pp. 1–16.
- Chen W and Liu L (2019) Pareto Monte Carlo tree search for multi-objective informative planning. In: Robotics: Science and Systems (RSS). pp. 1–10.
- The International Journal of Robotics Research (IJRR) 37(13-14): 1632–1672.
- Advances in neural information processing systems 31.
- Connolly C (1985) The determination of next best views. In: Proceedings. 1985 IEEE international conference on robotics and automation, volume 2. IEEE, pp. 432–435.
- Nature 521(7553): 503–507.
- Dang AT (2020) Resilient Large-Scale Informative Path Planning for Autonomous Robotic Exploration. PhD Thesis, University of Nevada, Reno.
- In: Conference on Robot Learning. PMLR, pp. 377–393.
- Deisenroth M and Ng JW (2015) Distributed Gaussian processes. In: International Conference on Machine Learning (ICML). pp. 1481–1490.
- Dhawale A and Michael N (2020) Efficient parametric multi-fidelity surface mapping. In: Robotics: Science and Systems (RSS), volume 2. p. 5.
- Di Caro GA and Yousaf AWZ (2021) Multi-robot informative path planning using a leader-follower architecture. In: 2021 International Conference on Robotics and Automation (ICRA). pp. 10045–10051.
- In: IEEE International Conference on Robotics and Automation (ICRA). pp. 1011–1018.
- IEEE Robotics and Automation Letters 6(3): 4994–5001.
- Dunbabin M and Marques L (2012) Robots for environmental monitoring: significant advancements and applications. IEEE Robotics & Automation Magazine (RAM) 19(1): 24–39.
- In: 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 80–86.
- IEEE Robotics and Automation Letters 7(4): 10280–10287.
- Ferrari S and Wettergren TA (2021) Information-driven planning and control. MIT Press.
- IEEE Robotics and Automation Letters (RA-L) 4(4): 3782–3789.
- Fox D, Burgard W and Thrun S (1998) Active markov localization for mobile robots. Robotics and Autonomous Systems 25(3-4): 195–207.
- In: Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1). pp. 1–13.
- Ghaffari Jadidi M, Valls Miro J and Dissanayake G (2018) Gaussian processes autonomous mapping and exploration for range-sensing mobile robots. Autonomous Robots (AURO) 42(2): 273–290.
- Gibbs MN (1997) Bayesian Gaussian processes for regression and classification. PhD Thesis, University of Cambridge.
- Girdhar Y, Giguère P and Dudek G (2014) Autonomous adaptive exploration using realtime online spatiotemporal topic modeling. The International Journal of Robotics Research (IJRR) 33(4): 645–657.
- Guizilini V and Ramos F (2017) Learning to reconstruct 3D structures for occupancy mapping. In: Robotics: Science and Systems (RSS). pp. 1–10.
- Guizilini V and Ramos F (2019) Variational Hilbert regression for terrain modeling and trajectory optimization. The International Journal of Robotics Research (IJRR) 38(12-13): 1375–1387.
- In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 6464–6470.
- In: Robotics: Science and Systems. pp. 1–20.
- In: 2021 IEEE International Conference on Robotics and Automation (ICRA). pp. 9474–9481.
- In: The Journal of Machine Learning Research (JMLR), volume 51. pp. 732–740.
- Journal of Field Robotics (JFR) 34(8): 1427–1449.
- Hoang TN, Hoang QM and Low BKH (2015) A unifying framework of anytime sparse Gaussian process regression models with stochastic variational inference for big data. In: International Conference on Machine Learning (ICML). pp. 569–578.
- The International Journal of Robotics Research (IJRR) 32(1): 3–18.
- Hollinger GA and Sukhatme GS (2014) Sampling-based robotic information gathering algorithms. The International Journal of Robotics Research (IJRR) 33(9): 1271–1287.
- In: 2019 International conference on robotics and automation (ICRA). IEEE, pp. 6265–6271.
- Jadidi MG, Miro JV and Dissanayake G (2019) Sampling-based incremental information gathering with applications to robotic exploration and environmental monitoring. The International Journal of Robotics Research (IJRR) 38(6): 658–685.
- IEEE Robotics and Automation Letters (RA-L) 5(4): 5905–5912.
- In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 7109–7115.
- Kaelbling LP, Littman ML and Cassandra AR (1998) Planning and acting in partially observable stochastic domains. Artificial intelligence 101(1-2): 99–134.
- Kaelbling LP and Lozano-Pérez T (2013) Integrated task and motion planning in belief space. The International Journal of Robotics Research 32(9-10): 1194–1227.
- Autonomous Robots (AURO) .
- Kemna S, Kroemer O and Sukhatme GS (2018) Pilot surveys for adaptive informative sampling. In: IEEE International Conference on Robotics and Automation (ICRA). pp. 6417–6424.
- Kim SK, Salzman O and Likhachev M (2019) POMHDP: Search-based belief space planning using multiple heuristics. In: Proceedings of the International Conference on Automated Planning and Scheduling, volume 29. pp. 734–744.
- Kingma DP and Ba J (2014) Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 .
- IEEE Robotics and Automation Letters (RA-L) 6(4): 7893–7900.
- Krause A and Guestrin C (2007) Nonmyopic active learning of Gaussian processes: an exploration-exploitation approach. In: International Conference on Machine learning (ICML). pp. 449–456.
- The Journal of Machine Learning Research (JMLR) 9: 235–284.
- Lang T, Plagemann C and Burgard W (2007) Adaptive non-stationary kernel regression for terrain modeling. In: Robotics: Science and Systems (RSS). pp. 1–8.
- Lauri M, Heinänen E and Frintrop S (2017) Multi-robot active information gathering with periodic communication. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 851–856.
- Lauri M, Hsu D and Pajarinen J (2022) Partially Observable Markov Decision Processes in Robotics: A Survey. IEEE Transactions on Robotics .
- IEEE Robotics and Automation Letters 5(4): 5323–5330.
- LaValle SM (2006) Planning algorithms. Cambridge university press.
- In: Conference on Robot Learning (CoRL). pp. 1168–1179.
- IEEE Transactions on Robotics .
- Li AQ (2020) Exploration and mapping with groups of robots: recent trends. Current Robotics Reports : 1–11.
- Liang J, Saxena S and Kroemer O (2020) Learning Active Task-Oriented Exploration Policies for Bridging the Sim-to-Real Gap. In: Proceedings of Robotics: Science and Systems. Corvalis, Oregon, USA, pp. 1–10.
- Lim ZW, Hsu D and Lee WS (2016) Adaptive informative path planning in metric spaces. The International Journal of Robotics Research 35(5): 585–598.
- Lluvia I, Lazkano E and Ansuategi A (2021) Active mapping and robot exploration: A survey. Sensors 21(7): 2445.
- In: Proceedings of the 39th International Conference on Machine Learning, Proceedings of Machine Learning Research, volume 162. PMLR, pp. 14223–14247.
- Low KH, Dolan J and Khosla P (2009) Information-theoretic approach to efficient adaptive path planning for mobile robotic environmental sensing. In: International Conference on Automated Planning and Scheduling (ICAPS), volume 19. pp. 233–240.
- Luo W and Sycara K (2018) Adaptive sampling and online learning in multi-robot sensor coverage with mixture of gaussian processes. In: IEEE International Conference on Robotics and Automation (ICRA). pp. 6359–6364.
- In: 2021 IEEE International Conference on Robotics and Automation (ICRA). pp. 4163–4170.
- Journal of Field Robotics (JFR) 35(5): 643–661.
- Ma KC, Liu L and Sukhatme GS (2017) Informative planning and online learning with sparse Gaussian processes. In: International Conference on Robotics and Automation (ICRA). pp. 4292–4298.
- MacDonald RA and Smith SL (2019) Active sensing for motion planning in uncertain environments via mutual information policies. The International Journal of Robotics Research (IJRR) 38(2-3): 146–161.
- In: IEEE International Conference on Robotics and Automation (ICRA). pp. 4873–4880.
- Marchant R and Ramos F (2012) Bayesian optimisation for intelligent environmental monitoring. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 2242–2249.
- Marchant R and Ramos F (2014) Bayesian optimisation for informative continuous path planning. In: IEEE International Conference on Robotics and Automation (ICRA). pp. 6136–6143.
- McCammon S and Hollinger GA (2018) Topological hotspot identification for informative path planning with a marine robot. In: 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 4865–4872.
- In: 2019 International Conference on Robotics and Automation (ICRA). pp. 718–724.
- In: Conference on Robot Learning. PMLR, pp. 1326–1340.
- In: The AAAI Conference on Artificial Intelligence (AAAI), volume 10. pp. 16–7.
- Moon B, Chatterjee S and Scherer S (2022) TIGRIS: An Informed Sampling-based Algorithm for Informative Path Planning. In: arXiv preprint arXiv:2203.12830. arXiv, pp. 1–7.
- Morere P, Marchant R and Ramos F (2017) Sequential Bayesian optimization as a POMDP for environment monitoring with UAVs. In: IEEE International Conference on Robotics and Automation (ICRA). pp. 6381–6388.
- IEEE Robotics and Automation Letters 6(2): 911–918.
- Frontiers in Robotics and AI 9.
- Nguyen-Tuong D, Peters J and Seeger M (2008) Local Gaussian process regression for real time online model learning. Advances in Neural Information Processing Systems (NeurIPS) 21.
- Nishimura H and Schwager M (2021) SACBP: belief space planning for continuous-time dynamical systems via stochastic sequential action control. The International Journal of Robotics Research (IJRR) 40(10-11): 1167–1195.
- Ober SW, Rasmussen CE and van der Wilk M (2021) The promises and pitfalls of deep kernel learning. In: Uncertainty in Artificial Intelligence (UAI). pp. 1206–1216.
- O’Callaghan ST and Ramos FT (2012) Gaussian process occupancy maps. The International Journal of Robotics Research (IJRR) 31(1): 42–62.
- O’Meadhra C, Tabib W and Michael N (2018) Variable resolution occupancy mapping using gaussian mixture models. IEEE Robotics and Automation Letters (RA-L) 4(2): 2015–2022.
- In: International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS). pp. 573–580.
- Paciorek CJ and Schervish MJ (2003) Nonstationary covariance functions for Gaussian process regression. In: Advances on Neural Information Processing Systems (NeurIPS). pp. 1–8.
- IEEE Robotics and Automation Letters 4(2): 1619–1625.
- Autonomous Robots 43(8): 2131–2161.
- In: NIPS 2017 Workshop on Autodiff. pp. 1–4.
- Pfingsten T, Kuss M and Rasmussen CE (2006) Nonstationary Gaussian process regression using a latent extension of the input space. In: International Society for Bayesian Analysis (ISBA). pp. 1–3.
- arXiv preprint arXiv:2207.00254 .
- Plagemann C, Kersting K and Burgard W (2008a) Nonstationary Gaussian process regression using point estimates of local smoothness. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-KDD). Springer, pp. 204–219.
- In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 3545–3552.
- In: Proceedings of Robotics: Science and Systems. pp. 1–8.
- In: IEEE International Conference on Robotics and Automation (ICRA). pp. 5753–5758.
- In: IEEE International Conference on Robotics and Automation (ICRA). pp. 10751–10757.
- Autonomous Robots (AURO) 44(6): 889–911.
- Prentice S and Roy N (2009) The belief roadmap: Efficient planning in belief space by factoring the covariance. The International Journal of Robotics Research 28(11-12): 1448–1465.
- arXiv preprint arXiv:2206.01364 .
- Quinonero-Candela J and Rasmussen CE (2005) A unifying view of sparse approximate Gaussian process regression. The Journal of Machine Learning Research (JMLR) 6: 1939–1959.
- Ramos F and Ott L (2016) Hilbert maps: scalable continuous occupancy mapping with stochastic gradient descent. The International Journal of Robotics Research (IJRR) 35(14): 1717–1730.
- Ramos F, Possas RC and Fox D (2019) Bayessim: adaptive domain randomization via probabilistic inference for robotics simulators. arXiv preprint arXiv:1906.01728 .
- Rasmussen C and Ghahramani Z (2001) Infinite mixtures of Gaussian process experts. In: Advances in Neural Information Processing Systems (NeurIPS), volume 14. pp. 1–8.
- Rasmussen CE and Williams CKI (2005) Gaussian processes for machine learning. The MIT Press.
- Remes S, Heinonen M and Kaski S (2017) Non-stationary spectral kernels. In: Advances on Neural Information Processing Systems (NeurIPS). pp. 1–10.
- Remes S, Heinonen M and Kaski S (2018) Neural non-stationary spectral kernel. arXiv .
- In: Proceedings of Robotics: Science and Systems. New York City, NY, USA, pp. 1–10. 10.15607/RSS.2022.XVIII.052.
- Rezaei-Shoshtari S, Meger D and Sharf I (2019) Cascaded gaussian processes for data-efficient robot dynamics learning. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 6871–6877.
- Rodríguez-Arévalo ML, Neira J and Castellanos JA (2018) On the importance of uncertainty representation in active SLAM. IEEE Transactions on Robotics 34(3): 829–834.
- In: 2019 International Conference on Robotics and Automation (ICRA). IEEE, pp. 3195–3202.
- In: Proceedings 1999 IEEE international conference on robotics and automation (Cat. No. 99CH36288C), volume 1. IEEE, pp. 35–40.
- Rückin J, Jin L and Popović M (2022) Adaptive Informative Path Planning Using Deep Reinforcement Learning for UAV-based Active Sensing. In: 2022 International Conference on Robotics and Automation (ICRA). IEEE, pp. 4473–4479.
- Salimbeni H and Deisenroth M (2017) Doubly stochastic variational inference for deep Gaussian processes. In: Advances in Neural Information Processing Systems, volume 30. pp. 1–12.
- Sampson PD and Guttorp P (1992) Nonparametric estimation of nonstationary spatial covariance structure. Journal of the American Statistical Association (JASA) 87(417): 108–119.
- Saroya M, Best G and Hollinger GA (2021) Roadmap learning for probabilistic occupancy maps with topology-informed growing neural gas. IEEE Robotics and Automation Letters (RA-L) 6(3): 4805–4812.
- Schlotfeldt B, Atanasov N and Pappas GJ (2019) Maximum information bounds for planning active sensing trajectories. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 4913–4920.
- IEEE Robotics and Automation Letters (RA-L) 3(2): 1025–1032.
- Schlotfeldt B, Tzoumas V and Pappas GJ (2021) Resilient active information acquisition with teams of robots. IEEE Transactions on Robotics (T-RO) .
- IEEE Robotics and Automation Letters (RA-L) .
- arXiv preprint arXiv:2210.12806 .
- Senanayake R and Ramos F (2017) Bayesian Hilbert maps for dynamic continuous occupancy mapping. In: Conference on Robot Learning (CoRL). pp. 458–471.
- Senanayake R, Tompkins A and Ramos F (2018) Automorphing kernels for nonstationarity in mapping unstructured environments. In: Conference on Robot Learning (CoRL). pp. 443–455.
- Settles B (2012) Active learning. Synthesis lectures on artificial intelligence and machine learning 6(1): 1–114.
- Sheth R, Wang Y and Khardon R (2015) Sparse variational inference for generalized GP models. In: International Conference on Machine Learning. PMLR, pp. 1302–1311.
- In: International Joint Conference on Artifical Intelligence (IJCAI). pp. 2204–2211.
- Snoek J, Larochelle H and Adams RP (2012) Practical bayesian optimization of machine learning algorithms. Advances in neural information processing systems 25.
- In: International Conference on Machine Learning (ICML), volume 32. pp. 1674–1682.
- Stachniss C, Hahnel D and Burgard W (2004) Exploration with active loop-closing for FastSLAM. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), volume 2. IEEE, pp. 1505–1510.
- Stachniss C, Plagemann C and Lilienthal AJ (2009) Learning gas distribution models using sparse Gaussian process mixtures. Autonomous Robots 26(2): 187–202.
- In: Learning for Dynamics and Control. PMLR, pp. 804–813.
- In: Robotics: Science and Systems (RSS). pp. 1–10.