GMKF: Generalized Moment Kalman Filter for Polynomial Systems with Arbitrary Noise (2403.04712v2)
Abstract: This paper develops a new filtering approach for state estimation in polynomial systems corrupted by arbitrary noise, which commonly arise in robotics. We first consider a batch setup where we perform state estimation using all data collected from the initial to the current time. We formulate the batch state estimation problem as a Polynomial Optimization Problem (POP) and relax the assumption of Gaussian noise by specifying a finite number of moments of the noise. We solve the resulting POP using a moment relaxation and prove that under suitable conditions on the rank of the relaxation, (i) we can extract a provably optimal estimate from the moment relaxation, and (ii) we can obtain a belief representation from the dual (sum-of-squares) relaxation. We then turn our attention to the filtering setup and apply similar insights to develop a GMKF for recursive state estimation in polynomial systems with arbitrary noise. The GMKF formulates the prediction and update steps as POPs and solves them using moment relaxations, carrying over a possibly non-Gaussian belief. In the linear-Gaussian case, GMKF reduces to the standard Kalman Filter. We demonstrate that GMKF performs well under highly non-Gaussian noise and outperforms common alternatives, including the Extended and Unscented Kalman Filter, and their variants on matrix Lie group.
- The extended Kalman filter as a local asymptotic observer for nonlinear discrete-time systems. In Proceedings of the American Control Conference, pages 3365–3369. IEEE, 1992.
- Eric A Wan and Rudolph Van Der Merwe. The unscented Kalman filter for nonlinear estimation. In Proceedings of the IEEE Adaptive Systems for Signal Processing, Communications, and Control Symposium, pages 153–158. Ieee, 2000.
- Convex Geometric Motion Planning on Lie Groups via Moment Relaxation. In Proceedings of the Robotics: Science and Systems Conference, Daegu, Republic of Korea, July 2023. doi: 10.15607/RSS.2023.XIX.058.
- Progress in symmetry preserving robot perception and control through geometry and learning. Frontiers in Robotics and AI, 9:232, 2022.
- An error-state model predictive control on connected matrix Lie groups for legged robot control. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 8850–8857. IEEE, 2022a.
- Lie algebraic cost function design for control on Lie groups. In Proceedings of the IEEE Conference on Decision and Control, pages 1867–1874. IEEE, 2022b.
- Convex geometric trajectory tracking using lie algebraic mpc for autonomous marine vehicles. IEEE Robotics and Automation Letters, 8(12):8374–8381, 2023. doi: 10.1109/LRA.2023.3328450.
- Certifiably optimal outlier-robust geometric perception: Semidefinite relaxations and scalable global optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
- Jean B Lasserre. Global optimization with polynomials and the problem of moments. SIAM Journal on optimization, 11(3):796–817, 2001.
- Jean Bernard Lasserre. An introduction to polynomial and semi-algebraic optimization, volume 52. Cambridge University Press, 2015.
- Pablo A Parrilo. Semidefinite programming relaxations for semialgebraic problems. Mathematical programming, 96(2):293–320, 2003.
- Luca Carlone. Estimation contracts for outlier-robust geometric perception. Foundations and Trends (FnT) in Robotics, 2023.
- Lars Peter Hansen. Large sample properties of generalized method of moments estimators. Econometrica: Journal of the econometric society, pages 1029–1054, 1982.
- Fumio Hayashi. Econometrics. Princeton University Press, 2011.
- Stable rank-one matrix completion is solved by the level 2 lasserre relaxation. Foundations of Computational Mathematics, 21:891–940, 2021.
- The geometry of sdp-exactness in quadratic optimization. Mathematical programming, 182(1-2):399–428, 2020a.
- Invariant Kalman filtering. Annual Review of Control, Robotics, and Autonomous Systems, 1:237–257, 2018.
- Unscented Kalman filtering on Lie groups. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2485–2491. IEEE, 2017.
- The banana distribution is gaussian: A localization study with exponential coordinates. Robotics: Science and Systems VIII, 265:1, 2013.
- Kalman Filtering: Theory and Practice with MATLAB. John Wiley & Sons, 2014.
- Approaches to multisensor data fusion in target tracking: A survey. IEEE Transactions on Knowledge and Data Engineering, 18(12):1696–1710, 2006.
- Rudolph E. Kalman. A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(1):35–45, 03 1960.
- A fresh look at the Kalman filter. SIAM review, 54(4):801–823, 2012.
- Sebastian Thrun. Probabilistic robotics. Communications of the ACM, 45(3):52–57, 2002.
- Observability-based rules for designing consistent EKF SLAM estimators. International Journal of Robotics Research, 29(5):502–528, 2010.
- The invariant extended Kalman filter as a stable observer. IEEE Transactions on Automatic Control, 62(4):1797–1812, 2016.
- An invariant-EKF VINS algorithm for improving consistency. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 1578–1585. IEEE, 2017.
- Convergence and consistency analysis for a 3-D invariant-EKF SLAM. IEEE Robotics and Automation Letters, 2(2):733–740, 2017.
- Contact-aided invariant extended Kalman filtering for robot state estimation. International Journal of Robotics Research, 39(4):402–430, 2020.
- Legged robot state estimation in slippery environments using invariant extended kalman filter with velocity update. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 3104–3110. IEEE, 2021.
- Proprioceptive invariant robot state estimation. arXiv preprint arXiv:2311.04320, 2023.
- Fully proprioceptive slip-velocity-aware state estimation for mobile robots via invariant kalman filtering and disturbance observer. In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 8096–8103. IEEE, 2023.
- Equivariant filter (eqf). IEEE Transactions on Automatic Control, 2022.
- Kalman filtering based on the maximum correntropy criterion in the presence of non-Gaussian noise. In Annual Conference on Information Science and Systems (CISS), pages 500–505. IEEE, 2016.
- Robust Kalman filtering for nonlinear multivariable stochastic systems in the presence of non-Gaussian noise. International Journal of Robust and Nonlinear Control, 26(3):445–460, 2016.
- State estimation under non-Gaussian Lévy noise: A modified Kalman filtering method. arXiv preprint arXiv:1303.2395, 2013.
- Moment-based Kalman filter: Nonlinear Kalman filtering with exact moment propagation. arXiv preprint arXiv:2301.09130, 2023.
- Moment-based exact uncertainty propagation through nonlinear stochastic autonomous systems. arXiv preprint arXiv:2101.12490, 2021.
- Globally optimal estimates for geometric reconstruction problems. International Journal of Computer Vision, 74:3–15, 2007.
- Planar pose graph optimization: Duality, optimal solutions, and verification. IEEE Transactions on Robotics, 32(3):545–565, 2016.
- SE-Sync: A certifiably correct algorithm for synchronization over the special euclidean group. International Journal of Robotics Research, 38(2-3):95–125, 2019.
- Simultaneous multiple rotation averaging using Lagrangian duality. In Asian Conference on Computer Vision, pages 245–258. Springer, 2012.
- Rotation averaging with the chordal distance: Global minimizers and strong duality. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(1):256–268, 2019.
- A qcqp approach to triangulation. In Proceedings of the European Conference on Computer Vision, pages 654–667. Springer, 2012.
- Diego Cifuentes. A convex relaxation to compute the nearest structured rank deficient matrix. SIAM Journal on Matrix Analysis and Applications, 42(2):708–729, 2021.
- Convex global 3D registration with Lagrangian duality. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4960–4969, 2017.
- Global registration of multiple point clouds using semidefinite programming. SIAM Journal on Optimization, 25(1):468–501, 2015.
- Point registration via efficient convex relaxation. ACM Transactions on Graphics (TOG), 35(4):1–12, 2016.
- Global optimality for point set registration using semidefinite programming. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 8287–8295, 2020.
- Cvxpnpl: A unified convex solution to the absolute pose estimation problem from point and line correspondences. Journal of Mathematical Imaging and Vision, 65(3):492–512, 2023.
- Certifiable relative pose estimation. Image and Vision Computing, 109:104142, 2021.
- A certifiably globally optimal solution to the non-minimal relative pose problem. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 145–154, 2018.
- Ji Zhao. An efficient solution to non-minimal case essential matrix estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(4):1777–1792, 2020.
- Hand-eye and robot-world calibration by global polynomial optimization. In Proceedings of the IEEE International Conference on Robotics and Automation, pages 3157–3164. IEEE, 2014.
- Certifiably globally optimal extrinsic calibration from per-sensor egomotion. IEEE Robotics and Automation Letters, 4(2):367–374, 2019.
- Optimal pose and shape estimation for category-level 3D object perception. In Proceedings of the Robotics: Science and Systems Conference, 2021.
- In perfect shape: Certifiably optimal 3D shape reconstruction from 2D landmarks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 621–630, 2020.
- Teaser: Fast and certifiable point cloud registration. IEEE Transactions on Robotics, 37(2):314–333, 2020.
- A quaternion-based certifiably optimal solution to the wahba problem with outliers. In Proceedings of the IEEE International Conference on Computer Vision, pages 1665–1674, 2019.
- On the local stability of semidefinite relaxations. Mathematical Programming, pages 1–35, 2020b.