Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

GMKF: Generalized Moment Kalman Filter for Polynomial Systems with Arbitrary Noise (2403.04712v2)

Published 7 Mar 2024 in cs.RO, cs.SY, and eess.SY

Abstract: This paper develops a new filtering approach for state estimation in polynomial systems corrupted by arbitrary noise, which commonly arise in robotics. We first consider a batch setup where we perform state estimation using all data collected from the initial to the current time. We formulate the batch state estimation problem as a Polynomial Optimization Problem (POP) and relax the assumption of Gaussian noise by specifying a finite number of moments of the noise. We solve the resulting POP using a moment relaxation and prove that under suitable conditions on the rank of the relaxation, (i) we can extract a provably optimal estimate from the moment relaxation, and (ii) we can obtain a belief representation from the dual (sum-of-squares) relaxation. We then turn our attention to the filtering setup and apply similar insights to develop a GMKF for recursive state estimation in polynomial systems with arbitrary noise. The GMKF formulates the prediction and update steps as POPs and solves them using moment relaxations, carrying over a possibly non-Gaussian belief. In the linear-Gaussian case, GMKF reduces to the standard Kalman Filter. We demonstrate that GMKF performs well under highly non-Gaussian noise and outperforms common alternatives, including the Extended and Unscented Kalman Filter, and their variants on matrix Lie group.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. The extended Kalman filter as a local asymptotic observer for nonlinear discrete-time systems. In Proceedings of the American Control Conference, pages 3365–3369. IEEE, 1992.
  2. Eric A Wan and Rudolph Van Der Merwe. The unscented Kalman filter for nonlinear estimation. In Proceedings of the IEEE Adaptive Systems for Signal Processing, Communications, and Control Symposium, pages 153–158. Ieee, 2000.
  3. Convex Geometric Motion Planning on Lie Groups via Moment Relaxation. In Proceedings of the Robotics: Science and Systems Conference, Daegu, Republic of Korea, July 2023. doi: 10.15607/RSS.2023.XIX.058.
  4. Progress in symmetry preserving robot perception and control through geometry and learning. Frontiers in Robotics and AI, 9:232, 2022.
  5. An error-state model predictive control on connected matrix Lie groups for legged robot control. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 8850–8857. IEEE, 2022a.
  6. Lie algebraic cost function design for control on Lie groups. In Proceedings of the IEEE Conference on Decision and Control, pages 1867–1874. IEEE, 2022b.
  7. Convex geometric trajectory tracking using lie algebraic mpc for autonomous marine vehicles. IEEE Robotics and Automation Letters, 8(12):8374–8381, 2023. doi: 10.1109/LRA.2023.3328450.
  8. Certifiably optimal outlier-robust geometric perception: Semidefinite relaxations and scalable global optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
  9. Jean B Lasserre. Global optimization with polynomials and the problem of moments. SIAM Journal on optimization, 11(3):796–817, 2001.
  10. Jean Bernard Lasserre. An introduction to polynomial and semi-algebraic optimization, volume 52. Cambridge University Press, 2015.
  11. Pablo A Parrilo. Semidefinite programming relaxations for semialgebraic problems. Mathematical programming, 96(2):293–320, 2003.
  12. Luca Carlone. Estimation contracts for outlier-robust geometric perception. Foundations and Trends (FnT) in Robotics, 2023.
  13. Lars Peter Hansen. Large sample properties of generalized method of moments estimators. Econometrica: Journal of the econometric society, pages 1029–1054, 1982.
  14. Fumio Hayashi. Econometrics. Princeton University Press, 2011.
  15. Stable rank-one matrix completion is solved by the level 2 lasserre relaxation. Foundations of Computational Mathematics, 21:891–940, 2021.
  16. The geometry of sdp-exactness in quadratic optimization. Mathematical programming, 182(1-2):399–428, 2020a.
  17. Invariant Kalman filtering. Annual Review of Control, Robotics, and Autonomous Systems, 1:237–257, 2018.
  18. Unscented Kalman filtering on Lie groups. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2485–2491. IEEE, 2017.
  19. The banana distribution is gaussian: A localization study with exponential coordinates. Robotics: Science and Systems VIII, 265:1, 2013.
  20. Kalman Filtering: Theory and Practice with MATLAB. John Wiley & Sons, 2014.
  21. Approaches to multisensor data fusion in target tracking: A survey. IEEE Transactions on Knowledge and Data Engineering, 18(12):1696–1710, 2006.
  22. Rudolph E. Kalman. A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(1):35–45, 03 1960.
  23. A fresh look at the Kalman filter. SIAM review, 54(4):801–823, 2012.
  24. Sebastian Thrun. Probabilistic robotics. Communications of the ACM, 45(3):52–57, 2002.
  25. Observability-based rules for designing consistent EKF SLAM estimators. International Journal of Robotics Research, 29(5):502–528, 2010.
  26. The invariant extended Kalman filter as a stable observer. IEEE Transactions on Automatic Control, 62(4):1797–1812, 2016.
  27. An invariant-EKF VINS algorithm for improving consistency. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 1578–1585. IEEE, 2017.
  28. Convergence and consistency analysis for a 3-D invariant-EKF SLAM. IEEE Robotics and Automation Letters, 2(2):733–740, 2017.
  29. Contact-aided invariant extended Kalman filtering for robot state estimation. International Journal of Robotics Research, 39(4):402–430, 2020.
  30. Legged robot state estimation in slippery environments using invariant extended kalman filter with velocity update. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 3104–3110. IEEE, 2021.
  31. Proprioceptive invariant robot state estimation. arXiv preprint arXiv:2311.04320, 2023.
  32. Fully proprioceptive slip-velocity-aware state estimation for mobile robots via invariant kalman filtering and disturbance observer. In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 8096–8103. IEEE, 2023.
  33. Equivariant filter (eqf). IEEE Transactions on Automatic Control, 2022.
  34. Kalman filtering based on the maximum correntropy criterion in the presence of non-Gaussian noise. In Annual Conference on Information Science and Systems (CISS), pages 500–505. IEEE, 2016.
  35. Robust Kalman filtering for nonlinear multivariable stochastic systems in the presence of non-Gaussian noise. International Journal of Robust and Nonlinear Control, 26(3):445–460, 2016.
  36. State estimation under non-Gaussian Lévy noise: A modified Kalman filtering method. arXiv preprint arXiv:1303.2395, 2013.
  37. Moment-based Kalman filter: Nonlinear Kalman filtering with exact moment propagation. arXiv preprint arXiv:2301.09130, 2023.
  38. Moment-based exact uncertainty propagation through nonlinear stochastic autonomous systems. arXiv preprint arXiv:2101.12490, 2021.
  39. Globally optimal estimates for geometric reconstruction problems. International Journal of Computer Vision, 74:3–15, 2007.
  40. Planar pose graph optimization: Duality, optimal solutions, and verification. IEEE Transactions on Robotics, 32(3):545–565, 2016.
  41. SE-Sync: A certifiably correct algorithm for synchronization over the special euclidean group. International Journal of Robotics Research, 38(2-3):95–125, 2019.
  42. Simultaneous multiple rotation averaging using Lagrangian duality. In Asian Conference on Computer Vision, pages 245–258. Springer, 2012.
  43. Rotation averaging with the chordal distance: Global minimizers and strong duality. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(1):256–268, 2019.
  44. A qcqp approach to triangulation. In Proceedings of the European Conference on Computer Vision, pages 654–667. Springer, 2012.
  45. Diego Cifuentes. A convex relaxation to compute the nearest structured rank deficient matrix. SIAM Journal on Matrix Analysis and Applications, 42(2):708–729, 2021.
  46. Convex global 3D registration with Lagrangian duality. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4960–4969, 2017.
  47. Global registration of multiple point clouds using semidefinite programming. SIAM Journal on Optimization, 25(1):468–501, 2015.
  48. Point registration via efficient convex relaxation. ACM Transactions on Graphics (TOG), 35(4):1–12, 2016.
  49. Global optimality for point set registration using semidefinite programming. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 8287–8295, 2020.
  50. Cvxpnpl: A unified convex solution to the absolute pose estimation problem from point and line correspondences. Journal of Mathematical Imaging and Vision, 65(3):492–512, 2023.
  51. Certifiable relative pose estimation. Image and Vision Computing, 109:104142, 2021.
  52. A certifiably globally optimal solution to the non-minimal relative pose problem. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 145–154, 2018.
  53. Ji Zhao. An efficient solution to non-minimal case essential matrix estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(4):1777–1792, 2020.
  54. Hand-eye and robot-world calibration by global polynomial optimization. In Proceedings of the IEEE International Conference on Robotics and Automation, pages 3157–3164. IEEE, 2014.
  55. Certifiably globally optimal extrinsic calibration from per-sensor egomotion. IEEE Robotics and Automation Letters, 4(2):367–374, 2019.
  56. Optimal pose and shape estimation for category-level 3D object perception. In Proceedings of the Robotics: Science and Systems Conference, 2021.
  57. In perfect shape: Certifiably optimal 3D shape reconstruction from 2D landmarks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 621–630, 2020.
  58. Teaser: Fast and certifiable point cloud registration. IEEE Transactions on Robotics, 37(2):314–333, 2020.
  59. A quaternion-based certifiably optimal solution to the wahba problem with outliers. In Proceedings of the IEEE International Conference on Computer Vision, pages 1665–1674, 2019.
  60. On the local stability of semidefinite relaxations. Mathematical Programming, pages 1–35, 2020b.
Citations (8)

Summary

  • The paper introduces the GMKF that extends Kalman Filtering to polynomial systems by managing arbitrary noise via higher-order moment relaxations.
  • It formulates state estimation as a polynomial optimization problem, enabling optimal estimation under non-Gaussian noise conditions.
  • Empirical results highlight the method's superior performance and robustness compared to traditional filters, especially for real-world robotics applications.

An Insightful Overview of the Generalized Moment Kalman Filter for Polynomial Systems with Arbitrary Noise

Introduction to \GMKFlong (\GMKF)

State estimation remains a pivotal problem in robotics, often approached through the lens of Kalman Filtering (KF) when dealing with linear systems and Gaussian noise. However, the extension of KF to nonlinear systems or systems perturbed by non-Gaussian noise necessitates sophisticated techniques that stray from the foundational principles of KF, losing its optimality guarantees. Addressing these limitations, recent advances introduce the \GMKFlong (\GMKF), a novel filtering approach tailored for polynomial systems subjected to arbitrary noise. This paper dissects the formulation and implications of \GMKF, comparing it against traditional Kalman Filtering and its variants on matrix Lie groups.

Batch Estimation with Arbitrarily Distributed Noise

The cornerstone of \GMKF is its capacity to handle arbitrarily distributed noise in polynomial systems by considering higher-order moments up to rr, drastically extending the efficacy of state estimation beyond the Gaussian assumption. By casting the batch state estimation as a Polynomial Optimization Problem (POP) and leveraging moment relaxations, the \BPUE (Best Polynomial Unbiased Estimator) guarantees provably optimal estimates under certain conditions. This development not only aligns with the Generalized Method of Moments (GMM) in econometrics for dealing with data of unknown distributions but also enriches the theoretical framework of polynomial optimization in state estimation.

Recursive Estimation and the Essence of \GMKF

Transitioning from batch to a recursive setup, \GMKF innovatively encapsulates the prediction and update steps within polynomial systems, resembling the traditional Kalman Filter structure but enriched with the robustness against non-Gaussian noise. It formulates these steps as POPs, solved through moment relaxations, enabling the propagation of non-Gaussian beliefs across time. Notably, in the linear-Gaussian scenario, \GMKF collapses to the standard Kalman Filter, underscoring its generality and versatility.

Theoretical Underpinnings and Practical Implications

The theoretical foundation of \GMKF reveals that the dual solutions of the moment relaxations facilitate the computation of an SOS belief, interpreted as an approximated covariance in noiseless cases. This feature not only highlights the method's fidelity in capturing the true distribution of the system's state but also signifies the potential for refined uncertainty quantification in polynomial systems. Moreover, the empirical validation of \GMKF against non-Gaussian noise showcases superior performance compared to conventional filters, suggesting its effectiveness in real-world robotics applications.

Future Perspectives on \GMKF

Despite its promising attributes, \GMKF necessitates further exploration, particularly in theoretical conditions ensuring the moment relaxation's rank-1 solutions and the observability properties of the polynomial system. Furthermore, establishing a fully probabilistic interpretation of the SOS belief and its connection to the estimation error remains an enticing avenue for research. Lastly, refining the choice of the moment order rr for balancing computational complexity and estimation accuracy could significantly enhance the practicality of \GMKF.

Conclusion

The introduction of the \GMKFlong marks a significant step forward in the domain of state estimation for polynomial systems, particularly in the presence of arbitrary noise. By meticulously integrating insights from polynomial optimization and moment theory, \GMKF not only extends the Kalman Filtering paradigm to accommodate non-Gaussian uncertainties but also opens up new horizons for robust state estimation in robotics and beyond.