Outlier-Insensitive Kalman Filtering: Theory and Applications (2309.09505v3)
Abstract: State estimation of dynamical systems from noisy observations is a fundamental task in many applications. It is commonly addressed using the linear Kalman filter (KF), whose performance can significantly degrade in the presence of outliers in the observations, due to the sensitivity of its convex quadratic objective function. To mitigate such behavior, outlier detection algorithms can be applied. In this work, we propose a parameter-free algorithm which mitigates the harmful effect of outliers while requiring only a short iterative process of the standard update step of the KF. To that end, we model each potential outlier as a normal process with unknown variance and apply online estimation through either expectation maximization or alternating maximization algorithms. Simulations and field experiment evaluations demonstrate competitive performance of our method, showcasing its robustness to outliers in filtering scenarios compared to alternative algorithms.
- S. Truzman, G. Revach, N. Shlezinger, and I. Klein, “Outlier-Insensitive Kalman Filtering Using NUV Priors,” IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5, 2023.
- H. Zhu, K. Zou, Y. Li, and H. Leung, “Robust sensor fusion with heavy-tailed noises,” Signal Process., vol. 175, p. 107659, 2020.
- Y. Yuan, Y. Wang, W. Gao, and F. Shen, “Vehicular Relative Positioning With Measurement Outliers and GNSS Outages,” IEEE Sensors Journal, vol. 23, no. 8, pp. 8556–8567, 2023.
- E. Navon and B. Bobrovsky, “An efficient outlier rejection technique for kalman filters,” Signal Process., vol. 188, p. 108164, 2021.
- R. E. Kalman, “A New Approach to Linear Filtering and Prediction Problems,” in Journal of Basic Engineering, 1960, vol. 82, no. 1, pp. 35–45.
- S. Farahmand, G. B. Giannakis, and D. Angelosante, “Doubly Robust Smoothing of Dynamical Processes via Outlier Sparsity Constraints,” IEEE Transactions on Signal Processing, vol. 59, no. 10, pp. 4529–4543, 2011.
- A. Y. Aravkin, J. V. Burke, and G. Pillonetto, “Sparse/Robust Estimation and Kalman Smoothing with Nonsmooth Log-Concave Densities: Modeling, Computation, and Theory,” J. Mach. Learn. Res., vol. 14, pp. 2689–2728, 2013.
- J. A. Knight, N.L.;Wang, “A Comparison of Outlier Detection Procedures and Robust Estimation Methods in GPS Positioning,” Journal of Navigation, vol. 62, pp. 699–709, 2009.
- F. Zhu, Z. Hu, W. Liu, and X. Zhang, “Dual-Antenna GNSS Integrated With MEMS for Reliable and Continuous Attitude Determination in Challenged Environments,” IEEE Sensors Journal, vol. 19, no. 9, pp. 3449–3461, 2019.
- N. Ye and Q. Chen, “An anomaly detection technique based on a chi-square statistic for detecting intrusions into information systems,” Quality and Reliability Engineering International, vol. 17, no. 2, pp. 105–112, 2001.
- A. Lekkas, M. Candeloro, and I. Schjølberg, “Outlier rejection in underwater acoustic position measurements based on prediction errorr,” 4th IFAC Workshop on Navigation, Guidance and Control of Underwater Vehicles, vol. 48, no. 2, pp. 82–87, 2015.
- F. Van Wyk, Y. Wang, A. Khojandi, and N. Masoud, “Real-time sensor anomaly detection and identification in automated vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 3, pp. 1264–1276, 2020.
- J. A. Ting, E. Theodorou, and S. Schaal, “A Kalman Filter for Robust Outlier Detection,” IEEE International Conference on Intelligent Robots and Systems, pp. 1514–1519, 2007.
- G. Agamennoni, J. I. Nieto, and E. M. Nebot, “An Outlier-Robust Kalman Filter,” IEEE International Conference on Robotics and Automation, pp. 1551–1558, 2011.
- Y. Tao and S. S. T. Yau, “Outlier-Robust Iterative Extended Kalman Filtering,” IEEE Signal Processing Letters, vol. 30, pp. 743–747, 2023.
- C. D. Karlgaard and H. Schaub, “Huber-based divided difference filtering,” Journal of guidance, control, and dynamics, vol. 30, no. 3, pp. 885–891, 2007.
- M. A. Gandhi and L. Mili, “Robust Kalman Filter Based on a Generalized Maximum-Likelihood-Type Estimator,” IEEE Transactions on Signal Processing, vol. 58, no. 5, pp. 2509–2520, 2010.
- A. Aravkin, J. V. Burke, L. Ljung, A. Lozano, and G. Pillonetto, “Generalized Kalman Smoothing: Modeling and Algorithms,” Automatica, vol. 86, no. 287381, pp. 63–86, 2017.
- G. Agamennoni, J. I. Nieto, and E. M. Nebot, “Approximate Inference in State-Space Models with Heavy-Tailed Noise,” IEEE Transactions on Signal Processing, vol. 60, no. 10, pp. 5024–5037, 2012.
- Y. Huang, Y. Zhang, N. Li, Z. Wu, and J. A. Chambers, “A Novel Robust Student’s t-based Kalman Filter,” IEEE Transactions on Aerospace and Electronic Systems, vol. 53, no. 3, pp. 1545–1554, 2017.
- N. Davari and A. P. Aguiar, “Real-Time Outlier Detection Applied to a Doppler Velocity Log Sensor Based on Hybrid Autoencoder and Recurrent Neural Network,” IEEE Journal of Oceanic Engineering, vol. 46, no. 4, pp. 1288–1301, 2021.
- F. Wadehn, L. Bruderer, J. Dauwels, V. Sahdeva, H. Yu, and H.-A. Loeliger, “Outlier-insensitive Kalman Smoothing and Marginal Message Passing,” 24th European Signal Processing Conference (EUSIPCO), pp. 1242–1246, 2016.
- M. E. Tipping, “Sparse Bayesian Learning and the Relevance Vector Machine,” J. Mach. Learn. Res., vol. 1, no. 8, pp. 211–244, 2001.
- D. Wipf and B. Rao, “Sparse Bayesian Learning for Basis Selection,” IEEE Transactions on Signal Processing, vol. 52, no. 8, pp. 2153–2164, 2004.
- H.-A. Loeliger, L. Bruderer, H. Malmberg, F. Wadehn, and N. Zalmai, “On Sparsity by NUV-EM, Gaussian Message Passing, and Kalman Smoothing,” Information Theory and Applications Workshop (ITA), pp. 1–10, 2016.
- H.-A. Loeliger, B. Ma, H. Malmberg, and F. Wadehn, “Factor Graphs with NUV Priors and Iteratively Reweighted Descent for Sparse Least Squares and More,” IEEE 10th International Symposium on Turbo Codes & Iterative Information Processing (ISTC), pp. 1–5, 2018.
- H.-A. Loeliger, “On NUV priors and Gaussian message passing,” IEEE International Workshop on Machine Learning for Signal Processing (MLSP), 2023.
- A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum Likelihood from Incomplete Data Via the EM Algorithm,” Journal of the Royal Statistical Society: Series B, vol. 39, no. 1, pp. 1–22, 1977.
- J. A. Palmer, D. P. Wipf, K. Kreutz-Delgado, and B. D. Rao, “Variational em algorithms for non-gaussian latent variable models,” in Advances in neural information processing systems, 2005, pp. 1059–1066.
- V. S. A Andresen, “Convergence of an Alternating Maximization Procedure,” Journal of Machine Learning Research, vol. 17, 2016.
- N. Carlevaris-Bianco, A. K. Ushani, and R. M. Eustice, “University of Michigan North Campus long-term vision and lidar dataset,” International Journal of Robotics Research, vol. 35, no. 9, pp. 1023–1035, 2016.
- A. Shurin, A. Saraev, M. Yona, Y. Gutnik, S. Faber, A. Etzion, and I. Klein, “The Autonomous Platforms Inertial Dataset,” IEEE Access, vol. 10, pp. 10 191–10 201, 2022.
- G. Revach, N. Shlezinger, X. Ni, A. L. Escoriza, R. J. G. van Sloun, and Y. C. Eldar, “KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics,” IEEE Transactions on Signal Processing, vol. 70, pp. 1532–1547, 2022.
- G. Revach, X. Ni, N. Shlezinger, R. J. G. van Sloun, and Y. C. Eldar, “RTSNet: Learning to Smooth in Partially Known State-Space Models,” IEEE Transactions on Signal Processing, vol. 71, no. 1, pp. 4441–4456, 2023.
- H. Ohlsson, F. Gustafsson, L. Ljung, and S. P. Boyd, “Smoothed state estimates under abrupt changes using sum-of-norms regularization,” Autom., vol. 48, no. 4, pp. 595–605, 2012.
- B. Bell and F. Cathey, “The Iterated Kalman Filter Update as a Gauss-Newton Method,” IEEE Transactions on Automatic Control, vol. 38, no. 2, pp. 294–297, 1993.
- J. Humpherys, P. Redd, and J. M. West, “A Fresh Look at the Kalman Filter,” SIAM Rev., vol. 54, no. 4, pp. 801–823, 2012.
- B. Ma, N. Zalmai, R. Torfason, C. Striti, and H.-A. Loeliger, “Color image segmentation using iterative edge cutting, NUV-EM, and Gaussian message passing,” IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp. 161–165, 2017.
- P. J. Rousseeuw and M. Hubert, “Robust Statistics for Outlier Detection,” WIREs Data Mining Knowl. Discov., vol. 1, no. 1, pp. 73–79, 2011.
- A. Shurin and I. Klein, “QuadNet: A Hybrid Framework for Quadrotor Dead Reckoning,” Sensors, vol. 22, no. 4, p. 1426, 2022.