Online Graph Topology Learning from Matrix-valued Time Series (2107.08020v4)
Abstract: The focus is on the statistical analysis of matrix-valued time series, where data is collected over a network of sensors, typically at spatial locations, over time. Each sensor records a vector of features at each time point, creating a vectorial time series for each sensor. The goal is to identify the dependency structure among these sensors and represent it with a graph. When only one feature per sensor is observed, vector auto-regressive (VAR) models are commonly used to infer Granger causality, resulting in a causal graph. The first contribution extends VAR models to matrix-variate models for the purpose of graph learning. Additionally, two online procedures are proposed for both low and high dimensions, enabling rapid updates of coefficient estimates as new samples arrive. In the high-dimensional setting, a novel Lasso-type approach is introduced, and homotopy algorithms are developed for online learning. An adaptive tuning procedure for the regularization parameter is also provided. Given that the application of auto-regressive models to data typically requires detrending, which is not feasible in an online context, the proposed AR models are augmented by incorporating trend as an additional parameter, with a particular focus on periodic trends. The online algorithms are adapted to these augmented data models, allowing for simultaneous learning of the graph and trend from streaming samples. Numerical experiments using both synthetic and real data demonstrate the effectiveness of the proposed methods.
- Learning graphical models for stationary time series. IEEE transactions on signal processing, 52(8):2189–2199, 2004.
- A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM journal on imaging sciences, 2(1):183–202, 2009.
- Causal network inference via group sparse regularization. IEEE transactions on signal processing, 59(6):2628–2641, 2011.
- Multi-task gaussian process prediction. Advances in neural information processing systems, 20, 2007.
- Bucci, A. A smooth transition autoregressive model for matrix-variate time series. arXiv preprint arXiv:2212.08615, 2022.
- Matrix autoregressive models: Generalization and bayesian estimation. Studies in Nonlinear Dynamics & Econometrics, (0), 2023.
- Autoregressive models for matrix-valued time series. Journal of Econometrics, 222(1):539–560, 2021.
- Weak connectedness of tensor product of digraphs. Discrete Applied Mathematics, 185:52–58, 2015.
- Learning graphs from data: A signal representation perspective. IEEE Signal Processing Magazine, 36(3):44–63, 2019.
- Least angle regression. Annals of statistics, 32(2):407–499, 2004.
- Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3):432–441, 2008.
- Regularization paths for generalized linear models via coordinate descent. Journal of statistical software, 33(1):1, 2010.
- An homotopy algorithm for the lasso with online observations. Advances in neural information processing systems, 21:489–496, 2008.
- Tensor graphical lasso (teralasso). Journal of the Royal Statistical Society: Series B (Statistical Methodology), 81(5):901–931, 2019.
- Handbook of product graphs, volume 2. CRC press Boca Raton, 2011.
- The elements of statistical learning: data mining, inference, and prediction, volume 2. Springer, 2009.
- Matrix autoregressive spatio-temporal models. Journal of Computational and Graphical Statistics, 30(4):1143–1155, 2021.
- Cartesian products of directed graphs with loops. Discrete Mathematics, 341(5):1336–1343, 2018.
- The bigraphical lasso. In International Conference on Machine Learning, pp. 1229–1237. PMLR, 2013.
- Multi-linear tensor autoregressive models. arXiv preprint arXiv:2110.00928, 2021.
- Lütkepohl, H. New introduction to multiple time series analysis. Springer Science & Business Media, 2005.
- Homotopy continuation for sparse signal representation. In Proceedings.(ICASSP’05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005., volume 5, pp. v–733. IEEE, 2005.
- Signal processing on graphs: Causal modeling of unstructured data. IEEE Transactions on Signal Processing, 65(8):2077–2092, 2016.
- High-dimensional graphs and variable selection with the lasso. Annals of statistics, 34(3):1436–1462, 2006.
- Adaptive regularization for lasso models in the context of nonstationary data streams. Statistical Analysis and Data Mining: The ASA Data Science Journal, 11(5):237–247, 2018.
- A new approach to variable selection in least squares problems. IMA journal of numerical analysis, 20(3):389–403, 2000.
- Proximal algorithms. Foundations and Trends in optimization, 1(3):127–239, 2014.
- Big data analysis with signal processing on graphs: Representation and processing of massive data sets with irregular structure. IEEE Signal Processing Magazine, 31(5):80–90, 2014.
- Topology selection in graphical models of autoregressive processes. The Journal of Machine Learning Research, 11:2671–2705, 2010.
- Matrix autoregressive model with vector time series covariates for spatio-temporal data. arXiv preprint arXiv:2305.15671, 2023.
- High-dimensional low-rank tensor autoregressive time series modeling. Journal of Econometrics, 238(1):105544, 2024.
- The sylvester graphical lasso (syglasso). In International Conference on Artificial Intelligence and Statistics, pp. 1943–1953. PMLR, 2020.
- Kronecker-structured covariance models for multiway data. Statistic Surveys, 16:238–270, 2022.
- Mixture matrix-valued autoregressive model. arXiv preprint arXiv:2312.06098, 2023.
- Autoregressive moving average model for matrix time series. Statistical Theory and Related Fields, pp. 1–18, 2023.
- Online topology identification from vector autoregressive time series. IEEE Transactions on Signal Processing, 69:210–225, 2020.
- Zhou, S. Gemini: Graph estimation with matrix variate normal instances. 2014.