Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
175 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Streaming data recovery via Bayesian tensor train decomposition (2302.12148v2)

Published 23 Feb 2023 in cs.LG, math.ST, stat.ML, and stat.TH

Abstract: In this paper, we study a Bayesian tensor train (TT) decomposition method to recover streaming data by approximating the latent structure in high-order streaming data. Drawing on the streaming variational Bayes method, we introduce the TT format into Bayesian tensor decomposition methods for streaming data, and formulate posteriors of TT cores. Thanks to the Bayesian framework of the TT format, the proposed algorithm (SPTT) excels in recovering streaming data with high-order, incomplete, and noisy properties. The experiments in synthetic and real-world datasets show the accuracy of our method compared to state-of-the-art Bayesian tensor decomposition methods for streaming data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. Tencentrec: Real-time stream recommendation in practice. In Proceedings of the 2015 ACM SIGMOD international conference on management of data, pages 227–238, 2015.
  2. Streaming data preprocessing via online tensor recovery for large environmental sensor networks. ACM Transactions on Knowledge Discovery from Data (TKDD), 16(6):1–24, 2022.
  3. Point-process models of social network interactions: Parameter estimation and missing data recovery. European journal of applied mathematics, 27(3):502–529, 2016.
  4. Richard A Harshman et al. Foundations of the parafac procedure: Models and conditions for an" explanatory" multimodal factor analysis. 1970.
  5. Rasmus Bro. Parafac. tutorial and applications. Chemometrics and intelligent laboratory systems, 38(2):149–171, 1997.
  6. Rank adaptive tensor recovery based model reduction for partial differential equations with high-dimensional random inputs. Journal of Computational Physics, 409:109326, 2020.
  7. Ledyard R Tucker. Some mathematical notes on three-mode factor analysis. Psychometrika, 31(3):279–311, 1966.
  8. Efficient alternating least squares algorithms for low multilinear rank approximation of tensors. Journal of Scientific Computing, 87:1–25, 2021.
  9. Ivan V Oseledets. Tensor-train decomposition. SIAM Journal on Scientific Computing, 33(5):2295–2317, 2011.
  10. Tensor train random projection. arXiv preprint arXiv:2010.10797, 2020.
  11. Survey on pre-processing web log files in web usage mining. International Journal of Advanced Science and Technology, 29(3 Special Issue):682–691, 2020.
  12. Tensorsplat: Spotting latent anomalies in time. In 2012 16th Panhellenic Conference on Informatics, pages 144–149. IEEE, 2012.
  13. Adaptive algorithms to track the parafac decomposition of a third-order tensor. IEEE Transactions on Signal Processing, 57(6):2299–2310, 2009.
  14. Adaptive parafac decomposition for third-order tensor completion. In 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE), pages 297–301. IEEE, 2016.
  15. Fast adaptive parafac decomposition algorithm with linear complexity. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6235–6239. IEEE, 2016.
  16. Second-order optimization based adaptive parafac decomposition of three-way tensors. Digital Signal Processing, 63:100–111, 2017.
  17. Multi-aspect streaming tensor completion. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pages 435–443, 2017.
  18. Outlier-robust multi-aspect streaming tensor completion and factorization. In IJCAI, pages 3187–3194, 2019.
  19. Multi-aspect incremental tensor decomposition based on distributed in-memory big data systems. Journal of Data and Information Science, 5(2):13–32, 2020.
  20. Dismastd: An efficient distributed multi-aspect streaming tensor decomposition. In Proceedings of the ACM Turing Award Celebration Conference-China 2023, pages 127–128, 2023.
  21. Beyond streams and graphs: dynamic tensor analysis. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 374–383, 2006.
  22. Incremental tensor analysis: Theory and applications. ACM Transactions on Knowledge Discovery from Data (TKDD), 2(3):1–37, 2008.
  23. Robust visual tracking based on incremental tensor subspace learning. In 2007 IEEE 11th international conference on computer vision, pages 1–8. IEEE, 2007.
  24. Incremental tensor subspace learning and its applications to foreground segmentation and tracking. International Journal of Computer Vision, 91:303–327, 2011.
  25. Probabilistic streaming tensor decomposition. In 2018 IEEE International Conference on Data Mining (ICDM), pages 99–108. IEEE, 2018.
  26. Bayesian streaming sparse tucker decomposition. In Cassio de Campos and Marloes H. Maathuis, editors, Proceedings of the Thirty-Seventh Conference on Uncertainty in Artificial Intelligence, volume 161 of Proceedings of Machine Learning Research, pages 558–567. PMLR, 27–30 Jul 2021.
  27. Probabilistic tensor train decomposition with automatic rank determination from noisy data. In 2021 IEEE Statistical Signal Processing Workshop (SSP), pages 461–465, 2021.
  28. Tensor completion by alternating minimization under the tensor train (tt) model. arXiv preprint arXiv:1609.05587, 2016.
  29. High-order tensor completion via gradient-based optimization under tensor train format. Signal Processing: Image Communication, 73:53–61, 2019. Tensor Image Processing.
  30. Streaming variational bayes. Advances in neural information processing systems, 26, 2013.
  31. Graphical models, exponential families, and variational inference. Foundations and Trends® in Machine Learning, 1(1–2):1–305, 2008.
  32. Variational inference: A review for statisticians. Journal of the American statistical Association, 112(518):859–877, 2017.
  33. Tamara G. Kolda Brett W. Bader et al. Tensor toolbox for matlab, version 3.4. www.tensortoolbox.org, September 2022.
  34. Scalable tensor factorizations for incomplete data. Chemometrics and Intelligent Laboratory Systems, 106(1):41–56, 2011.
  35. On the best rank-1 and rank-(r 1, r 2,…, rn) approximation of higher-order tensors. SIAM journal on Matrix Analysis and Applications, 21(4):1324–1342, 2000.
  36. Distributed flexible nonlinear tensor factorization. Advances in neural information processing systems, 29, 2016.
  37. Robust tensor completion using transformed tensor singular value decomposition. Numerical Linear Algebra with Applications, 27(3):e2299, 2020.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets