Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Poisson-Gamma Dynamic Factor Model with Time-Varying Transition Dynamics (2402.16297v2)

Published 26 Feb 2024 in cs.LG and cs.AI

Abstract: Probabilistic approaches for handling count-valued time sequences have attracted amounts of research attentions because their ability to infer explainable latent structures and to estimate uncertainties, and thus are especially suitable for dealing with \emph{noisy} and \emph{incomplete} count data. Among these models, Poisson-Gamma Dynamical Systems (PGDSs) are proven to be effective in capturing the evolving dynamics underlying observed count sequences. However, the state-of-the-art PGDS still fails to capture the \emph{time-varying} transition dynamics that are commonly observed in real-world count time sequences. To mitigate this gap, a non-stationary PGDS is proposed to allow the underlying transition matrices to evolve over time, and the evolving transition matrices are modeled by sophisticatedly-designed Dirichlet Markov chains. Leveraging Dirichlet-Multinomial-Beta data augmentation techniques, a fully-conjugate and efficient Gibbs sampler is developed to perform posterior simulation. Experiments show that, in comparison with related models, the proposed non-stationary PGDS achieves improved predictive performance due to its capacity to learn non-stationary dependency structure captured by the time-evolving transition matrices.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. Nonparametric bayesian factor analysis for dynamic count matrices. In Artificial Intelligence and Statistics, pages 1–9, 2015.
  2. Dynamic topic models. In Proceedings of the 23rd international conference on Machine learning, pages 113–120, 2006.
  3. Relational topic models for document networks. In Proceedings of the Twelth International Conference on Artificial Intelligence and Statistics, pages 81–88, 2009.
  4. Switching poisson gamma dynamical systems. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, pages 2029–2036, 2021.
  5. Impact of covid-19 outbreaks and interventions on influenza in china and the united states. Nature communications, 12(1):3249, 2021.
  6. A comparative study of gamma markov chains for temporal non-negative matrix factorization. IEEE Transactions on Signal Processing, 69:1614–1626, 2021.
  7. Learning nonlinear dynamical systems using an em algorithm. In Proceedings of the 11th International Conference on Neural Information Processing Systems, pages 431–437, 1998.
  8. Deep dynamic poisson factorization model. In Proceedings of the 31st International Conference on Neural Information Processing Systems, pages 1665–1673, 2017.
  9. Political partisanship influences behavioral responses to governors’ recommendations for covid-19 prevention in the united states. Proceedings of the National Academy of Sciences, 117(39):24144–24153, 2020.
  10. Deep poisson gamma dynamical systems. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, pages 8451–8461, 2018.
  11. Dynamic rank factor model for text streams. In Proceedings of the 27th International Conference on Neural Information Processing Systems-Volume 2, pages 2663–2671, 2014.
  12. Scalable generalized dynamic topic models. In International Conference on Artificial Intelligence and Statistics, pages 1427–1435, 2018.
  13. Univariate discrete distributions, volume 444. John Wiley & Sons, 2005.
  14. Graph gamma process generalized linear dynamical systems. arXiv preprint arXiv:2007.12852, 2020.
  15. R. E. Kalman. A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(1):35–45, 1960.
  16. Gamma processes. Stochastic Models, 5(1):1–30, 1989.
  17. Integrated modeling of european migration. Journal of the American Statistical Association, 108(503):801–819, 2013.
  18. Bayesian poisson tensor factorization for inferring multilateral relations from sparse dyadic event counts. In Proceedings of the 21th ACM SIGKDD International conference on knowledge discovery and data mining, pages 1045–1054, 2015.
  19. Bayesian poisson tucker decomposition for learning the structure of international relations. In International Conference on Machine Learning, pages 2810–2819, 2016.
  20. Poisson-gamma dynamical systems. In Proceedings of the 30th International Conference on Neural Information Processing Systems, pages 5012–5020, 2016.
  21. Poisson-randomized gamma dynamical systems. In Proceedings of the 33rd International Conference on Neural Information Processing Systems, pages 782–793, 2019.
  22. Collective graphical models. In Proceedings of the 24th International Conference on Neural Information Processing Systems, pages 1161–1169, 2011.
  23. IHME COVID-19 Forecasting Team. Modeling covid-19 scenarios for the united states. Nature medicine, 27(1):94–105, 2021.
  24. Hierarchical dirichlet processes. Journal of the American Statistical Association, 101(476):1566–1581, 2006.
  25. State-level tracking of covid-19 in the united states. Nature Communications, 11(1):1–9, 2020.
  26. Topics over time: a non-markov continuous-time model of topical trends. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 424–433, 2006.
  27. Philippe Wanner. How well can we estimate immigration trends using google data? Quality & Quantity, 55(4):1181–1202, 2021.
  28. Tom Wilson. Methods for estimating sub-state international migration: The case of australia. Spatial Demography, 5(3):171–192, 2017.
  29. Rainer Winkelmann. Econometric Analysis of Count Data. Springer Publishing Company, Incorporated, 5th edition, 2008.
  30. Dependent relational gamma process models for longitudinal networks. In International Conference on Machine Learning, pages 5551–5560, 2018.
  31. Dependent relational gamma process models for longitudinal networks. In Proceedings of the International Conference on Machine Learning (ICML), pages 5551–5560, 2018.
  32. A Poisson gamma probabilistic model for latent node-group memberships in dynamic networks. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), pages 4366–4373, 2018.
  33. The Hawkes edge partition model for continuous-time event-based temporal networks. In Proceedings of the 36th Conference on Uncertainty in Artificial Intelligence (UAI), pages 460–469, 2020.
  34. Estimating latent population flows from aggregated data via inversing multi-marginal optimal transport. In Proceedings of the 2023 SIAM International Conference on Data Mining (SDM), pages 181–189, 2023.
  35. A variational autoencoder for neural temporal point processes with dynamic latent graphs. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024.
  36. On the bessel distribution and related problems. Annals of the Institute of Statistical Mathematics, 52:438–447, 2000.
  37. M Zhou and L Carin. Augment-and-conquer negative binomial processes. Advances in Neural Information Processing Systems, 4:2546–2554, 2012.
  38. Negative binomial process count and mixture modeling. IEEE Transactions on Pattern Analysis & Machine Intelligence, 37(02):307–320, 2015.
  39. Mingyuan Zhou. Nonparametric bayesian negative binomial factor analysis. Bayesian Analysis, 13(4):1065–1093, 2018.

Summary

We haven't generated a summary for this paper yet.