TNPAR: Topological Neural Poisson Auto-Regressive Model for Learning Granger Causal Structure from Event Sequences (2306.14114v2)
Abstract: Learning Granger causality from event sequences is a challenging but essential task across various applications. Most existing methods rely on the assumption that event sequences are independent and identically distributed (i.i.d.). However, this i.i.d. assumption is often violated due to the inherent dependencies among the event sequences. Fortunately, in practice, we find these dependencies can be modeled by a topological network, suggesting a potential solution to the non-i.i.d. problem by introducing the prior topological network into Granger causal discovery. This observation prompts us to tackle two ensuing challenges: 1) how to model the event sequences while incorporating both the prior topological network and the latent Granger causal structure, and 2) how to learn the Granger causal structure. To this end, we devise a unified topological neural Poisson auto-regressive model with two processes. In the generation process, we employ a variant of the neural Poisson process to model the event sequences, considering influences from both the topological network and the Granger causal structure. In the inference process, we formulate an amortized inference algorithm to infer the latent Granger causal structure. We encapsulate these two processes within a unified likelihood function, providing an end-to-end framework for this task. Experiments on simulated and real-world data demonstrate the effectiveness of our approach.
- Spatial point processes in astronomy. Journal of Statistical Planning and Inference, 50(3): 311–326.
- Proximal graphical event models. Advances in Neural Information Processing Systems, 31.
- Geodesic distance in planar graphs. Nuclear physics B, 663(3): 535–567.
- Brillinger, D. R. 1994. Time series, point processes, and hybrids. Canadian Journal of Statistics, 22(2): 177–206.
- THPs: Topological Hawkes Processes for Learning Causal Structure on Event Sequences. IEEE Transactions on Neural Networks and Learning Systems.
- Mining hidden non-redundant causal relationships in online social networks. Neural Computing and Applications, 32(11): 6913–6923.
- Cox, D. R. 1955. Some statistical methods connected with series of events. Journal of the Royal Statistical Society: Series B (Methodological), 17(2): 129–157.
- Reactive point processes: A new approach to predicting power failures in underground electrical systems. The Annals of Applied Statistics, 9(1): 122–144.
- Amortized inference in probabilistic reasoning. In Annual Meeting of the Cognitive Science Society, volume 36.
- Granger, C. W. 1969. Investigating causal relations by econometric models and cross-spectral methods. Econometrica: Journal of the Econometric Society, 424–438.
- The elements of statistical learning: data mining, inference, and prediction, volume 2. Springer.
- Hawkes, A. G. 1971. Spectra of some self-exciting and mutually exciting point processes. Biometrika, 58(1): 83–90.
- A self-correcting point process. Stochastic processes and their applications, 8(3): 335–347.
- Categorical Reparameterization with Gumbel-Softmax. In International Conference on Learning Representations.
- Adam: A method for stochastic optimization. In International Conference on Learning Representations.
- Transferable time-series forecasting under causal conditional shift. IEEE Transactions on Pattern Analysis and Machine Intelligence.
- Amortized causal discovery: Learning to infer causal graphs from time-series data. In Conference on Causal Learning and Reasoning, 509–525. PMLR.
- An information-theoretic framework to measure the dynamic interaction between neural spike trains. IEEE Transactions on Biomedical Engineering, 68(12): 3471–3481.
- Structural intervention distance for evaluating causal graphs. Neural Computation, 27(3): 771–799.
- Powers, D. 2011. Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation. Journal of Machine Learning Technologies, 2(1): 37–63.
- Runge, J. 2020. Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasets. In Conference on Uncertainty in Artificial Intelligence, 1388–1397.
- Neural Temporal Point Processes: A Review. In International Joint Conference on Artificial Intelligence, 4585–4593.
- Granger causality: A review and recent advances. Annual Review of Statistics and Its Application, 9: 289–319.
- Stochastic geometry and its applications. John Wiley & Sons.
- Neural granger causality for nonlinear time series. Stat, 1050: 16.
- Causal Discovery in Manufacturing: A Structured Literature Review. Journal of Manufacturing and Materials Processing, 6(1): 10.
- Learning time series associated event sequences with recurrent point process networks. IEEE Transactions on Neural Networks and Learning Systems, 30(10): 3124–3136.
- Learning granger causality for hawkes processes. In International Conference on Machine Learning, 1717–1726.
- DAG-GNN: DAG structure learning with graph neural networks. In International Conference on Machine Learning, 7154–7163.
- Advances in variational inference. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(8): 2008–2026.
- Cause: Learning granger causality from event sequences using attribution methods. In International Conference on Machine Learning, 11235–11245.
- Learning social infectivity in sparse low-rank networks using multi-dimensional hawkes processes. In Artificial Intelligence and Statistics, 641–649.