On Robust Clustering of Temporal Point Process
Abstract: Clustering of event stream data is of great importance in many application scenarios, including but not limited to, e-commerce, electronic health, online testing, mobile music service, etc. Existing clustering algorithms fail to take outlier data into consideration and are implemented without theoretical guarantees. In this paper, we propose a robust temporal point processes clustering framework which works under mild assumptions and meanwhile addresses several important issues in the event stream clustering problem.Specifically, we introduce a computationally efficient model-free distance function to quantify the dissimilarity between different event streams so that the outliers can be detected and the good initial clusters could be obtained. We further consider an expectation-maximization-type algorithm incorporated with a Catoni's influence function for robust estimation and fine-tuning of clusters. We also establish the theoretical results including algorithmic convergence, estimation error bound, outlier detection, etc. Simulation results corroborate our theoretical findings and real data applications show the effectiveness of our proposed methodology.
- A scalable stochastic model for the electricity demand of electric and plug-in hybrid vehicles. IEEE Transactions on Smart Grid, 5(2):848–860, 2013.
- K-means++ the advantages of careful seeding. In Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms, pages 1027–1035, 2007.
- GA Barnard. Time intervals between accidents—a note on maguire, pearson and wynn’s paper. Biometrika, 40(1-2):212–213, 1953.
- Using dynamic time warping to find patterns in time series. In Proceedings of the 3rd international conference on knowledge discovery and data mining, pages 359–370, 1994.
- Minimax m-estimation under adversarial corruption. In Proceedings of the 39th International Conference on Machine Learning (ICML), Bartimore, MD, 2022.
- Concentration Inequalities: A Nonasymptotic Theory of Independence. Oxford University Press, 02 2013. ISBN 9780199535255. doi: 10.1093/acprof:oso/9780199535255.001.0001. URL https://doi.org/10.1093/acprof:oso/9780199535255.001.0001.
- Refining initial points for k-means clustering. In ICML, volume 98, pages 91–99. Citeseer, 1998.
- The time-rescaling theorem and its application to neural spike train data analysis. Neural computation, 14(2):325–346, 2002.
- Bandits with heavy tail. IEEE Transactions on Information Theory, 59(11):7711–7717, 2013.
- Latent network structure learning from high-dimensional multivariate point processes. Journal of the American Statistical Association, pages 1–14, 2022.
- Deep structural point process for learning temporal interaction networks. In Machine Learning and Knowledge Discovery in Databases. Research Track: European Conference, ECML PKDD 2021, Bilbao, Spain, September 13–17, 2021, Proceedings, Part I 21, pages 305–320. Springer, 2021.
- Mário João Teixeira Carneiro et al. Towards the discovery of temporal patterns in music listening using last. fm profiles. 2011.
- Statistical inference. Cengage Learning, 2021.
- Olivier Catoni. Challenging the empirical mean and empirical variance: a deviation study. In Annales de l’IHP Probabilités et statistiques, volume 48, pages 1148–1185, 2012.
- The statistical analysis of series of events. 1966.
- An introduction to the theory of point processes: volume I: elementary theory and methods. Springer, 2003.
- Carl De Boor. On calculating with b-splines. Journal of Approximation theory, 6(1):50–62, 1972.
- Maximum likelihood from incomplete data via the em algorithm. Journal of the royal statistical society: series B (methodological), 39(1):1–22, 1977.
- Robust k𝑘kitalic_k-means++. In Conference on Uncertainty in Artificial Intelligence, pages 799–808. PMLR, 2020.
- Computing discrete fréchet distance. 1994.
- Neural temporal point processes for modelling electronic health records. In Machine Learning for Health, pages 85–113. PMLR, 2020.
- Empirical risk minimization for losses without variance. arXiv preprint arXiv:2309.03818, 2023a.
- Group network hawkes process. Journal of the American Statistical Association, (just-accepted):1–78, 2023b.
- Discriminatory analysis. nonparametric discrimination: Consistency properties. International Statistical Review/Revue Internationale de Statistique, 57(3):238–247, 1989.
- Model-based clustering, discriminant analysis, and density estimation. Journal of the American statistical Association, 97(458):611–631, 2002.
- Alexandros Georgogiannis. Robust k-means: a theoretical revisit. Advances in Neural Information Processing Systems, 29, 2016.
- Applying the multivariate time-rescaling theorem to neural population models. Neural computation, 23(6):1452–1483, 2011.
- Major Greenwood. The statistical study of infectious diseases. Journal of the Royal Statistical Society, 109(2):85–110, 1946.
- Outlier detection for temporal data: A survey. IEEE Transactions on Knowledge and data Engineering, 26(9):2250–2267, 2013.
- Recurrent poisson factorization for temporal recommendation. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 847–855, 2017.
- Loss minimization and parameter estimation with heavy tails. The Journal of Machine Learning Research, 17(1):543–582, 2016.
- Peter J Huber. Robust estimation of a location parameter. In Breakthroughs in statistics: Methodology and distribution, pages 492–518. Springer, 1992.
- Stephen C Johnson. Hierarchical clustering schemes. Psychometrika, 32(3):241–254, 1967.
- The statistical analysis of failure time data. John Wiley & Sons, 2011.
- Are call center and hospital arrivals well modeled by nonhomogeneous poisson processes? Manufacturing & Service Operations Management, 16(3):464–480, 2014.
- Theory of point estimation. Springer Science & Business Media, 2006.
- Learning temporal point processes via reinforcement learning. Advances in neural information processing systems, 31, 2018.
- The analysis of social science data with missing values. Sociological methods & research, 18(2-3):292–326, 1989.
- Stuart Lloyd. Least squares quantization in pcm. IEEE transactions on information theory, 28(2):129–137, 1982.
- Robust multivariate mean estimation: the optimality of trimmed mean. The Annals of Statistics, 49:393–410, 2021.
- You are what you watch and when you watch: Inferring household structures from iptv viewing data. IEEE Transactions on Broadcasting, 60(1):61–72, 2014. doi: 10.1109/TBC.2013.2295894.
- Multi-task multi-dimensional hawkes processes for modeling event sequences. 2015.
- Finite mixture models. Annual review of statistics and its application, 6:355–378, 2019.
- Yurii Nesterov. Introductory lectures on convex optimization: A basic course, volume 87. Springer Science & Business Media, 2003.
- Clustering of temporal event processes. International Journal of Geographical Information Science, 27(3):484–510, 2013.
- Distance-based clustering of sparsely observed stochastic processes, with applications to online auctions. 2008.
- Jonathan Pillow. Time-rescaling methods for the estimation and assessment of non-poisson neural encoding models. Advances in neural information processing systems, 22, 2009.
- A robust univariate mean estimator is all you need. In International Conference on Artificial Intelligence and Statistics, pages 4034–4044. PMLR, 2020.
- Douglas A Reynolds et al. Gaussian mixture models. Encyclopedia of biometrics, 741(659-663), 2009.
- Em algorithms for ml factor analysis. Psychometrika, 47:69–76, 1982.
- Repairing outlier behaviour in event logs using contextual behaviour. Enterprise Modelling and Information Systems Architectures (EMISAJ), 14:5–1, 2019.
- Introduction to information retrieval, volume 39. Cambridge University Press Cambridge, 2008.
- Detecting anomalous event sequences with temporal point processes. Advances in Neural Information Processing Systems, 34:13419–13431, 2021.
- A common goodness-of-fit framework for neural population models using marked point process time-rescaling. Journal of computational neuroscience, 45:147–162, 2018.
- Joel A Tropp. User-friendly tail bounds for sums of random matrices. Foundations of computational mathematics, 12:389–434, 2012.
- Roman Vershynin. High-dimensional probability: An introduction with applications in data science, volume 47. Cambridge university press, 2018.
- Ulrike Von Luxburg. A tutorial on spectral clustering. Statistics and computing, 17:395–416, 2007.
- Modeling sequential listening behaviors with attentive temporal point process for next and next new music recommendation. IEEE Transactions on Multimedia, 24:4170–4182, 2021.
- Latent class analysis of recurrent events in problem-solving items. Applied Psychological Measurement, 42(6):478–498, 2018.
- A dirichlet mixture model of hawkes processes for event sequence clustering. Advances in neural information processing systems, 30, 2017.
- Path to purchase: A mutually exciting point process model for online advertising and conversion. Management Science, 60(6):1392–1412, 2014.
- Junchi Yan. Recent advance in temporal point process: from machine learning perspective. SJTU Technical Report, 2019.
- Row-clustering of a point process-valued matrix. Advances in Neural Information Processing Systems, 34:20028–20039, 2021.
- A stochastic expectation and maximization algorithm for detecting quantitative trait-associated genes. Bioinformatics, 27(1):63–69, 2011.
- Learning mixture of neural temporal point processes for multi-dimensional event sequence clustering. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, Vienna, Austria, pages 23–29, 2022.
- Òscar Celma. lastfm music recommendation dataset, March 2010. URL https://doi.org/10.5281/zenodo.6090214.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.