Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Log-Linear Non-Parametric Online Changepoint Detection Algorithm based on Functional Pruning (2302.02718v2)

Published 6 Feb 2023 in stat.ME, stat.CO, and stat.ML

Abstract: Online changepoint detection aims to detect anomalies and changes in real-time in high-frequency data streams, sometimes with limited available computational resources. This is an important task that is rooted in many real-world applications, including and not limited to cybersecurity, medicine and astrophysics. While fast and efficient online algorithms have been recently introduced, these rely on parametric assumptions which are often violated in practical applications. Motivated by data streams from the telecommunications sector, we build a flexible nonparametric approach to detect a change in the distribution of a sequence. Our procedure, NP-FOCuS, builds a sequential likelihood ratio test for a change in a set of points of the empirical cumulative density function of our data. This is achieved by keeping track of the number of observations above or below those points. Thanks to functional pruning ideas, NP-FOCuS has a computational cost that is log-linear in the number of observations and is suitable for high-frequency data streams. In terms of detection power, NP-FOCuS is seen to outperform current nonparametric online changepoint techniques in a variety of settings. We demonstrate the utility of the procedure on both simulated and real data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Abramson, J. S. (2012). Some minorants and majorants of random walks and Lévy processes. PhD thesis, UC Berkeley.
  2. In-flight and wireless damage detection in a uav composite wing using fiber optic sensors and strain field pattern recognition. Mechanical Systems and Signal Processing, 136:106526.
  3. Andersen, E. S. (1955). On the fluctuations of sums of random variables ii. Mathematica Scandinavica, pages 195–223.
  4. Online non-parametric changepoint detection with application to monitoring operational performance of network devices. Computational Statistics & Data Analysis, 177:107551.
  5. Detection of abrupt changes: theory and application, volume 104. Prentice Hall Englewood Cliffs.
  6. Chen, H. (2019). Sequential change-point detection based on nearest neighbors. The Annals of Statistics, 47(3):1381–1407.
  7. Graph-based change-point analysis. Annual Review of Statistics and Its Application, 10:475–499.
  8. High-dimensional, multiscale online changepoint detection. arXiv preprint arXiv:2003.03668.
  9. High-dimensional, multiscale online changepoint detection. Journal of the Royal Statistical Society Series B: Statistical Methodology, 84(1):234–266.
  10. Multiple change point detection under serial dependence: Wild energy maximisation and gappy schwarz criterion. arXiv:2011.13884.
  11. Data segmentation algorithms: Univariate mean change and beyond. Econometrics and Statistics.
  12. Sequential change-point detection for high-dimensional and non-euclidean data. IEEE Transactions on Signal Processing, 70:4498–4511.
  13. Detecting a single change-point. arXiv preprint arXiv:2210.07066.
  14. Relating and comparing methods for detecting changes in mean. Stat, 9(1):e291.
  15. Change detection with the kernel cumulative sum algorithm. In 2019 IEEE 58th Conference on Decision and Control (CDC), pages 6092–6099. IEEE.
  16. Fridman, P. (2010). A method of detecting radio transients. Monthly Notices of the Royal Astronomical Society, 409(2):808–820.
  17. Multiple-change-point detection for auto-regressive conditional heteroscedastic processes. Journal of the Royal Statistical Society: Series B: Statistical Methodology, pages 903–924.
  18. Hermes: An ultra-wide band x and gamma-ray transient monitor on board a nano-satellite constellation. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 936:199–203.
  19. Changepoint detection in non-exchangeable data. arXiv preprint arXiv:2111.05054.
  20. A nonparametric change-point control chart. Journal of Quality Technology, 42(2):165–173.
  21. Computationally efficient changepoint detection for a range of penalties. Journal of Computational and Graphical Statistics, 26(1):134–143.
  22. Fault detection and diagnosis for aeronautic and aerospace missions. In Fault tolerant flight control, pages 91–128. Springer.
  23. High-dimensional process monitoring and change point detection using embedding distributions in reproducing kernel Hilbert space. IIE Transactions, 46(10):999–1016.
  24. Fast nonconvex deconvolution of calcium imaging data. Biostatistics, 21(4):709–726.
  25. Newma: A new method for scalable model-free online change-point detection. IEEE Transactions on Signal Processing, 68:3515–3528.
  26. Seeded binary segmentation: A general methodology for fast and optimal change point detection. arXiv preprint arXiv:2002.06633.
  27. Real-time nonparametric anomaly detection in high-dimensional settings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(7):2463–2479.
  28. A nonparametric approach for multiple change point analysis of multivariate data. Journal of the American Statistical Association, 109(505):334–345.
  29. Mei, Y. (2010). Efficient scalable schemes for monitoring a large number of data streams. Biometrika, 97(2):419–433.
  30. Transcriptional landscape estimation from tiling array data using a model of signal shift and drift. Bioinformatics, 25(18):2341–2347.
  31. Page, E. S. (1954). Continuous inspection schemes. Biometrika, 41(1/2):100–115.
  32. Pettitt, A. N. (1979). A non-parametric approach to the change-point problem. Journal of the Royal Statistical Society: Series C (Applied Statistics), 28(2):126–135.
  33. Real time fault monitoring of industrial processes, volume 12. Springer Science & Business Media.
  34. Fast online changepoint detection via functional pruning cusum statistics. Journal of Machine Learning Research, 24(81):1–36.
  35. Detecting abrupt changes in the presence of local fluctuations and autocorrelated noise. Journal of the American Statistical Association, pages 1–16.
  36. Ross, G. J. (2015). Parametric and nonparametric sequential change detection in r: The cpm package. Journal of Statistical Software, 66:1–20.
  37. Ross, G. J. (2021). Nonparametric detection of multiple location-scale change points via wild binary segmentation. arXiv preprint arXiv:2107.01742.
  38. Two nonparametric control charts for detecting arbitrary distribution changes. Journal of Quality Technology, 44(2):102–116.
  39. A cluster analysis method for grouping means in the analysis of variance. Biometrics, 30(3):507–512.
  40. E-detectors: a nonparametric framework for online changepoint detection. arXiv preprint arXiv:2203.03532.
  41. A nonparametric multichart cusum test for rapid intrusion detection. In Proceedings of Joint Statistical Meetings, volume 7, page 11.
  42. Sequential change-point detection: Computation versus statistical performance. arXiv preprint arXiv:2210.05181.
  43. A constant-per-iteration likelihood ratio test for online changepoint detection for exponential family models. arXiv preprint arXiv:2302.04743.
  44. Online kernel cusum for change-point detection. arXiv preprint arXiv:2211.15070.
  45. Window-limited cusum for sequential change detection. IEEE Transactions on Information Theory, pages 1–1.
  46. A note on online change point detection. arXiv preprint arXiv:2006.03283.
  47. Nonparametric maximum likelihood approach to multiple change-point problems. The Annals of Statistics, 42(3):970–1002.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now