Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Reducing sequential change detection to sequential estimation (2309.09111v2)

Published 16 Sep 2023 in math.ST, cs.LG, stat.ME, stat.ML, and stat.TH

Abstract: We consider the problem of sequential change detection, where the goal is to design a scheme for detecting any changes in a parameter or functional $\theta$ of the data stream distribution that has small detection delay, but guarantees control on the frequency of false alarms in the absence of changes. In this paper, we describe a simple reduction from sequential change detection to sequential estimation using confidence sequences: we begin a new $(1-\alpha)$-confidence sequence at each time step, and proclaim a change when the intersection of all active confidence sequences becomes empty. We prove that the average run length is at least $1/\alpha$, resulting in a change detection scheme with minimal structural assumptions~(thus allowing for possibly dependent observations, and nonparametric distribution classes), but strong guarantees. Our approach bears an interesting parallel with the reduction from change detection to sequential testing of Lorden (1971) and the e-detector of Shin et al. (2022).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (14)
  1. R. Durrett. Probability: Theory and Examples. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, 5th edition, 2019.
  2. E. Hazan. Introduction to online convex optimization. Foundations and Trends in Optimization, 2(3-4):157–325, 2016.
  3. J. Honda and A. Takemura. An asymptotically optimal bandit algorithm for bounded support models. In The Twenty Third Annual Conference on Learning Theory, pages 67–79. PMLR, 2010.
  4. G. Lorden. Procedures for reacting to a change in distribution. The Annals of Mathematical Statistics, pages 1897–1908, 1971.
  5. F. Orabona and K.-S. Jun. Tight concentrations and confidence sequences from the regret of universal portfolio. IEEE Transactions on Information Theory (to appear), 2024+.
  6. E. S. Page. Continuous inspection schemes. Biometrika, 41(1/2):100–115, 1954.
  7. S. Shekhar and A. Ramdas. Sequential changepoint detection via backward confidence sequences. In Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pages 30908–30930. PMLR, 23–29 Jul 2023.
  8. W. A. Shewhart. The application of statistics as an aid in maintaining quality of a manufactured product. Journal of the American Statistical Association, 20(152):546–548, 1925.
  9. W. A. Shewhart. Economic quality control of manufactured product. Bell System Technical Journal, 9(2):364–389, 1930.
  10. E-detectors: a nonparametric framework for online changepoint detection. New England Journal of Statistics and Data Science (to appear), 2024.
  11. A. N. Shiryaev. On optimum methods in quickest detection problems. Theory of Probability & Its Applications, 8(1):22–46, 1963.
  12. Sequential analysis: Hypothesis testing and changepoint detection. CRC Press, 2014.
  13. A. B. Tsybakov. Introduction to Nonparametric Estimation. Springer Series in Statistics, 2009.
  14. I. Waudby-Smith and A. Ramdas. Estimating means of bounded random variables by betting. Journal of the Royal Statistical Society B, 2023.
Citations (1)

Summary

We haven't generated a summary for this paper yet.