Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Partially-Observable Sequential Change-Point Detection for Autocorrelated Data via Upper Confidence Region (2404.00220v1)

Published 30 Mar 2024 in stat.ML and cs.LG

Abstract: Sequential change point detection for multivariate autocorrelated data is a very common problem in practice. However, when the sensing resources are limited, only a subset of variables from the multivariate system can be observed at each sensing time point. This raises the problem of partially observable multi-sensor sequential change point detection. For it, we propose a detection scheme called adaptive upper confidence region with state space model (AUCRSS). It models multivariate time series via a state space model (SSM), and uses an adaptive sampling policy for efficient change point detection and localization. A partially-observable Kalman filter algorithm is developed for online inference of SSM, and accordingly, a change point detection scheme based on a generalized likelihood ratio test is developed. How its detection power relates to the adaptive sampling strategy is analyzed. Meanwhile, by treating the detection power as a reward, its connection with the online combinatorial multi-armed bandit (CMAB) problem is formulated and an adaptive upper confidence region algorithm is proposed for adaptive sampling policy design. Theoretical analysis of the asymptotic average detection delay is performed, and thorough numerical studies with synthetic data and real-world data are conducted to demonstrate the effectiveness of our method.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. K. Liu, Y. Mei, and J. Shi, “An adaptive sampling strategy for online high-dimensional process monitoring,” Technometrics, vol. 57, no. 3, pp. 305–319, 2015.
  2. A. Wang, X. Xian, F. Tsung, and K. Liu, “A spatial-adaptive sampling procedure for online monitoring of big data streams,” Journal of Quality Technology, vol. 50, no. 4, pp. 329–343, 2018.
  3. X. Xian, C. Zhang, S. Bonk, and K. Liu, “Online monitoring of big data streams: A rank-based sampling algorithm by data augmentation,” Journal of Quality Technology, vol. 53, no. 2, pp. 135–153, 2021.
  4. C. Zhang and S. C. Hoi, “Partially observable multi-sensor sequential change detection: A combinatorial multi-armed bandit approach,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, 2019, pp. 5733–5740.
  5. X. Xian, A. Wang, and K. Liu, “A nonparametric adaptive sampling strategy for online monitoring of big data streams,” Technometrics, vol. 60, no. 1, pp. 14–25, 2018.
  6. A. M. E. Gómez, D. Li, and K. Paynabar, “An adaptive sampling strategy for online monitoring and diagnosis of high-dimensional streaming data,” Technometrics, pp. 1–17, 2021.
  7. W. Jiang, K.-L. Tsui, and W. H. Woodall, “A new spc monitoring method: The arma chart,” Technometrics, vol. 42, no. 4, pp. 399–410, 2000.
  8. X. Pan and J. Jarrett, “Applying state space to spc: monitoring multivariate time series,” Journal of Applied Statistics, vol. 31, no. 4, pp. 397–418, 2004.
  9. Y. Shang, F. Tsung, and C. Zou, “Statistical process control for multistage processes with binary outputs,” IIE transactions, vol. 45, no. 9, pp. 1008–1023, 2013.
  10. D. W. Apley and J. Shi, “The glrt for statistical process control of autocorrelated processes,” IIE transactions, vol. 31, no. 12, pp. 1123–1134, 1999.
  11. S. Chen and H. B. Nembhard, “Multivariate cuscore control charts for monitoring the mean vector in autocorrelated processes,” IIE transactions, vol. 43, no. 4, pp. 291–307, 2011.
  12. A. Carpentier, A. Lazaric, M. Ghavamzadeh, R. Munos, and P. Auer, “Upper-confidence-bound algorithms for active learning in multi-armed bandits,” in International Conference on Algorithmic Learning Theory.   Springer, 2011, pp. 189–203.
  13. H. Ye, X. Xian, J.-R. C. Cheng, B. Hable, R. W. Shannon, M. K. Elyaderani, and K. Liu, “Online nonparametric monitoring of heterogeneous data streams with partial observations based on thompson sampling,” IISE Transactions, pp. 1–13, 2022.
  14. Y. Xie and D. Siegmund, “Sequential multi-sensor change-point detection,” in 2013 Information Theory and Applications Workshop (ITA).   IEEE, 2013, pp. 1–20.
  15. H. P. Chan et al., “Optimal sequential detection in multi-stream data,” Annals of Statistics, vol. 45, no. 6, pp. 2736–2763, 2017.
  16. S. Aminikhanghahi and D. J. Cook, “A survey of methods for time series change point detection,” Knowledge and information systems, vol. 51, no. 2, pp. 339–367, 2017.
  17. O.-A. Maillard, “Sequential change-point detection: Laplace concentration of scan statistics and non-asymptotic delay bounds,” in Algorithmic Learning Theory.   PMLR, 2019, pp. 610–632.
  18. C. Zou and F. Tsung, “Directional mewma schemes for multistage process monitoring and diagnosis,” Journal of Quality Technology, vol. 40, no. 4, pp. 407–427, 2008.
  19. J. Jin and J. Shi, “State Space Modeling of Sheet Metal Assembly for Dimensional Control,” Journal of Manufacturing Science and Engineering, vol. 121, no. 4, pp. 756–762, 11 1999. [Online]. Available: https://doi.org/10.1115/1.2833137
  20. J. V. Abellan-Nebot, J. Liu, F. R. Subirón, and J. Shi, “State space modeling of variation propagation in multistation machining processes considering machining-induced variations,” Journal of Manufacturing Science and Engineering, vol. 134, no. 2, 2012.
  21. Y. Kawahara, T. Yairi, and K. Machida, “Change-point detection in time-series data based on subspace identification,” in Seventh IEEE International Conference on Data Mining (ICDM 2007).   IEEE, 2007, pp. 559–564.
  22. D. Das, S. Zhou, Y. Chen, and J. Horst, “Statistical monitoring of over-dispersed multivariate count data using approximate likelihood ratio tests,” International Journal of Production Research, vol. 54, no. 21, pp. 6579–6593, 2016.
  23. D. Das and S. Zhou, “Detecting entropy increase in categorical data using maximum entropy distribution approximations,” IISE Transactions, vol. 49, no. 8, pp. 827–837, 2017.
  24. R. Kontar, S. Zhou, and J. Horst, “Estimation and monitoring of key performance indicators of manufacturing systems using the multi-output gaussian process,” International Journal of Production Research, vol. 55, no. 8, pp. 2304–2319, 2017.
  25. Y. Mei, “Efficient scalable schemes for monitoring a large number of data streams,” Biometrika, vol. 97, no. 2, pp. 419–433, 2010.
  26. M. Nabhan, Y. Mei, and J. Shi, “Correlation-based dynamic sampling for online high dimensional process monitoring,” Journal of Quality Technology, vol. 53, no. 3, pp. 289–308, 2021.
  27. H. Ye, X. Xian, J.-R. C. Cheng, B. Hable, R. W. Shannon, M. K. Elyaderani, and K. Liu, “Online nonparametric monitoring of heterogeneous data streams with partial observations based on thompson sampling,” IISE Transactions, vol. 0, no. ja, pp. 1–20, 2022. [Online]. Available: https://www.tandfonline.com/doi/abs/10.1080/24725854.2022.2039423
  28. E. Even-Dar, S. Mannor, Y. Mansour, and S. Mahadevan, “Action elimination and stopping conditions for the multi-armed bandit and reinforcement learning problems.” Journal of machine learning research, vol. 7, no. 6, 2006.
  29. S. Bubeck, T. Wang, and N. Viswanathan, “Multiple identifications in multi-armed bandits,” in International Conference on Machine Learning.   PMLR, 2013, pp. 258–265.
  30. X. Guo, X. Wang, and X. Liu, “Adalinucb: Opportunistic learning for contextual bandits,” arXiv preprint arXiv:1902.07802, 2019.
  31. H. Wu, X. Guo, and X. Liu, “Adaptive exploration-exploitation tradeoff for opportunistic bandits,” in International Conference on Machine Learning.   PMLR, 2018, pp. 5306–5314.
  32. S. Guha, K. Munagala, and P. Shi, “Approximation algorithms for restless bandit problems,” Journal of the ACM (JACM), vol. 58, no. 1, pp. 1–50, 2010.
  33. T. Gafni and K. Cohen, “Learning in restless multiarmed bandits via adaptive arm sequencing rules,” IEEE Transactions on Automatic Control, vol. 66, no. 10, pp. 5029–5036, 2020.
  34. H. Liu, K. Liu, and Q. Zhao, “Learning in a changing world: Restless multiarmed bandit with unknown dynamics,” IEEE Transactions on Information Theory, vol. 59, no. 3, pp. 1902–1916, 2012.
  35. C. R. Dance and T. Silander, “Optimal policies for observing time series and related restless bandit problems.” Journal of Machine Learning Research, vol. 20, pp. 35–1, 2019.
  36. F. Liu, J. Lee, and N. Shroff, “A change-detection based framework for piecewise-stationary multi-armed bandit problem,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1, 2018.
  37. Y. Cao, Z. Wen, B. Kveton, and Y. Xie, “Nearly optimal adaptive procedure with change detection for piecewise-stationary bandit,” in The 22nd International Conference on Artificial Intelligence and Statistics.   PMLR, 2019, pp. 418–427.
  38. A. C. Smith and E. N. Brown, “Estimating a state-space model from point process observations,” Neural computation, vol. 15, no. 5, pp. 965–991, 2003.
  39. W. Mader, Y. Linke, M. Mader, L. Sommerlade, J. Timmer, and B. Schelter, “A numerically efficient implementation of the expectation maximization algorithm for state space models,” Applied Mathematics and Computation, vol. 241, pp. 222–232, 2014.
  40. Y. Cao, A. Thompson, M. Wang, and Y. Xie, “Sketching for sequential change-point detection,” EURASIP Journal on Advances in Signal Processing, vol. 2019, no. 1, pp. 1–22, 2019.
  41. Y. Xie, “Sequential change-point approach for online community detection,” IEEE Signal Processing Letter, vol. 22, no. 8, pp. 1035–1039, 2015.
  42. P. Qiu, C. Zou, and Z. Wang, “Nonparametric profile monitoring by mixed effects modeling,” Technometrics, vol. 52, no. 3, pp. 265–277, 2010.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets