Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Active Learning for Abrupt Shifts Change-point Detection via Derivative-Aware Gaussian Processes (2312.03176v1)

Published 5 Dec 2023 in cs.LG

Abstract: Change-point detection (CPD) is crucial for identifying abrupt shifts in data, which influence decision-making and efficient resource allocation across various domains. To address the challenges posed by the costly and time-intensive data acquisition in CPD, we introduce the Derivative-Aware Change Detection (DACD) method. It leverages the derivative process of a Gaussian process (GP) for Active Learning (AL), aiming to pinpoint change-point locations effectively. DACD balances the exploitation and exploration of derivative processes through multiple data acquisition functions (AFs). By utilizing GP derivative mean and variance as criteria, DACD sequentially selects the next sampling data point, thus enhancing algorithmic efficiency and ensuring reliable and accurate results. We investigate the effectiveness of DACD method in diverse scenarios and show it outperforms other active learning change-point detection approaches.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. Ahmadzadeh, F. (2018). Change point detection with multivariate control charts by artificial neural network. The International Journal of Advanced Manufacturing Technology, 97:3179–3190.
  2. A survey of methods for time series change point detection. Knowledge and information systems, 51(2):339–367.
  3. Adaptive sequential segmentation of piecewise stationary time series. Information sciences, 29(1):27–56.
  4. Detection of abrupt changes: theory and application, volume 104. prentice Hall Englewood Cliffs.
  5. Off-line detection of multiple change points by the filtered derivative with p-value method. Sequential Analysis, 30(2):172–207.
  6. Offline change detection under contamination. In Uncertainty in Artificial Intelligence, pages 191–201. PMLR.
  7. Semi-supervised change point detection using active learning. In Discovery Science: 25th International Conference, DS 2022, Montpellier, France, October 10–12, 2022, Proceedings, pages 74–88. Springer.
  8. Data-driven discontinuity detection in derivatives of a regression function. Communications in Statistics-Theory and Methods, 33(4):851–871.
  9. A method for structure breaking point detection in engine oil pressure data. Energies, 14(17):5496.
  10. Active change-point detection. In Asian Conference on Machine Learning, pages 1017–1032. PMLR.
  11. Active learning for enumerating local minima based on gaussian process derivatives. Neural Computation, 32(10):2032–2068.
  12. Kernel methods and their derivatives: Concept and perspectives for the earth system sciences. Plos one, 15(10):e0235885.
  13. Kushner, H. J. (1964). A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise.
  14. McHutchon, A. J. et al. (2015). Nonlinear modelling and control using Gaussian processes. PhD thesis, Citeseer.
  15. Merton, R. C. (1976). Option pricing when underlying stock returns are discontinuous. Journal of financial economics, 3(1-2):125–144.
  16. Mockus, J. (1998). The application of bayesian methods for seeking the extremum. Towards global optimization, 2:117.
  17. Response surface methodology: process and product optimization using designed experiments. John Wiley & Sons.
  18. Regret for expected improvement over the best-observed value and stopping condition. In Asian conference on machine learning, pages 279–294. PMLR.
  19. Bayesian modelling of piecewise trends and discontinuities to improve the estimation of coastal vertical land motion: Discotimes: a method to detect change points in gnss, satellite altimetry, tide gauge and other geophysical time series. Journal of Geodesy, 96(9):62.
  20. Scaling gaussian processes with derivative information using variational inference. Advances in Neural Information Processing Systems, 34:6442–6453.
  21. A bayesian approach to change point estimation in multivariate spc. Journal of Quality Technology, 44(3):231–248.
  22. Real-time financial surveillance via quickest change-point detection methods. arXiv preprint arXiv:1509.01570.
  23. Gaussian processes for machine learning, volume 1. Springer.
  24. Early observations on the impact of the covid-19 lockdown on air quality trends across the uk. Science of the Total Environment, 754:142374.
  25. Convergent validation of methods for the identification of psychotherapeutic phase transitions in time series of empirical and model systems. Frontiers in Psychology, 11:1970.
  26. Settles, B. (2009). Active learning literature survey.
  27. Taking the human out of the loop: A review of bayesian optimization. Proceedings of the IEEE, 104(1):148–175.
  28. Impact of landscape pattern at multiple spatial scales on water quality: A case study in a typical urbanised watershed in china. Ecological Indicators, 48:417–427.
  29. Derivative observations in gaussian process models of dynamic systems. Advances in neural information processing systems, 15.
  30. Gaussian process optimization in the bandit setting: No regret and experimental design. arXiv preprint arXiv:0912.3995.
  31. Prediction of changes in seafloor depths based on time series of bathymetry observations: Dutch north sea case. Journal of Marine Science and Engineering, 9(9):931.
  32. Selective review of offline change point detection methods. Signal Processing, 167:107299.
  33. Turner, R. D. (2012). Gaussian processes for state space models and change point detection. PhD thesis, University of Cambridge.
  34. An evaluation of change point detection algorithms. arXiv preprint arXiv:2003.06222.
  35. Detecting trend and seasonal changes in satellite image time series. Remote sensing of Environment, 114(1):106–115.
  36. Active learning for semantic segmentation with expected change. In 2012 IEEE conference on computer vision and pattern recognition, pages 3162–3169. IEEE.
  37. Bayesian optimization with gradients. Advances in neural information processing systems, 30.
  38. Online nonparametric monitoring of heterogeneous data streams with partial observations based on thompson sampling. IISE Transactions, 55(4):392–404.
  39. Active learning for gaussian process considering uncertainties with application to shape control of composite fuselage. IEEE Transactions on Automation Science and Engineering, 18(1):36–46.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now