Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

InDiD: Instant Disorder Detection via Representation Learning (2106.02602v3)

Published 4 Jun 2021 in cs.LG

Abstract: For sequential data, a change point is a moment of abrupt regime switch in data streams. Such changes appear in different scenarios, including simpler data from sensors and more challenging video surveillance data. We need to detect disorders as fast as possible. Classic approaches for change point detection (CPD) might underperform for semi-structured sequential data because they cannot process its structure without a proper representation. We propose a principled loss function that balances change detection delay and time to a false alarm. It approximates classic rigorous solutions but is differentiable and allows representation learning for deep models. We consider synthetic sequences, real-world data sensors and videos with change points. We carefully labelled available data with change point moments for video data and released it for the first time. Experiments suggest that complex data require meaningful representations tailored for the specificity of the CPD task -- and our approach provides them outperforming considered baselines. For example, for explosion detection in video, the F1 score for our method is $0.53$ compared to baseline scores of $0.31$ and $0.35$.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Nauman Ahad and Mark A Davenport. 2021. Semi-supervised Sequence Classification through Change Point Detection. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35/8. 6574–6581.
  2. Samaneh Aminikhanghahi and Diane J Cook. 2017. A survey of methods for time series change point detection. Knowledge and information systems 51, 2 (2017), 339–367.
  3. A kernel multiple change-point algorithm via model selection. Journal of machine learning research 20, 162 (2019), 1–56.
  4. Jushan Bai. 1997. Estimating multiple breaks one at a time. Econometric theory 13, 3 (1997), 315–352.
  5. Kernel Change-point Detection with Auxiliary Deep Generative Models. In International Conference on Learning Representations. ICLR, Vancouver, Canada.
  6. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Conference on Empirical Methods in Natural Language Processing (EMNLP 2014). ACL, Doha, Qatar, 1724–1734.
  7. Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding. In Proceedings of The Web Conference 2021 (WWW ’21). Association for Computing Machinery. https://doi.org/10.1145/3442381.3449903
  8. Oops! predicting unintentional action in video. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. IEEE, Virtual, 919–929.
  9. Slowfast networks for video recognition. In Proceedings of the IEEE/CVF international conference on computer vision. 6202–6211.
  10. Generative adversarial nets. Advances in neural information processing systems 27 (2014).
  11. Kernel change-point analysis. In Advances in neural information processing systems. NeurIPS, Vancouver, Canada, 609–616.
  12. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
  13. Online Neural Networks for Change-Point Detection. arXiv preprint arXiv:2010.01388 (2020).
  14. Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, Long Beach, CA, USA, 7842–7851.
  15. Aarish Iyer and Soroush Vosoughi. 2020. Style Change Detection Using BERT.. In CLEF (Working Notes).
  16. Optimal detection of changepoints with a linear computational cost. J. Amer. Statist. Assoc. 107, 500 (2012), 1590–1598.
  17. Yann LeCun and Corinna Cortes. 2010. MNIST handwritten digit database. http://yann.lecun.com/exdb/mnist/. (2010). http://yann.lecun.com/exdb/mnist/
  18. Anomaly detection with generative adversarial networks for multivariate time series. arXiv preprint arXiv:1809.04758 abs/1809.04758 (2018).
  19. M-statistic for kernel change-point detection. Advances in Neural Information Processing Systems 28 (2015).
  20. A Deep Q-Network Based Approach for Online Bayesian Change Point Detection. In 2021 IEEE 31st International Workshop on Machine Learning for Signal Processing (MLSP). IEEE, IEEE, Queensland, Australia, 1–6.
  21. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018).
  22. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
  23. Aleksey S Polunchenko and Alexander G Tartakovsky. 2012. State-of-the-art in sequential change-point detection. Methodology and computing in applied probability 14, 3 (2012), 649–684.
  24. Real-Time Data-Driven Detection of the Rock-Type Alteration During a Directional Drilling. IEEE Geoscience and Remote Sensing Letters 17, 11 (2019), 1861–1865.
  25. Timeseries anomaly detection using temporal hierarchical one-class network. Advances in Neural Information Processing Systems 33 (2020), 13016–13026.
  26. AN Shiryaev. 2017. Stochastic Change-Point Detection Problems. Moscow: MCCME (in Russian) (2017).
  27. Learning structured output representation using deep conditional generative models. Advances in neural information processing systems 28 (2015), 3483–3491.
  28. Real-world anomaly detection in surveillance videos. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, Salt Lake City, Utah, USA, 6479–6488.
  29. Alexander G Tartakovsky and George V Moustakides. 2010. State-of-the-art in Bayesian changepoint detection. Sequential Analysis 29, 2 (2010), 125–145.
  30. Selective review of offline change point detection methods. Signal Processing 167 (2020), 107299.
  31. Gerrit JJ van den Burg and Christopher KI Williams. 2020. An evaluation of change point detection algorithms. arXiv preprint arXiv:2003.06222 (2020).
  32. High-dimensional, multiscale online changepoint detection. Journal of the Royal Statistical Society Series B: Statistical Methodology (2022).
  33. Sequential (quickest) change detection: Classical results and new directions. IEEE Journal on Selected Areas in Information Theory 2, 2 (2021), 494–514.
  34. Temporal recurrent networks for online action detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision. IEEE, Seoul, Korea, 5532–5541.
  35. Mi Zhang and Alexander A Sawchuk. 2012. USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, Pittsburgh, Pennsylvania, 1036–1043.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now