Papers
Topics
Authors
Recent
2000 character limit reached

SimAD: A Simple Dissimilarity-based Approach for Time Series Anomaly Detection (2405.11238v1)

Published 18 May 2024 in cs.LG and cs.AI

Abstract: Despite the prevalence of reconstruction-based deep learning methods, time series anomaly detection remains challenging. Existing approaches often struggle with limited temporal contexts, inadequate representation of normal patterns, and flawed evaluation metrics, hindering their effectiveness in identifying aberrant behavior. To address these issues, we introduce $\textbf{{SimAD}}$, a $\textbf{{Sim}}$ple dissimilarity-based approach for time series $\textbf{{A}}$nomaly $\textbf{{D}}$etection. SimAD incorporates an advanced feature extractor adept at processing extended temporal windows, utilizes the EmbedPatch encoder to integrate normal behavioral patterns comprehensively, and introduces an innovative ContrastFusion module designed to accentuate distributional divergences between normal and abnormal data, thereby enhancing the robustness of anomaly discrimination. Additionally, we propose two robust evaluation metrics, UAff and NAff, addressing the limitations of existing metrics and demonstrating their reliability through theoretical and experimental analyses. Experiments across $\textbf{seven}$ diverse time series datasets demonstrate SimAD's superior performance compared to state-of-the-art methods, achieving relative improvements of $\textbf{19.85%}$ on F1, $\textbf{4.44%}$ on Aff-F1, $\textbf{77.79%}$ on NAff-F1, and $\textbf{9.69%}$ on AUC on six multivariate datasets. Code and pre-trained models are available at https://github.com/EmorZz1G/SimAD.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Sparse Deep Learning for Time Series Data: Theory and Applications, 2023.
  2. Deep learning for anomaly detection in multivariate time series: Approaches, applications, and challenges. Information Fusion, 91:93–102, 2023.
  3. A Comparative Study of Time Series Anomaly Detection Models for Industrial Control Systems. Sensors, 23(3):1310, 2023.
  4. Adaptive Memory Networks with Self-supervised Learning for Unsupervised Anomaly Detection. IEEE Transactions on Knowledge and Data Engineering, 4347(c):1–13, 2022.
  5. SimpleNet: A Simple Network for Image Anomaly Detection and Localization, 2023.
  6. A Unified Model for Multi-class Anomaly Detection, 2022.
  7. Towards Efficient Anomaly Detection Using Memory Broad Learning System.
  8. Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. 2021.
  9. An evaluation of anomaly detection and diagnosis in multivariate time series. IEEE Transactions on Neural Networks and Learning Systems, 33(6):2508–2517, 2021.
  10. Towards a Rigorous Evaluation of Time-Series Anomaly Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 36(7):7194–7201, 2022.
  11. Reward Once, Penalize Once: Rectifying Time Series Anomaly Detection. In 2022 International Joint Conference on Neural Networks (IJCNN), pages 1–8, 2022.
  12. Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progress (Extended Abstract). In 2022 IEEE 38th International Conference on Data Engineering (ICDE), pages 1479–1480, Kuala Lumpur, Malaysia, 2022. IEEE.
  13. Deep one-class classification. In International conference on machine learning, pages 4393–4402. PMLR, 2018.
  14. Deep isolation forest for anomaly detection. IEEE Transactions on Knowledge and Data Engineering, 2023.
  15. USAD: UnSupervised Anomaly Detection on Multivariate Time Series. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 3395–3404, Virtual Event CA USA, 2020. ACM.
  16. Anomaly detection using spatial and temporal information in multivariate time series. Scientific Reports, 13(1):4400, 2023.
  17. Timesnet: Temporal 2d-variation modeling for general time series analysis. In The eleventh international conference on learning representations, 2022.
  18. Multivariate time series anomaly detection with adversarial transformer architecture in the Internet of Things. Future Generation Computer Systems, 144:244–255, 2023.
  19. Time Series Anomaly Detection Using Transformer-Based GAN With Two-Step Masking. IEEE Access, 11:74035–74047, 2023.
  20. GAN-Based Anomaly Detection for Multivariate Time Series Using Polluted Training Set. IEEE Transactions on Knowledge and Data Engineering, pages 1–1, 2021.
  21. Time-series anomaly detection with stacked Transformer representations and 1D convolutional network. Engineering Applications of Artificial Intelligence, 120:105964, 2023.
  22. TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data, 2022.
  23. Calibrated One-class Classification for Unsupervised Time Series Anomaly Detection, 2022.
  24. Neural Contextual Anomaly Detection for Time Series, 2021.
  25. DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection. Technical Report arXiv:2306.10347, arXiv, 2023.
  26. Contrastive autoencoder for anomaly detection in multivariate time series. Information Sciences, 610:266–280, 2022.
  27. Contrastive predictive coding for Anomaly Detection in Multi-variate Time Series Data. https://arxiv.org/abs/2202.03639v1, 2022.
  28. Drift doesn’t matter: Dynamic decomposition with diffusion reconstruction for unstable multivariate time series anomaly detection. Advances in Neural Information Processing Systems, 36, 2024.
  29. ImDiffusion: Imputed Diffusion Models for Multivariate Time Series Anomaly Detection, 2023.
  30. One Fits All: Power General Time Series Analysis by Pretrained LM. Advances in Neural Information Processing Systems, 36:43322–43355, 2023.
  31. Reversible instance normalization for accurate time-series forecasting against distribution shift. In International Conference on Learning Representations, 2021.
  32. LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters, 2024.
  33. Time-LLM: Time Series Forecasting by Reprogramming Large Language Models, 2024.
  34. A simple framework for contrastive learning of visual representations. In International conference on machine learning, pages 1597–1607. PMLR, 2020.
  35. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on Machine learning, pages 1096–1103, 2008.
  36. Local Evaluation of Time Series Anomaly Detection Algorithms. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 635–645, 2022.
  37. The ucr time series archive. IEEE/CAA Journal of Automatica Sinica, 6(6):1293–1305, 2019.
  38. Nominality Score Conditioned Time Series Anomaly Detection by Point/Sequential Reconstruction. Advances in Neural Information Processing Systems, 36:76637–76655, 2023.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 tweet and received 0 likes.

Upgrade to Pro to view all of the tweets about this paper:

Start a free 7-day Pro trial