Unsupervised Distance Metric Learning for Anomaly Detection Over Multivariate Time Series (2403.01895v1)
Abstract: Distance-based time series anomaly detection methods are prevalent due to their relative non-parametric nature and interpretability. However, the commonly used Euclidean distance is sensitive to noise. While existing works have explored dynamic time warping (DTW) for its robustness, they only support supervised tasks over multivariate time series (MTS), leaving a scarcity of unsupervised methods. In this work, we propose FCM-wDTW, an unsupervised distance metric learning method for anomaly detection over MTS, which encodes raw data into latent space and reveals normal dimension relationships through cluster centers. FCM-wDTW introduces locally weighted DTW into fuzzy C-means clustering and learns the optimal latent space efficiently, enabling anomaly identification via data reconstruction. Experiments with 11 different types of benchmarks demonstrate our method's competitive accuracy and efficiency.
- “Codetect: Financial fraud detection with anomaly feature detection,” IEEE Access, vol. 6, pp. 19161–19174, 2018.
- “Anomaly-based network intrusion detection: An outlier detection techniques,” in Proceedings of the Eighth International Conference on Soft Computing and Pattern Recognition (SoCPaR 2016). Springer, 2018, pp. 262–269.
- “An evaluation of anomaly detection and diagnosis in multivariate time series,” IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 6, pp. 2508–2517, 2021.
- Douglas M Hawkins, Identification of outliers, vol. 11, Springer, 1980.
- “Anomaly detection in time series: a comprehensive evaluation,” Proceedings of the VLDB Endowment, vol. 15, no. 9, pp. 1779–1797, 2022.
- “A review on outlier/anomaly detection in time series data,” ACM Computing Surveys (CSUR), vol. 54, no. 3, pp. 1–33, 2021.
- “Do deep neural networks contribute to multivariate time series anomaly detection?,” Pattern Recognition, vol. 132, pp. 108945, 2022.
- “Towards a rigorous evaluation of time-series anomaly detection,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2022, vol. 36, pp. 7194–7201.
- “Lof: identifying density-based local outliers,” in Proceedings of the 2000 ACM SIGMOD international conference on Management of data, 2000, pp. 93–104.
- “Efficient algorithms for mining outliers from large data sets,” in Proceedings of the 2000 ACM SIGMOD international conference on Management of data, 2000, pp. 427–438.
- “Clustering-based anomaly detection in multivariate time series data,” Applied Soft Computing, vol. 100, pp. 106919, 2021.
- “Unsupervised outlier detection for time series by entropy and dynamic time warping,” Knowledge and Information Systems, vol. 54, no. 2, pp. 463–486, 2018.
- “Correlation based dynamic time warping of multivariate time series,” Expert Systems with Applications, vol. 39, no. 17, pp. 12814–12823, 2012.
- “Piecewise statistic approximation based similarity measure for time series,” Knowledge-Based Systems, vol. 85, pp. 181–195, 2015.
- “Learning a mahalanobis distance-based dynamic time warping measure for multivariate time series classification,” IEEE transactions on Cybernetics, vol. 46, no. 6, pp. 1363–1374, 2015.
- “A novel similarity measure model for multivariate time series based on lmnn and dtw,” Neural Processing Letters, vol. 45, pp. 925–937, 2017.
- “A development of fuzzy encoding and decoding through fuzzy clustering,” IEEE Transactions on Instrumentation and Measurement, vol. 57, no. 4, pp. 829–837, 2008.
- “Discovering cluster-based local outliers,” Pattern recognition letters, vol. 24, no. 9-10, pp. 1641–1650, 2003.
- “Histogram-based outlier score (hbos): A fast unsupervised anomaly detection algorithm,” KI-2012: poster and demo track, vol. 1, pp. 59–63, 2012.
- “Enhancing effectiveness of outlier detections for low density patterns,” in Advances in Knowledge Discovery and Data Mining: 6th Pacific-Asia Conference, PAKDD 2002 Taipei, Taiwan, May 6–8, 2002 Proceedings 6. Springer, 2002, pp. 535–548.
- “Extended isolation forest,” IEEE transactions on knowledge and data engineering, vol. 33, no. 4, pp. 1479–1489, 2019.
- “Outlier detection using isolation forest and local outlier factor,” in Proceedings of the conference on research in adaptive and convergent systems, 2019, pp. 161–168.
- “Isolation forest,” in 2008 eighth ieee international conference on data mining. IEEE, 2008, pp. 413–422.
- “Copod: copula-based outlier detection,” in 2020 IEEE international conference on data mining (ICDM). IEEE, 2020, pp. 1118–1123.
- “A novel anomaly detection scheme based on principal component classifier,” in Proceedings of the IEEE foundations and new directions of data mining workshop. IEEE Press, 2003, pp. 172–179.
- “Adaptive anomaly detection in chaotic time series with a spatially aware echo state network,” arXiv preprint arXiv:1909.01709, 2019.
- “Uci machine learning repository,” 2007.
- “Clustering by fast search and find of density peaks,” science, vol. 344, no. 6191, pp. 1492–1496, 2014.
- “Fuzzy clustering based on feature weights for multivariate time series,” Knowledge-Based Systems, vol. 197, pp. 105907, 2020.
- Mustafa Gokce Baydogan, “Multivariate time series classification datasets,” 2015.