Interpretable Data-driven Anomaly Detection in Industrial Processes with ExIFFI (2405.01158v1)
Abstract: Anomaly detection (AD) is a crucial process often required in industrial settings. Anomalies can signal underlying issues within a system, prompting further investigation. Industrial processes aim to streamline operations as much as possible, encompassing the production of the final product, making AD an essential mean to reach this goal.Conventional anomaly detection methodologies typically classify observations as either normal or anomalous without providing insight into the reasons behind these classifications.Consequently, in light of the emergence of Industry 5.0, a more desirable approach involves providing interpretable outcomes, enabling users to understand the rationale behind the results.This paper presents the first industrial application of ExIFFI, a recently developed approach focused on the production of fast and efficient explanations for the Extended Isolation Forest (EIF) Anomaly detection method. ExIFFI is tested on two publicly available industrial datasets demonstrating superior effectiveness in explanations and computational efficiency with the respect to other state-of-the-art explainable AD models.
- F. T. Liu, K. M. Ting, and Z.-H. Zhou, “Isolation forest,” in 2008 Eighth IEEE International Conference on Data Mining, 2008, pp. 413–422.
- R. Bouman, Z. Bukhsh, and T. Heskes, “Unsupervised anomaly detection algorithms on real-world data: How many do we need?” Journal of Machine Learning Research, vol. 25, no. 105, pp. 1–34, 2024. [Online]. Available: http://jmlr.org/papers/v25/23-0570.html
- A. Arcudi, D. Frizzo, C. Masiero, and G. A. Susto, “Exiffi and eif+: Interpretability and enhanced generalizability to extend the extended isolation forest,” 2024.
- L. C. Brito, G. A. Susto, J. N. Brito, and M. A. Duarte, “An explainable artificial intelligence approach for unsupervised fault detection and diagnosis in rotating machinery,” Mechanical Systems and Signal Processing, vol. 163, p. 108105, 2022.
- M. Carletti, M. Maggipinto, A. Beghi, G. A. Susto, N. Gentner, Y. Yang, and A. Kyek, “Interpretable anomaly detection for knowledge discovery in semiconductor manufacturing,” in 2020 Winter Simulation Conference (WSC). IEEE, 2020, pp. 1875–1885.
- M. Carletti, C. Masiero, A. Beghi, and G. A. Susto, “A deep learning approach for anomaly detection with industrial time series data: a refrigerators manufacturing case study,” Procedia Manufacturing, vol. 38, pp. 233–240, 2019.
- S. Vollert, M. Atzmueller, and A. Theissler, “Interpretable machine learning: A brief survey from the predictive maintenance perspective,” in 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA ), 2021, pp. 01–08.
- M. Carletti, M. Terzi, and G. A. Susto, “Interpretable anomaly detection with diffi: Depth-based feature importance of isolation forest,” Engineering Applications of Artificial Intelligence, vol. 119, p. 105730, 2023.
- S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” Advances in neural information processing systems, vol. 30, 2017.
- V. Zaccaria, D. Dandolo, C. Masiero, and G. A. Susto, “Acme-ad: Accelerated model explanations for anomaly detection,” arXiv preprint arXiv:2403.01245, 2024.
- S. Hariri, M. C. Kind, and R. J. Brunner, “Extended isolation forest,” IEEE Transactions on Knowledge and Data Engineering, vol. 33, no. 4, pp. 1479–1489, 2021.
- C. A. Rieth, B. D. Amsel, R. Tran, and M. B. Cook, “Additional tennessee eastman process simulation data for anomaly detection evaluation,” Harvard Dataverse, vol. 1, p. 2017, 2017.
- T. Diego, C. Enrico, C. Masiero, G. Susto, A. Beghi et al., “Packaging industry anomaly detection (piade) dataset,” 2022.
- M. G. Don and F. Khan, “Dynamic process fault detection and diagnosis based on a combined approach of hidden markov and bayesian network model,” Chemical Engineering Science, vol. 201, pp. 82–96, 2019.
- V. Zaccaria, C. Masiero, D. Dandolo, and G. A. Susto, “Enabling efficient and flexible interpretability of data-driven anomaly detection in industrial processes with acme-ad,” 2024.
- D. Dandolo, C. Masiero, M. Carletti, D. Dalle Pezze, and G. A. Susto, “Acme—accelerated model-agnostic explanations: Fast whitening of the machine-learning black box,” Expert Systems with Applications, vol. 214, p. 119115, 2023.