Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Intelligent Condition Monitoring of Industrial Plants: An Overview of Methodologies and Uncertainty Management Strategies (2401.10266v1)

Published 3 Jan 2024 in cs.LG, cs.AI, cs.SY, eess.SP, and eess.SY

Abstract: Condition monitoring plays a significant role in the safety and reliability of modern industrial systems. AI approaches are gaining attention from academia and industry as a growing subject in industrial applications and as a powerful way of identifying faults. This paper provides an overview of intelligent condition monitoring and fault detection and diagnosis methods for industrial plants with a focus on the open-source benchmark Tennessee Eastman Process (TEP). In this survey, the most popular and state-of-the-art deep learning (DL) and ML algorithms for industrial plant condition monitoring, fault detection, and diagnosis are summarized and the advantages and disadvantages of each algorithm are studied. Challenges like imbalanced data, unlabelled samples and how deep learning models can handle them are also covered. Finally, a comparison of the accuracies and specifications of different algorithms utilizing the Tennessee Eastman Process (TEP) is conducted. This research will be beneficial for both researchers who are new to the field and experts, as it covers the literature on condition monitoring and state-of-the-art methods alongside the challenges and possible solutions to them.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (131)
  1. Hierarchical deep lstm for fault detection and diagnosis for a chemical process. Processes, 10(12):2557, 2022.
  2. Explainability: Relevance based dynamic deep learning algorithm for fault detection and diagnosis in chemical processes. Computers & Chemical Engineering, 154:107467, 2021.
  3. Synthesizing rolling bearing fault samples in new conditions: A framework based on a modified cgan. Sensors, 22(14):5413, 2022.
  4. N. Amini and Q. Zhu. Fault detection and diagnosis with a novel source-aware autoencoder and deep residual neural network. Neurocomputing, 488:618–633, 2022.
  5. Autonomous fault diagnosis and root cause analysis for the processing system using one-class svm and nn permutation algorithm. Industrial & Engineering Chemistry Research, 61(3):1408–1422, 2022.
  6. Chemical process fault diagnosis based on a combined deep learning method. The Canadian Journal of Chemical Engineering, 100(1):54–66, 2022.
  7. An explainable artificial intelligence based approach for interpretation of fault classification results from deep neural networks. Chemical Engineering Science, 250:117373, 2022.
  8. One step forward for smart chemical process fault detection and diagnosis. Computers & Chemical Engineering, 164:107884, 2022.
  9. Large-scale chemical process causal discovery from big data with transformer-based deep learning. Process Safety and Environmental Protection, 173:163–177, 2023.
  10. X. Bi and J. Zhao. A novel orthogonal self-attentive variational autoencoder method for interpretable chemical process fault detection and identification. Process Safety and Environmental Protection, 156:581–597, 2021.
  11. Deep convolutional clustering-based time series anomaly detection. Sensors, 21(16):5488, 2021.
  12. Time series based fault detection in industrial processes using convolutional neural networks. In IECON 2019-45th Annual Conference of the IEEE Industrial Electronics Society, volume 1, pages 173–178. IEEE, 2019.
  13. Bidirectional deep recurrent neural networks for process fault classification. ISA transactions, 106:330–342, 2020.
  14. One-dimensional convolutional auto-encoder-based feature learning for fault diagnosis of multivariate processes. Journal of Process Control, 87:54–67, 2020.
  15. A novel process monitoring approach based on variational recurrent autoencoder. Computers & Chemical Engineering, 129:106515, 2019.
  16. A historical perspective of explainable artificial intelligence. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 11(1):e1391, 2021.
  17. L. A. Cox Jr. Causally explainable decision recommendations using causal artificial intelligence. AI-ML for Decision and Risk Analysis: Challenges and Opportunities for Normative Decision Theory, pages 273–316, 2023.
  18. Improved convolutional neural network based on multi-head attention mechanism for industrial process fault classification. In 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS), pages 918–922. IEEE, 2020.
  19. Integrating feature optimization using a dynamic convolutional neural network for chemical process supervised fault classification. Process Safety and Environmental Protection, 155:473–485, 2021.
  20. A plant-wide industrial process control problem. Computers & chemical engineering, 17(3):245–255, 1993.
  21. A process fault diagnosis method using multi-time scale dynamic feature extraction based on convolutional neural network. The Canadian Journal of Chemical Engineering, 98(6):1280–1292, 2020.
  22. Generative adversarial networks. Communications of the ACM, 63(11):139–144, 2020.
  23. Anomaly detection in batch manufacturing processes using localized reconstruction errors from 1-d convolutional autoencoders. IEEE Transactions on Semiconductor Manufacturing, 36(1):147–150, 2022.
  24. An imbalance modified convolutional neural network with incremental learning for chemical fault diagnosis. IEEE Transactions on Industrial Informatics, 18(6):3630–3639, 2021.
  25. Deep learning technique for process fault detection and diagnosis in the presence of incomplete data. Chinese Journal of Chemical Engineering, 28(9):2358–2367, 2020.
  26. Multiblock adaptive convolution kernel neural network for fault diagnosis in a large-scale industrial process. Industrial & Engineering Chemistry Research, 61(14):4879–4895, 2022.
  27. An optimized long short-term memory network based fault diagnosis model for chemical processes. Journal of Process Control, 92:161–168, 2020.
  28. Multiblock temporal convolution network-based temporal-correlated feature learning for fault diagnosis of multivariate processes. Journal of the Taiwan Institute of Chemical Engineers, 122:78–84, 2021.
  29. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
  30. Z. Hu and P. Jiang. An imbalance modified deep neural network with dynamical incremental learning for chemical fault diagnosis. IEEE Transactions on Industrial Electronics, 66(1):540–550, 2018.
  31. A novel fault diagnosis method based on cnn and lstm and its application in fault diagnosis for complex systems. Artificial Intelligence Review, pages 1–27, 2022.
  32. R. Isermann. Model-based fault-detection and diagnosis–status and applications. Annual Reviews in control, 29(1):71–85, 2005.
  33. I. Izadi Najaf Abadi. Fault diagnosis in sampled-data systems. PhD thesis, University of Alberta, 2006.
  34. Adversarial autoencoder based feature learning for fault detection in industrial processes. IEEE Transactions on Industrial Informatics, 18(2):827–834, 2021.
  35. Wavelons-constructed autoencoder-based deep neural network for fault detection in chemical processes. In 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS), pages 332–337. IEEE, 2018.
  36. J.-L. Kang. Visualization analysis for fault diagnosis in chemical processes using recurrent neural networks. Journal of the Taiwan Institute of Chemical Engineers, 112:137–151, 2020.
  37. Handwritten digit recognition: Applications of neural network chips and automatic learning. IEEE Communications Magazine, 27(11):41–46, 1989.
  38. Toward interpretable process monitoring: Slow feature analysis-aided autoencoder for spatiotemporal process feature learning. IEEE Transactions on Instrumentation and Measurement, 71:1–11, 2021.
  39. A wavelet transform-assisted convolutional neural network multi-model framework for monitoring large-scale fluorochemical engineering processes. Processes, 8(11):1480, 2020.
  40. Y. Li. A fault prediction and cause identification approach in complex industrial processes based on deep learning. Computational Intelligence and Neuroscience, 2021:1–13, 2021.
  41. Fault diagnostic method based on deep learning and multimodel feature fusion for complex industrial processes. Industrial & Engineering Chemistry Research, 59(40):18061–18069, 2020.
  42. Industrial process fault detection based on deep highly-sensitive feature capture. Journal of Process Control, 102:54–65, 2021.
  43. Toward robust process monitoring of complex process industries based on denoising sparse auto-encoder. Journal of Industrial Information Integration, 30:100410, 2022.
  44. Toward robust fault identification of complex industrial processes using stacked sparse-denoising autoencoder with softmax classifier. IEEE Transactions on Cybernetics, 53(1):428–442, 2021.
  45. Fault diagnosis based on sparse semi-supervised gan model. In 2020 Chinese Control and Decision Conference (CCDC), IEEE, pages 5620–5624, 2020.
  46. Fault detection in tennessee eastman process with temporal deep learning models. Journal of Industrial Information Integration, 23:100216, 2021.
  47. Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Advanced Engineering Informatics, 32:139–151, 2017.
  48. A unified approach to interpreting model predictions. Advances in neural information processing systems, 30, 2017.
  49. Weighted time series fault diagnosis based on a stacked sparse autoencoder. Journal of Chemometrics, 31(9):e2912, 2017.
  50. A novel key performance indicator oriented hierarchical monitoring and propagation path identification framework for complex industrial processes. ISA transactions, 96:1–13, 2020.
  51. Consistency regularization auto-encoder network for semi-supervised process fault diagnosis. IEEE Transactions on Instrumentation and Measurement, 71:1–15, 2022.
  52. Double branch rebalanced network for class imbalance learning in process fault diagnosis. Industrial & Engineering Chemistry Research, 62(2):1057–1072, 2023.
  53. A review of data-driven fault detection and diagnosis methods: Applications in chemical process systems. Reviews in Chemical Engineering, 36(4):513–553, 2020.
  54. Open benchmarks for assessment of process monitoring and fault diagnosis techniques: a review and critical analysis. Computers & Chemical Engineering, page 107964, 2022.
  55. Identification of unknown faults in chemical processes using few-shot learning. Measurement, 207:112393, 2023.
  56. A comparative study on long short-term memory and gated recurrent unit neural networks in fault diagnosis for chemical processes using visualization. Journal of the Taiwan Institute of Chemical Engineers, 130:104028, 2022.
  57. A. Morales-Forero and S. Bassetto. Case study: a semi-supervised methodology for anomaly detection and diagnosis. In 2019 IEEE international conference on industrial engineering and engineering management (IEEM), pages 1031–1037. IEEE, 2019.
  58. X. Niu and X. Yang. A novel one-dimensional convolutional neural network architecture for chemical process fault diagnosis. The Canadian Journal of Chemical Engineering, 100(2):302–316, 2022.
  59. Overview of explainable artificial intelligence for prognostic and health management of industrial assets based on preferred reporting items for systematic reviews and meta-analyses. Sensors, 21(23):8020, 2021.
  60. A classification-driven neuron-grouped sae for feature representation and its application to fault classification in chemical processes. Knowledge-Based Systems, 230:107350, 2021.
  61. Fault detection and diagnosis using combined autoencoder and long short-term memory network. Sensors, 19(21):4612, 2019.
  62. J. Pearl. Causality. Cambridge university press, 2009.
  63. Progressively balanced supervised contrastive representation learning for long-tailed fault diagnosis. IEEE Transactions on Instrumentation and Measurement, 71:1–12, 2022.
  64. Open-set fault diagnosis via supervised contrastive learning with negative out-of-distribution data augmentation. IEEE Transactions on Industrial Informatics, 19(3):2463–2473, 2022.
  65. Imbalanced process fault diagnosis using enhanced auxiliary classifier gan. In 2020 Chinese Automation Congress (CAC), pages 313–316. IEEE, 2020.
  66. Non-revisiting genetic cost-sensitive sparse autoencoder for imbalanced fault diagnosis. Applied Soft Computing, 114:108138, 2022.
  67. Cost sensitive active learning using bidirectional gated recurrent neural networks for imbalanced fault diagnosis. Neurocomputing, 407:232–245, 2020.
  68. Towards robust and understandable fault detection and diagnosis using denoising sparse autoencoder and smooth integrated gradients. ISA transactions, 125:371–383, 2022.
  69. S. Plakias and Y. S. Boutalis. A novel information processing method based on an ensemble of auto-encoders for unsupervised fault detection. Computers in Industry, 142:103743, 2022.
  70. Contrastive learning based self-supervised time-series analysis. Applied Soft Computing, 117:108397, 2022.
  71. R. Qin and J. Zhao. Adaptive multiscale convolutional neural network model for chemical process fault diagnosis. Chinese Journal of Chemical Engineering, 50:398–411, 2022.
  72. R. Qin and J. Zhao. High-efficiency generative adversarial network model for chemical process fault diagnosis. IFAC-PapersOnLine, 55(7):732–737, 2022.
  73. " why should i trust you?" explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pages 1135–1144, 2016.
  74. O. Sagi and L. Rokach. Ensemble learning: A survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(4):e1249, 2018.
  75. J. Schmidhuber. Deep learning in neural networks: An overview. Neural networks, 61:85–117, 2015.
  76. A multichannel lstm-cnn method for fault diagnosis of chemical process. Mathematical Problems in Engineering, 2019:1–14, 2019.
  77. Intelligent manufacturing execution systems: A systematic review. Journal of Manufacturing Systems, 62:503–522, 2022.
  78. A comprehensive review of deep learning applications in hydrology and water resources. Water Science and Technology, 82(12):2635–2670, 2020.
  79. Q. Song and P. Jiang. A multi-scale convolutional neural network based fault diagnosis model for complex chemical processes. Process Safety and Environmental Protection, 159:575–584, 2022.
  80. Fault detection and identification using bayesian recurrent neural networks. Computers & Chemical Engineering, 141:106991, 2020.
  81. Tallaswapna. Types of autoencoders in deep learning, Jul 2023.
  82. Identification of abnormal conditions in high-dimensional chemical process based on feature selection and deep learning. Chinese Journal of Chemical Engineering, 28(7):1875–1883, 2020.
  83. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  84. M. Vuković and S. Thalmann. Causal discovery in manufacturing: A structured literature review. Journal of Manufacturing and Materials Processing, 6(1):10, 2022.
  85. A novel fault detection method based on one-dimension convolutional adversarial autoencoder (1daae). Processes, 11(2):384, 2023.
  86. Fault diagnosis of complex chemical processes using feature fusion of a convolutional network. Industrial & Engineering Chemistry Research, 60(5):2232–2248, 2021.
  87. Root cause diagnosis for process faults based on multisensor time-series causality discovery. Journal of Process Control, 122:27–40, 2023.
  88. A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. ISA transactions, 96:457–467, 2020.
  89. Y. Wei and Z. Weng. Research on te process fault diagnosis method based on dbn and dropout. The Canadian Journal of Chemical Engineering, 98(6):1293–1306, 2020.
  90. A novel deep learning model based on target transformer for fault diagnosis of chemical process. Process Safety and Environmental Protection, 167:480–492, 2022.
  91. A three-step framework for multimodal industrial process monitoring based on dlan, tsqta, and fsbn. Processes, 11(2):318, 2023.
  92. H. Wu and J. Zhao. Deep convolutional neural network model based chemical process fault diagnosis. Computers & chemical engineering, 115:185–197, 2018.
  93. H. Wu and J. Zhao. Self-adaptive deep learning for multimode process monitoring. Computers & chemical engineering, 141:107024, 2020.
  94. Fault diagnosis of unseen modes in chemical processes based on labeling and class progressive adversarial learning. IEEE Transactions on Instrumentation and Measurement, 72:1–12, 2022.
  95. D. Xie and L. Bai. A hierarchical deep neural network for fault diagnosis on tennessee-eastman process. In 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA), pages 745–748. IEEE, 2015.
  96. Attention-based long short-term memory fully convolutional network for chemical process fault diagnosis. Chinese Journal of Chemical Engineering, 56:1–14, 2023.
  97. A new diagnosis method with few-shot learning based on a class-rebalance strategy for scarce faults in industrial processes. Machine Intelligence Research, pages 1–12, 2023.
  98. S. Yan and X. Yan. Design teacher and supervised dual stacked auto-encoders for quality-relevant fault detection in industrial process. Applied Soft Computing, 81:105526, 2019.
  99. A review of real-time fault diagnosis methods for industrial smart manufacturing. Processes, 11(2):369, 2023.
  100. A pairwise graph regularized constraint based on deep belief network for fault diagnosis. Digital Signal Processing, 108:102868, 2021.
  101. J. Yang and L. Wang. Nonlocal, local and global preserving stacked autoencoder based fault detection method for nonlinear process monitoring. Chemometrics and Intelligent Laboratory Systems, 235:104758, 2023.
  102. A hybrid intelligent fault diagnosis strategy for chemical processes based on penalty iterative optimization. Processes, 9(8):1266, 2021.
  103. J. Yin and X. Yan. Mutual information–dynamic stacked sparse autoencoders for fault detection. Industrial & Engineering Chemistry Research, 58(47):21614–21624, 2019.
  104. A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark tennessee eastman process. Journal of process control, 22(9):1567–1581, 2012.
  105. A review on basic data-driven approaches for industrial process monitoring. IEEE Transactions on Industrial electronics, 61(11):6418–6428, 2014.
  106. Supervised convolutional autoencoder-based fault-relevant feature learning for fault diagnosis in industrial processes. Journal of the Taiwan Institute of Chemical Engineers, 132:104200, 2022.
  107. J. Yu and X. Liu. One-dimensional residual convolutional auto-encoder for fault detection in complex industrial processes. International Journal of Production Research, 60(18):5655–5674, 2022.
  108. Convolutional long short-term memory autoencoder-based feature learning for fault detection in industrial processes. IEEE Transactions on Instrumentation and Measurement, 70:1–15, 2020.
  109. J. Yu and X. Yan. Layer-by-layer enhancement strategy of favorable features of the deep belief network for industrial process monitoring. Industrial & Engineering Chemistry Research, 57(45):15479–15490, 2018.
  110. J. Yu and C. Zhang. Manifold regularized stacked autoencoders-based feature learning for fault detection in industrial processes. Journal of Process Control, 92:119–136, 2020.
  111. Multichannel one-dimensional convolutional neural network-based feature learning for fault diagnosis of industrial processes. Neural Computing and Applications, 33:3085–3104, 2021.
  112. Sparse one-dimensional convolutional neural network-based feature learning for fault detection and diagnosis in multivariable manufacturing processes. Neural Computing and Applications, pages 1–24, 2022.
  113. J. Yuan and Y. Tian. An intelligent fault diagnosis method using gru neural network towards sequential data in dynamic processes. Processes, 7(3):152, 2019.
  114. J. Yuan and Y. Tian. A multiscale feature learning scheme based on deep learning for industrial process monitoring and fault diagnosis. IEEE Access, 7:151189–151202, 2019.
  115. Fault detection and recognition of multivariate process based on feature learning of one-dimensional convolutional neural network and stacked denoised autoencoder. International Journal of Production Research, 59(8):2426–2449, 2021.
  116. Amplitude-frequency images-based convnet: Applications of fault detection and diagnosis in chemical processes. Journal of Chemometrics, 33(9):e3168, 2019.
  117. Generalized transformer in fault diagnosis of tennessee eastman process. Neural Computing and Applications, 34(11):8575–8585, 2022.
  118. A novel fault diagnosis method based on stacked lstm. IFAC-PapersOnLine, 53(2):790–795, 2020.
  119. R. Zhang and Z. Xiong. Recurrent neural network model with self-attention mechanism for fault detection and diagnosis. In 2019 Chinese Automation Congress (CAC), pages 4706–4711. IEEE, 2019.
  120. Bidirectional recurrent neural network-based chemical process fault diagnosis. Industrial & Engineering Chemistry Research, 59(2):824–834, 2019.
  121. S. Zhang and T. Qiu. A dynamic-inner convolutional autoencoder for process monitoring. Computers & Chemical Engineering, 158:107654, 2022.
  122. S. Zhang and T. Qiu. Semi-supervised lstm ladder autoencoder for chemical process fault diagnosis and localization. Chemical Engineering Science, 251:117467, 2022.
  123. An effective zero-shot learning approach for intelligent fault detection using 1d cnn. Applied Intelligence, 53(12):16041–16058, 2023.
  124. Automated feature learning for nonlinear process monitoring–an approach using stacked denoising autoencoder and k-nearest neighbor rule. Journal of Process Control, 64:49–61, 2018.
  125. H. Zhao. Neural component analysis for fault detection. Chemometrics and Intelligent Laboratory Systems, 176:11–21, 2018.
  126. Sequential fault diagnosis based on lstm neural network. Ieee Access, 6:12929–12939, 2018.
  127. S. Zheng and J. Zhao. A new unsupervised data mining method based on the stacked autoencoder for chemical process fault diagnosis. Computers & Chemical Engineering, 135:106755, 2020.
  128. S. Zheng and J. Zhao. High-fidelity positive-unlabeled deep learning for semi-supervised fault detection of chemical processes. Process Safety and Environmental Protection, 165:191–204, 2022.
  129. Exploring global attention mechanism on fault detection and diagnosis for complex engineering processes. Process Safety and Environmental Protection, 170:660–669, 2023.
  130. Deep neural network based recursive feature learning for nonlinear dynamic process monitoring. The Canadian Journal of Chemical Engineering, 98(4):919–933, 2020.
  131. E. Zio. Prognostics and health management (phm): Where are we and where do we (need to) go in theory and practice. Reliability Engineering & System Safety, 218:108119, 2022.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

Youtube Logo Streamline Icon: https://streamlinehq.com