Ensemble Neural Networks for Remaining Useful Life (RUL) Prediction (2309.12445v1)
Abstract: A core part of maintenance planning is a monitoring system that provides a good prognosis on health and degradation, often expressed as remaining useful life (RUL). Most of the current data-driven approaches for RUL prediction focus on single-point prediction. These point prediction approaches do not include the probabilistic nature of the failure. The few probabilistic approaches to date either include the aleatoric uncertainty (which originates from the system), or the epistemic uncertainty (which originates from the model parameters), or both simultaneously as a total uncertainty. Here, we propose ensemble neural networks for probabilistic RUL predictions which considers both uncertainties and decouples these two uncertainties. These decoupled uncertainties are vital in knowing and interpreting the confidence of the predictions. This method is tested on NASA's turbofan jet engine CMAPSS data-set. Our results show how these uncertainties can be modeled and how to disentangle the contribution of aleatoric and epistemic uncertainty. Additionally, our approach is evaluated on different metrics and compared against the current state-of-the-art methods.
- Y. Lei, N. Li, S. Gontarz, J. Lin, S. Radkowski, and J. Dybala, “A model-based method for remaining useful life prediction of machinery,” IEEE Transactions on reliability, vol. 65, no. 3, pp. 1314–1326, 2016.
- M. Tan and Q. Le, “Efficientnetv2: Smaller models and faster training,” in International conference on machine learning. PMLR, 2021, pp. 10 096–10 106.
- W. X. Zhao, K. Zhou, J. Li, T. Tang, X. Wang, Y. Hou, Y. Min, B. Zhang, J. Zhang, Z. Dong et al., “A survey of large language models,” arXiv preprint arXiv:2303.18223, 2023.
- S. Zheng, K. Ristovski, A. Farahat, and C. Gupta, “Long short-term memory network for remaining useful life estimation,” in 2017 IEEE international conference on prognostics and health management (ICPHM). IEEE, 2017, pp. 88–95.
- L. Fan, Y. Chai, and X. Chen, “Trend attention fully convolutional network for remaining useful life estimation,” Reliability Engineering & System Safety, vol. 225, p. 108590, 2022.
- V. P. Nemani, H. Lu, A. Thelen, C. Hu, and A. T. Zimmerman, “Ensembles of probabilistic lstm predictors and correctors for bearing prognostics using industrial standards,” Neurocomputing, vol. 491, pp. 575–596, 2022.
- E. Hüllermeier and W. Waegeman, “Aleatoric and epistemic uncertainty in machine learning: An introduction to concepts and methods,” Machine Learning, vol. 110, pp. 457–506, 2021.
- A. Saxena, K. Goebel, D. Simon, and N. Eklund, “Damage propagation modeling for aircraft engine run-to-failure simulation,” in 2008 international conference on prognostics and health management. IEEE, 2008, pp. 1–9.
- A. Muneer, S. M. Taib, S. Naseer, R. F. Ali, and I. A. Aziz, “Data-driven deep learning-based attention mechanism for remaining useful life prediction: Case study application to turbofan engine analysis,” Electronics, vol. 10, no. 20, p. 2453, 2021.
- K. T. Nguyen, K. Medjaher, and C. Gogu, “Probabilistic deep learning methodology for uncertainty quantification of remaining useful lifetime of multi-component systems,” Reliability Engineering & System Safety, vol. 222, p. 108383, 2022.
- M. Mitici, I. de Pater, A. Barros, and Z. Zeng, “Dynamic predictive maintenance for multiple components using data-driven probabilistic rul prognostics: The case of turbofan engines,” Reliability Engineering & System Safety, vol. 234, p. 109199, 2023.
- B. Lakshminarayanan, A. Pritzel, and C. Blundell, “Simple and scalable predictive uncertainty estimation using deep ensembles,” Advances in neural information processing systems, vol. 30, 2017.
- A. Malinin, B. Mlodozeniec, and M. Gales, “Ensemble distribution distillation,” arXiv preprint arXiv:1905.00076, 2019.
- X. Zhang, P. Xiao, Y. Yang, Y. Cheng, B. Chen, D. Gao, W. Liu, and Z. Huang, “Remaining useful life estimation using cnn-xgb with extended time window,” IEEE Access, vol. 7, pp. 154 386–154 397, 2019.
- E. Ramasso, “Investigating computational geometry for failure prognostics in presence of imprecise health indicator: Results and comparisons on c-mapss datasets,” in PHM Society European Conference, vol. 2, no. 1, 2014.
- C. Zhang, P. Lim, A. K. Qin, and K. C. Tan, “Multiobjective deep belief networks ensemble for remaining useful life estimation in prognostics,” IEEE transactions on neural networks and learning systems, vol. 28, no. 10, pp. 2306–2318, 2016.
- V. T. Narendhar Gugulothu, P. Malhotra, L. Vig, P. Agarwal, and G. Shroff, “Predicting remaining useful life using time series embeddings based on recurrent neural networks,” International Journal of Prognostics and Health Management, vol. 9, 2018.
- W. Yu, I. Y. Kim, and C. Mechefske, “Remaining useful life estimation using a bidirectional recurrent neural network based autoencoder scheme,” Mechanical Systems and Signal Processing, vol. 129, pp. 764–780, 2019.
- H. Xu, N. Fard, and Y. Fang, “Time series chain graph for modeling reliability covariates in degradation process,” Reliability Engineering & System Safety, vol. 204, p. 107207, 2020.
- S. Xiang, Y. Qin, J. Luo, H. Pu, and B. Tang, “Multicellular lstm-based deep learning model for aero-engine remaining useful life prediction,” Reliability Engineering & System Safety, vol. 216, p. 107927, 2021.
- Y. Liao, L. Zhang, and C. Liu, “Uncertainty prediction of remaining useful life using long short-term memory network based on bootstrap method,” in 2018 IEEE international conference on prognostics and health management (ICPHM). IEEE, 2018, pp. 1–8.
- C. Liu, L. Zhang, Y. Liao, C. Wu, and G. Peng, “Multiple sensors based prognostics with prediction interval optimization via echo state gaussian process,” IEEE Access, vol. 7, pp. 112 397–112 409, 2019.