Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Real-time Adaptation for Condition Monitoring Signal Prediction using Label-aware Neural Processes (2403.16377v1)

Published 25 Mar 2024 in cs.LG, cs.SY, eess.SY, and stat.ML

Abstract: Building a predictive model that rapidly adapts to real-time condition monitoring (CM) signals is critical for engineering systems/units. Unfortunately, many current methods suffer from a trade-off between representation power and agility in online settings. For instance, parametric methods that assume an underlying functional form for CM signals facilitate efficient online prediction updates. However, this simplification leads to vulnerability to model specifications and an inability to capture complex signals. On the other hand, approaches based on over-parameterized or non-parametric models can excel at explaining complex nonlinear signals, but real-time updates for such models pose a challenging task. In this paper, we propose a neural process-based approach that addresses this trade-off. It encodes available observations within a CM signal into a representation space and then reconstructs the signal's history and evolution for prediction. Once trained, the model can encode an arbitrary number of observations without requiring retraining, enabling on-the-spot real-time predictions along with quantified uncertainty and can be readily updated as more online data is gathered. Furthermore, our model is designed to incorporate qualitative information (i.e., labels) from individual units. This integration not only enhances individualized predictions for each unit but also enables joint inference for both signals and their associated labels. Numerical studies on both synthetic and real-world data in reliability engineering highlight the advantageous features of our model in real-time adaptation, enhanced signal prediction with uncertainty quantification, and joint prediction for labels and signals.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Residual-life distributions from component degradation signals: A bayesian approach. IiE Transactions, 37(6):543–557, 2005.
  2. Long short-term memory recurrent neural network for remaining useful life prediction of lithium-ion batteries. IEEE Transactions on Vehicular Technology, 67(7):5695–5705, 2018.
  3. Nonparametric-condition-based remaining useful life prediction incorporating external factors. IEEE Transactions on Reliability, 67(1):41–52, 2017.
  4. Functional principal component analysis for extrapolating multistream longitudinal data. IEEE Transactions on Reliability, 70(4):1321–1331, 2020.
  5. The neural process family: Survey, applications and perspectives. arXiv preprint arXiv:2209.00517, 2022.
  6. Conditional neural processes. In International conference on machine learning, pages 1704–1713. PMLR, 2018.
  7. Neural processes. arXiv preprint arXiv:1807.01622, 2018.
  8. Advances in variational inference. IEEE transactions on pattern analysis and machine intelligence, 41(8):2008–2026, 2018.
  9. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
  10. What uncertainties do we need in bayesian deep learning for computer vision? Advances in neural information processing systems, 30, 2017.
  11. Semi-supervised learning with deep generative models. Advances in neural information processing systems, 27, 2014.
  12. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  13. Attentive neural processes. arXiv preprint arXiv:1901.05761, 2019.
  14. Remaining useful life estimation–a review on the statistical data driven approaches. European journal of operational research, 213(1):1–14, 2011.
  15. A hierarchical bayesian degradation model for heterogeneous data. IEEE Transactions on Reliability, 64(1):63–70, 2014.
  16. Reliability modeling for degradation-shock dependence systems with multiple species of shocks. Reliability Engineering & System Safety, 185:133–143, 2019.
  17. Estimating remaining useful life with three-source variability in degradation modeling. IEEE Transactions on Reliability, 63(1):167–190, 2014.
  18. Degradation modeling and rul prediction using wiener process subject to multiple change points and unit heterogeneity. Reliability Engineering & System Safety, 176:113–124, 2018.
  19. A mixed-effects model of two-phase degradation process for reliability assessment and rul prediction. Microelectronics Reliability, 107:113622, 2020.
  20. Nonparametric modeling and prognosis of condition monitoring signals using multivariate gaussian convolution processes. Technometrics, 60(4):484–496, 2018.
  21. Degradation modeling applied to residual lifetime prediction using functional data analysis. The Annals of Applied Statistics, pages 1586–1610, 2011.
  22. Transfer learning of degradation modeling and prognosis based on multivariate functional analysis with heterogeneous sampling rates. Reliability engineering & system safety, 223:108448, 2022.
  23. Regularized multi-output gaussian convolution process with domain adaptation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(5):6142–6156, 2022.
  24. Federated multi-output gaussian processes. Technometrics, pages 1–14, 2023.
  25. Online sparse multi-output gaussian process regression and learning. IEEE Transactions on Signal and Information Processing over Networks, 5(2):258–272, 2018.
  26. Nonlinear online multioutput gaussian process for multistream data informatics. IEEE transactions on industrial informatics, 18(6):3885–3893, 2021.
  27. Bootstrapping neural processes. Advances in neural information processing systems, 33:6606–6615, 2020.
  28. Neural processes with stochastic attention: Paying more attention to the context dataset. arXiv preprint arXiv:2204.05449, 2022.
  29. Transformer neural processes: Uncertainty-aware meta learning via sequence modeling. arXiv preprint arXiv:2207.04179, 2022.
  30. Sequential neural processes. Advances in Neural Information Processing Systems, 32, 2019.
  31. Robustifying sequential neural processes. In International Conference on Machine Learning, pages 10861–10870. PMLR, 2020.
  32. Efficient gaussian neural processes for regression. arXiv preprint arXiv:2108.09676, 2021.
  33. Convolutional conditional neural processes. arXiv preprint arXiv:1910.13556, 2019.
  34. Neural processes mixed-effect models for deep normative modeling of clinical neuroimaging data. In International Conference on Medical Imaging with Deep Learning, pages 297–314. PMLR, 2019.
  35. Convolutional conditional neural processes for local climate downscaling. arXiv preprint arXiv:2101.07950, 2021.
  36. Np-match: When neural processes meet semi-supervised learning. In International Conference on Machine Learning, pages 22919–22934. PMLR, 2022.
  37. Meta-learning regrasping strategies for physical-agnostic objects. arXiv preprint arXiv:2205.11110, 2022.
  38. Category-agnostic 6d pose estimation with conditional neural processes. arXiv preprint arXiv:2206.07162, 2022.
  39. Semi-supervised anomaly detection via neural process. IEEE Transactions on Knowledge and Data Engineering, 2023.
  40. Sparse convolved gaussian processes for multi-output regression. Advances in neural information processing systems, 21, 2008.
  41. Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of machine learning research, 9(11), 2008.
  42. Reduction of li-ion battery qualification time based on prognostics and health management. IEEE Transactions on industrial electronics, 66(9):7310–7315, 2018.
  43. Functional Data Analysis. Springer, NY, 2nd edition, 2005.
  44. refund: Regression with Functional Data, 2023. R package version 0.1-32.
  45. scikit-fda: a python package for functional data analysis. arXiv preprint arXiv:2211.02566, 2022.
  46. Maximum likelihood from incomplete data via the em algorithm. Journal of the royal statistical society: series B (methodological), 39(1):1–22, 1977.
  47. Pattern recognition and machine learning, volume 4. Springer, 2006.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets