Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Solving PDEs with Unmeasurable Source Terms Using Coupled Physics-Informed Neural Network with Recurrent Prediction for Soft Sensors (2301.08618v3)

Published 20 Jan 2023 in cs.LG, cs.NA, and math.NA

Abstract: Partial differential equations (PDEs) are a model candidate for soft sensors in industrial processes with spatiotemporal dependence. Although physics-informed neural networks (PINNs) are a promising machine learning method for solving PDEs, they are infeasible for the nonhomogeneous PDEs with unmeasurable source terms. To this end, a coupled PINN (CPINN) with a recurrent prediction (RP) learning strategy (CPINN- RP) is proposed. First, CPINN composed of NetU and NetG is proposed. NetU is for approximating PDEs solutions and NetG is for regularizing the training of NetU. The two networks are integrated into a data-physics-hybrid loss function. Then, we theoretically prove that the proposed CPINN has a satisfying approximation capability for solutions to nonhomogeneous PDEs with unmeasurable source terms. Besides the theoretical aspects, we propose a hierarchical training strategy to optimize and couple NetU and NetG. Secondly, NetU-RP is proposed for compensating information loss in data sampling to improve the prediction performance, in which RP is the recurrently delayed outputs of well-trained CPINN and hard sensors. Finally, the artificial and practical datasets are used to verify the feasibility and effectiveness of CPINN-RP for soft sensors.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. C. F. Lui, Y. Liu, and M. Xie, “A supervised bidirectional long short-term memory network for data-driven dynamic soft sensor modeling,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–13, 2022.
  2. K. Zhu and C. Zhao, “Dynamic graph-based adaptive learning for online industrial soft sensor with mutable spatial coupling relations,” IEEE Transactions on Industrial Electronics, vol. 70, no. 9, pp. 9614–9622, 2023.
  3. X. Jiang and Z. Ge, “Improving the performance of just-in-time learning-based soft sensor through data augmentation,” IEEE Transactions on Industrial Electronics, vol. 69, no. 12, pp. 13 716–13 726, 2022.
  4. G. Welch, G. Bishop et al., “An introduction to the kalman filter,” 1995.
  5. F. Fischer and J. Deutscher, “Fault diagnosis for linear heterodirectional hyperbolic ode–pde systems using backstepping-based trajectory planning,” Automatica, vol. 135, p. 109952, 2022.
  6. Y. Tang, H. Su, T. Jin, and R. C. Flesch, “Adaptive pid control approach considering simulated annealing algorithm for thermal damage of brain tumor during magnetic hyperthermia,” IEEE Transactions on Instrumentation and Measurement, 2023.
  7. H. Karami, M. Azadifar, A. Mostajabi, P. Favrat, M. Rubinstein, and F. Rachidi, “Localization of electromagnetic interference sources using a time-reversal cavity,” IEEE Transactions on Industrial Electronics, vol. 68, no. 1, pp. 654–662, 2021.
  8. J. Tu, C. Liu, and P. Qi, “Physics-informed neural network integrating pointnet-based adaptive refinement for investigating crack propagation in industrial applications,” IEEE Transactions on Industrial Informatics, pp. 1–9, 2022.
  9. R. Pintelon, J. Schoukens, L. Pauwels, and E. Van Gheem, “Diffusion systems: stability, modeling, and identification,” IEEE Transactions on Instrumentation and Measurement, vol. 54, no. 5, pp. 2061–2067, 2005.
  10. C. Oszkinat, S. E. Luczak, and I. Rosen, “Uncertainty quantification in estimating blood alcohol concentration from transdermal alcohol level with physics-informed neural networks,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
  11. J. Sirignano and K. Spiliopoulos, “Dgm: A deep learning algorithm for solving partial differential equations,” Journal of computational physics, vol. 375, pp. 1339–1364, 2018.
  12. K. Kashinath, M. Mustafa, A. Albert, J. Wu, C. Jiang, S. Esmaeilzadeh, K. Azizzadenesheli, R. Wang, A. Chattopadhyay, A. Singh et al., “Physics-informed machine learning: case studies for weather and climate modelling,” Philosophical Transactions of the Royal Society A, vol. 379, no. 2194, p. 20200093, 2021.
  13. X. Yuan, L. Li, Y. A. W. Shardt, Y. Wang, and C. Yang, “Deep learning with spatiotemporal attention-based lstm for industrial soft sensor model development,” IEEE Transactions on Industrial Electronics, vol. 68, no. 5, pp. 4404–4414, 2021.
  14. X. Lu, T. Hu, and F. Yin, “A novel spatiotemporal fuzzy method for modeling of complex distributed parameter processes,” IEEE Transactions on Industrial Electronics, vol. 66, no. 10, pp. 7882–7892, 2019.
  15. G. Dziuk and C. M. Elliott, “Finite element methods for surface pdes,” Acta Numerica, vol. 22, pp. 289–396, 2013.
  16. J. Peiró and S. Sherwin, “Finite difference, finite element and finite volume methods for partial differential equations,” in Handbook of materials modeling.   Springer, 2005, pp. 2415–2446.
  17. X. Zhuang and C. Augarde, “Aspects of the use of orthogonal basis functions in the element-free galerkin method,” International Journal for Numerical Methods in Engineering, vol. 81, no. 3, pp. 366–380, 2010.
  18. M. Ye, J. Shen, G. Lin, T. Xiang, L. Shao, and S. C. Hoi, “Deep learning for person re-identification: A survey and outlook,” IEEE transactions on pattern analysis and machine intelligence, vol. 44, no. 6, pp. 2872–2893, 2021.
  19. R. Mondal, S. Bhowmik, and R. Sarkar, “tseggan: A generative adversarial network for segmenting touching nontext components from text ones in handwriting,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–10, 2021.
  20. A. Kamble, P. H. Ghare, and V. Kumar, “Deep-learning-based bci for automatic imagined speech recognition using spwvd,” IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1–10, 2023.
  21. A. J. Meade Jr and A. A. Fernandez, “The numerical solution of linear ordinary differential equations by feedforward neural networks,” Mathematical and Computer Modelling, vol. 19, no. 12, pp. 1–25, 1994.
  22. I. E. Lagaris, A. Likas, and D. I. Fotiadis, “Artificial neural networks for solving ordinary and partial differential equations,” IEEE transactions on neural networks, vol. 9, no. 5, pp. 987–1000, 1998.
  23. I. E. Lagaris, A. C. Likas, and D. G. Papageorgiou, “Neural-network methods for boundary value problems with irregular boundaries,” IEEE Transactions on Neural Networks, vol. 11, no. 5, pp. 1041–1049, 2000.
  24. M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational physics, vol. 378, pp. 686–707, 2019.
  25. M. Zhang, Q. Xu, and X. Wang, “Physics-informed neural network based online impedance identification of voltage source converters,” IEEE Transactions on Industrial Electronics, vol. 70, no. 4, pp. 3717–3728, 2023.
  26. S. Cuomo, V. S. Di Cola, F. Giampaolo, G. Rozza, M. Raissi, and F. Piccialli, “Scientific machine learning through physics-informed neural networks: Where we are and what’s next,” arXiv preprint arXiv:2201.05624, 2022.
  27. N. Zobeiry and K. D. Humfeld, “A physics-informed machine learning approach for solving heat transfer equation in advanced manufacturing and engineering applications,” Engineering Applications of Artificial Intelligence, vol. 101, p. 104232, 2021.
  28. W. Chen, Q. Wang, J. S. Hesthaven, and C. Zhang, “Physics-informed machine learning for reduced-order modeling of nonlinear problems,” Journal of computational physics, vol. 446, p. 110666, 2021.
  29. M. Yang and J. T. Foster, “Multi-output physics-informed neural networks for forward and inverse pde problems with uncertainties,” Computer Methods in Applied Mechanics and Engineering, p. 115041, 2022.
  30. H. Gao, M. J. Zahr, and J.-X. Wang, “Physics-informed graph neural galerkin networks: A unified framework for solving pde-governed forward and inverse problems,” Computer Methods in Applied Mechanics and Engineering, vol. 390, p. 114502, 2022.
  31. S. Stenen Blakseth, A. Rasheed, T. Kvamsdal, and O. San, “Combining physics-based and data-driven techniques for reliable hybrid analysis and modeling using the corrective source term approach,” arXiv e-prints, pp. arXiv–2206, 2022.
  32. A. G. Baydin, B. A. Pearlmutter, A. A. Radul, and J. M. Siskind, “Automatic differentiation in machine learning: a survey,” Journal of Marchine Learning Research, vol. 18, pp. 1–43, 2018.
  33. Z. Fang, “A high-efficient hybrid physics-informed neural networks based on convolutional neural network,” IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 10, pp. 5514–5526, 2021.
  34. C. Zhu, R. H. Byrd, P. Lu, and J. Nocedal, “Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization,” ACM Transactions on mathematical software (TOMS), vol. 23, no. 4, pp. 550–560, 1997.
  35. V. Bubanja, Y. Amagai, K. Okawa, and N.-H. Kaneko, “Mathematical modeling and measurement of low frequency characteristics of single-junction thermal converters,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–4, 2022.
  36. B.-C. Wang, H.-X. Li, and H.-D. Yang, “Spatial correlation-based incremental learning for spatiotemporal modeling of battery thermal process,” IEEE Transactions on Industrial Electronics, vol. 67, no. 4, pp. 2885–2893, 2020.
  37. Z. Liu, X. He, Z. Zhao, C. K. Ahn, and H.-X. Li, “Vibration control for spatial aerial refueling hoses with bounded actuators,” IEEE Transactions on Industrial Electronics, vol. 68, no. 5, pp. 4209–4217, 2021.
  38. N. Chu, Y. Ning, L. Yu, Q. Liu, Q. Huang, D. Wu, and P. Hou, “Acoustic source localization in a reverberant environment based on sound field morphological component analysis and alternating direction method of multipliers,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–13, 2021.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now