Physics-informed State-space Neural Networks for Transport Phenomena (2309.12211v2)
Abstract: This work introduces Physics-informed State-space neural network Models (PSMs), a novel solution to achieving real-time optimization, flexibility, and fault tolerance in autonomous systems, particularly in transport-dominated systems such as chemical, biomedical, and power plants. Traditional data-driven methods fall short due to a lack of physical constraints like mass conservation; PSMs address this issue by training deep neural networks with sensor data and physics-informing using components' Partial Differential Equations (PDEs), resulting in a physics-constrained, end-to-end differentiable forward dynamics model. Through two in silico experiments -- a heated channel and a cooling system loop -- we demonstrate that PSMs offer a more accurate approach than a purely data-driven model. In the former experiment, PSMs demonstrated significantly lower average root-mean-square errors across test datasets compared to a purely data-driven neural network, with reductions of 44 %, 48 %, and 94 % in predicting pressure, velocity, and temperature, respectively. Beyond accuracy, PSMs demonstrate a compelling multitask capability, making them highly versatile. In this work, we showcase two: supervisory control of a nonlinear system through a sequentially updated state-space representation and the proposal of a diagnostic algorithm using residuals from each of the PDEs. The former demonstrates PSMs' ability to handle constant and time-dependent constraints, while the latter illustrates their value in system diagnostics and fault detection. We further posit that PSMs could serve as a foundation for Digital Twins, constantly updated digital representations of physical systems.
- The autonomous industrial plant–future of process engineering, operations and maintenance. Journal of Process Control, 88:101–110, 2020.
- Laurence A Belfiore. Transport phenomena for chemical reactor design. John Wiley & Sons, 2003.
- Ronald L Fournier. Basic transport phenomena in biomedical engineering. CRC press, 2011.
- Transport Phenomena, volume 1. John Wiley & Sons, 2006.
- Nuclear systems volume I: Thermal hydraulic fundamentals. CRC press, 2021.
- Claudio Mattiussi. An analysis of finite volume, finite element, and finite difference methods using some concepts from algebraic topology. Journal of Computational Physics, 133(2):289–309, 1997.
- J Richalet. Industrial applications of model based predictive control. Automatica, 29(5):1251–1274, 1993.
- From model-based control to data-driven control: Survey, classification and perspective. Information Sciences, 235:3–35, 2013.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
- Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next. Journal of Scientific Computing, 92(3):88, July 2022. ISSN 1573-7691. doi:10.1007/s10915-022-01939-z.
- State–space modeling for control based on physics-informed neural networks. Engineering Applications of Artificial Intelligence, 101:104195, 2021.
- Rui Hu. An advanced one-dimensional finite element model for incompressible thermally expandable flow. Nuclear Technology, 190(3):313–322, 2015.
- Rui Hu. SAM Theory Manual. Technical report, Argonne National Laboratory (ANL), Argonne, IL (United States), March 2017. URL http://www.osti.gov/servlets/purl/1353375/.
- Raúl Rojas. The backpropagation algorithm. Neural networks: a systematic introduction, pages 149–182, 1996.
- Sensor selection via convex optimization. IEEE Transactions on Signal Processing, 57(2):451–462, 2008.
- Real-world data-driven machine-learning-based optimal sensor selection approach for equipment fault detection in a thermal power plant. Mathematics, 9(21):2814, 2021.
- Physics informed deep learning (part i): Data-driven solutions of nonlinear partial differential equations. arXiv preprint arXiv:1711.10561, 2017.
- Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
- A comprehensive survey of loss functions in machine learning. Annals of Data Science, pages 1–26, 2020.
- Efficient backprop. In Neural networks: Tricks of the trade, pages 9–50. Springer, 2002.
- Thomas E Rehm. Advanced nuclear energy: the safest and most renewable clean energy. Current Opinion in Chemical Engineering, 39:100878, 2023.
- Fluoride salt coolant properties for nuclear reactor applications: A review. Annals of Nuclear Energy, 109:635–647, 2017.
- Reference and command governors for systems with constraints. Automatica, 75:306–328, 2017. ISSN 00051098. doi:10.1016/j.automatica.2016.08.013.
- CVXPY: A Python-embedded modeling language for convex optimization. Journal of Machine Learning Research, 17(83):1–5, 2016.
- Janos Gertler. Fault detection and diagnosis in engineering systems. CRC press, 2017.
- Rolf Isermann. Model-based fault-detection and diagnosis–status and applications. Annual Reviews in control, 29(1):71–85, 2005.
- A physics-based parametric regression approach for feedwater pump system diagnosis. Annals of Nuclear Energy, 166, 2022. doi:10.1016/J.ANUCENE.2021.108692.
- Characterising the digital twin: A systematic literature review. CIRP Journal of Manufacturing Science and Technology, 29:36–52, 2020.