Scaling up machine learning-based chemical plant simulation: A method for fine-tuning a model to induce stable fixed points (2307.13621v2)
Abstract: Idealized first-principles models of chemical plants can be inaccurate. An alternative is to fit a Machine Learning (ML) model directly to plant sensor data. We use a structured approach: Each unit within the plant gets represented by one ML model. After fitting the models to the data, the models are connected into a flowsheet-like directed graph. We find that for smaller plants, this approach works well, but for larger plants, the complex dynamics arising from large and nested cycles in the flowsheet lead to instabilities in the solver during model initialization. We show that a high accuracy of the single-unit models is not enough: The gradient can point in unexpected directions, which prevents the solver from converging to the correct stationary state. To address this problem, we present a way to fine-tune ML models such that initialization, even with very simple solvers, becomes robust.
- Deep equilibrium models. Advances in Neural Information Processing Systems 32.
- Sur les opérations dans les ensembles abstraits et leur application aux équations intégrales. Fundamenta mathematicae 3, 133–181.
- Combining machine learning and process engineering physics towards enhanced accuracy and explainability of data-driven models. Computers & Chemical Engineering 138, 106834.
- Forecasting industrial aging processes with machine learning methods. Computers & Chemical Engineering 144, 107123.
- Deterministic global flowsheet optimization: Between equation-oriented and sequential-modular methods. AIChE Journal 65, 1022–1034.
- Machine learning-based surrogate models and transfer learning for derivative free optimization of ht-pem fuel cells. Computers & Chemical Engineering 171, 108159.
- A modular approach for surrogate modeling of flowsheets. Chemie Ingenieur Technik 93, 1987–1997.
- Global flowsheet optimization for reductive dimethoxymethane production using data-driven thermodynamic models. Computers & Chemical Engineering 162, 107806.
- Global optimization of modular process flowsheets. Industrial & engineering chemistry research 39, 4296–4301.
- An algorithm for the use of surrogate models in modular flowsheet optimization. AIChE journal 54, 2633–2650.
- On the choice of initial guesses for the newton-raphson algorithm. Applied Mathematics and Computation 398, 125991.
- Neural ordinary differential equations. Advances in neural information processing systems 31.
- Convergence promotion in the simulation of chemical processes—the general dominant eigenvalue method. AIChE Journal 21, 528–533.
- Practical methods of optimization. John Wiley & Sons.
- Data-driven and safety-aware holistic production planning. Journal of Loss Prevention in the Process Industries 77, 104754.
- Optimized data exploration applied to the simulation of a chemical process. Computers & Chemical Engineering 124, 326–342.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 .
- Machine learning: Overview of the recent progresses and implications for the process systems engineering field. Computers & Chemical Engineering 114, 111–121.
- Using machine learning models to explore the solution space of large nonlinear systems underlying flowsheet simulations with constraints. Frontiers of Chemical Science and Engineering 16, 183–197.
- Design and control of the cumene process. Industrial & engineering chemistry research 49, 719–734.
- Convergence promotion in the simulation of chemical processes with recycle-the dominant eigenvalue method. The Canadian Journal of Chemical Engineering 49, 509–513.
- Metamodeling approach to optimization of steady-state flowsheet simulations: Model generation. Chemical Engineering Research and Design 80, 760–772.
- Optimization and validation of steady-state flowsheet simulation metamodels. Chemical Engineering Research and Design 80, 773–782.
- Topics in computer-aided design: Part i. an optimum tearing algorithm for recycle systems. AIChE Journal 19, 1170–1181.
- Algorithmic differentiation for automated modeling of machine learned force fields. The Journal of Physical Chemistry Letters 13, 10183–10189.
- Optimization with trained machine learning models embedded, in: Encyclopedia of Optimization. Springer, pp. 1–8.
- Equation oriented approach to process flowsheeting. Computers & Chemical Engineering 6, 79–95.
- A machine learning approach for modeling and optimization of a co2 post-combustion capture unit. Energy 215, 119113.
- Chemical process: design and integration. John Wiley & Sons.
- Kernels, pre-images and optimization. Empirical Inference: Festschrift in Honor of Vladimir N. Vapnik , 245–259.
- Accelerating convergence of iterative processes. Communications of the ACM 1, 9–13.
- Gray-box surrogate models for flash, distillation and compression units of chemical processes. Computers & Chemical Engineering 155, 107510.