Uncertainty-aware multi-fidelity surrogate modeling with noisy data (2401.06447v2)
Abstract: Emulating high-accuracy computationally expensive models is crucial for tasks requiring numerous model evaluations, such as uncertainty quantification and optimization. When lower-fidelity models are available, they can be used to improve the predictions of high-fidelity models. Multi-fidelity surrogate models combine information from sources of varying fidelities to construct an efficient surrogate model. However, in real-world applications, uncertainty is present in both high- and low-fidelity models due to measurement or numerical noise, as well as lack of knowledge due to the limited experimental design budget. This paper introduces a comprehensive framework for multi-fidelity surrogate modeling that handles noise-contaminated data and is able to estimate the underlying noise-free high-fidelity model. Our methodology quantitatively incorporates the different types of uncertainty affecting the problem and emphasizes on delivering precise estimates of the uncertainty in its predictions both with respect to the underlying high-fidelity model and unseen noise-contaminated high-fidelity observations, presented through confidence and prediction intervals, respectively. Additionally, the proposed framework offers a natural approach to combining physical experiments and computational models by treating noisy experimental data as high-fidelity sources and white-box computational models as their low-fidelity counterparts. The effectiveness of our methodology is showcased through synthetic examples and a wind turbine application.
- A global sensitivity analysis framework for hybrid simulation. Mechanical Systems and Signal Processing 146, 106997.
- Parametric hierarchical Kriging for multi-fidelity aero-servo-elastic simulators – Application to extreme loads on wind turbines. Probabilistic Engineering Mechanics 55, 67–77.
- Berchier, M. (2016). Multi-fidelity surrogate modelling with polynomial chaos expansions. Master’s thesis, ETH Zürich.
- Sparse polynomial chaos expansions and adaptive stochastic finite elements using a regression approach. Comptes Rendus Mécanique 336(6), 518–523.
- Adaptive sparse polynomial chaos expansion based on Least Angle Regression. Journal of Computational Physics 230(6), 2345–2367.
- Bossanyi, E. A. (2003). GH Bladed theory manual. Technical Report 282/BR/009, Garrad Hassan & Partners Ltd.
- Overview of Gaussian process based multi-fidelity techniques with variable relationship between fidelities, application to aerospace systems. Aerospace Science and Technology 107, 106339.
- Bootstrap confidence intervals: when, which, what? a practical guide for medical statisticians. Statistics in Medicine 19(9), 1141–1164.
- A least-squares method for sparse low rank approximation of multivariate functions. SIAM/ASA Journal on Uncertainty Quantification 3(1), 897–921.
- Deep Gaussian processes for multi-fidelity modeling. In 32nd Neural Information Processing Systems Conference, Montreal, Canada.
- Davison, A. C. and D. V. Hinkley (1997). Bootstrap Methods and their Application. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press.
- Support vector regression machines. In M. Mozer, M. Jordan, and T. Petsche (Eds.), Advances in Neural Information Processing Systems, Volume 9. MIT Press.
- Construction of bootstrap confidence intervals on sensitivity indices computed by polynomial chaos expansion. Reliability Engineering & System Safety 121, 263–275.
- Efron, B. and R. J. Tibshirani (1994). An introduction to the bootstrap. CRC press.
- Fernández-Godino, M. G. (2023). Review of multi-fidelity models. Advances in Computational Science and Engineering 1(4), 0–50.
- Assessing the performance of an adaptive multi-fidelity Gaussian process with noisy training data: A statistical analysis. In AIAA AVIATION 2021 FORUM. American Institute of Aeronautics and Astronautics.
- Multi-fidelity optimization via surrogate modelling. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 463(2088), 3251–3269.
- Freedman, D. A. (1981). Bootstrapping regression models. The Annals of Statistics 9(6), 1218–1228.
- Stochastic finite elements: A spectral approach (2nd ed.). Courier Dover Publications, Mineola.
- Combining field data and computer simulations for calibration and prediction. SIAM Journal on Scientific Computing 26(2), 448–466.
- FAST user’s guide. Technical Report NREL/EL-500-38230, National Renewable Energy Laboratory Golden, CO, USA.
- Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1), 1–13.
- Bayesian calibration of computer models. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 63(3), 425–464.
- A Bayesian neural network approach to multi-fidelity surrogate modeling. International Journal for Uncertainty Quantification 14(1), 43–60.
- Applied linear statistical models (5th ed.). New York: McGraw-Hill.
- Multifidelity surrogate modeling of experimental and computational aerodynamic data sets. AIAA Journal 49(2), 289–298.
- Recursive co-Kriging model for design of computer experiments with multiple levels of fidelity. International Journal for Uncertainty Quantification 4(5), 365–386.
- Ljung, L. (1998). System identification. In A. Procházka, J. Uhlíř, P. W. J. Rayner, and N. G. Kingsbury (Eds.), Signal Analysis and Prediction, pp. 163–173. Boston, MA: Birkhäuser Boston.
- Sparse polynomial chaos expansions: Literature survey and benchmark. SIAM/ASA Journal on Uncertainty Quantification 9(2), 593–649.
- Automatic selection of basis-adaptive sparse polynomial chaos expansions for engineering applications. International Journal for Uncertainty Quantification 12(3), 49–74.
- UQLab user manual – Polynomial chaos expansions. Technical report, Chair of Risk, Safety and Uncertainty Quantification, ETH Zurich, Switzerland. Report UQLab-V2.0-104.
- UQLab: A framework for uncertainty quantification in Matlab. In Vulnerability, Uncertainty, and Risk. American Society of Civil Engineers.
- An active-learning algorithm that combines sparse polynomial chaos expansions and bootstrap for structural reliability analysis. Structural Safety 75, 67–74.
- A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 2, 239–245.
- Multi-fidelity Bayesian neural networks: Algorithms and applications. Journal of Computational Physics 438, 110361.
- Ng, L. W.-T. and M. S. Eldred (2012). Multifidelity uncertainty quantification using non-intrusive polynomial chaos and stochastic collocation. In 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Honolulu, Hawaii, pp. 1852.
- Multi-fidelity non-intrusive polynomial chaos based on regression. Computer Methods in Applied Mechanics and Engineering 305, 579–606.
- Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 473(2198), 20160751.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics 378, 686–707.
- Inferring solutions of differential equations using noisy multi-fidelity data. Journal of Computational Physics 335, 736–746.
- Gaussian processes for machine learning (Internet ed.). Adaptive computation and machine learning. Cambridge, Massachusetts: MIT Press.
- On a grey box modelling framework for nonlinear system identification. In Special Topics in Structural Dynamics, Volume 6, pp. 167–178. Springer International Publishing.
- Advanced implementation of hybrid simulation. Technical report, University of California, Berkeley, Berkeley, CA.
- Schwartz, G. (1978). Estimating the dimension of a model. Annals of Statistics 6(2), 461–464.
- Data-driven polynomial chaos expansion for machine learning regression. Journal of Computational Physics 388, 601–623.
- Tulleken, H. J. A. F. (1993). Grey-box modelling and identification using physical knowledge and Bayesian techniques. Automatica 29(2), 285–308.
- Optimal prediction intervals of wind power generation. IEEE Transactions on Power Systems 29(3), 1166–1174.
- Xiu, D. and G. E. Karniadakis (2002). The Wiener-Askey polynomial chaos for stochastic differential equations. SIAM Journal on Scientific Computing 24(2), 619–644.
- A framework based on physics-informed neural networks and extreme learning for the analysis of composite structures. Computers & Structures 265, 106761.
- SCGAN: stacking-based generative adversarial networks for multi-fidelity surrogate modeling. Structural and Multidisciplinary Optimization 65(6), 1–16.
- Multifidelity surrogate based on single linear regression. AIAA Journal 56(12), 4944–4952.