Physics-Aware Multifidelity Bayesian Optimization: a Generalized Formulation (2312.05831v2)
Abstract: The adoption of high-fidelity models for many-query optimization problems is majorly limited by the significant computational cost required for their evaluation at every query. Multifidelity Bayesian methods (MFBO) allow to include costly high-fidelity responses for a sub-selection of queries only, and use fast lower-fidelity models to accelerate the optimization process. State-of-the-art methods rely on a purely data-driven search and do not include explicit information about the physical context. This paper acknowledges that prior knowledge about the physical domains of engineering problems can be leveraged to accelerate these data-driven searches, and proposes a generalized formulation for MFBO to embed a form of domain awareness during the optimization procedure. In particular, we formalize a bias as a multifidelity acquisition function that captures the physical structure of the domain. This permits to partially alleviate the data-driven search from learning the domain properties on-the-fly, and sensitively enhances the management of multiple sources of information. The method allows to efficiently include high-fidelity simulations to guide the optimization search while containing the overall computational expense. Our physics-aware multifidelity Bayesian optimization is presented and illustrated for two classes of optimization problems frequently met in science and engineering, namely design optimization and health monitoring problems.
- Engineering design optimization. Cambridge University Press, 2021.
- Multi-fidelity optimization via surrogate modelling. Proceedings of the royal society a: mathematical, physical and engineering sciences, 463(2088):3251–3269, 2007.
- Remarks on multi-fidelity surrogates. Structural and Multidisciplinary Optimization, 55:1029–1050, 2017.
- Survey of multifidelity methods in uncertainty propagation, inference, and optimization. Siam Review, 60(3):550–591, 2018.
- Comparison of multi-fidelity approaches for military vehicle design. In AIAA AVIATION 2020 FORUM, page 3158, 2020.
- Multi-fidelity gradient-based optimization for high-dimensional aeroelastic configurations. Algorithms, 15(4):131, 2022.
- A multifidelity approach coupling parameter space reduction and nonintrusive pod with application to structural optimization of passenger ship hulls. International Journal for Numerical Methods in Engineering, 124(5):1193–1210, 2023.
- Multidisciplinary design optimization for hybrid electric vehicles: component sizing and multi-fidelity frontal crashworthiness. Structural and Multidisciplinary Optimization, 62:2149–2166, 2020.
- Building a lightweight digital twin of a crane boom for structural safety monitoring based on a multifidelity surrogate model. Journal of Mechanical Design, 144(6):064502, 2022.
- A machine learning framework for physics-based multi-fidelity modeling and health monitoring for a composite wing. In ASME International Mechanical Engineering Congress and Exposition, volume 86625, page V001T01A008. American Society of Mechanical Engineers, 2022.
- Special section on multidisciplinary design optimization: metamodeling in multidisciplinary design optimization: how far have we really come? AIAA journal, 52(4):670–690, 2014.
- Analysis of dataset selection for multi-fidelity surrogates for a turbine problem. Structural and Multidisciplinary Optimization, 57:2127–2142, 2018.
- A general framework for multi-fidelity bayesian optimization with gaussian processes. In The 22nd International Conference on Artificial Intelligence and Statistics, pages 3158–3167. PMLR, 2019.
- Jonas Močkus. On bayesian methods for seeking the extremum. In Optimization Techniques IFIP Technical Conference: Novosibirsk, July 1–7, 1974, pages 400–404. Springer, 1975.
- Practical bayesian optimization of machine learning algorithms. Advances in neural information processing systems, 25, 2012.
- Peter I Frazier. Bayesian optimization. In Recent advances in optimization and modeling of contemporary problems, pages 255–278. Informs, 2018.
- Multi-fidelity efficient global optimization: Methodology and application to airfoil shape design. In AIAA aviation 2019 forum, page 3236, 2019.
- Multi-fidelity machine-learning with uncertainty quantification and bayesian optimization for materials design: Application to ternary random alloys. The Journal of Chemical Physics, 153(7):074705, 2020.
- Adaptive multi-fidelity sampling for cfd-based optimisation via radial basis function metamodels. International Journal of Computational Fluid Dynamics, 33(6-7):237–255, 2019.
- Model inversion via multi-fidelity bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond. Journal of The Royal Society Interface, 13(118):20151107, 2016.
- Multifidelity domain-aware learning for the design of re-entry vehicles. Structural and Multidisciplinary Optimization, 64(5):3017–3035, 2021.
- Nm-mf: Non-myopic multifidelity framework for constrained multi-regime aerodynamic optimization. AIAA Journal, 61(3):1270–1280, 2023.
- Gaussian processes for regression. Advances in neural information processing systems, 8, 1995.
- A tutorial on gaussian process regression: Modelling, exploring, and exploiting functions. Journal of Mathematical Psychology, 85:1–16, 2018.
- Predicting the output from a complex computer code when fast approximations are available. Biometrika, 87(1):1–13, 2000.
- Efficient global optimization of expensive black-box functions. Journal of Global optimization, 13(4):455, 1998.
- Harold J Kushner. A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise. Journal of Basic Engineering, 86(1):97–106, 1964.
- Entropy search for information-efficient global optimization. Journal of Machine Learning Research, 13(6), 2012.
- Sequential kriging optimization using multiple-fidelity evaluations. Structural and Multidisciplinary Optimization, 32(5):369–382, 2006.
- Variable-fidelity probability of improvement method for efficient global optimization of expensive black-box problems. Structural and Multidisciplinary Optimization, 62(6):3021–3052, 2020.
- Information-based multi-fidelity bayesian optimization. In NIPS Workshop on Bayesian Optimization, 2017.
- Multi-fidelity bayesian optimization with max-value entropy search and its parallelization. In International Conference on Machine Learning, pages 9334–9345. PMLR, 2020.
- Engineering design via surrogate modelling: a practical guide. John Wiley & Sons, 2008.
- Mark Drela. Pros and cons of airfoil optimization. Frontiers of computational fluid dynamics, 1998:363–381, 1998.
- Robust airfoil optimization to achieve drag reduction over a range of mach numbers. Structural and Multidisciplinary Optimization, 24(1):38–50, 2002.
- Engineering fluid mechanics. John Wiley & Sons, 2020.
- A brief introduction to fluid mechanics. John Wiley & Sons, 2010.
- An open-source aerodynamic framework for benchmarking multi-fidelity methods. In AIAA AVIATION 2020 FORUM, page 3179, 2020.
- Su2: An open-source suite for multiphysics simulation and design. Aiaa Journal, 54(3):828–846, 2016.
- Gmsh: A 3-d finite element mesh generator with built-in pre-and post-processing facilities. International journal for numerical methods in engineering, 79(11):1309–1331, 2009.
- Felipe AC Viana. A tutorial on latin hypercube design of experiments. Quality and reliability engineering international, 32(5):1975–1985, 2016.
- Victor Giurgiutiu. Structural health monitoring of aerospace composites. pages 449–507, 2015.
- Hexcel Corporation. Hexply® 8552 product datasheet. 2016.
- R.D. Mindlin. Influence of rotatory inertia and shear on flexural motions of isotropic, elastic plates. Journal of Applied Mechanics, 18(1):31–38, 1951.
- Real-time fault detection and prognostics for aircraft actuation systems. In AIAA Scitech 2019 Forum, page 2210, 2019.
- Francesco Di Fiore (3 papers)
- Laura Mainini (5 papers)