Bayesian Optimisation for Sequential Experimental Design with Applications in Additive Manufacturing (2107.12809v4)
Abstract: Bayesian optimization (BO) is an approach to globally optimizing black-box objective functions that are expensive to evaluate. BO-powered experimental design has found wide application in materials science, chemistry, experimental physics, drug development, etc. This work aims to bring attention to the benefits of applying BO in designing experiments and to provide a BO manual, covering both methodology and software, for the convenience of anyone who wants to apply or learn BO. In particular, we briefly explain the BO technique, review all the applications of BO in additive manufacturing, compare and exemplify the features of different open BO libraries, unlock new potential applications of BO to other types of data (e.g., preferential output). This article is aimed at readers with some understanding of Bayesian methods, but not necessarily with knowledge of additive manufacturing; the software performance overview and implementation instructions are instrumental for any experimental-design practitioner. Moreover, our review in the field of additive manufacturing highlights the current knowledge and technological trends of BO. This article has a supplementary material online.
- Botorch: A framework for efficient monte-carlo bayesian optimization. volume 2020-December.
- Skew gaussian processes for classification. Machine Learning, 109:1877–1902.
- Preferential Bayesian optimisation with Skew Gaussian Processes. In 2021 Genetic and Evolutionary Computation Conference Companion (GECCO ’21 Companion), July 10–14, 2021, Lille, France, New York, NY, USA. ACM.
- A unified framework for closed-form nonparametric regression, classification, preference and mixed problems with skew gaussian processes. arXiv:2008.06677.
- Optimization of surface roughness and dimensional accuracy in lpbf additive manufacturing. Optics & Laser Technology, 142:107246.
- A comparative study of infill sampling criteria for computationally expensive constrained optimization problems. Symmetry, 12(10).
- Differentiable expected hypervolume improvement for parallel multi-objective bayesian optimization. Advances in Neural Information Processing Systems, 33.
- Toward autonomous additive manufacturing: Bayesian optimization on a 3d printer. MRS Bulletin.
- Bayesian optimization of nanoporous materials. Cambridge: Cambridge Open Engage.
- Engineering Design via Surrogate Modelling: A Practical Guide. John Wiley & Sons.
- Frazier, P. I. (2018). A tutorial on bayesian optimization. arXiv:1807.02811.
- Frazier, W. (2014). Metal additive manufacturing: A review. Journal of Materials Engineering and Performance, 23(6):1917–1928.
- A bayesian experimental autonomous researcher for mechanical design. Science Advances, 6(15).
- Preferential bayesian optimization. In Proceedings of the 34th International Conference on Machine Learning-Volume 70, pages 1282–1291. JMLR. org.
- Bayesian optimization for adaptive experimental design: A review. IEEE Access, 8:13937–13948.
- Bayesian Optimization of Energy-Absorbing Lattice Structures for Additive Manufacturing. volume 6 of ASME International Mechanical Engineering Congress and Exposition.
- Hunt, N. (2020). Batch bayesian optimization. Master thesis, Massachusetts Institute of Technology.
- Efficient global optimization of expensive black-box functions. Journal of Global optimization, 13(4):455–492.
- Tuning hyperparameters without grad students: Scalable and robust bayesian optimisation with dragonfly. Journal of Machine Learning Research, 21.
- Advances in bayesian optimization with applications in aerospace engineering. Number 209969 in AIAA Non-Deterministic Approaches Conference, 2018.
- Detecting surface roughness on sls parts with various measuring techniques. Polymer Testing, 53:217–226.
- Openbox: A generalized black-box optimization service. arXiv:2106.00421.
- Luna, J. J. (2017). Bayesian optimization in machine learning. Master thesis, The Polytechnic University of Catalonia.
- A prediction model for finding the optimal laser parameters in additive manufacturing of niti shape memory alloy. International Journal of Advanced Manufacturing Technology, 105(11):4691–4699.
- Investigation of melt pool geometry control in additive manufacturing using hybrid modeling. Metals, 10(5).
- Engineering Design:A Systematic Approach. Springer-Verlag London.
- Optimization of 3d printing parameters for BaTiO3 piezoelectric ceramics through design of experiments. Materials Research Express, 6(8):085706.
- Taking the human out of the loop: A review of bayesian optimization. Proceedings of the IEEE, 104(1):148–175.
- Design of Mechanical Metamaterials via Constrained Bayesian Optimization. volume 2A of International Design Engineering Technical Conferences and Computers and Information in Engineering Conference.
- Optimization of binder jetting using taguchi method. JOM, 69(3):491–497.
- Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020. arXiv:2104.10201.
- New bayesian-optimization-based design of high-strength 7xxx-series alloys from recycled aluminum. JOM, 70(11):2704–2709.
- Constrained, global optimization of functions with lipschitz continuous gradients. arXiv:2011.08997.
- Continuous-fidelity bayesian optimization with knowledge gradient. NIPS Workshop on Bayesian Optimization.
- Data-Driven Design Space Exploration and Exploitation for Design for Additive Manufacturing. Journal of Mechanical Design, 141(10).
- Machine learning generative models for automatic design of multi-material 3d printed composite solids. Extreme Mechanics Letters, 41:100992.
- Additive manufacturing of fatigue resistant materials: Challenges and opportunities. International Journal of Fatigue, 98:14–31.
- Mimi Zhang (6 papers)
- Andrew Parnell (30 papers)
- Dermot Brabazon (2 papers)
- Alessio Benavoli (36 papers)