Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Robust Entropy Search for Safe Efficient Bayesian Optimization (2405.19059v2)

Published 29 May 2024 in cs.LG and stat.ML

Abstract: The practical use of Bayesian Optimization (BO) in engineering applications imposes special requirements: high sampling efficiency on the one hand and finding a robust solution on the other hand. We address the case of adversarial robustness, where all parameters are controllable during the optimization process, but a subset of them is uncontrollable or even adversely perturbed at the time of application. To this end, we develop an efficient information-based acquisition function that we call Robust Entropy Search (RES). We empirically demonstrate its benefits in experiments on synthetic and real-life data. The results showthat RES reliably finds robust optima, outperforming state-of-the-art algorithms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Asymmetric Correlations of Equity Portfolios. Journal of Financial Economics, 63(3):443–494, 2002.
  2. Max-value entropy search for multi-objective bayesian optimization. In Advances in Neural Information Processing Systems, volume 32, 2019.
  3. Bayesian optimization under uncertainty. In NIPS BayesOpt 2017 Workshop, 2017.
  4. Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Robotics. Machine Learning, 112(10):3713–3747, 2023.
  5. Nonconvex robust optimization for problems with constraints. INFORMS J. Comput., 22:44–58, 2010.
  6. Adversarially robust optimization with gaussian processes. In Advances in Neural Information Processing Systems, volume 31, 2018.
  7. Robust expected improvement for Bayesian optimization. IISE Transactions, pages 1–22, 2023.
  8. Multi-fidelity optimization via surrogate modelling. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 463:3251 – 3269, 2007.
  9. A knowledge-gradient policy for sequential information collection. SIAM Journal on Control and Optimization, 47(5):2410–2439, 2008.
  10. Noisy-input entropy search for efficient robust bayesian optimization. In Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, volume 108 of Proceedings of Machine Learning Research, pages 2262–2272, 2020.
  11. Bayesian optimization with inequality constraints. In Proceedings of the 31st International Conference on Machine Learning, volume 32 of Proceedings of Machine Learning Research, pages 937–945. PMLR, 2014.
  12. Discovering and Exploiting Additive Structure for Bayesian Optimization. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, volume 54 of Proceedings of Machine Learning Research, pages 1311–1319, 2017.
  13. Smoothing and worst-case complexity for direct-search methods in nonsmooth optimization. IMA Journal of Numerical Analysis, 33(3):1008–1028, 2013.
  14. Roman Garnett. Bayesian optimization. Cambridge University Press, 2023.
  15. Bayesian optimization with unknown constraints. In Proceedings of the 30th Conference on Uncertainty in Artificial Intelligence (UAI), 2014.
  16. Alan Genz. Numerical computation of multivariate normal probabilities. Journal of Computational and Graphical Statistics, 1(2):141–149, 1992.
  17. Integrals over gaussians under linear domain constraints. In Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, volume 108 of Proceedings of Machine Learning Research, pages 2764–2774, 2020.
  18. GPy. GPy: A gaussian process framework in python. http://github.com/SheffieldML/GPy, since 2012.
  19. Entropy search for information-efficient global optimization. Journal of Machine Learning Research, 13:1809–1837, 2012.
  20. Ralf Herbrich. On gaussian expectation propagation. Technical report, Microsoft Research Cambridge, 2005.
  21. Predictive entropy search for efficient global optimization of black-box functions. In Advances in Neural Information Processing Systems, volume 27, 2014.
  22. Output-space predictive entropy search for flexible global optimization. In NIPS workshop on Bayesian Optimization, pages 1–5, 2015.
  23. Distributionally Robust Bayesian Optimization with ϕitalic-ϕ\phiitalic_ϕ-divergences. In Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems, NeurIPS Workshop, 2022.
  24. Joint entropy search for maximally-informed bayesian optimization. In Advances in Neural Information Processing Systems, volume 35, pages 11494–11506, 2022.
  25. Baran Ivo. CC BY 3.0, https://creativecommons.org/licenses/by/3.0, via Wikimedia Commons, adapted to include labels, 2007.
  26. Mean-variance analysis in bayesian optimization under uncertainty. In Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, volume 130 of Proceedings of Machine Learning Research, pages 973–981, 2021.
  27. Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13(4):455–492, 1998.
  28. Distributionally robust bayesian optimization. In The 23rd International Conference on Artificial Intelligence and Statistics, volume 108 of Proceedings of Machine Learning Research, pages 2174–2184, 2020.
  29. Advances in bayesian optimization with applications in aerospace engineering. In 2018 AIAA Non-Deterministic Approaches Conference, 2018.
  30. Sparse spectrum gaussian process regression. Journal of Machine Learning Research, 11:1865–1881, 2010.
  31. Automating bayesian optimization with bayesian optimization. In Advances in Neural Information Processing Systems, volume 31, 2018.
  32. Thomas P. Minka. Expectation propagation for approximate bayesian inference. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, page 362–369, 2001.
  33. Generalizing bayesian optimization with decision-theoretic entropies. In Advances in Neural Information Processing Systems, volume 35, pages 21016–21029, 2022.
  34. Unscented bayesian optimization for safe robot grasping. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 1967–1972, 2016.
  35. Bayesian optimisation under uncertain inputs. In The 22nd International Conference on Artificial Intelligence and Statistics, volume 89 of Proceedings of Machine Learning Research, pages 1177–1184, 2019.
  36. Emukit: A Python toolkit for decision making under uncertainty. Proceedings of the Python in Science Conference, 2023.
  37. Spectral representation of robustness measures for optimization under input uncertainty. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 18096–18121, 2022.
  38. Random features for large-scale kernel machines. In Advances in Neural Information Processing Systems, volume 20, 2007.
  39. Carl Edward Rasmussen and Christopher K. I. Williams. Gaussian processes for machine learning. MIT Press, 2006.
  40. Sidney Rosenbaum. Moments of a truncated bivariate normal distribution. Journal of the Royal Statistical Society. Series B (Methodological), 23(2):405–408, 1961.
  41. Taking the human out of the loop: A review of bayesian optimization. Proceedings of the IEEE, 104(1):148–175, 2016.
  42. Bayesian reaction optimization as a tool for chemical synthesis. Nature, 590(7844):89–96, 2021.
  43. Gaussian process optimization in the bandit setting: No regret and experimental design. In Proceedings of the 27th International Conference on Machine Learning, page 1015–1022, 2010.
  44. Virtual library of simulation experiments: Test functions and datasets. optimization test problems., 2013. URL https://www.sfu.ca/~ssurjano/optimization.html. Online; accessed 02-January-2023.
  45. Multi-task bayesian optimization. In Advances in Neural Information Processing Systems, volume 26, 2013.
  46. Sequential and parallel constrained max-value entropy search via information lower bound. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 20960–20986. PMLR, 2022.
  47. Efficient distributionally robust Bayesian optimization with worst-case sensitivity. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 21180–21204, 2022.
  48. Stratified bayesian optimization. In Monte Carlo and Quasi-Monte Carlo Methods, pages 145–166. Springer International Publishing, 2018.
  49. Bayesian Optimization With Expensive Integrands. SIAM Journal on Optimization, 32(2):417–444, 2022.
  50. Zi Wang and Stefanie Jegelka. Max-value entropy search for efficient bayesian optimization. In Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 3627–3635, 2017.
  51. Bayesian optimization for min max optimization. In Workshop on Real World Experiment Design and Active Learning at ICML 2020, 2020.
  52. Efficient Robust Bayesian Optimization for Arbitrary Uncertain inputs. In Advances in Neural Information Processing Systems, 2023.
  53. Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. ACM Transactions on Mathematical Software, 23(4):550–560, 1997.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets