---
title: Acquisition Functions in Bayesian Optimization
url: https://www.emergentmind.com/topics/acquisition-functions
type: topic
---

# Acquisition Functions in Bayesian Optimization

Acquisition functions are central elements in Bayesian optimization (BO), active learning, and Bayesian quadrature: they prescribe where to query next by formalizing the trade-off between exploration (sampling where the surrogate model is uncertain) and exploitation (refining regions known to be promising). Mathematically, an acquisition function is any mapping that assigns to each candidate $x$ (given current data) a real score, typically derived from the posterior mean and variance of a probabilistic surrogate (e.g., Gaussian process). Their correct design, efficient optimization, adaptation to task structure, and even meta-learning or programmatic synthesis remain active research frontiers. Recent years have seen the emergence of dynamic ensembles, meta-learned neural acquisitions, information-theoretic criteria, high-dimensional variants, and advanced strategies for acquisition maximization. This article provides a comprehensive, rigorously sourced overview.

## 1. Classical Acquisition Functions: Definitions and Taxonomy

Canonical acquisition functions for Gaussian process–based BO are parametrized by the posterior mean $\mu(x)$ and variance $\sigma^2(x)$ computed on a dataset $D_t = \{(x_i, y_i)\}_{i=1}^t$. The most widely used forms include:

- **Upper Confidence Bound (UCB)**:
  \[
  a_{\text{UCB}}(x) = \mu(x) + \kappa \sigma(x)
  \]
  where $\kappa > 0$ controls the exploration–exploitation trade-off [2111.00639].

- **Probability of Improvement (PI)**:
  \[
  a_{\text{PI}}(x) = \Phi\left(\frac{\mu(x) - y^+ - \xi}{\sigma(x)}\right)
  \]
  with $y^+ = \max_i y_i$, $\xi \geq 0$ (jitter), and $\Phi$ the standard normal CDF [2111.00639].

- **Expected Improvement (EI)**:
  \[
  a_{\text{EI}}(x) = (\mu(x) - y^+ - \xi)\Phi(z) + \sigma(x)\phi(z)
  \]
  where $z = \frac{\mu(x) - y^+ - \xi}{\sigma(x)}$ and $\phi$ is the standard normal PDF [1805.10196].

- **Mutual Information (MI)**:
  \[
  a_{\text{MI}}(x) = I[y; f(x) | D] = H[y|D] - H[y|f(x), D]
  \]
  For Gaussian likelihood $\sigma_n^2$, this admits the form $\frac{1}{2}\log(1 + \sigma^2(x)/\sigma_n^2)$ [2111.00639].

- **Parametric Generalizations**: A continuous one-parameter family recovers PI and EI as special cases:
  \[
  \alpha_p(x) = \mathbb{E}[(f(x) - y_*)_+^p] = \int_{y_*}^\infty (y-y_*)^p\, \mathcal{N}(y|\mu(x),\sigma^2(x))\,dy
  \]
  with $p=0$ recovers PI, $p=1$ gives EI. For $p > 0$, closed-form expressions involve confluent hypergeometric functions [2104.12363].

- **Uncertainty-based AL (Active Learning) Acquisitions**: In classification, one uses predictive entropy (MaxEnt), mean class probability standard deviation (MeanSTD), or mutual information with weights (BALD) [2401.15721].

Further developments include information-theoretic criteria such as Max-value Entropy Search (MES) [2502.10778], and acquisition Thompson sampling (ATS) for batch queries, which induces multiple acquisition functions by sampling the surrogate’s hyperparameters [1903.09434].

## 2. Advanced Acquisition Optimization: Theory and Practice

The maximization of acquisition functions per iteration is itself a nonconvex global optimization challenge, and is critical for regret guarantees [1805.10196, 1901.08350, 2302.08298, 2410.16893]. 

**Key principles**:
- **Bayes Decision Rule**: Choosing $x^* = \arg\max_x \alpha(x)$ constitutes the myopic Bayes action.
- **Gradient-Based Maximization**: Most acquisition functions can be rewritten as expectations (or integrals) over Gaussians, facilitating reparameterization:
  \[
  y = \mu(x) + \sigma(x)\epsilon, \quad \epsilon \sim \mathcal{N}(0,1)
  \]
  This enables unbiased stochastic gradient estimation and efficient use of optimizers such as L-BFGS or Adam (especially in parallel/batch settings) [1712.00424, 1805.10196].
- **Submodularity and Greedy Selection**: For batch (q-point) selections, many acquisition functions (PI, EI, UCB) are submodular when formulated as set utilities; sequential greedy maximization delivers a $(1-1/e)$ approximation to the global joint optimum [1805.10196].
- **Local vs. Global Maximizers**: Multi-start local optimization with a moderate number of restarts ($N=10$–100) yields negligible additional regret compared to global solvers, providing strong empirical and theoretical justification for this practice [1901.08350].
- **Piecewise-Linear Kernel MIP**: Mixed-integer programming with piecewise-linear kernel surrogates enables certifiably global AF maximization and regret bounds, outperforming multi-start heuristics on multimodal landscapes at moderate scale [2410.16893].
- **Initialization in High Dimension**: Heuristic initializations (e.g., via CMA-ES, GA, or by leveraging historical data) can dramatically improve AF maximization in high-dimensions compared to random restarts. Poor initializations lead to pathological over-exploration [2302.08298].

## 3. Learning and Adapting Acquisition Functions

While traditional acquisition functions are handcrafted, a spectrum of contemporary research seeks data-driven, transferable, or adaptive design:

- **Ensembles and Meta-Adaptation**: Weighted or dynamically combined ensembles of EI, PI, LCB/UCB, with generator functions (random, cycling, meta-optimized weights), enhance robustness across tasks. Meta-optimization of AF weights as an outer-loop BO problem consistently reduces regret [2003.09643, 2206.11118].
- **Switching Schedules**: Explicitly switching between explorative (EI) and exploitative (PI or MSP) AFs, either on a preset schedule (e.g., first 25% steps EI, rest PI) or adaptively (switch on local convergence), delivers strong performance across diverse problems [2211.01455, 2502.10778].
- **Meta-Learned Neural AFs**: Training neural acquisition policies via reinforcement learning over families of tasks yields parameterized AFs (e.g., $f_\theta[\mu,\sigma,x,t,T]$) that adapt to structural regularities, outperforming fixed EI/UCB in transfer and few-shot scenarios [1904.02642, 2111.00639].
- **LLM-Guided and Programmatic Synthesis**: Recent methods employ large language models and symbolic program search to synthesize novel, interpretable AFs with empirically superior convergence (FunBO). These AFs blend and extend classical forms (EI, UCB, PI) using higher-order rational expressions, CDF shifts, PDF powers, and empirically tuned reweightings; they generalize robustly beyond their training distribution [2406.04824].

| Approach               | Adaptivity     | Relevant References    |
|------------------------|---------------|-----------------------|
| Weighted Ensemble      | Static/Dynamic| [2003.09643, 2206.11118] |
| Meta-Learned Neural AF | Task-Adaptive | [1904.02642, 2111.00639] |
| Switch Schedule        | Stage-Adaptive | [2211.01455, 2502.10778] |
| LLM/Program Search     | Task-Specific  | [2406.04824]          |

## 4. Multi-Objective, Likelihood-Free, and Domain-Specific AFs

Acquisition function innovation extends into multi-objective, likelihood-free, and domain-specific regimes:

- **Dynamic Multi-objective Ensembles**: At each BO iteration, DMEA identifies a triple of best-performing acquisition functions (from a pool of EI, PI, LCBs) based on penalties reflecting their historical success. Batch candidates are then selected by Pareto-optimal evolutionary search and layered preference scores, balancing diversity and expected utility [2206.11118].
- **Active Learning and Uncertainty**: In deep active learning (e.g., for medical imaging), uncertainty measures such as BALD (predictive information gain), maximal entropy, and mean STD are key. Empirical studies confirm BALD’s stability but reveal all such AFs can be myopic under heavy class imbalance [2401.15721].
- **Likelihood-Free AFs**: In structured domains (e.g., molecular optimization), density-ratio classifiers replace surrogate-based AFs. Tree-based partitioning with local acquisition functions and LLM/chemistry foundation model priors enables scalable, sample-efficient search over vast, structured spaces [2512.13935].

## 5. Information-Theoretic and Bayesian Quadrature Acquisitions

Beyond improvement and confidence-based AFs, information-theoretic approaches play a central role:

- **Mutual Information (MI) and Max-value Entropy Search (MES)**: GP-MI and MES directly optimize for expected information gain about the location or value of the maximum; they are especially effective when exploration of epistemic uncertainty is crucial [2111.00639, 2502.10778]. Adaptive switching between exploitation (MSP) and exploration (MES) phases yields superior performance on high-fidelity, costly problems [2502.10778].
- **Bayesian Quadrature (BQ) AFs**: In model evidence estimation, one-step or prospective AFs maximize pointwise variance (PUQ), aim to reduce posterior or evidence variance contributions (PVC, PLUR, PEUR), with closed-form or efficiently estimated objectives. Empirical benchmarks show that PEUR is generally the most sample-efficient for evidence estimation, while PLUR excels in capturing secondary modes [2510.08974].

## 6. Empirical Insights, Recommendations, and Limitations

Experimental comparisons consistently show:
- **No single acquisition function is universally optimal**. Ensemble, adaptive, or meta-learned AFs consistently outperform static baselines across benchmarks [2003.09643, 2206.11118, 2406.04824].
- **Well-tuned AFs and their maximization dominate asymptotic regret**. Poor AF maximization (e.g., random or single-start local methods in high dimensions) can erase theoretical guarantees of BO [1901.08350, 2302.08298]. 
- **Switching schemes and meta-adaptation align AF mode to problem phase** (exploration when the surrogate is rough, exploitation on local refinement) [2211.01455, 2502.10778].
- **Tree-structured local AFs and surrogate-free classifiers significantly improve scalability in combinatorial/structured domains** [2512.13935].

Open challenges include the high computational cost of meta-optimization and programmatic AF discovery, balancing the overhead of ensemble or neural AF selection, and the lack of unified theoretical regret bounds for complex, adaptive AF policies. In extremely high dimensions or with heavy-tailed priors, additional research is needed to reconcile practical speed with optimal global search.

## 7. Notable Empirical Results Across Domains

- **Meta-learned neural AFs** reduced median simple regret by 1–2 orders of magnitude relative to standard EI/UCB on function families and transfer tasks [1904.02642].
- **Dynamic ensembles and meta-optimized weights** halved the simple regret on Branin and real HPO benchmarks relative to static EI/PI/LCB [2003.09643, 2206.11118].
- **LLM-synthesized FunBO AFs** consistently dominated classical and neural baselines, converging 2–3× faster on out-of-distribution and high-multimodality benchmarks [2406.04824].
- **Likelihood-free, LLM-informed local AFs** achieved $\sim$80% optimality (measured by GAP or regret) in 20 rounds on challenging chemical property optimization, outperforming Laplace-BNN or GP surrogates even with generic features [2512.13935].
- **Switch-scheduled AFs (EI then PI)** realized the best overall regret on the COCO benchmark suite, with explore-then-exploit schedules universally dominating frequent switches or fixed-function baselines [2211.01455].
- **Global mixed-integer solvers (PK-MIQP)** found lower minima for acquisition functions in 1–5D and achieved better accuracy on constrained BO than widely used multi-start local optimizers [2410.16893].

## References

- End-to-End Learning of Deep Kernel Acquisition Functions for Bayesian Optimization [2111.00639]
- Dynamic Multi-objective Ensemble of Acquisition Functions in Batch Bayesian Optimization [2206.11118]
- A Study of Acquisition Functions for Medical Imaging Deep Active Learning [2401.15721]
- One-parameter family of acquisition functions for efficient global optimization [2104.12363]
- Maximizing acquisition functions for Bayesian optimization [1805.10196]
- On Local Optimizers of Acquisition Functions in Bayesian Optimization [1901.08350]
- Optimizing Bayesian acquisition functions in Gaussian Processes [2111.04930]
- PI is back! Switching Acquisition Functions in Bayesian Optimization [2211.01455]
- Inverse Bayesian Optimization: Learning Human Acquisition Functions in an Exploration vs Exploitation Search Task [2104.09237]
- Towards Automatic Bayesian Optimization: A first step involving acquisition functions [2003.09643]
- Sampling Acquisition Functions for Batch Bayesian Optimization [1903.09434]
- An adaptive switch strategy for acquisition functions in Bayesian optimization of wind farm layout [2502.10778]
- Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization [1904.02642]
- The reparameterization trick for acquisition functions [1712.00424]
- Unleashing the Potential of Acquisition Functions in High-Dimensional Bayesian Optimization [2302.08298]
- Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximation [2410.16893]
- Bayesian Model Inference using Bayesian Quadrature: the Art of Acquisition Functions and Beyond [2510.08974]
- Bayesian Optimization for Enhanced Language Models: Optimizing Acquisition Functions [2505.17151]
- Informing Acquisition Functions via Foundation Models for Molecular Discovery [2512.13935]
- FunBO: Discovering Acquisition Functions for Bayesian Optimization with FunSearch [2406.04824]

This literature demonstrates that acquisition function design, selection, and optimization now constitute an independent—and fast-evolving—discipline at the interface of statistical modeling, learning theory, and real-world experimental design.

Source: https://www.emergentmind.com/topics/acquisition-functions