---
title: Targeting-Aware Acquisition Function
url: https://www.emergentmind.com/topics/targeting-aware-acquisition-function
type: topic
---

# Targeting-Aware Acquisition Function

Searching arXiv for recent and relevant papers on targeting-aware acquisition functions and closely related formulations.
A targeting-aware acquisition function is an acquisition rule whose score is aligned with the actual downstream target of a sequential decision problem rather than with a generic proxy alone. In the recent literature, that target has taken multiple forms: validation accuracy after retraining in active learning, validation/generalization performance in bilevel Bayesian optimization, reduction of posterior uncertainty over scientific parameters in experimental design, boundary identification for treatment assignment under aggregate and differentially private queries, localization of a source as the maximizer of a field, and the improvement of a user-specified goal functional \(J(\theta)\) through data acquisition [2310.17044; 2505.17151; 2201.06998; 2507.05175; 2510.14790; 2602.19578]. The unifying principle is explicit task alignment: acquisition is designed to optimize what the procedure ultimately cares about, while still handling exploration, uncertainty, feasibility, and computational constraints.

## 1. Conceptual basis

In active learning and Bayesian optimization, classical acquisition rules frequently optimize surrogate criteria such as predictive uncertainty, diversity, expected improvement, or confidence bounds. Several recent works treat this as insufficient when the true objective is validation performance, parameter identification, or a task-specific notion of success. RAMBO formulates active learning as direct utility maximization over validation accuracy, with
\[
U(S; H_t) = \mathrm{Acc}(M_{\phi^*(S,H_t)}; V),
\qquad
\phi^*(S,H_t) = \arg\min_{\phi} L_{\mathrm{train}}(M_\phi; D_t \cup S),
\]
so the selected batch is the one predicted to maximize post-training validation accuracy rather than uncertainty alone [2310.17044]. In bilevel BO for fine-tuning RoBERTa-base, the same principle appears as an outer loop that is optimized with respect to a validation metric while the inner loop minimizes training loss [2505.17151].

This alignment principle also appears outside conventional active learning. In privacy-constrained targeting, the acquisition is designed for the policy boundary \(f(x)-c=0\) rather than for pointwise maximization, because the relevant decision is whether treatment effect exceeds treatment cost [2507.05175]. In climate-model experimental design, candidate region–time windows are scored by the posterior covariance they would leave over uncertain GCM parameters, so acquisition is defined by uncertainty reduction about parameters rather than by predictive fit at the queried location [2201.06998]. In goal-oriented influence maximization, the target is an explicit user goal \(\mathcal{G}(\theta)\), such as test loss, predictive entropy, or the value of an optimizer-recommended design [2602.19578].

A recurrent contrast is with fixed heuristics chosen a priori. Deep active learning with adaptive acquisition argues that no single heuristic consistently dominates and instead learns a policy from reinforcement feedback collected during labeling rounds [1906.11471]. Inverse Bayesian optimization reaches a similar conclusion in a different setting: standard PI, EI, and UCB do not fully explain human sequential search, and augmented thresholded acquisitions better capture the strategy of “explore enough to learn the target direction” [2104.09237]. This suggests that “targeting-aware” denotes a family of acquisition designs rather than a single formula.

## 2. Mathematical formulations

The central mathematical move is to encode the task target directly into the acquisition. The resulting forms differ by problem class, but they share a common structure: a score for a candidate query, batch, region, or action is defined in terms of its expected effect on the true objective.

| Setting | Targeted quantity | Representative acquisition |
|---|---|---|
| Active learning [2310.17044] | Validation accuracy after retraining | \(U(S;H_t)=\mathrm{Acc}(M_{\phi^*(S,H_t)};V)\) |
| Bilevel BO for LLM fine-tuning [2505.17151] | Validation metric with training-loss awareness | \(a_{\mathrm{mix}}(x)=\alpha EI_{\mathrm{val}}(x)-(1-\alpha)LCB_{\mathrm{train}}(x)\) |
| Privacy-preserving targeting [2507.05175] | Boundary refinement around \(f(x)-c=0\) | \(TAAF(R)=\beta V(R)-|m(R)-c|\) |
| Climate experimental design [2201.06998] | Parametric uncertainty reduction | \(U(W_k)=\big(\det \mathrm{Cov}(\theta\mid W_k y)\big)^{-1}\) |
| Goal-oriented influence acquisition [2602.19578] | Improvement in user-specified goal \(J(\theta)\) | \(a(x)=\mathbb{E}_{y\mid x}\!\left[-\nabla_\theta J(\theta)^\top H_\theta^{-1}\nabla_\theta \ell(\theta;(x,y))\right]\) |

In RAMBO, the acquisition is not trained to regress absolute utility values; instead, it is trained as a ranking model over candidate batches using a RankNet objective. For utility samples \((S_1,S_2)\) with utilities \(u_1\) and \(u_2\),
\[
P_{12} = \sigma(f_\theta(S_1,H_t)-f_\theta(S_2,H_t)),
\]
\[
L^{12}_{\mathrm{Rank}} = -\bar P_{12}\log P_{12} - (1-\bar P_{12})\log(1-P_{12}),
\]
with \(\bar P_{12}=1\) if \(u_1>u_2\) and \(0\) otherwise [2310.17044]. This converts task targeting into a learned pairwise utility ordering.

In bilevel BO for LLM fine-tuning, the target-aware structure is explicit in the bilevel problem
\[
\theta^*(x)=\arg\min_\theta L_{\mathrm{train}}(\theta;x), \qquad
x^*=\arg\max_x M_{\mathrm{val}}(\theta^*(x)),
\]
with separate GP surrogates for \(f_{\mathrm{val}}(x)\) and \(g_{\mathrm{train}}(x)\). The paper studies mixed outer acquisitions such as
\[
a_{\mathrm{mix}}(x)=\alpha EI_{\mathrm{val}}(x)-(1-\alpha)LCB_{\mathrm{train}}(x),
\]
and reports that the best empirical configuration uses EI in the inner loop and UCB in the outer loop [2505.17151].

In privacy-preserving targeting, the target is the treatment boundary rather than the global maximum. The regional acquisition is
\[
TAAF(R)=\beta V(R)-|m(R)-c|,
\]
where \(m(R)\) and \(V(R)\) are the posterior predictive mean and variance of the regional average, and \(c\) is treatment cost [2507.05175]. High variance supports exploration, while small \(|m(R)-c|\) emphasizes regions near the policy boundary.

A further generalization appears in curvature-aware Expected Free Energy, where a Gaussian preference distribution \(p(y)=\mathcal{N}(y^*,\tau^2)\) encodes the desired target outcome \(y^*\). The acquisition is
\[
\alpha_{\mathrm{EFE},t}(x)
=
-\frac{(\mu_t(x)-y^*)^2}{2\tau^2}
-\frac{\sigma_t^2(x)+\sigma^2}{2\tau^2}
+\frac{1}{2}\ln\!\Big(1+\frac{\sigma_t^2(x)}{\sigma^2}\Big),
\]
so targeting and information gain appear in a single functional [2603.26339].

## 3. Design patterns and optimization strategies

A common design pattern is multi-level optimization. RAMBO uses a bilevel framework in which the inner level fits the surrogate on shorter utility samples and the outer level optimizes hyperparameters so that the surrogate generalizes to longer histories:
\[
w(\lambda)=\arg\min_{\hat w} \sum_{(S_1,S_2)\in D_{\mathrm{tr}}} L_{\mathrm{Total}}(\hat w)+\Omega_\lambda(\hat w),
\]
\[
\min_\lambda \sum_{(S_1,S_2)\in D_{\mathrm{val}}} L_{\mathrm{Total}}(w(\lambda)),
\]
with
\[
L_{\mathrm{Total}}=L_{\mathrm{Rank}}+\lambda_{OT}L_{OT}.
\]
This makes targeting aware of the growing history \(H_t\), since longer sets act as validation tasks for the acquisition surrogate [2310.17044].

Another recurring pattern is auxiliary alignment to the target distribution. RAMBO adds an OT-distance head that predicts \(\widehat{OT}(S,V)\), regularizing candidate selection toward the validation distribution [2310.17044]. Bilevel BO with SWA uses separate surrogates for validation metric and training loss, allowing exploration strength to adapt to the observed sensitivity between them [2505.17151]. In privacy-preserving targeting, posterior uncertainty already incorporates differentially private noise through \(\Sigma\), so boundary-focused acquisition automatically reflects privacy-induced measurement degradation [2507.05175].

Several works also integrate targeting into the surrogate itself rather than only into the acquisition layer. Approximation-aware BO replaces global posterior fidelity with utility-calibrated variational inference:
\[
L_{\mathrm{EULBO}}(\lambda,Z,\theta,x;D_t)
=
L_{\mathrm{SVGP}}(\lambda,Z,\theta;D_t)
+
\mathbb{E}_{q_\lambda(f)}[\log u(x,f;D_t)].
\]
The variational approximation is therefore optimized jointly with the decision utility, which reallocates approximation capacity toward decision-relevant regions [2406.04308]. This differs materially from the usual pattern of first fitting an approximate GP globally and only then maximizing an acquisition.

Targeting can also be embedded into path planning or stateful policies. In jammer localization, UCB over the surrogate field,
\[
\alpha_{\mathrm{UCB}}(\mathbf{x})=\mu_n(\tilde{\mathbf{x}})+\kappa \sigma_n(\tilde{\mathbf{x}}),
\]
is treated as targeting-aware because the task is to locate the maximizer of the field. The path planner then incorporates acquisition into edge costs,
\[
c_{\mathbf{x},\mathbf{x}'}
=
\Big(\lambda_{\mathrm{len}}-\lambda_{\mathrm{info}}\,\bar\alpha_{\mathrm{UCB}}(\mathbf{x},\mathbf{x}')\Big)\|\mathbf{x}-\mathbf{x}'\|_2,
\]
so the agent moves through high-acquisition regions while obeying mobility constraints [2510.14790].

## 4. Representative instantiations across domains

In active learning, targeting-aware acquisition is most explicit when the selected batch is ranked by its predicted effect on validation accuracy. RAMBO combines a set-based encoder, pairwise ranking, OT regularization, and bilevel generalization across growing histories. Its decision rule is
\[
S^*=\arg\max_{S\in C_t} f_\theta(S,H_t),
\]
after candidate generation through a margin filter and batching [2310.17044]. A different active-learning instantiation is reinforcement-learned acquisition. There the state is a product Gaussian over predictive moments on a bootstrap shortlist, and the policy is trained with rewards combining marginal-likelihood improvement and label diversity:
\[
J(\pi_\phi)=\mathbb{E}_{\tau\sim\pi_\phi}\Big[\sum_{t=1}^T \gamma^t R_t\Big],\qquad \gamma=0.95,
\]
with \(R_t=R_{\mathrm{improv}}+R_{\mathrm{div}}\) [1906.11471].

In hyperparameter optimization for language-model fine-tuning, targeting-aware acquisition separates the training objective from the real deployment objective. The inner loop minimizes training loss using early stopping and SWA, while the outer acquisition targets validation performance. The paper evaluates EI-only, UCB-only, UCB-EI, and EI-UCB; the targeting-aware interpretation is that the outer decision rule should reflect the true target metric even when training loss and validation behave differently [2505.17151].

In privacy-preserving personalization, the acquisition acts on regions rather than points because the platform exposes only aggregate, noisy queries. The latent CATE surface \(f(x)\) is updated through integral GP operators, and the acquisition chooses the next region \(R\) to refine treatment decisions near the boundary \(f(x)-c=0\) [2507.05175]. This is a structurally different use of acquisition from classical BO, but it preserves the core idea of goal alignment.

In scientific experimental design, the target is posterior contraction in parameter space. For uncertain GCM parameters, candidate latitudes and seasonal windows are scored by a D-optimal criterion,
\[
U(W_k)=\big(\det \mathrm{Cov}(\theta\mid W_k y)\big)^{-1},
\]
which functions as a proxy for expected information gain about \(\theta\) [2201.06998]. The acquisition therefore ranks prospective measurements by how much they would reduce uncertainty in the calibrated parameters, not by local predictive variance alone.

Behavioral and human-in-the-loop settings yield yet another variant. In inverse BO for sequential target search, standard PI, EI, and UCB are augmented with angular thresholds \(\tau\) or \((\tau^+,\tau^-)\) so that insufficient exploration is penalized:
\[
\widetilde{u}(\theta_2\mid \Delta r_1,\hat f_1,\tau)
=
\begin{cases}
u(\theta_2\mid \Delta r_1,\hat f_1), & (|\theta_2|>\tau)\cap(\Delta r_1\ge 0),\\
u(\theta_2\mid \Delta r_1,\hat f_1), & (|\theta_2|<\pi-\tau)\cap(\Delta r_1<0),\\
\min_{\theta_2,\Delta r_1} u(\theta_2\mid \Delta r_1,\hat f_1), & \text{otherwise}.
\end{cases}
\]
The augmentation operationalizes the strategy of enforcing enough angular deviation to learn target direction [2104.09237].

A more abstract formulation is GOIMDA, where the acquisition is the expected first-order influence of a new labeled example on a user-specified goal:
\[
x_{\mathrm{next}}
=
\arg\max_x
\mathbb{E}_{y\sim p_\phi(\cdot\mid x)}
\Big[
\tilde{\mathcal{I}\circ\mathcal{G}_\phi}\big(\theta(\mathcal{D}\cup\{(x,y)\})\big)
\Big],
\]
\[
\tilde{\mathcal{I}\circ\mathcal{G}_\phi}
=
\big[\nabla_\theta \mathcal{G}_\phi(\theta(\mathcal{D}))\big]^\top
\hat H_\theta^{-1}
\big[\nabla_\theta \ell(\theta;(x,y))\big].
\]
This makes “targeting-aware” literal: the acquisition is parameterized by the chosen goal functional \(\mathcal{G}\) [2602.19578].

## 5. Empirical behavior and computational trade-offs

Empirical results repeatedly show that explicit targeting can outperform proxy-driven acquisition, particularly when the proxy is unstable or misaligned. In RAMBO, full RAMBO on CIFAR-10 ablation with \(k=3500\) and \(B=5000\) reaches \(77.3\pm0.2\%\), whereas weaker variants are reported around \(70.5\)–\(76.2\%\); the method also reports total runtimes of approximately \(1\)h\(20\)m on CIFAR-10 and \(1\)h on SVHN on a single GPU without parallelism [2310.17044]. In bilevel BO-SWA on GLUE with RoBERTa-base, EI-UCB achieves average score \(76.82\), compared with \(74.80\) for standard fine-tuning, corresponding to an improvement of up to \(2.7\%\) [2505.17151].

The same pattern appears in privacy-preserving targeting. Under the Criteo AI Labs uplift setting, uniform querying can achieve as little as \(33\%\) of the non-privacy-preserving targeting potential in the \(64\)-query, \(s=0.1\) condition, whereas the strategic querying method based on TAAF reaches \(97\)–\(101\%\) across the reported privacy settings and is statistically indistinguishable from Causal Forest [2507.05175]. In human-search inverse BO, augmented thresholded acquisitions improve total out-of-sample log-likelihood from \(-2036.46\) for standard acquisitions to \(-1843.54\) for symmetric thresholding and \(-1709.19\) for asymmetric thresholding [2104.09237].

Targeting-aware acquisitions also change where exploration occurs. In climate design, the largest information gain typically, but not always, results from regions near the ITCZ; in the stationary single-latitude setting, utility peaks near the subtropical precipitation minima at \(\pm19^\circ\), while wider stencils move the optimum closer to the ITCZ [2201.06998]. In active jammer localization, acquisition-aware path planning reduces localization error relative to uninformed baselines: for example, in Chicago Downtown, A-UCB* with \(\delta=50\) reports SME \(13.4\,[7.8\text{–}28.0]\) and BOE \(12.9\,[7.8\text{–}24.0]\), compared with RIS SME \(57.4\,[27.6\text{–}120.1]\) and BOE \(65.6\,[28.1\text{–}103.8]\) [2510.14790].

The computational cost of targeting-awareness is usually shifted from label acquisition or function evaluation toward surrogate training, posterior updating, or meta-optimization. RAMBO reduces full retraining cost through interpolation-based utility labels [2310.17044]. Bilevel BO-SWA pays for separate surrogates and nested evaluation loops [2505.17151]. Integral GP updates under aggregate queries require regional kernel computations and \(O(n^3)\) linear algebra, though moderate query budgets remain tractable [2507.05175]. Utility-calibrated SVGPs add an expected log-utility term but remain scalable through minibatching and inducing variables [2406.04308]. GOIMDA avoids explicit posterior inference, but it replaces it with inverse-Hessian–vector products computed by CG or LiSSA [2602.19578].

## 6. Limitations, misconceptions, and directions

A common misconception is that targeting-aware acquisition is merely exploitation under a different name. The surveyed methods do not support that view. Boundary-focused TAAF includes an explicit variance term \(\beta V(R)\) [2507.05175]; curvature-aware EFE contains both a risk term and an information-gain term [2603.26339]; climate design uses posterior uncertainty reduction [2201.06998]; and EI-UCB places UCB, not EI, in the outer validation-targeting loop precisely to preserve exploration in generalization space [2505.17151]. The distinction is not exploration versus exploitation, but whether either is organized around the true downstream target.

Another misconception is that targeting-awareness removes the need for auxiliary heuristics. In practice, many methods retain them. RAMBO still uses a margin filter to generate candidate batches before scoring them with the learned surrogate [2310.17044]. Reinforcement-learned active acquisition bootstraps from entropy ranking and only learns to warp the top of that ranking [1906.11471]. Jammer localization first maximizes UCB over the feasible grid and then embeds acquisition in path costs [2510.14790]. This indicates that targeting-aware acquisition is often layered on top of simpler candidate-generation machinery.

The principal limitations are computational and modeling-related. Severe history shift, new classes, or label noise may require re-pretraining in learned active learning [2310.17044]. GP assumptions, sensitivity estimation, and budget overhead limit bilevel BO-SWA [2505.17151]. Very strong differential privacy noise or extremely small lengthscale degrades aggregate-query targeting [2507.05175]. In climate design, sparse designs and short averaging windows can induce multimodality and reduce reliability of the predicted utility map [2201.06998]. GOIMDA depends on stable inverse-curvature estimates, while curvature-aware EFE becomes more difficult in high-dimensional spaces where Hessian information is expensive or noisy [2602.19578; 2603.26339].

Several papers make the extension space explicit. The BO-SWA work lists multi-objective BO, constrained BO, dynamic acquisition switching, and better uncertainty modeling as natural extensions [2505.17151]. Privacy-constrained targeting points to adaptive region refinement and nonstationary kernels under high-dimensional heterogeneity [2507.05175]. Goal-oriented influence acquisition notes that diversity-aware batching is a natural next step for sequential designs [2602.19578]. Taken together, these results suggest that targeting-aware acquisition functions are evolving toward more explicit goal specification, stronger coupling between surrogate learning and decision utility, and broader treatment of constraints, distribution shift, and path-dependent costs.

Source: https://www.emergentmind.com/topics/targeting-aware-acquisition-function