Expert-Tilted Bayes Posterior

• Expert-Tilted Bayes Posterior is a class of modifications that reweights and adjusts traditional Bayesian updates using expert inputs, such as quadratic tilts and moment-based corrections.
• The methodology integrates denoising oracles, alternative prior-likelihood judgments, and test-derived losses to enhance uncertainty quantification, robustness, and decision relevance.
• Applications span linear inverse problems, robust empirical likelihood, deep learning cold posteriors, and nonparametric tilts, offering improved tractability and calibrated risk control.

In the cited literature, the phrase Expert-Tilted Bayes Posterior is used for several related but non-identical constructions in which a baseline Bayesian update is reweighted, transported, or adjusted by additional expert structure. The added structure may be a denoising oracle and a quadratic likelihood tilt in a linear inverse problem, a Bayes-linear adjustment across alternative prior and likelihood judgements, a moment-based surrogate likelihood, a test-derived loss, a new set of class priors, or a tilt on a random probability measure (Bruna et al., 2024, Williamson et al., 2015, Tang et al., 2021). What unifies these constructions is not a single canonical density, but the use of an explicit tilting mechanism to move posterior inference toward a target regarded as more faithful, more robust, more computationally tractable, or more decision-relevant than a single unmodified Bayes posterior.

1. Conceptual scope and unifying structure

Several mathematically distinct objects appear under this label or a closely allied interpretation.

Construction	Update form	Salient property
Tilted transport	$$\nu_t(x) \propto \pi_t(x)\exp\!\left(-\frac12 x^\top Q_t x + x^\top b_t\right)$$	Exact reverse diffusion maps $\nu_t$ to $\nu$
Posterior belief assessment	$$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$	Closer in mean-square to $P_t(Y)$
PETEL / BETEL	$$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$ or $\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$	Moment-based Bayes or generalized Bayes update
e-posterior / robust-test posterior	$\bar P(\theta\mid y)=1/S_\theta(y)$ or $d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$	Frequentist-valid risk bounds or non-asymptotic concentration

In the transport formulation, the expert contribution is explicit in the score decomposition: the denoising oracle provides an “expert” score for the prior, and the likelihood contributes a quadratic tilt that is itself an “expert” favoring consistency with the data (Bruna et al., 2024). In posterior belief assessment, the tilt is not a literal density transformation but an expectation-level correction obtained from a finite collection of alternative Bayesian analyses judged “not ruled out”; it does not assign model probabilities and does not assume one alternative is true (Williamson et al., 2015). In PETEL, BETEL, and RBETEL, the tilt replaces or augments the likelihood by exponentially tilted empirical likelihood terms, often with an additional penalty or contamination mechanism (Tang et al., 2021, Liu et al., 2017). In the e-posterior literature, the object is explicitly not a probability distribution: it is a reciprocal e-density-like quantity used to construct minimax-safe decision rules and risk certificates (Grünwald, 2023).

This diversity suggests that the phrase denotes a class of posterior modifications rather than a single standardized posterior. Some variants preserve Bayesian semantics exactly, some produce a single adjusted posterior judgement, and some are Bayes-like devices whose primary output is calibrated uncertainty or worst-case risk control.

2. Tilted transport in Bayesian inverse problems

For the Bayesian linear inverse problem

$$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$

with prior density $\nu_t$0 on $\nu_t$1, the Bayes posterior is

$\nu_t$2

Writing $\nu_t$3 and $\nu_t$4, this becomes the quadratic tilt

$\nu_t$5

The score-based denoising oracle supplies an approximation $\nu_t$6, and in the variance-preserving Ornstein–Uhlenbeck setting the time-dependent prior score satisfies Tweedie’s formula. Tilted transport then defines a boosted family

$\nu_t$7

where $\nu_t$8 evolve according to

$\nu_t$9

$\nu$0

If $\nu$1 and one runs the OU reverse SDE from $\nu$2 to $\nu$3, then $\nu$4 has law $\nu$5; sampling $\nu$6 is therefore equivalent to sampling the boosted posterior and reversing the diffusion (Bruna et al., 2024).

The boosted posterior has log-density

$\nu$7

with gradient

$\nu$8

The paper interprets this as a combination of two experts:

$\nu$9

and at transport time $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$0,

$$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$1

The likelihood-derived quadratic tilt boosts curvature by $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$2, while $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$3 becomes smoother and closer to unimodal as $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$4 increases. The method quantifies the role of the signal-to-noise ratio

$$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$5

and the condition number $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$6 in determining posterior difficulty (Bruna et al., 2024).

The principal theoretical guarantee is a strong log-concavity condition for the boosted posterior at the blowup time $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$7. With susceptibility

$$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$8

and $$\mathbb{E}_G[Y] = \mathbb{E}[Y] + \mathrm{Cov}(Y,G)\mathrm{Var}(G)^{-1}(G-\mathbb{E}[G])$$9, strong log-concavity holds if

$P_t(Y)$0

Under this condition, the strong convexity parameter satisfies $P_t(Y)$1, Langevin dynamics converges in KL at rate $P_t(Y)$2 with $P_t(Y)$3, and ULA, MALA, or HMC can be used with standard controls. For Ising models, $P_t(Y)$4, so the criterion reduces to

$P_t(Y)$5

which matches the Kunisky low-degree computational threshold and the rapid mixing regime of Glauber dynamics. The paper further reports Gaussian-mixture experiments with mixtures of 25 Gaussians in dimensions $P_t(Y)$6, $P_t(Y)$7, $P_t(Y)$8, and $P_t(Y)$9, as well as scalar field $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$0 experiments on a $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$1 lattice, where tilted transport accelerates relaxation and yields a direct Bakry–Émery guarantee for $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$2 (Bruna et al., 2024).

3. Posterior belief assessment as expectation-level expert tilting

Posterior belief assessment addresses complex problems in which no single prior and likelihood pair can be claimed to represent the analyst’s actual probabilistic judgements. The construction begins with a quantity of interest $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$3, observed data $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$4, and several alternative modelling judgements $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$5 that are “not ruled out” and regarded as representative of prior knowledge and problem structure. One computes the posterior expectations under these alternatives and forms

$$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$6

The posterior belief assessment is then the Bayes-linear projection

$$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$7

with adjusted variance

$$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$8

This construction is explicitly expectation-based rather than model-probability-based, and the paper states that it is not Bayesian model averaging: no model probabilities are assigned, no assumption is made that one $$\pi(\theta)\,L(\theta)\,\exp\{-\alpha_n R_n(\theta)\}$$9 is true, and the weights are determined by second-order relationships to optimize mean-square closeness to the future posterior prevision $\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$0 (Williamson et al., 2015).

The foundational device is the Temporal Sure Preference principle. If $\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$1 denotes the future posterior prevision after seeing $\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$2, then one obtains the orthogonal decomposition

$\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$3

and the corresponding variance partition

$\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$4

From this, the paper proves that for each component $\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$5,

$\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$6

and similarly

$\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$7

The adjusted judgement is therefore at least as close in mean square to the analyst’s future posterior prevision as the original single Bayesian analysis (Williamson et al., 2015).

When infinitely many alternatives are contemplated, the framework uses second-order exchangeability and co-exchangeability. Within each class $\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$8,

$\pi(\theta)\prod_i p_i(\theta,\lambda(\theta))$9

and Bayes-linear sufficiency implies

$\bar P(\theta\mid y)=1/S_\theta(y)$0

This reduces an infinite family of alternatives to a finite set of class means. The methodology was illustrated on calibration of the NEMO ocean model, where the target quantity was global mean temperature at approximately $\bar P(\theta\mid y)=1/S_\theta(y)$1 m depth. The reported result was

$\bar P(\theta\mid y)=1/S_\theta(y)$2

compared with the original

$\bar P(\theta\mid y)=1/S_\theta(y)$3

The adjusted variances were reported as $\bar P(\theta\mid y)=1/S_\theta(y)$4 for the posterior belief assessment and $\bar P(\theta\mid y)=1/S_\theta(y)$5 under the single analysis, with an uncertainty reduction lower bound of approximately $\bar P(\theta\mid y)=1/S_\theta(y)$6; the weights indicated that high-discrepancy classes contributed most to the tilt (Williamson et al., 2015).

4. Exponentially tilted empirical likelihood and robust moment restrictions

A second major usage arises in generalized Bayes procedures that replace a misspecified or unavailable likelihood by exponentially tilted empirical likelihood. For i.i.d. observations $\bar P(\theta\mid y)=1/S_\theta(y)$7, parameter $\bar P(\theta\mid y)=1/S_\theta(y)$8, and loss $\bar P(\theta\mid y)=1/S_\theta(y)$9, the empirical risk minimizer is

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$0

Using moment conditions

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$1

the exponentially tilted empirical likelihood weights are

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$2

where $d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$3 solves

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$4

The Penalized ETEL posterior is

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$5

Under smoothness and uniqueness assumptions, if

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$6

then the PETEL posterior satisfies a Bernstein–von Mises theorem:

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$7

with sandwich covariance

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$8

The credible ellipsoid based on the posterior mean and covariance has frequentist coverage error bounded by

$d\Pi_X(P)\propto \exp\{-\beta \bar T(X,P)\}d\Pi(P)$9

The paper extends this to non-smooth losses and to a sparse high-dimensional model-averaged PETEL posterior with variable-selection consistency (Tang et al., 2021).

BETEL and RBETEL place the same exponential tilting within moment-condition models. For data $$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$0, parameter $$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$1, and moment restrictions

$$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$2

ETEL arises from maximizing entropy subject to the moment constraints. The implied probabilities are

$$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$3

and the BETEL posterior is

$$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$4

RBETEL adds latent indicators $$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$5 for “good” observations, imposes the moment conditions only on the active subset, and uses the joint posterior

$$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$6

The majority constraint $$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$7 enforces domination by the “good” subset, and the robust loss is constructed so that contaminated observations can be assigned $$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$8 and receive zero implied probability. In the empirical illustration relating brain weight to body weight, RBETEL assigned low posterior probabilities of being “good” to three leverage outliers, approximately $$y = A x + \varepsilon, \qquad \varepsilon \sim \mathcal N(0,\sigma^2 I_{d'}),$$9, $\nu_t$00, and $\nu_t$01, while producing posterior means close to robust M-estimation and sharper posteriors than a parametric Student-$\nu_t$02 error model (Liu et al., 2017).

5. Decision-theoretic and test-based Bayes-like tilts

Another line of work constructs Bayes-like posteriors directly from robust tests. Let $\nu_t$03 be a model of candidate probability measures, endowed with prior $\nu_t$04, and let $\nu_t$05 be a loss such as total variation, squared Hellinger, or an $\nu_t$06 loss. For each pair $\nu_t$07, one defines a bounded antisymmetric per-observation statistic $\nu_t$08 and aggregates it over the sample:

$\nu_t$09

With tuning parameters $\nu_t$10 and $\nu_t$11, the construction first defines

$\nu_t$12

then the averaged score

$\nu_t$13

and finally the posterior

$\nu_t$14

The paper proves non-asymptotic concentration under local prior growth conditions. Under Assumption 3 alone,

$\nu_t$15

and with the variance assumption one obtains the sharper radius involving $\nu_t$16. The theorems require only independence, not identical distribution, so the posterior remains stable around the average law when the data are independent but non-i.i.d. The paper gives explicit constants, including $\nu_t$17 for total variation with $\nu_t$18 and $\nu_t$19, and $\nu_t$20 for squared Hellinger with $\nu_t$21 and $\nu_t$22 (Baraud, 2021).

The e-posterior is more radical. For an e-collection $\nu_t$23 satisfying

$\nu_t$24

the e-posterior is defined by

$\nu_t$25

with the convention $\nu_t$26. The paper states explicitly that this is not a probability distribution. Its basic decision object is

$\nu_t$27

and Proposition 1 gives the validity bound

$\nu_t$28

Under the Savage–Dickey construction,

$\nu_t$29

so the e-posterior becomes the posterior-to-prior ratio. The paper emphasizes that the same e-posterior can support arbitrary loss functions chosen post hoc, and that generalized Savage–Dickey e-processes preserve validity under optional stopping (Grünwald, 2023).

These two constructions differ sharply from density-based Bayes updates. The robust-test posterior is still a posterior measure on the model, but its energy is test-derived rather than likelihood-derived. The e-posterior is an e-density-like object designed for worst-case decision-making. Both place robustness and finite-sample validity ahead of standard posterior semantics.

6. Prior adaptation, cold posteriors, nonparametric tilts, and posterior mean bounds

In multiclass classification under prior probability shift, expert tilting can be completely explicit. If the original class priors are $\nu_t$30, the original posteriors are $\nu_t$31, and the expert supplies new priors $\nu_t$32, then, under unchanged class-conditionals,

$\nu_t$33

The paper proves that the per-example likelihood vector $\nu_t$34 is uniquely determined up to a positive scale by the original posteriors and priors, using a Perron–Frobenius argument for a positive matrix $\nu_t$35 whose dominant eigenvector spans the nullspace of the associated homogeneous system. Computationally, the update is $\nu_t$36 per example, vectorizable, and equivalent at the logit level to adding the bias $\nu_t$37 before softmax (Davis, 2020).

In Bayesian deep learning, tempering itself is interpreted as an expert tilt. With posterior energy

$\nu_t$38

the fully tempered posterior is

$\nu_t$39

The paper defines a cold posterior as the case in which the best posterior predictive performance is achieved at $\nu_t$40. On ResNet-20 for CIFAR-10, both accuracy and test cross-entropy improved markedly for $\nu_t$41, continuing down to temperatures as small as $\nu_t$42; on a CNN-LSTM for IMDB, the best test accuracy and cross-entropy were attained for $\nu_t$43. By contrast, for small well-specified MLPs sampled with HMC, the optimal predictive performance occurred at $\nu_t$44. The paper therefore interprets $\nu_t$45 as a pragmatic expert correction that upweights the data relative to the prior, while also stressing that such cold posteriors sharply deviate from the Bayesian paradigm under the original model (Wenzel et al., 2020).

In Bayesian nonparametrics, expert tilt can act on the law of a completely random measure. If $\nu_t$46 is a CRM with total mass $\nu_t$47, the tilted law is

$\nu_t$48

and the normalized tilted random probability measure is $\nu_t$49. The class is conjugate: after observing i.i.d. data from $\nu_t$50, the posterior remains in the tilted class, admits an augmented representation through an auxiliary variable $\nu_t$51, and yields predictive distributions via a generalized Blackwell–MacQueen Pólya urn scheme. The construction contains the Dirichlet process, the Poisson–Dirichlet or Pitman–Yor process, and the normalized generalized gamma process within one framework (Lau, 2013).

A more classical sense of expert tilt appears in exact bounds for posterior means in exponential families. For densities

$\nu_t$52

a prior with mean $\nu_t$53, variance at most $\nu_t$54, and upper support bound $\nu_t$55 yields posterior mean

$\nu_t$56

Writing $\nu_t$57, the paper shows

$\nu_t$58

where $\nu_t$59 is the exact optimal upper bound in terms of $\nu_t$60 alone. The extremal prior is two-point, and the bound is derived through a Winsorised-tilted mean

$\nu_t$61

This is an exact posterior-mean control for an exponential reweighting constrained by expert support information (Pinelis, 2011).

7. Assumptions, guarantees, and comparative interpretation

The constructions collected under this label differ primarily in what is being tilted and what guarantees are sought. Tilted transport assumes a linear Gaussian noise model, known $\nu_t$62 and $\nu_t$63, a prior score oracle robust across OU or heat times, and finite susceptibility; under explicit conditions involving $\nu_t$64, $\nu_t$65, and SNR, it yields strong log-concavity and polynomial-time sampling guarantees, but the paper also states that strong log-concavity may fail at mid-SNR and large $\nu_t$66, that degenerate $\nu_t$67 weakens guarantees, and that stability requires score accuracy along posterior paths (Bruna et al., 2024). Posterior belief assessment assumes Temporal Sure Preference and second-order exchangeability or co-exchangeability; it produces a single adjusted expectation and variance rather than a posterior over models, and its practical success depends on credible second-order specifications and diagnostics for exchangeability (Williamson et al., 2015).

PETEL, BETEL, and RBETEL assume valid moment conditions, identifiable parameters, and feasibility of the exponentially tilted empirical likelihood. PETEL requires prior positivity and local regularity near the target risk minimizer, together with a penalty range such as

$\nu_t$68

while RBETEL requires moments that are valid for the majority “good” distribution and invalid for the contamination mechanism, as well as the majority constraint $\nu_t$69 (Tang et al., 2021, Liu et al., 2017). The robust-test posterior assumes a loss with triangle-type behavior, bounded antisymmetric tests, and local prior growth conditions; the e-posterior assumes a suitably chosen e-collection and a loss satisfying a no-sure-gain condition, but its bounds can become loose if the e-collection is badly chosen even though they remain valid (Baraud, 2021, Grünwald, 2023).

Other variants impose narrower structural assumptions. Prior-shift posterior adaptation requires unchanged class-conditionals between training and deployment, strictly positive priors, calibrated original posteriors, and the same label set (Davis, 2020). Cold posteriors improve predictive performance in the reported deep-learning experiments, but the paper emphasizes that they are not coherent posteriors under the original model, and that $\nu_t$70 is restored as optimal in well-specified synthetic settings (Wenzel et al., 2020). CRM tilting requires the integrability conditions ensuring finite total mass and well-defined normalization (Lau, 2013).

Taken together, these results suggest a precise but plural meaning of Expert-Tilted Bayes Posterior. In one group of papers, the tilt is an exact posterior transformation that preserves Bayesian semantics, as in tilted transport or conjugate tilting of CRMs. In a second group, the tilt is an expectation-level or empirical-likelihood correction designed to better align inference with expert judgement, moment restrictions, or contamination structure. In a third group, the tilt produces Bayes-like or nonprobabilistic objects whose central output is calibrated concentration or risk control rather than a conventional posterior density. Across all of these uses, “expert tilt” denotes the deliberate insertion of additional structure into posterior updating, with the aim of improving tractability, robustness, calibration, or fidelity to the decision maker’s actual judgements.