Bayesian Level Set Sampling Methods
- Bayesian level set sampling is a framework that infers interfaces and partitions by thresholding latent functions combined with Bayesian updating.
- It integrates Gaussian priors and surrogate models with likelihood-based MCMC and sequential design to robustly handle inverse and sampling problems.
- The approach has been successfully applied to reconstruct sharp boundaries in geometric inverse problems and to sample nested convex slices in high-dimensional settings.
Bayesian level set sampling denotes a family of Bayesian methodologies in which the object of interest is a set defined by thresholding a function. In geometric inverse problems, the unknown interface between regions is represented implicitly as the level set of a latent function, and Bayesian inference is performed on that latent function; in black-box level-set estimation, the target is a super-level set or a reliable level set of an expensive response; and in distributional sampling, nested level sets of a target density are used to construct samplers over convex slices (Iglesias et al., 2015, Huang et al., 2021, Iwazaki et al., 2019, Cheng et al., 2024, Foster et al., 2012). The resulting methods combine priors on latent fields or surrogates, likelihood-based posterior updating, and either Markov chain Monte Carlo or sequential evaluation policies to quantify uncertainty about interfaces, partitions, and threshold-defined regions.
1. Core formulations
A canonical geometric formulation introduces a real-valued level-set function or , together with thresholds
The physical domain is partitioned by the sublevel bands
and a piecewise-constant coefficient is recovered through a level-set map
This representation is used for discontinuous coefficients, refractive indices, and related geometric inverse problems (Iglesias et al., 2015, Huang et al., 2021).
A second formulation treats the level set itself as the primary inferential target for an expensive black-box function . For a threshold , the super-level set is
while under input uncertainty one instead studies the reliable level set
For scalar equality constraints, level sets may also be written as
with multivariate generalization to 0 (Cheng et al., 2024, Iwazaki et al., 2019, Edwards et al., 2024).
A third formulation uses level sets of a density rather than a forward model. For a quasi-concave density 1, the upper level set
2
is convex for every 3. The sampler operates across a nested sequence 4, estimates relative slice volumes, and reweights pooled samples to recover the target density (Foster et al., 2012).
| Setting | Level-set object | Target of inference or sampling |
|---|---|---|
| Geometric inverse problems | 5 or 6 | Interfaces and piecewise-constant fields |
| Black-box level-set estimation | 7 or a surrogate for 8 | Super-level or reliable level sets |
| Smoothed ABC level sets | 9 through 0 | Posterior mass concentrated near 1 |
| Quasi-concave density sampling | 2 | Samples from the target density |
This suggests that “Bayesian level set sampling” is not a single algorithmic template. Rather, it is a shared strategy in which threshold-induced geometry is made inferentially explicit.
2. Latent representations and prior models
In the inverse-problem literature, the standard prior is Gaussian on the level-set function. One formulation uses
3
with 4 for 5 under Neumann-zero-mean conditions, or an integral operator
6
chosen so that draws lie almost surely in 7 (Iglesias et al., 2015). In acoustic inverse medium scattering, the prior is taken as
8
with Neumann boundary conditions, where 9 controls smoothness, 0 is an inverse length-scale parameter, and 1 is a marginal variance (Huang et al., 2021). The same Whittle–Matérn prior may be generated by the SPDE
2
Several extensions retain the level-set geometry but alter the latent state. For multiple level sets, one writes
3
and places independent Gaussian priors on both the level-set functions 4 and the region magnitudes 5 (Reese et al., 2021). In point-source identification for the heat equation, the positive set of 6 determines the support of a discrete source term,
7
with 8 on 9 (Deng et al., 4 Sep 2025). In level-set Cox processes, a latent Gaussian process 0 with thresholds 1 induces regions
2
and the intensity becomes
3
In sequential level-set estimation, the prior is typically placed on the unknown response rather than on an interface field. The standard choice is a Gaussian process,
4
with noisy observations 5, 6 (Cheng et al., 2024, Iwazaki et al., 2019). For high-dimensional settings, a Bayesian neural network surrogate replaces the GP: a prior 7 is placed on the network weights, the posterior is approximated by MC-dropout variational inference 8, and predictive mean and variance are computed by Monte Carlo over dropout samples (Ha et al., 2020).
3. Likelihoods, posteriors, and well-posedness
For geometric inverse problems, the observational model has the form
9
or, more generally,
0
The negative log-likelihood is written as
1
and Bayes’ theorem yields a posterior absolutely continuous with respect to the Gaussian prior: 2 The principal well-posedness result is that the level-set map is discontinuous only on functions for which a threshold value is attained on a set of positive measure; under the Gaussian prior these events have zero probability, so the forward map is 3-almost surely continuous, the posterior is well-defined, and the data-to-posterior map is locally Lipschitz in the Hellinger distance (Iglesias et al., 2015, Huang et al., 2021).
Approximate Bayesian formulations modify the likelihood while retaining the level-set target. In Smoothed Approximate Bayesian Computation, one begins from the formal posterior
4
and replaces the Dirac constraint by a Gaussian kernel 5. The approximate posterior becomes
6
with 7 replaced in practice by the GP predictive density. As 8, the marginal 9 converges to 0 (Edwards et al., 2024).
Other formulations emphasize exactness rather than approximation. For level-set Cox processes with piecewise constant intensity, the obstacle is the intractable factor
1
because the areas 2 are induced by a random level-set partition. The proposed solution is an almost-surely positive unbiased Poisson estimator 3, embedded in a pseudo-marginal infinite-dimensional MCMC algorithm with retrospective sampling. The resulting inference is “exact” in the sense that no space discretization approximation is used and MCMC error is the only source of inaccuracy (Gonçalves et al., 2020).
A distinct approximation route is the Gauss–Newton Laplace approximation for piecewise constant reconstructions. With
4
the MAP point 5 is found by Gauss–Newton, and the Hessian
6
defines the Gaussian approximation 7 (Reese et al., 2021).
4. Sampling mechanisms
The most common function-space sampler in Bayesian level-set inversion is preconditioned Crank–Nicolson. Given the current state 8 or 9, one draws 0 and proposes
1
with acceptance probability
2
Because the proposal preserves the Gaussian prior, the method remains well-behaved under mesh refinement, and no explicit velocity law or reinitialization of the level set is required (Iglesias et al., 2015, Huang et al., 2021). In the acoustic scattering experiments, 3 was chosen 4, the mesh size was 5, and 6 samples were generated, with the last 7 used to compute conditional-mean estimates (Huang et al., 2021).
For quasi-concave densities, the sampling mechanism is different. The level-set hit-and-run sampler constructs nested convex slices 8, runs hit-and-run within each slice, enforces a warm-start condition through the volume-ratio rule
9
estimates slice masses, and finally reweights the pooled samples. For exponentially-tilted quasi-concave posteriors 0, the method augments the state with an auxiliary variable 1 and samples along one-dimensional chords with density proportional to 2 (Foster et al., 2012). Theoretical mixing guarantees cited there yield 3 hit-and-run mixing within a warm convex slice and overall cost 4 when the number of slices is 5 (Foster et al., 2012).
Smoothed ABC level-set MCMC uses a Metropolis–Hastings chain on 6. At each step one proposes 7, draws
8
and accepts with
9
thereby targeting the smoothed posterior 0 (Edwards et al., 2024).
When a Laplace approximation is adopted, posterior sampling is often performed without a Cholesky factorization. The construction in (Reese et al., 2021) applies a preconditioned Lanczos method to the preconditioned Hessian 1, approximates 2 through a low-dimensional tridiagonal projection, and returns
3
All steps require only matrix-vector products with 4, 5, and applications of 6 and 7 (Reese et al., 2021).
5. Sequential design for discovering level sets
In Bayesian experimental design, “sampling” often refers to adaptive data acquisition rather than posterior MCMC. Under input uncertainty, the Input-Uncertain Reliable Level-Set Estimation framework models the actual query point by 8 and defines the reliability
9
A pointwise credible interval
00
is formed around 01 using 02, and points are classified as reliable, unreliable, or uncertain according to whether 03, 04, or neither condition holds (Iwazaki et al., 2019). The acquisition function seeks the expected increase in the size of the reliably classified set, and the approximation 05 reduces the cost from 06 to 07. The same work proves an accuracy guarantee via Chebyshev’s inequality and finite-time termination with probability 08 under mild regularity and a vanishing randomization schedule with 09 (Iwazaki et al., 2019).
Posterior-sampling-based design adopts a simpler policy. In PS-BAX, one samples a function realization 10, forms the sampled super-level set
11
and then chooses
12
The final estimate is 13, and on a finite domain the method is asymptotically convergent under the complement-independence condition (Cheng et al., 2024).
High-dimensional level-set estimation replaces GP surrogates with Bayesian neural networks. For explicit LSE with threshold 14, the acquisition function is the mutual information
15
while for implicit LSE with threshold 16, where 17, the acquisition is
18
Their stated evaluation costs over 19 candidates are 20 and 21, respectively (Ha et al., 2020).
A common source of confusion is the relation between reliable and standard level-set estimation. The IU-rLSE formulation shows that when there is no input uncertainty, 22 and 23, so the method reduces to the usual GP-based LSE (Iwazaki et al., 2019).
6. Applications, empirical behavior, and limitations
The acoustic inverse medium-scattering study provides a representative function-space Bayesian level-set workflow. For a love-shaped obstacle with 24 and 25, a cross-shaped domain with 26 and 27, and two disjoint circles with 28 and 29, both regular Bayesian and level-set Bayesian methods recover the shape, but the level-set posterior mean shows a much sharper boundary or yields crisper interfaces (Huang et al., 2021). Trace-plots of 30 and selected coefficients are stationary after 31 steps, autocorrelation functions decay rapidly under pCN, and Gaussian noise with 32 produces mild widening of uncertainty belts while MAP and conditional-mean estimates remain accurate (Huang et al., 2021).
In the earlier geometric inverse-problem study, the same level-set methodology was demonstrated on an inverse potential problem and on discontinuous permeability in Darcy flow (Iglesias et al., 2015). The implementation used an 33 finite-difference grid, pCN chains of 34–35 steps, and tuning of 36 for 37 acceptance. A recurring observation was that the prior correlation length 38 or smoothness 39 markedly influences the posterior mean and variance, with a “critical” length-scale above which the main geometric features are accurately recovered and posterior variance localizes near interfaces (Iglesias et al., 2015). This indicates that prior length-scale selection is not a secondary implementation detail.
For quasi-concave density sampling, empirical comparisons were made against Gibbs sampling on a spike-and-slab mixture and a Cauchy–normal posterior (Foster et al., 2012). In the spike-and-slab example, Gibbs gets “stuck” in one component for 40, with expected switching time scaling like 41, whereas the level-set sampler explores both components in 42 slices. In the multivariate normal example with 43, Gibbs shows extremely slow ACF decay, whereas the exponentially tilted level-set sampler has ACF near zero after one step (Foster et al., 2012).
For point-source identification in the heat equation, Bayesian level-set sampling is paired with a thinning mechanism that removes statistically unsupported candidate points (Deng et al., 4 Sep 2025). On 44 with 45 relative Gaussian noise, the reported reconstruction errors for 46 are 47, 48, 49, and 50 in 51, with source number errors 52. The chains mix well under pCN with effective sample sizes 53 for 54-modes, removal of thinning greatly increases false positives, increasing prior smoothness slightly under-estimates 55 but maintains location accuracy, and the method tolerates up to 56 noise with 57-error increasing linearly (Deng et al., 4 Sep 2025).
In high-dimensional level-set estimation, Bayesian neural networks outperform several GP-based baselines on synthetic and real problems, but the empirical results are explicitly qualified: in low dimensions (58), standard GP-based LSE still has the edge, whereas a stated rule of thumb is that BNN-LSE wins when 59 (Ha et al., 2020). The same study reports that BNN plus hyperparameter tuning takes 60–61 h per experiment on GPUs, while GP methods with batch size 62 can exceed 63 h in high dimensions due to cubic scaling in data (Ha et al., 2020). This is a practical limitation rather than a purely statistical one.
The literature also distinguishes clearly between exact and approximate Bayesian constructions. Smoothed ABC targets a tolerance-thickened level set and converges to the true level-set posterior only as 64 (Edwards et al., 2024); Gauss–Newton Laplace methods approximate the posterior by a Gaussian around the MAP (Reese et al., 2021); exact level-set Cox-process inference avoids spatial discretization error by using retrospective sampling and a pseudo-marginal scheme (Gonçalves et al., 2020). A further misconception addressed directly by the function-space pCN literature is that level-set inference requires evolving a classical level-set PDE with an explicit velocity field. In the Bayesian formulation, the interface is updated implicitly by MCMC on the level-set function, and no explicit velocity field is required (Iglesias et al., 2015).
Taken together, these developments show that Bayesian level set sampling spans well-posed function-space inversion, exact and approximate posterior simulation, sequential design for threshold discovery, and density sampling through nested convex slices. The common structure is the use of threshold-defined geometry as the primary inferential object, with uncertainty represented by a posterior distribution rather than by a single reconstructed interface.