Papers
Topics
Authors
Recent
Search
2000 character limit reached

Vertical Weighted Strips (VWS)

Updated 12 July 2026
  • Vertical Weighted Strips (VWS) is a rejection-sampling framework for weighted densities f(x) ∝ w(x)g(x), enabling stratified proposals with explicit rejection probability bounds.
  • The method partitions the support into regions, upper-bounds the weight function on each strip, and constructs a finite mixture proposal that is both sampleable and efficient.
  • VWS extends classical vertical strip methods by incorporating nonuniform base densities and adaptive refinement strategies, including self-tuning for repeated sampling applications.

Searching arXiv for the VWS papers and related follow-up work. Vertical Weighted Strips (VWS) is a rejection-sampling framework for target distributions that can be written as weighted densities, that is, densities of the form f(x)w(x)g(x)f(x)\propto w(x)g(x) where gg is a normalized base density and ww is a nonnegative weight function. The method constructs a finite mixture proposal by partitioning the support into regions and majorizing the weight function on each region, so that the proposal remains convenient to sample from while admitting an explicit upper bound on the rejection probability before sampling begins. In the formulation introduced in “Rejection Sampling with Vertical Weighted Strips” (Raim et al., 2024), VWS is particularly relevant when the normalizing constant ψ\psi is intractable and when assumptions required by adaptive rejection sampling and related methods are not met.

1. Weighted-density formulation and problem setting

VWS is built for targets whose possibly unnormalized density has the weighted form

f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),

where Ω\Omega is the support, ν\nu is a dominating measure, g(x)g(x) is a normalized base density, w(x)0w(x)\ge 0 is a weight function, and ψ\psi is the normalizing constant (Raim et al., 2024). In this setting, gg0 is assumed evaluable and sampleable, while gg1 is nonnegative and finite on the relevant support. For the univariate analysis, gg2 is partitioned into intervals gg3 (Raim et al., 2024).

The central computational difficulty is that generating variates from gg4 may be nontrivial even when gg5 is simple, because the weight function may be complicated and gg6 may be intractable. Classical rejection sampling remains applicable in principle, but it requires a proposal that both dominates the target and is practically sampleable. VWS exploits the factorization gg7 so that proposal design focuses on bounding the weight function rather than the full target density (Raim et al., 2024).

This formulation also clarifies the scope of the method. Some VWS constructions use only boundedness of gg8, whereas others use stripwise log-convexity or log-concavity of gg9 to obtain sharper majorizers (Raim et al., 2024). A plausible implication is that the method separates structural information about the target into a tractable base ww0 and a localized envelope problem for ww1.

2. Proposal construction by stripwise majorization

The defining step in VWS is the choice of a majorizing function ww2 and the induced proposal

ww3

Because ww4, the rejection-sampling constant can be taken as ww5 (Raim et al., 2024). This is the basic simplification that drives the framework.

To improve efficiency, the support is partitioned into disjoint regions

ww6

and each region is assigned a strip-specific majorizer ww7 satisfying

ww8

The global majorizer is then

ww9

with

ψ\psi0

If ψ\psi1, the strip integrals are

ψ\psi2

and

ψ\psi3

(Raim et al., 2024).

The proposal density therefore admits the finite-mixture representation

ψ\psi4

with mixture weights

ψ\psi5

and strip components

ψ\psi6

Each component is the base distribution ψ\psi7, truncated to ψ\psi8 and reweighted by ψ\psi9 (Raim et al., 2024).

The terminology “vertical weighted strips” is explained geometrically in the original paper. In classical vertical strip methods one partitions the horizontal axis and uses vertical bounds on the density; here one partitions the support into horizontal regions f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),0 and bounds the weight f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),1 vertically by a constant or a linear function in f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),2, while retaining the base density f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),3 (Raim et al., 2024).

3. Rejection-sampling algorithm and efficiency criteria

Under the VWS envelope f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),4, the rejection sampler proceeds by drawing f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),5, then f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),6, and accepting if

f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),7

Since f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),8, the acceptance probability is

f(x)=f0(x)ψ,f0(x)=w(x)g(x),ψ=Ωf0(x)dν(x),f(x) = \frac{f_0(x)}{\psi},\qquad f_0(x) = w(x)\,g(x),\qquad \psi = \int_\Omega f_0(x)\,d\nu(x),9

and the expected number of proposals per accepted draw is Ω\Omega0 (Raim et al., 2024).

Sampling from the proposal requires sampling from the finite mixture. One first draws a strip index Ω\Omega1 with Ω\Omega2, then samples

Ω\Omega3

The paper identifies three implementation routes: drawing from Ω\Omega4 and conditioning when that is easy, exploiting analytic forms such as exponential-family structure, or using inverse CDF within each strip through

Ω\Omega5

and the mixture CDF Ω\Omega6 (Raim et al., 2024). In many examples, including exponential-family and uniform bases, the necessary integrals and inverses are available in closed form (Raim et al., 2024).

Because Ω\Omega7 is often unavailable, VWS emphasizes computable efficiency diagnostics. For each strip one may define a minorizer Ω\Omega8 with

Ω\Omega9

and

ν\nu0

Then the rejection probability satisfies

ν\nu1

If the trivial minorizer ν\nu2 is used, the bound equals the true rejection probability (Raim et al., 2024).

The same quantity controls approximation error. Proposition 2 in the original paper shows that if ν\nu3 and ν\nu4, then for any measurable set ν\nu5,

ν\nu6

so a small rejection bound implies that the proposal is also close to the target in total variation (Raim et al., 2024). This suggests that VWS serves both as an exact-sampling device and as a controlled approximation framework.

4. Partitioning, majorizers, and adaptive bifurcation

The efficiency of VWS depends strongly on the partition ν\nu7. The original paper proposes an adaptive bifurcation scheme based on each region’s contribution to the rejection bound. For a partition with ν\nu8 regions, the contribution of region ν\nu9 is

g(x)g(x)0

and g(x)g(x)1 equals the computable upper bound on the rejection probability (Raim et al., 2024).

The bifurcation strategy starts from a coarse partition, often a single region. At each refinement step, it draws a region index with probability proportional to g(x)g(x)2, splits that region at a midpoint, and recomputes g(x)g(x)3, g(x)g(x)4, and g(x)g(x)5. The process continues until a desired number of regions is reached or the rejection bound falls below a target threshold (Raim et al., 2024). The continuous-case midpoint rules in the paper explicitly cover finite endpoints, doubly infinite intervals, and one-sided infinite intervals (Raim et al., 2024).

Two stripwise envelope families are emphasized. In constant VWS, one uses

g(x)g(x)6

which requires only boundedness of g(x)g(x)7 on each strip (Raim et al., 2024). In linear VWS, one works on the log scale and uses a majorizer of the form

g(x)g(x)8

with a corresponding minorizer based on an endpoint chord or another tangent, depending on convexity (Raim et al., 2024). The linear construction is available when g(x)g(x)9 is log-convex or log-concave on each strip and is especially effective when w(x)0w(x)\ge 00 belongs to an exponential family, because the resulting components remain analytically sampleable (Raim et al., 2024).

The paper treats the refinement problem as heuristic rather than globally optimal. It states that minimizing w(x)0w(x)\ge 01 over partitions and majorizers leads to more efficient samplers, but exact optimal partitions are not derived (Raim et al., 2024). A plausible implication is that VWS trades formal optimality for envelope constructions that remain explicit and implementable.

5. Relation to rejection-sampling literature

VWS is positioned relative to several established proposal-construction paradigms. Standard rejection sampling often selects simple envelopes such as uniform or exponential distributions without exploiting the weighted factorization w(x)0w(x)\ge 02. VWS instead focuses on majorizing the weight w(x)0w(x)\ge 03 while retaining the tractable base w(x)0w(x)\ge 04, which can be more efficient when w(x)0w(x)\ge 05 is already close to the target (Raim et al., 2024).

The method also generalizes classical vertical strips. In the bounded-support case, standard vertical strips correspond to taking w(x)0w(x)\ge 06 uniform on w(x)0w(x)\ge 07, w(x)0w(x)\ge 08, and stripwise majorizers and minorizers given by the maximum and minimum of w(x)0w(x)\ge 09 on each strip. VWS extends this by allowing nonuniform bases and by working with ψ\psi0 rather than the full target density (Raim et al., 2024).

Compared with Adaptive Rejection Sampling (ARS) and its variants, the distinction is structural. ARS requires the log of the target to be concave, while ARMS relaxes this at the cost of a Metropolis step and Markov dependence. VWS does not require log-concavity of the target ψ\psi1 itself; it only needs log-convexity or log-concavity of the weight function ψ\psi2 on strips when linear majorizers are used, and constant majorizers require only boundedness. It produces i.i.d. exact samples rather than a Markov chain and provides a pre-sampling bound on rejection probability (Raim et al., 2024).

The original paper also compares VWS with direct sampling methods based on auxiliary variables. Raim’s 2023 direct-sampling formulation is described there as viewable as a special case of VWS where the auxiliary density is majorized by a step function. The comparison given is that VWS works directly on ψ\psi3, whereas direct sampling reformulates the problem through an auxiliary variable on ψ\psi4, with possible numerical difficulties when the auxiliary distribution is extremely concentrated (Raim et al., 2024).

A common misconception is that VWS is merely a restatement of generic rejection sampling. The distinctive feature is not the acceptance-rejection step itself, but the stripwise construction of a finite-mixture proposal through majorization of ψ\psi5, together with the computable bound on rejection probability before sampling (Raim et al., 2024).

6. von Mises–Fisher examples and practical implementation

The main applications in the original paper are based on the von Mises–Fisher (VMF) distribution. After transformation to a univariate coordinate ψ\psi6, the target density becomes

ψ\psi7

and the paper uses the decomposition

ψ\psi8

so that ψ\psi9 is a doubly truncated exponential (Raim et al., 2024). On gg00, gg01, and its second derivative shows that gg02 is log-concave for gg03, log-convex for gg04, and constant for gg05 (Raim et al., 2024). This makes the example particularly suitable for comparing constant and linear VWS.

For constant VWS, the strip majorizer is gg06 and the minorizer is gg07, so each strip component is simply the truncated base gg08 on that interval (Raim et al., 2024). For linear VWS, the log-weight is bounded by a tangent line, and because gg09 is exponential-family form, each mixture component becomes a truncated exponential with parameter gg10, from which sampling is analytic via inverse CDF (Raim et al., 2024).

The paper reports that for moderately fine partitions such as gg11, linear VWS achieves rejection rates substantially lower than vertical strips and constant VWS, and that with gg12 up to 100, linear VWS often yields extremely low rejection probabilities, for example well below gg13, even at high gg14 and dimension gg15, outperforming the Ulrich–Wood VMF sampler in some regimes (Raim et al., 2024). It recommends constant VWS when ease of implementation is primary and linear VWS when gg16 is log-convex or log-concave and gg17 is exponential-family-like (Raim et al., 2024).

The implementation guidance given in the paper is procedural. One chooses a factorization gg18, picks gg19 close to gg20 and convenient to sample from, partitions the support, constructs constant or linear majorizers and minorizers, computes gg21 and gg22, evaluates the rejection bound, and then samples from the mixture proposal and accepts with probability gg23 (Raim et al., 2024). The paper also lists practical pitfalls: infinite or unbounded weights near support edges, numerical instability in gg24 or Bessel functions, and excessive region counts. Suggested remedies include slight support truncation, working on the log scale, using scaled special functions, and moderating refinement when VWS is embedded in Gibbs samplers (Raim et al., 2024).

7. Subsequent development: self-tuned VWS within Gibbs

A later development revisits the method for repeated conditional simulation in Gibbs samplers. “Self-Tuned Rejection Sampling within Gibbs and a Case Study in Small Area Estimation” (Raim et al., 21 Sep 2025) considers univariate conditionals that can be written as weighted densities and maintains persistent VWS proposals that tune themselves gradually instead of rebuilding a new proposal from scratch for each conditional draw.

In that follow-up formulation, constant VWS is used with stripwise piecewise-constant majorizers and minorizers, and the same rejection-bound quantity

gg25

governs refinement (Raim et al., 21 Sep 2025). The paper introduces a self-tuning rule in which rejected points can be added as new knots when the bound is too crude, while strips with sufficiently small contribution can be removed when coarsening does not push the bound above a threshold (Raim et al., 21 Sep 2025). This extends VWS from a single-target proposal-construction method to a persistent proposal mechanism inside Gibbs.

The case study concerns a Bayesian small area estimation model in which the unfamiliar conditional for gg26 is proportional to an inverse-gamma density times a lognormal density, so that

gg27

There, self-tuned VWS is used to obtain exact draws within Gibbs while controlling proposal-maintenance cost (Raim et al., 21 Sep 2025). The paper reports that self-tuned VWS is much cheaper than rebuilding proposals repeatedly, yet markedly improves mixing relative to an independent Metropolis–Hastings step for the same conditional family (Raim et al., 21 Sep 2025).

This follow-up work suggests an important interpretation of VWS. The original method is a finite-mixture rejection-sampling design for weighted densities (Raim et al., 2024); the later extension shows that the same design can be made persistent and adaptive in repeated-sampling contexts without changing its exact-draw character (Raim et al., 21 Sep 2025).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Vertical Weighted Strips (VWS).