---
title: Capped-Interval Heuristic Overview
url: https://www.emergentmind.com/topics/capped-interval-heuristic
type: topic
---

# Capped-Interval Heuristic Overview

“Capped-interval heuristic” (Editor's term) designates a family of methods in which a cap or interval restriction is imposed first, and the resulting admissible set is then searched, projected onto, sampled from, or certified by a secondary rule. In the cited literature, the expression is not used uniformly: some works study literal capped intervals or box constraints, some cap the effect of interval uncertainty on regret, and some use interval geometry to classify nodes or candidate updates. This suggests a unifying interpretation in which a capped-interval heuristic is not a single algorithmic primitive but a recurrent structural pattern for enforcing feasibility, limiting uncertainty, or restricting search while retaining a tractable optimization or decision step [1503.01002, 1609.09179, 2606.22773, 2210.00653].

## 1. Taxonomy and common structure

Across the sources, the same schematic move recurs: define a bounded interval-like region, identify admissible states or candidates within it, and then optimize only over that restricted region or certify whole regions at once. In some papers the cap is literal, as in \(0 \le x_i \le 1\) or a payoff cap \(\epsilon\); in others it is operational, as when LP dual information “caps” regret, or node rectangles in corner space cap the possible coordinates of intervals. A plausible abstraction is that capped-interval heuristics convert a global problem into a bounded local decision rule whose correctness or usefulness derives from monotonicity, KKT structure, LP duality, or interval geometry [1503.01002, 1609.09179, 2606.22773, 2210.00653, 1707.00496, 1204.3119, 1609.07766].

| Context | Capped object | Operational rule |
|---|---|---|
| Capped simplex projection | \(0 \le x_i \le 1\), \(\sum_i x_i = s\) | sort, search \((a,b)\), compute \(\gamma\) |
| Interval min–max regret | interval costs \([l_i,u_i]\) | replace exact inner optimum by LP-dual lower bound |
| Disk interval indexes | node rectangles in corner space | classify nodes as must, may, or prune |
| Nonlinear Kaczmarz | capped index sets \(\mathcal U_k,\mathcal I_k\) | sample or block-update only inside the capped set |
| BPPC on interval graphs | bin capacity \(B\) | interval coloring, then TAIL-EXCHANGE and INSERTION |
| Capped optimal stopping | payoff cap \(\epsilon\) | stop when excursion exceeds \(g_\epsilon(\overline X_t)\) |
| Interval separation | movement threshold \(D\) | compare \(\delta_{\mathrm{opt}}\) with the cap |

The significance of this taxonomy is methodological rather than terminological. The papers do not define a single named framework, but they repeatedly exploit the same idea: once the feasible or relevant region has been “capped,” one can either derive an exact finite procedure, as in capped simplex projection, or obtain a compact heuristic surrogate, as in LP-based min–max regret and greedy capped Kaczmarz.

## 2. Projection-based feasibility restoration

The most literal capped-interval construction in the sources is Euclidean projection onto the capped simplex, defined by
\[
\min_{\mathbf{x}\in\mathbb{R}^D}\ \frac12\lVert \mathbf{x}-\mathbf{y}\rVert_2^2
\quad \text{s.t.}\quad
\sum_{i=1}^D x_i=s,\qquad 0\le x_i\le 1,\ i=1,\dots,D.
\]
The feasible set is the intersection of the unit cube \([0,1]^D\) and the hyperplane \(\{\mathbf{x}:\mathbf{x}^\top\mathbf{1}=s\}\), and the problem is a strictly convex quadratic program, hence the projection is unique. The paper derives an exact algorithm from the KKT conditions. After sorting \(\mathbf y\) in ascending order, the solution has three regimes,
\[
0=x_1=\dots=x_a < x_{a+1}\le \dots \le x_b < x_{b+1}=\dots=x_D=1,
\]
with some coordinates fixed at \(0\), some fixed at \(1\), and the remainder strictly interior. For the interior block, \(x_k=y_k+\gamma\), where
\[
\gamma=\frac{s+b-D-\sum_{k=a+1}^b y_k}{b-a},
\]
and \((a,b,\gamma)\) is validated by KKT-derived inequalities on \(y_a+\gamma\), \(y_{a+1}+\gamma\), \(y_b+\gamma\), and \(y_{b+1}+\gamma\). The implementation sorts once, precomputes partial sums \(T_k\), scans candidate \((a,b)\), and reconstructs the projected vector in sorted order before permuting back. The complexity is \(O(D^2)\) overall, with sorting \(O(D\log D)\), prefix sums \(O(D)\), and the nested search \(O(D^2)\) [1503.01002].

The same paper explicitly interprets this projection as a projected-gradient or proximal step. Given an unconstrained update \(\mathbf y^k=\mathbf x^k-\eta_k\nabla f(\mathbf x^k)\), the next iterate is
\[
\mathbf x^{k+1}=P_{\Delta_{\mathrm{cap}(s)}}(\mathbf y^k).
\]
In that sense, the capped-interval heuristic is exact rather than approximate: feasibility restoration is performed by a one-shot Euclidean projector onto box constraints plus a global sum constraint. The paper also notes that \(0\le \mathbf x\le 1\) generalizes to \(0\le \mathbf x\le t\) for any \(t>0\) by scaling, so the same mechanism covers non-unit caps.

## 3. Interval uncertainty and regret capping

A different use of the motif appears in interval data min–max regret combinatorial optimization. The deterministic problem is
\[
(\mathcal G)\quad \min cy \quad \text{s.t.}\quad Ay\ge b,\ y\in\{0,1\}^n,
\]
while the robust version allows interval costs \(c_i\in[l_i,u_i]\). For a feasible \(y\), the maximum regret occurs in the solution-induced scenario \(s(y)\), where \(c_i^{s(y)}=u_i\) if \(y_i=1\) and \(c_i^{s(y)}=l_i\) otherwise. The robust objective can therefore be written as
\[
\min_{y\in\Omega}\Big(c^{s(y)}y-\min_{x\in\Omega}c^{s(y)}x\Big).
\]
For interval robust-hard problems, the inner optimization is already NP-hard, and the standard exact formulation requires an exponential number of cuts, each separated by solving the classical NP-hard problem. The LP-based heuristic replaces the exact inner minimum by the optimal value \(\vartheta(y)\) of an LP relaxation and then embeds the dual constraints directly:
\[
(\hat{\mathcal R})\quad \min\ c^{s(y)}y-b^T\lambda-1^T\mu
\]
subject to \(y\in\Omega\), \(\lambda\ge 0\), \(\mu\le 0\), and \(A^T\lambda+I^T\mu\le (c^{s(y)})^T\). Because \(\vartheta(y)\le \min_{x\in\Omega}c^{s(y)}x\), this produces an upper bound on the true regret. The paper explicitly states that the heuristic “caps (bounds) the effect of interval uncertainty on regret” by substituting an LP lower bound for the exact inner optimum; if the classical problem has a totally unimodular constraint matrix and integer right-hand side, the bound is tight and the heuristic solution is optimal [1609.09179].

The framework is instantiated for the Restricted Robust Shortest Path and Robust Set Covering problems. In both cases, the workflow is: build a strong LP relaxation of the classical problem, derive its dual, construct a robust heuristic MILP with binary solution variables and continuous dual variables, solve that MILP once, and then compute the exact robustness cost of the final solution by solving one classical NP-hard instance. Computationally, this avoids the cut-generation regime of LB-Benders while improving markedly over the AMU 2-approximation. For R-RSP, the reported average gaps are approximately \(3.35\%\) versus \(6.65\%\) in one benchmark and approximately \(1.26\%\) versus \(4.69\%\) in another; on hard instances, the heuristic sometimes gives better upper bounds than LB-Benders within a \(3600\)s limit. For RSC, the heuristic always has lower average gaps than AMU and can even beat LB-Benders on the most challenging KZ instances when the exact method times out or stalls.

## 4. Geometric caps in temporal interval indexing

In temporal databases, the cap is geometric rather than algebraic. Intervals \(I_i=[t_s(i),t_e(i))\) are mapped to corner-space coordinates such as \((c,t_e)\), with \(c=(t_s+t_e)/2\), or \((d,t_e)\), with \(d=t_e-t_s\). Under the Increasing Ending Time assumption, the paper develops two disk-based indexes: CEB, organized by center and endpoint, and TIDE, organized by duration and endpoint. Both use a two-layer architecture in which a top B\(^+\)-tree partitions the \(c\)- or \(d\)-axis and each leaf points to a bottom B\(^+\)-tree on \(t_e\). Because insertions arrive in non-decreasing order of end time, both top and bottom trees are append-only. The central query-processing optimization is the distinction between nodes that “must contain results” and nodes that “may contain results.” Each data node has a capped region given by its key ranges, for example
\[
R(DN)=[key^{\min}_{top},key^{\max}_{top}] \times [key^{\min}_{te},key^{\max}_{te}],
\]
and range queries become regions in corner space bounded by a horizontal line and a slash or diagonal line. If the node rectangle lies entirely inside the query region, all records are reported directly; if it lies entirely outside, the node is pruned; otherwise its records are inspected individually. The paper explicitly identifies this must/may distinction as the essence of the capped-interval heuristic in this setting [2606.22773].

The IET assumption is structural. It makes bottom trees append-only, stabilizes \(key^{\max}_{te}\), and creates immutable nodes whose caps no longer change. That stability is what permits safe must-report and prune decisions. In CEB, the query region for \([q_s,q_e]\) is
\[
\mathcal Q_{CEB}=\{(c,t_e): t_e\ge q_s,\ 2c-t_e\le q_e\},
\]
while in TIDE the overlap condition becomes \(q_s\le t_e\le q_e+key^{\max}_{top}\) inside a bottom tree. The paper gives concrete node tests for both structures, including break conditions and must-report conditions based on \(key^{\min}_{te}\), \(key^{\max}_{te}\), \(key^{\min}_{top}\), and \(key^{\max}_{top}\). Empirically, CEB and TIDE outperform state-of-the-art competitors in index size and insertion speed, and TIDE is always faster in query processing, sometimes by orders of magnitude. The reported speedups are attributed largely to the ability to certify whole nodes geometrically rather than reading them from disk.

## 5. Adaptive capped candidate sets in iterative solvers

In greedy capped nonlinear Kaczmarz methods, the cap is imposed on the row-selection mechanism for solving \(f(x)=0\), where \(f:\mathbb R^n\to\mathbb R^m\) is continuously differentiable. The base update is the nonlinear Kaczmarz projection
\[
x_{k+1}=x_k-\frac{f_{i_k}(x_k)}{\|\nabla f_{i_k}(x_k)\|_2^2}\,\nabla f_{i_k}(x_k).
\]
The capped methods alter only the choice of \(i_k\). In DR-CNK, the threshold is
\[
\varepsilon_k=\frac12\left(\frac{1}{\|f(x_k)\|_2^2}\max_{i\in[m]}\bigl(|f_i(x_k)|^2\|\nabla f_i(x_k)\|_2^2\bigr)+\frac{1}{\|f'(x_k)\|_F^2}\right),
\]
and the eligible set is
\[
\mathcal U_k=\left\{i\in[m]: |f_i(x_k)|^2\ge \varepsilon_k\,\|f(x_k)\|_2^2\,\|\nabla f_i(x_k)\|_2^2\right\}.
\]
Sampling is then residual-weighted inside \(\mathcal U_k\). In RD-CNK, the threshold is
\[
\delta_k=\frac12\left(\frac{\max_{i\in[m]}|f_i(x_k)|^2}{\|f(x_k)\|_2^2}+\frac1m\right),
\]
with capped set
\[
\mathcal I_k=\left\{i\in[m]: |f_i(x_k)|^2\ge \delta_k\,\|f(x_k)\|_2^2\right\},
\]
and probabilities proportional to \(|f_i(x_k)|^2/\|\nabla f_i(x_k)\|_2^2\) inside \(\mathcal I_k\). The paper presents these as “two-level greedy” mechanisms: one rule defines the cap, and a second rule defines the probability distribution within the cap. Block variants DB-CNK and RB-CNK simply use the entire capped set as a block and update with a pseudoinverse step [2210.00653].

Under the local tangential cone condition and existence of a solution \(x_\star\) with \(f(x_\star)=0\), the paper proves expected linear convergence for DR-CNK and RD-CNK, and shows that their convergence factors satisfy
\[
\rho_{\mathrm{DR\text{-}CNK}}<\rho_{\mathrm{NRK}}=\rho_{\mathrm{NURK}},
\qquad
\rho_{\mathrm{RD\text{-}CNK}}<\rho_{\mathrm{NRK}}=\rho_{\mathrm{NURK}}.
\]
Thus the cap is not merely a filtering device; it improves the expected contraction factor by excluding low-impact rows. The numerical section reports large iteration reductions on the Brown almost linear function, including approximately \(4{,}780\to 755\) for a \(50\times 50\) problem and approximately \(199{,}400\to 4{,}992\) for a \(400\times 400\) problem, while DB-CNK and RB-CNK often converge in one block step on those tests. On regularized GLM instances, both single-sample and multi-sample capped methods outperform Kaczmarz-TCS and Block TCS in iteration counts and CPU time.

## 6. Interval-structured local search and motion capping

For the Bin Packing Problem with Conflicts on interval graphs, the cap is the bin capacity \(B\), while conflicts are induced by interval overlap. The heuristic BN exploits interval-graph structure via a leftmost maximum clique \(C\) and its associated coordinate \(T\). Phase I builds a coloring with \(z=X=\max\{\mathrm{LB}_{\mathrm{BP}},\omega(G)\}\) subsets, assigning each interval of \(C\) to a different subset, then processing intervals left of \(T\) by decreasing right endpoint and intervals right of \(T\) by increasing left endpoint. On the left side, the chosen subset minimizes
\[
W(V_i)+\mathrm{West}(V_i),
\]
where \(\mathrm{West}(V_i)=u\cdot(R-R_i)\) estimates the weight of empty space to the right of color \(V_i\). Phase II restores capacity feasibility by TAIL-EXCHANGE, which swaps interval tails at a coordinate \(p\) between a heavy and a light subset, and INSERTION, which moves an interval \(I_j\) from a heavy subset into a light subset, a heavy subset, or a new subset, with the explicit goal of making the recipient as full as possible without exceeding \(B\). The total complexity is \(O(n^3)\). Over \(40{,}000\) instances, BN typically outperforms the adapted M heuristics for large bins, while M shows better or similar performance for small bins [1707.00496].

A movement-capped variant arises in interval separation on a line. The exact problem is to move intervals so that no two overlap while minimizing the maximum moving distance. The paper reduces the two-direction problem to a one-direction problem: if \(\delta_{\mathrm{opt}}\) is the optimal rightward max-displacement, then an optimal two-direction solution is obtained by shifting every interval in the one-direction optimum left by \(\delta_{\mathrm{opt}}/2\). The key combinatorial object is an optimal list \(L_{\mathrm{opt}}\), and once such an order is known, the left-possible placement strategy yields the optimal configuration in \(O(n)\) time. The hard part is order selection. The paper shows that it is sufficient to maintain at most \(n\) candidate lists, prune dominated lists using exchange arguments and dominance lemmas, and compute an optimal solution in \(O(n\log n)\) time and \(O(n)\) space, which matches an \(\Omega(n\log n)\) lower bound. This suggests a capped-interval interpretation in which a displacement threshold \(D\) can be tested by computing \(\delta_{\mathrm{opt}}\) and checking whether \(\delta_{\mathrm{opt}}\le D\), while the candidate-list logic also provides a template for simpler capped movement heuristics based on local order updates and pruning [1609.07766].

## 7. Capped stopping regions in stochastic control

In capped optimal stopping for the running maximum of a spectrally negative Lévy process \(X\), the cap acts directly on the payoff. With running maximum
\[
\overline X_t:= s\vee \sup_{0\le u\le t}X_u,
\]
the value function is
\[
V_\epsilon^*(x,s)
=
\sup_{\tau\in\mathcal M}
\mathbb E_{x,s}\!\left[e^{-q\tau}\big(e^{\overline X_\tau\wedge \epsilon}-K\big)^+\right].
\]
The cap \(\epsilon\) has two structural consequences stated explicitly in the paper: once the running maximum hits \(\epsilon\), the spatial component of the payoff is frozen at \(e^\epsilon-K\), and because of discounting there is then no upside from waiting. The optimal rule is excursion-based: stop when the excursion below the current maximum is too deep,
\[
\tau_{g_\epsilon}
=
\inf\left\{t\ge 0:\ \overline X_t-X_t\ge g_\epsilon(\overline X_t)\ \text{and}\ \overline X_t>\log K\right\},
\]
so the continuation interval at level \(s\) is \(x\in (s-g_\epsilon(s),s)\). The boundary \(g_\epsilon\) is characterized by the ODE
\[
g_\epsilon'(s)=
1-
\frac{e^s Z^{(q)}(g_\epsilon(s))}
{(e^s-K)\,q\,W^{(q)}(g_\epsilon(s))},
\qquad s\in(\log K,\epsilon),
\]
with \(\lim_{s\uparrow\epsilon}g_\epsilon(s)=0\). The paper further shows that the slope near the cap depends on whether \(X\) has bounded or unbounded variation, and reformulates the solution through a version of Peskir’s maximality principle: among solutions of the ODE, the relevant boundary is the minimal one in the excursion-depth parameterization [1204.3119].

As a synthesis, this is the most literal state-space version of the capped-interval heuristic. For each running-maximum level \(s\), the method defines a continuation interval in the state variable \(x\); the interval shrinks to zero at the cap; and stopping occurs when the process exits that interval from below. The same high-level logic reappears, with different technical machinery, in the other domains surveyed here: KKT projection onto capped boxes, LP-dual capping of interval regret, node-rectangle certification in interval indexes, capped candidate sets in nonlinear Kaczmarz, and interval-structured local search under a bin-cap or movement cap. The common theme is that a cap converts an unconstrained or globally coupled problem into a bounded decision geometry, and the heuristic or exact method derives its power from exploiting the resulting structure rather than from generic optimization alone.

Source: https://www.emergentmind.com/topics/capped-interval-heuristic