---
title: Submodular Knapsack Problem
url: https://www.emergentmind.com/topics/submodular-knapsack-problem
type: topic
---

# Submodular Knapsack Problem

The **Submodular Knapsack Problem**, also called **Budgeted Submodular Maximization**, is the problem of maximizing a submodular set function under a budget constraint. In its classical single-knapsack form, one is given a ground set \(V\), a non-negative monotone submodular function \(f:2^V\to \mathbb{R}\), positive costs \(c(v)\), and a budget \(B\), and seeks
\[
\max_{S\subseteq V,\; c(S)\le B} f(S),
\qquad
c(S)=\sum_{v\in S} c(v).
\]
Broader formulations allow any non-negative submodular function and a fixed constant number \(d\) of knapsack constraints, so that feasibility requires \(\sum_{i\in S} c_r(i)\le L_r\) for every dimension \(r\) [2007.04937][1101.2940]. For monotone objectives, the subject is organized around the classic \(1-1/e\) approximation barrier: even for maximum coverage, and therefore for monotone submodular maximization in the oracle model, no algorithm can surpass \(1-1/e\) unless \(P=NP\) [1705.06319].

## 1. Formal problem and core notions

The standard formulation assumes a finite universe \(U\) or \(V\), oracle access to a set function \(f\), and a knapsack feasibility condition expressed by additive costs. In the single-knapsack setting, the feasible family is
\[
\{S\subseteq U : \sum_{u\in S} c_u \le B\},
\]
while the more general **SUB** formulation under \(d\) knapsack constraints is
\[
\max\{ f(S) : S\subseteq U,\; \sum_{i\in S} c_r(i)\le L_r \;\; \forall r=1,\dots,d \}.
\]
This formulation is explicitly studied for non-negative submodular functions, with monotone and non-monotone cases treated separately [1101.2940].

Submodularity is used in the standard diminishing-returns sense. In marginal notation, if \(S\subseteq T\subseteq A\) and \(i\notin T\), then
\[
v(i\,|\,S)\ge v(i\,|\,T),
\]
or equivalently,
\[
f(S)+f(T)\ge f(S\cup T)+f(S\cap T).
\]
Monotonicity means \(f(S)\le f(T)\) whenever \(S\subseteq T\). In the monotone regime, many covering, facility-location, and influence-maximization objectives fall into the model; in the non-monotone regime, standard examples include cut functions [1910.05646][1101.2940].

The terminology is not uniform across the literature. One source states explicitly that **Submodular Knapsack Problem** and **Budgeted Submodular Maximization** are used interchangeably for maximizing a non-negative monotone submodular function subject to a single knapsack constraint [2007.04937]. Other works use **SKP** for the same task, especially in the context of exact optimization [2507.11107].

## 2. Approximation thresholds and representative guarantees

The monotone single-knapsack problem is governed by the \(1-1/e\) benchmark. Sviridenko’s classical three-guess greedy method achieves this optimal ratio, and later work shows that two guesses already suffice: **2-Guess \(\mathbf{PG}\)** achieves approximation ratio \(\alpha=1-1/e\approx 0.632\), while **1-Guess \(\mathbf{GP}\)** attains
\[
\frac{3-\ln 4}{4-\ln 4}>0.6174>0.9767\,\alpha
\]
with lower running time [2007.04937]. For fixed constant \(d\), the broader \(d\)-knapsack monotone problem admits a randomized \((1-e^{-1}-\varepsilon)\)-approximation, and also a deterministic \((1-e^{-1}-\varepsilon)\)-approximation assuming the multilinear extension \(F\) can be evaluated deterministically [1101.2940].

For non-monotone objectives, the guarantees are weaker but still constant in several settings. Under a fixed constant number \(d\) of knapsack constraints, the continuous-to-discrete reduction of [1101.2940] yields a randomized \((1/4-\varepsilon)\)-approximation, and also a deterministic \((1/4-\varepsilon)\)-approximation assuming oracle access to \(F\). For a single knapsack and possibly non-monotone objectives, a simple randomized greedy algorithm achieves a \((3+2\sqrt{2})\)-approximation, i.e. a **5.83-approximation**, with a lazy version giving \((3+2\sqrt{2}+\varepsilon)\) using
\[
O\bigl(n\varepsilon^{-1}\log(n/\varepsilon)\bigr)
\]
oracle calls [2007.05014].

Representative guarantees appearing in the sources are summarized below.

| Setting | Guarantee | Representative source |
|---|---:|---|
| Monotone, single knapsack | \(1-1/e\) | [2007.04937] |
| Monotone, fixed \(d\) knapsacks | \(1-e^{-1}-\varepsilon\) | [1101.2940] |
| Non-monotone, fixed \(d\) knapsacks | \(1/4-\varepsilon\) | [1101.2940] |
| Monotone, knapsack + one matroid | \((1-e^{-2})/2\) | [1705.06319] |
| Monotone, multiple knapsack | \(1-e^{-1}-\varepsilon\) | [2004.12224][2003.11450] |

These guarantees illustrate a recurring structural distinction. The \(1-1/e\) threshold is essentially optimal for several monotone knapsack families, whereas extensions involving additional combinatorial structure, generalized objective classes, or adaptivity often trade approximation quality for simpler combinatorial methods, stronger robustness properties, or broader modeling power.

## 3. Greedy, local-search, and combinatorial paradigms

A central algorithmic pattern is **marginal density greedy**, which selects items according to
\[
\frac{f(v\mid S)}{c(v)}.
\]
This rule underlies many classical and modern methods, but the literature is explicit that the plain density-based greedy rule is not sufficient by itself. One source states that plain Greedy does **not** guarantee any approximation for knapsack, and another that the plain density-based greedy algorithm is **not** guaranteed a constant ratio by itself [1910.05646][2007.04937]. This is a common source of confusion because the same rule is optimal for several simpler constraints.

A simple but influential correction is to augment greedy prefixes with a single additional item. The **“Bring Your Own Greedy” + Max** framework returns the best set of the form \(G_i\cup\{s_i\}\), where \(G_i\) is a greedy prefix and \(s_i\) is the best remaining fitting item. In the offline setting, **Greedy+Max** gives a \(1/2\)-approximation for monotone submodular maximization under a knapsack constraint; streaming and distributed instantiations, **Sieve+Max** and **Distributed+Max**, achieve \((1/2-\epsilon)\)-approximation with near-optimal resource parameters [1910.05646].

Another line keeps the greedy core but adds limited enumeration. In **Practical Budgeted Submodular Maximization**, the algorithmic templates **2-Guess \(\mathbf{PG}\)** and **1-Guess \(\mathbf{GP}\)** show that fewer guesses than in Sviridenko’s original method suffice to approach or match the optimal monotone ratio. The same source sharpens the analysis of the simpler greedy-plus-singleton rule \(\mathbf{Gr}\), placing its approximation ratio in the interval
\[
0.427 \le \text{ratio} \le 0.462
\]
and thereby distinguishing it sharply from the optimal \(1-1/e\) frontier [2007.04937].

For knapsack combined with matroid structure, greedy is often embedded in local search. The algorithm of **“Constrained Submodular Maximization via Greedy Local Search”** begins by guessing two seed elements \(Y=\{u_1,u_2\}\), then repeatedly performs feasibility-preserving swaps chosen by maximum profit density
\[
\rho_{(x,y)}=\frac{f((S\setminus\{y\})\cup\{x\})-f(S)}{c_x},
\]
or a \(k\)-swap analogue under \(k\) matroids. For a single knapsack plus one matroid, this yields the combinatorial ratio
\[
\frac{1-e^{-2}}{2}\approx 0.432,
\]
and for a single knapsack plus the intersection of \(k\) matroids, the guarantee becomes
\[
\frac{1-e^{-(k+1)}}{k+1}.
\]
Polynomial termination is enforced by accepting only multiplicative improvements of factor \(1+\epsilon/n^2\), leading to running times \(\tilde O(n^6)\) for one matroid and \(\tilde O(n^{k+5})\) for fixed \(k\) [1705.06319].

For non-monotone single-knapsack optimization, the combinatorial emphasis shifts to randomization. **SampleGreedy** samples items with probability \(p\), runs density greedy on the sample, and returns the better of the greedy set and the best singleton. With \(p=\sqrt{2}-1\), the method is a \((3+2\sqrt{2})\)-approximation; its robustness further supports an adaptive extension, **AdaptiveGreedy**, which is a \(9\)-approximation to the best adaptive policy in the corresponding stochastic setting [2007.05014].

## 4. Continuous relaxations, near-linear algorithms, and curvature

A major conceptual development is the passage from the discrete problem to a continuous relaxation through **extension by expectation**, also called the **multilinear extension** in many later works. For \(\bar y\in[0,1]^U\), let \(R\sim \bar y\) denote the random subset obtained by including each element independently with probability \(y_i\), and define
\[
F(\bar y)=\mathbb{E}[f(R)].
\]
The natural relaxation for \(d\) knapsack constraints is
\[
\max \{F(\bar y): \bar y\in P\}, \qquad
P=\left\{\bar y\in [0,1]^U:\sum_{i\in U} y_i c_r(i)\le L_r\;\; \forall r\right\}.
\]
The central theorem of [1101.2940] states that if there is a polynomial-time \(\alpha\)-approximation algorithm for this continuous relaxation, then for any \(\varepsilon>0\) there is a randomized polynomial-time \((\alpha-\varepsilon)\)-approximation algorithm for the discrete SUB problem; if \(F\) can be evaluated deterministically, a deterministic \((\alpha-\varepsilon)\)-approximation follows as well. This reduction is the main reason that continuous methods dominate the near-optimal approximation landscape.

The difficulty is computational. Standard multilinear-extension frameworks typically encounter an \(\Omega(n^2)\) bottleneck because evaluating \(F(x)\) is expensive. **“A Nearly-linear Time Algorithm for Submodular Maximization with a Knapsack Constraint”** breaks this bottleneck by maintaining a fractional solution with only
\[
O(1/\epsilon^4)
\]
strictly fractional entries. This makes exact evaluation of the multilinear extension combinatorially cheap on the fractional support and leads to a \(1-1/e-\epsilon\) approximation using
\[
(1/\epsilon)^{O(1/\epsilon^4)} n \log n
\]
function evaluations and
\[
(1/\epsilon)^{O(1/\epsilon^4)} n \log^2 n
\]
arithmetic operations [1709.09767]. The result is explicitly described as theoretically interesting rather than practical, but it shows that near-linear dependence on \(n\) is possible without abandoning the continuous paradigm.

A separate structural refinement uses **curvature**. For a monotone submodular function \(f\), total curvature is defined as
\[
c_f = 1-\min_{e\in E}\frac{f_{E-e}(e)}{f(e)}.
\]
Under a single knapsack constraint, there exists a polynomial-time algorithm with approximation ratio
\[
1-\frac{c_f}{e}-\epsilon,
\]
and this ratio is tight up to \(\epsilon\) for every \(c_f\in[0,1]\) [1607.04527]. When \(c_f=1\), the guarantee matches the standard \(1-1/e\) barrier; when \(c_f=0\), it approaches \(1\), consistent with the modular case. This suggests a more refined taxonomy than the usual monotone/non-monotone dichotomy: the effective approximability of the knapsack problem depends not only on submodularity, but also on how far the objective is from linearity.

## 5. Generalizations: multiple knapsacks, matroids, fairness, adaptivity, and generalized objective classes

The classical single-knapsack model has been extended in several orthogonal directions. One axis concerns **additional constraints**. For a single knapsack combined with matroid independence, greedy local search yields \((1-e^{-2})/2\), and for a single knapsack plus the intersection of \(k\) matroids it yields \((1-e^{-(k+1)})/(k+1)\) [1705.06319]. Another axis concerns **multiple knapsacks**. The monotone submodular multiple knapsack problem admits a randomized \((1-e^{-1}-\varepsilon)\)-approximation via structuring, leveled bins, continuous greedy, and rounding [2004.12224], and also a deterministic combinatorial \((1-e^{-1}-\varepsilon)\)-approximation based on greedy density packing, large-element enumeration, reserved bins, and blockwise iterative packing [2003.11450].

A different family of extensions changes the objective class rather than the feasibility family. For **monotone \(k\)-submodular** objectives under a knapsack constraint, a deterministic algorithm based on Sviridenko’s philosophy was originally claimed to achieve
\[
\left(\frac12-\frac{1}{2e}\right)\approx 0.316
\]
with \(O(n^4k^3)\) function evaluations; a corrigendum notes that the same algorithm can in fact be analyzed to give a stronger \(0.4\)-approximation [2105.15159]. On **finite distributive lattices**, where feasible solutions are ideals of a poset and knapsack costs are required to be order-consistent, a generalized continuous greedy algorithm on the **median complex** yields a \((1-\epsilon)(1-1/e)\) approximation for multiple knapsack-constrained monotone DR-submodular maximization [1907.04279].

Recent work also adds **fairness** constraints. In **Fair Knapsack-constrained Submodular Maximization**, each element has a weight and a color, and the selected set must satisfy both a knapsack constraint and per-group lower and upper bounds. When the number of colors is constant, there is a polynomial-time algorithm achieving
\[
\frac12\left(1-\frac1e\right)-\epsilon
\]
with probability at least
\[
1-\frac1e-\frac1{e^2},
\]
while relaxing either the knapsack or fairness constraint to expected satisfaction yields the tight \((1-1/e-\epsilon)\) ratio in expectation [2505.12126]. The same paper notes that the general case with many groups remains open.

Adaptive, uncertain-capacity, and stochastic formulations move beyond static feasibility. For **non-monotone adaptive submodular maximization** under a knapsack constraint, a sampling-based randomized policy achieves a \(1/10\) approximation without assuming pointwise submodularity; the paper presents this as the first constant-factor approximation for that knapsack setting under adaptive submodularity alone [2104.04853]. When the knapsack capacity is unknown and only feasibility feedback is available, a randomized adaptive policy with cancellation allowed achieves robustness ratio \((1-1/e)/2\), a deterministic adaptive policy achieves \(2(1-1/e)/21\), and a randomized universal policy achieves \((1-1/\sqrt[4]{e})/2\); without cancellation, no randomized adaptive policy achieves a constant robustness ratio [1803.02565]. A curvature-sensitive refinement for the unknown-capacity setting gives robustness factor
\[
\alpha(c)=\frac{1-x}{2-(2-c)x},
\]
where \(x\) is the unique root of
\[
\frac{1}{c}\bigl(1-e^{-cz}\bigr)=\frac{1-z}{2-(2-c)z};
\]
at the extremes, this yields \(1/2\) for \(c=0\) and approximately \(0.3578\) for \(c=1\) [2209.09668].

Stochasticity can also enter through item realizations. For the correlated stochastic knapsack problem with a lattice-submodular objective and optional partition-matroid side constraints, a pseudo-polynomial-time algorithm based on stochastic continuous greedy and a new contention-resolution-compatible rounding scheme achieves
\[
\frac{1-1/\sqrt e}{2}\simeq 0.1967,
\]
improving on the \((1-1/\sqrt[4]{e})/2\simeq 0.1106\) approximation reported for the earlier model [2207.01551]. These variants show that the phrase “Submodular Knapsack Problem” now denotes not a single isolated model, but a family of optimization problems sharing a budget structure and a diminishing-returns objective.

## 6. Exact optimization and contemporary solver design

Although the dominant literature is approximation-oriented, recent work has revived **exact optimization** for monotone submodular knapsack. Two 2025 papers develop branch-and-bound solvers tailored specifically to SKP. The first proposes an exact depth-first branch-and-bound method built around a greedy primal heuristic, a novel **refined subset upper bound**, and a **dual branching** strategy. At a node \(T=(S_T,C_T,W_T)\), the refined bound minimizes a fractional-knapsack-style upper bound over intermediate greedy subsets \(X_i\), producing a bound \(ub_{rs}\) that is at least as tight as the usual fractional knapsack bound and that can be computed in
\[
O(|C_T|^2(T(f)+\log |C_T|))
\]
time. The same work proves a worst-case tightness guarantee using Wolsey’s lemma and reports that the variant **dual-rs** is the best overall performer, with dual branching providing about a **2× speedup on average** [2507.11107].

A second exact line studies a depth-first branch-and-bound framework with three acceleration techniques: **Lazy Evaluations**, **Early Pruning**, and **Candidate Reduction**. The core upper bound is the fractional knapsack relaxation
\[
\fkh(S,J)=f(S)+l(S,J),
\]
and the strongest empirical variant combines lazy evaluations with candidate reduction in the solver **LECR**. The same source also examines a tighter bound \(\kv\) obtained by solving the inner knapsack subproblem exactly, but concludes empirically that the stronger bound is too expensive in practice; the structural accelerations are more effective than replacing the relaxation by an exact integer knapsack computation at every node [2507.16149].

These exact methods do not alter the NP-hardness of the problem or the approximation barrier for polynomial-time algorithms, but they shift the practical discussion. Approximation guarantees remain central when scale dominates, yet the exact-solvers literature emphasizes settings in which approximate solutions are not sufficient in practice, including facility location and risk-sensitive decision-making [2507.11107][2507.16149]. A plausible implication is that the contemporary theory of the Submodular Knapsack Problem now has two mature fronts: approximation algorithms that optimize worst-case ratios under rich structural assumptions, and exact solvers that exploit submodularity aggressively enough to make optimal search competitive on benchmark families.

Source: https://www.emergentmind.com/topics/submodular-knapsack-problem