---
title: Submodular Maximization
url: https://www.emergentmind.com/topics/submodular-maximization
type: topic
---

# Submodular Maximization

A submodular function $f:2^V\to\mathbb{R}$ is defined on the subsets of a finite ground set $V$ and satisfies the diminishing returns property: for all $A\subseteq B\subseteq V$ and $x\notin B$, $f(A\cup\{x\})-f(A)\geq f(B\cup\{x\})-f(B)$. Submodular maximization focuses on finding a subset $S\subseteq V$ maximizing $f(S)$, possibly subject to combinatorial constraints such as cardinality, matroid, or knapsack constraints, and is a core paradigm in combinatorial and discrete optimization with significant applications in machine learning, economics, and network design.

## 1. Mathematical Foundations and Problem Settings

Maximizing a submodular function is NP-hard in general, even for basic constraints, but its structure enables approximation algorithms with tight guarantees. The canonical objective is
\[
\max_{S\in\mathcal{I}} f(S)
\]
where $\mathcal{I} \subseteq 2^V$ encodes the feasible sets, often a family closed under subset operations (down-closed), e.g., uniform matroid ($|S|\leq k$), partition matroid ($S$ has at most $k_i$ elements in group $i$), or knapsack (total weight $\leq B$). In unconstrained or cardinality-constrained settings, the greedy algorithm provides a $(1-1/e)$-approximation for monotone $f$ [2006.09327, 1807.07889].

The multilinear extension $F(x)=\mathbb{E}_{R\sim x}[f(R)]$, where $x\in[0,1]^n$ and $R$ is a random subset where $i$ is included independently with probability $x_i$, is central for fractional relaxations and continuous optimization frameworks [2311.01129]. This extension is DR-submodular, inheriting the diminishing returns structure:
\[
x\le y, z\ge 0, x+z\le 1 \implies F(x+z\,e_i)-F(x) \ge F(y+z\,e_i)-F(y)
\]
This permits the use of continuous algorithms for approximate maximization.

## 2. Key Algorithms and Approximation Guarantees

### Greedy and Threshold-Based Methods

The classical greedy method iteratively adds the element with the largest marginal gain, achieving $(1-1/e)$ approximation for monotone $f$ under cardinality constraint, tight by known hardness [2006.09327, 1807.07889]. For non-monotone objectives, double greedy and random greedy techniques are employed, achieving $1/2$ or $1/e$-type approximation factors [1606.05615, 1808.06932]. Deterministic threshold-based “clean linear time” algorithms matching this ratio with $O(n)$ queries have been developed [2006.09327].

### Continuous Greedy and Multilinear Relaxations

For matroid and more general constraints, the continuous greedy algorithm, operating on the multilinear extension, combined with swap or pipage rounding, achieves $(1-1/e)$ for monotone $f$ [2311.01129, 2006.13474]. For general down-closed constraints and non-monotone $f$, Buchbinder and Feldman established a $0.385$-approximation via a sophisticated measured continuous greedy [2311.01129]. Recent advances have closed the gap towards the $0.478$ hardness bound (Oveis Gharan & Vondrák), achieving a $0.401$-approximation by leveraging a new full-history DR-submodularity bound [2311.01129].

### Advanced Exact and Branch-and-Bound Approaches

For moderate-scale instances, exact algorithms via branch-and-bound on complex binary integer programming formulations, augmented with batch constraint generation, have been developed to solve cardinality-constrained monotone submodular maximization to optimality, outperforming prior exact methods [1811.04177].

### Streaming, Online, and Sliding Window Models

Streaming algorithms address computation over data streams, maintaining $(1-1/e)$-approximations in a single pass with memory scaling in $k$ [2002.03503]. For the sliding window model (focus on most recent $W$ items), reductions to streaming algorithms with only constant-factor loss and $O(\log M/\epsilon)$ overhead in time/space enable approximation for both monotone and non-monotone $f$ under cardinality and matroid constraints [1611.00129].

### Query Complexity and Adaptivity

Linear query complexity (exactly $n$ queries) and nearly optimal adaptivity (parallel rounds) have been achieved by deterministic algorithms guaranteeing constant-factor approximations for monotone and general submodular maximization under matroid constraints [2406.00148]. Adaptivity-optimal algorithms for the cardinality-constrained case achieve $(1-1/e)-\epsilon$ with $O(\log n)$ rounds and $O(n)$ queries [1807.07889].

## 3. Recent Theoretical Advances: New DR-Submodular Bounds

The classic “Feldman $\gamma$-bound” for the marginal gain loss along continuous trajectories underpins most continuous greedy analysis:
\[
F(x+v)-F(x)\;\ge\;(1-\|x\|_\infty)[F(v)-F(0)]
\]
A new, substantially sharper bound by Buchbinder & Feldman for DR-submodular functions captures the cumulative “damage” across the entire path, yielding bounds of the form
\[
F(1 - a\odot\exp(-\int_0^t x(\tau)d\tau)) \geq e^{-t}\Bigl[F(1-a) + \text{series involving F at intermediate points}\Bigr]
\]
This strengthens both the analysis and practical performance of continuous greedy frameworks: the first $0.401$-approximation for maximizing a general (non-monotone) submodular function under down-closed combinatorial constraints is thus established [2311.01129]. This result closes the gap with the $0.478$ inapproximability result, and the new bound has implications for other algorithmic frameworks using continuous relaxations.

## 4. Bicriteria Maximization and Constraint Relaxations

Bicriteria algorithms allow controlled constraint violation, e.g., slightly exceeding budget or cardinality constraints, to obtain improved approximation ratios unattainable under strict feasibility:
- Monotone $f$: $(1-\epsilon,1+1/\epsilon)$-bicriteria for cardinality/knapsack constraints via greedy or continuous methods.
- General (non-monotone) $f$: $(1/2-O(\epsilon),O(1/\epsilon))$-bicriteria for general down-closed polytopes using repeated continuous greedy and double greedy [2507.10248].
- Symmetric $f$: specialized variants reach $(1/2-O(\epsilon),o(\log 1/\epsilon))$-bicriteria.
These relaxations inform both submodular cover and soft-constrained maximization and serve as benchmarks for streaming and parallel algorithms. Hardness results preclude improving the bicriteria factor below certain thresholds for general constraints [2507.10248].

## 5. Streaming and Distributed Submodular Maximization

Efficient streaming and distributed submodular maximization frameworks address the scalability of submodular maximization in modern data-centric applications:
- One-pass streaming algorithms for regularized objectives $f=g-\ell$ attain $(\phi^{-2}-\epsilon)\cdot g(\mathrm{OPT}) - \ell(\mathrm{OPT})$ [2002.03503].
- Distributed MapReduce-style algorithms run in $O(1/\epsilon)$ rounds and match the classical $(1-1/e)$ guarantee for monotone $f$ with $O(k/\epsilon)$ machine-local memory, improving previous memory bounds [2002.03503].
- Streaming algorithms for sliding windows derive from reductions of infinite-window algorithms, with deterministic $(1/4-O(\epsilon))$-approximation for monotone $f$ and $O(k \log k / \epsilon^2 \log M)$ space [1611.00129].

## 6. Submodular Maximization in Continuous Domains and Advanced Extensions

Continuous submodular maximization generalizes set functions to $f:[0,1]^n\to\mathbb{R}$, with applications spanning influence maximization, DPP MAP inference, and mean-field inference in log-submodular models [2006.13474, 1606.05615]. The Frank-Wolfe variant for DR-submodular $f$ under convex constraints attains the tight $(1-1/e)$ bound, while double greedy yields $1/3$ for unconstrained non-monotone problems [2006.13474, 1606.05615]. These methods exploit the equivalence between lattice submodularity and weak DR-property, and provide dimension-independent guarantees that extend greedy methods to complex function classes.

## 7. Applications, Empirical Performance, and Open Problems

Applications of submodular maximization algorithms include data and video summarization, sensor placement, recommendation systems (balancing relevance and diversity), social influence, and robust coverage in networks. Empirical evaluations across real-world datasets demonstrate that threshold-based, continuous, and streaming algorithms achieve close to greedy and sometimes optimal performance with orders-of-magnitude fewer oracle calls [2006.09327, 2002.03503, 2305.08367]. Recent developments raise further questions:
- Can the gap between the best known and inapproximability factors for general submodular maximization (currently $0.401$ vs. $0.478$) be closed [2311.01129]?
- Can adaptivity-optimal, high-approximation algorithms extend uniformly to non-monotone functions and more general constraints?
- Extensions to bicriteria, distributed, and online settings, along with partial monotonicity and compositionality of submodular functions, remain active research directions [2202.03051, 2507.10248].

Source: https://www.emergentmind.com/topics/submodular-maximization