---
title: Infimal Convolution in Convex Analysis
url: https://www.emergentmind.com/topics/infimal-convolution
type: topic
---

# Infimal Convolution in Convex Analysis

Infimal convolution is a fundamental operation in convex analysis, optimization, variational methods, and geometric analysis, which combines two (or more) extended-real-valued functions into a new function reflecting the "cheapest" way of splitting an argument between two costs. The infimal convolution is closely related to smoothing, duality, and regularization techniques and underlies robust statistics, optimal transport, nonsmooth analysis, PDE theory, and modern machine learning loss constructions.

## 1. Definition and Fundamental Properties

Given two functions \( f, g: X \rightarrow (-\infty, +\infty] \) on a vector space \(X\), the infimal convolution \( f \infconv g \) is defined as
\[
(f \infconv g)(x) := \inf_{y \in X} \left\{ f(y) + g(x - y) \right\}.
\]
In finite dimensions, this operation is symmetric, commutative (\( f \infconv g = g \infconv f \)), and associative. For convex, proper, lower semicontinuous (l.s.c.) functions, the infimal convolution inherits convexity and closedness. If both \(f\) and \(g\) are proper and l.s.c., so is \(f\infconv g\), and \(\mathrm{dom}(f\infconv g) = \mathrm{dom} f + \mathrm{dom} g\) [2206.08220, 1404.0787, 1907.08318].

Crucially, in convex analysis, the epigraph of \( f \infconv g \) is the Minkowski sum of the epigraphs of \(f\) and \(g\): \(\mathrm{epi} (f \infconv g) = \mathrm{epi} f + \mathrm{epi} g\).

The infimal convolution generalizes to \(m\) functions \( f_1, \ldots, f_m \) via
\[
(f_1 \infconv \cdots \infconv f_m)(x) = \inf_{\substack{x = u_1 + \cdots + u_m}} \left( \sum_{i=1}^m f_i(u_i)\right),
\]
and this formulation provides flexibility for constructing complex composite penalties or data fidelities [2102.07874, 2304.08628].

## 2. Duality and Connections with Convex Analysis

A cornerstone property is the Fenchel–Rockafellar conjugacy:
\[
(f \infconv g)^* = f^* + g^*,
\]
where \(f^*\) is the Fenchel conjugate. Conversely, addition in the primal yields infimal convolution in the dual:
\[
(f + g)^* = f^* \infconv g^*.
\]
These identities are essential for deriving dual problems in variational and optimal control contexts and underlie the Moreau–Rockafellar theory of regularization [1907.08318, 1906.06872, 2406.02003].

The Moreau envelope, a smooth approximation of \(f\), is the infimal convolution with a rescaled squared norm:
\[
f_\lambda(x) = (f \infconv \frac{1}{2\lambda}\| \cdot \|^2)(x).
\]
If \(f\) is convex, \(f_\lambda\) is \(C^1\) with Lipschitz continuous gradient, and the proximal map is given by
\[
\mathrm{Prox}_{\lambda f}(x) = \argmin_y \{f(y) + \frac{1}{2\lambda}\|x-y\|^2\}.
\]
This fundamental smoothing via infimal convolution is widely used in first-order optimization schemes [2406.02003].

## 3. Subdifferential Calculus and Differentiability

Generalized differentiation of the infimal convolution function has been characterized under mild regularity conditions. If \(f\) is proper, l.s.c., and Lipschitz on \(\mathrm{dom}\,f\), and \(p\) is a proper, l.s.c., coercive gauge (i.e., subadditive, p.h.) with \(p(0)=0\), the Fréchet and Mordukhovich subdifferentials of \(f\infconv p\) at \(x\) are described by
\[
\hat{\partial}(f \infconv p)(x) = \hat{\partial} f(x) \cap [-\hat{\partial} p(0)],
\]
with analogous formulas for the limiting subdifferential, provided the minimizer set is a singleton or other regularity holds [1404.0787].

Strict differentiability of \(f\infconv p\) at a point requires strict differentiability of either factor at the relevant location and single-valuedness of the minimizer map. This unifies Moreau envelopes, distance functions, minimal time functions, and other classical nonsmooth objects [1404.0787].

## 4. Applications in Regularization, Statistics, and Imaging

Infimal convolution is employed to build regularization functionals that balance different structural priors. For example, in imaging:
- The family of TVL\(^{p}\) functionals,
  \[
  \mathrm{TVL}^{p}_{\alpha,\beta}(u) := \inf_{w} \left\{ \alpha \|D u - w\|_{\mathcal M} + \beta \|w\|_{L^{p}} \right\},
  \]
  interpolates between total variation (TV)-based regularization (\(p=1\)) and Huber-type smoothness (\(p=2\)), and in the limit \(p=\infty\), it matches second-order TGV while providing enhanced preservation of piecewise-affine features [1504.01956, 1510.09032]. 

- The oscillation TGV model uses the infimal convolution over multiple oscillation directions to enable accurate texture-preserving reconstructions. The convexity and lower semicontinuity of the resulting regularizer ensure well-posedness and enable efficient primal-dual algorithms [1710.11591].

In robust statistics and regression, losses such as the Huber and \(\varepsilon\)-insensitive are constructed as infimal convolutions:
\[
\text{Huber}_\kappa^p(f) = (\tfrac{1}{2}\|\,\cdot\,\|_Y^2) \infconv (\kappa\|\cdot\|_p)(f), \qquad
\ell^p_\varepsilon(f) = (\tfrac{1}{2}\|\,\cdot\,\|_Y^2) \infconv \iota_{\|\,\cdot\,\|_p\leq\varepsilon}(f),
\]
yielding robust, sparse or outlier-insensitive alternatives to the squared loss [2206.08220].

In mixed-noise image denoising, the IC-fidelity allows simultaneous adaptation to, e.g., Gaussian and Poisson noise, reflecting a data-driven decomposition of residuals into multiple channels [1611.00690, 2108.03642].

Infinite infimal convolution regularization extends this approach to a continuous family of one-homogeneous functionals, processed via a measure-valued lifting. The theory guarantees sparsity of solutions (atomic supports), and efficient Frank–Wolfe algorithms can solve the resulting convex problems [2304.08628].

## 5. Metric and Optimal Transport Convolutions

A metric analog of infimal convolution arises in the geometric context of distances. Given two extended metrics \(d_1, d_2\) on \(U\), the metric-infimal-convolution is
\[
(d_1 \nabla d_2)(z_0, z_1) = \inf_{y\in U} \left[d_1(z_0, y) + d_2(y, z_1)\right].
\]
Notably, the Hellinger–Kantorovich metric \(HK\) is expressed as
\[
HK^2(\mu, \nu) = \inf_{\eta} \left\{ He^2(\mu, \eta) + W^2(\eta, \nu) \right\},
\]
where \(He\) is the Hellinger distance and \(W\) the Wasserstein-2 distance. This expresses a composite geometry interpolating unbalanced mass change (Hellinger) and transport (Wasserstein) mechanisms; the associated minimization has a rich duality and convex-analytic structure [2503.12939].

In multi-marginal optimal transport, infimal convolution cost yields the Wasserstein barycenter problem:
\[
\min_{\nu}\sum_{i=1}^N W_p^p(\nu, \mu_i) = \inf_{\gamma} \int \inf_{z} \sum_{i=1}^N c_i(x_i, z) d\gamma(x_1, ..., x_N),
\]
connecting barycenters, Benamou–Brenier dynamics, and barycentric measures via natural convex optimization [2512.12555].

## 6. Smoothing, Approximation, and PDEs

Infimal convolution underpins nonlinear smoothing mechanisms. In optimization and PDEs, the Moreau envelope yields a smooth function, and the Hopf–Lax formula provides viscosity solutions to Hamilton–Jacobi equations:
\[
u_t(x) = \inf_{y} \left[ u(y) + t L((x-y)/t) \right].
\]
Regularity, convergence, and Sobolev embedding properties induce strong smoothing effects, with sharp characterizations depending on the integrability and growth of \(L\) [1208.3959].

Laplace’s method gives a smoothing approximation to the infimal convolution:
\[
L_\delta[f \infconv g](x) = -\delta \log \int e^{-(f(y) + g(x-y))/\delta} dy,
\]
with uniform smoothness for \(\delta>0\) and gradient/Hessian structure determined by the kernel of integration. For small \(\delta\), \(L_\delta[f\infconv g](x)\) closely approximates \((f\infconv g)(x)\), enabling Monte Carlo and softmin-based optimization algorithms [2406.02003].

In discrete and graph settings, variant notions replace the infimum over points by infima over probability measures; these enter non-Euclidean Hamilton–Jacobi equations and lead to discrete analogs of log–Sobolev and transport inequalities [1512.02416].

## 7. Quantitative Norm and Inequality Results

Infimal convolution operators satisfy sharp norm inequalities in various function spaces. In Lebesgue and Grand Lebesgue spaces, one has:
\[
\|f_1 \infconv \cdots \infconv f_m\|_{L^p} \leq m^{d/p} \left( \prod_{j=1}^m \|f_j\|_{L^p} \right)^{1/m},
\]
with best possible constants and corresponding extensions to Orlicz, Lorentz, and mixed spaces, reflecting the growth of infimal convolution in high-dimensional and random settings [2102.07874, 1501.04513].

Integral inequalities for infimal convolution have implications for long-time behavior of Hamilton–Jacobi equations and necessary conditions for infimal-convolution equation solvability [1501.04513].

---

Infimal convolution organizes and extends smoothing, regularization, duality, and variational schemes across convex analysis, PDE theory, optimization, and geometric analysis. Its structure is key for theoretical understanding and practical algorithmic design in robust statistics, signal/image processing, transport, and learning frameworks [2206.08220, 1710.11591, 1504.01956, 2503.12939, 2512.12555].

Source: https://www.emergentmind.com/topics/infimal-convolution