---
title: 'Weakly Convex Functions: Theory & Applications'
url: https://www.emergentmind.com/topics/weakly-convex-functions
type: topic
---

# Weakly Convex Functions: Theory & Applications

A weakly convex function is a proper, lower-semicontinuous function \( f: \mathbb{R}^d \rightarrow \mathbb{R} \cup \{+\infty\} \) that admits a bounded negative curvature in a precise sense: \( f \) is called \(\rho\)-weakly convex if there exists \( \rho \geq 0 \) such that \( x \mapsto f(x) + \tfrac{\rho}{2} \|x\|^2 \) is convex. This class strictly generalizes convex functions (\( \rho = 0 \)), subsumes smooth functions with Lipschitz gradient (\( \rho \) is the gradient Lipschitz constant), and is central in modern nonsmooth and nonconvex optimization theory.

## 1. Fundamental Definitions and Characterizations

Weak convexity can be formulated via several equivalent but operationally distinct conditions, all appearing widely in the literature:

- **Quadratic perturbation:** \( f \) is \(\rho\)-weakly convex if \( f(x) + \frac{\rho}{2}\|x\|^2 \) is convex.
- **Subgradient lower bound:** For all \(x, y\) and any \( v \in \partial f(x) \),
  \[
  f(y) \geq f(x) + \langle v, y-x \rangle - \tfrac{\rho}{2} \|y-x\|^2.
  \]
- **Secant inequality:** For all \(x, y\), \( \lambda \in [0,1] \),
  \[
  f(\lambda x + (1-\lambda) y) \leq \lambda f(x) + (1-\lambda) f(y) + \tfrac{\rho}{2} \lambda (1-\lambda) \|x-y\|^2.
  \]
- **Differentiable case:** If \( f \) is \( C^1 \), then weak convexity is equivalent to
  \[
  \langle \nabla f(x) - \nabla f(y), x-y \rangle \geq -\rho \|x-y\|^2.
  \]
- **Second-order conditions:** For \( C^2 \) functions, \( \nabla^2 f(x) \succeq -\rho I \) for all \( x \).
- **Subdifferential hypomonotonicity:** \( \langle v-w, x-y \rangle \geq -\rho\|x-y\|^2 \) for all \( v \in \partial f(x), w \in \partial f(y) \) [1803.06523], [2509.13960].

These conditions admit natural generalization to Banach and Hilbert spaces and underpin the analytic and algorithmic properties of weakly convex functions.

## 2. Key Properties and Examples

Weakly convex functions preserve many of the powerful properties of convex analysis while accommodating mild nonconvexities:

- **Stability under sums and composition:** The sum of a \(\rho_1\)- and a \(\rho_2\)-weakly convex function is \((\rho_1+\rho_2)\)-weakly convex. Compositions \( h \circ c \), with \( h \) convex and Lipschitz, and \( c \) \( C^1 \) with Lipschitz Jacobian, are \( L \beta \)-weakly convex, where \( L \) and \( \beta \) are the respective Lipschitz constants [1803.06523], [1908.01871].
- **Closure under supremum:** The supremum of uniformly \(\rho\)-weakly convex functions is also \(\rho\)-weakly convex [2502.00525].
- **Proximal properties:** For any \( \lambda < 1/\rho \), \( f + \frac{1}{2\lambda} \|\cdot - z\|^2 \) is strongly convex in \( x \), so the proximal operator is single-valued and Lipschitz [2509.13960].
- **Active examples:**
  - Robust loss functions (MCP, SCAD, Tukey, capped-ℓ1),
  - Robust phase retrieval: \( x \mapsto \frac{1}{m}\sum_i | \langle a_i, x \rangle^2 - b_i^2 | \),
  - Conditional Value-at-Risk (CVaR),
  - Nonconvex penalization in sparse logistic regression [1708.02059], [2502.00525].

## 3. Moreau Envelope and Proximal Calculus

A central tool for weakly convex analysis is the Moreau envelope:
\[
f_{\lambda}(x) = \inf_y \left\{ f(y) + \frac{1}{2\lambda}\|x-y\|^2 \right\}, \quad \lambda < 1/\rho,
\]
with associated proximal map \( \operatorname{prox}_{\lambda f}(x) \). For weakly convex \(f\):

- \( f_{\lambda} \) is everywhere finite and \(C^1\); \( \nabla f_{\lambda}(x) = \frac{1}{\lambda}(x - \operatorname{prox}_{\lambda f}(x)) \).
- \( \operatorname{prox}_{\lambda f} \) is \((1-\lambda\rho)^{-1}\)-Lipschitz [2509.13960].
- \( f_\lambda \to f \) pointwise as \( \lambda \to 0 \).
- The Moreau envelope preserves minimizers and critical points [2509.13960].
- The gradient \( \nabla f_{\lambda}(x) \) serves as a natural stationarity measure for nonconvex, nonsmooth problems, and underpins optimality guarantees in algorithmic schemes [1803.06523], [1803.06523].

For inexact proximal computations, detailed calculus using ε-subdifferentials is available, establishing rigorous inexact stationarity conditions and sum rules for composite functions [2211.14525].

## 4. Optimization Algorithms, Complexity, and Regularity

Optimization of weakly convex objectives leverages the structure through proximal, subgradient, and first-order splitting algorithms:

### Algorithmic Frameworks

- **Proximal Point and Proximal Gradient Methods:** These methods operate directly or with inexact solves on the Moreau envelope and enjoy convergence guarantees when suitable regularity (e.g., Kurdyka–Łojasiewicz (KL) property) is present [2307.15596], [2509.02804].
- **Stochastic Subgradient Methods:** For composite problems \( g(x) + r(x) \), the stochastic subgradient or proximity-based variants yield convergence of the Moreau envelope gradient at rate \( O(k^{-1/4}) \), settling the rate for nonconvex, nonsmooth composite stochastic optimization [1802.02988], [1803.06523].
- **Variable Smoothing Schemes:** By decreasing the smoothing parameter, algorithms interpolate between smooth and nonsmooth rates, obtaining dimension-independent complexity \( O(\epsilon^{-3}) \) for composite structured problems [2003.07612], [2502.00525].
- **Quadratically Regularized Subgradient for Constrained Optimization:** By regularizing both objective and constraints, provable complexity guarantees are established for finding nearly stationary points under uniform Slater conditions [1908.01871].
- **Primal-Dual and Forward–Backward Algorithms:** When sharpness holds, linear convergence rates can be attained globally or locally for primal-dual and splitting schemes targeting weakly convex (and possibly nonconvex) objectives [2303.14021], [2410.20977].

### Regularity Conditions, Error Bounds, and Linear Convergence

Regularity conditions for weakly convex functions mirror, but generalize, those in the convex setting. On any sublevel set, there exists a chain of implications:
\[
\text{Strong Convexity} \implies \text{Restricted Secant Inequality} \implies \text{Error Bound} \iff \text{Polyak-Łojasiewicz} \implies \text{Quadratic Growth}
\]
[2312.16775]. Under quadratic growth, linear convergence of (inexact) proximal point and forward–backward algorithms is established.

## 5. Saddle Points, Sharpness, and Generic Avoidance

A notable structural property of weakly convex objectives is the landscape organization: generic weakly convex, o-minimal (definable) functions possess only local minimizers and "active strict saddles." Proximal-point, subgradient, and stochastic algorithms provably avoid strict saddles almost surely, converging instead to minimizers [1912.07146], [2108.02072], [2102.02837]. The geometric mechanism is the instability of strict saddle fixed points under the proximal update and landscape sharpness away from active manifolds. Random perturbation methods accelerate escape from saddle traps even in nonsmooth cases [2102.02837].

Sharpness—a linear growth condition away from minimizers—enables local (and sometimes global) linear convergence for subgradient and forward–backward schemes on weakly convex objectives, conditional on initialization in a basin of attraction [1803.02461], [2303.14021], [2410.20977].

## 6. Second-order Calculus and Convexity Characterization

Recent work leverages generalized second-order subderivatives and coderivatives to precisely demarcate the convexity of weakly convex functions [2603.24951]:

- **Graphical derivatives of the subgradient mapping:** Convexity is equivalent to the positive semi-definiteness of the graphical derivative in each direction.
- **Second subderivatives:** Convexity is equivalent to non-negativity of the second subderivative for all directions at each subgradient pair.
- **Second-order subdifferential:** Convexity holds if \( \langle z, w \rangle \geq 0 \) for all \( z \in \breve{\partial}^2 f(x, v)(w) \) and all \( (x, v) \in \operatorname{gph} \partial f \).

These characterizations unify various fragments of second-order analysis across generalized convexity and inform Newton-type methods.

## 7. Applications and Practical Implications

Weakly convex models are prevalent in contemporary statistical and machine learning models, including high-dimensional robust estimation, sparse regression, dictionary learning, phase retrieval, robust PCA, and distributionally robust optimization [1803.06523], [1708.02059], [2502.00525].

- **Sparsity-inducing regularization:** Weakly convex penalties (like MCP, SCAD, firm-threshold) encode \( \ell_0 \)-like properties while maintaining algorithmic tractability and provable stationarity when used with proximal-gradient descent [1708.02059].
- **Nonconvex regularization in deep learning:** Nonsmooth yet weakly convex loss surfaces, as in ReLU networks and robust estimators, are amenable to first-order and splitting methods.
- **Supremum of weakly convex functions:** Moreau envelope calculus extends to pointwise maxima and supremum operations, allowing envelope and proximity operator computation for classes of DRO and min-max problems [2502.00525].

Algorithmically, the Moreau envelope enables efficient smoothing, splitting, and stochastic optimization frameworks in large-scale settings without reliance on variance reduction, mini-batching, or strong convexity [1802.02988], [2509.13960].

---

**References**:  
[1802.02988], [1803.06523], [1908.01871], [2003.07612], [2509.13960], [2211.14525], [2303.14021], [2102.02837], [2410.20977], [1708.02059], [1912.07146], [2108.02072], [2502.00525], [2312.16775], [2603.24951], [2509.02804], [2307.15596], [1803.02461].

Source: https://www.emergentmind.com/topics/weakly-convex-functions