---
title: Composite Quasi-DC Optimization
url: https://www.emergentmind.com/topics/composite-quasi-dc-programs
type: topic
---

# Composite Quasi-DC Optimization

Searching arXiv for the cited work and closely related papers on composite quasi-DC / DC-composite optimization.
Composite quasi-DC programs are a class of nonconvex, nonsmooth optimization problems in which compositional structure and generalized DC-type directional information are central. In the terminology proposed in "Quasi-difference-convexity: Modernization of Quasi-differentiable Optimization" [2507.12413], a quasi-differentiable function is renamed a quasi-difference-convex, or quasi-dc, function: its directional derivative at a reference point is a difference of two positively homogeneous convex functions. In a general composite formulation over a closed convex set \(X\), one studies objectives of the form \(\Theta_{\max}(x)=\max_{1\le j\le J}\theta_j(x)\) with \(\theta_j(x)=\phi_j(P^j(x))\), where \(\phi_j\) is Bouligand differentiable and each inner component has mixed convex, concave, and max-of-differentiable structure [2507.12413]. Earlier work on modern statistical estimation formulated a related "composite quasi-DC" framework through empirical risk minimization, \(F(\theta)=R(\theta)+(1/N)\sum_{i=1}^N \ell_i(\theta)\), where the regularizer and losses admit dc decompositions, but the algorithmic treatment exploits a special pointwise-max structure rather than an explicit global DC decomposition [1803.00205].

## 1. Terminology, differentiability, and quasi-dc structure

A function \(f:O\subseteq \mathbb{R}^n\to\mathbb{R}\) is Bouligand differentiable at \(x\in O\) if it is locally Lipschitz and the directional derivative
\[
f'(x;v)\coloneqq \lim_{\tau\downarrow 0}\frac{f(x+\tau v)-f(x)}{\tau}
\]
exists for all \(v\in\mathbb{R}^n\) [2507.12413]. The quasi-dc property is defined at a reference point \(\bar x\) by requiring \(f'(\bar x;\cdot)\) to be a difference of two positively homogeneous convex functions. Equivalently,
\[
f'(\bar x;v)=g(v)-h(v),
\]
where \(g\) and \(h\) are convex and positively homogeneous, and there exist compact convex sets \(\overline\partial f(\bar x)\) and \(\underline\partial f(\bar x)\) such that
\[
f'(\bar x;v)=\max_{a\in\overline\partial f(\bar x)} a^\top v-\max_{b\in\underline\partial f(\bar x)} b^\top v.
\]
The pair \((\overline\partial f(\bar x),\underline\partial f(\bar x))\) is called a quasi-differential of \(f\) at \(\bar x\) [2507.12413].

This terminology shift is historically motivated. Quasi-differentiable functions were introduced by Pshenichnyi in a 1969 monograph written in Russian and translated in an English version in 1971, and the 2025 modernization proposes the name quasi-difference-convexity to align the class more closely with contemporary DC programming [2507.12413]. A common misconception is that quasi-dc functions are simply DC functions in disguise. The available formulations do not make that identification: the quasi-dc definition is stated in terms of directional derivatives, while DC formulations are typically stated through explicit difference-of-convex decompositions of the function itself [2507.12413].

## 2. Canonical formulations of composite quasi-DC programs

One general composite quasi-dc program is defined on a closed convex set \(X\subseteq\mathbb{R}^n\) through
\[
\Theta_{\max}(x)=\max_{1\le j\le J}\theta_j(x),
\qquad
\theta_j(x)=\phi_j(P^j(x)),
\]
where \(\phi_j:\mathbb{R}^K\to\mathbb{R}\) is Bouligand differentiable and
\[
P^j(x)=\bigl(p_{jk}(x)\bigr)_{k=1}^K,
\qquad
p_{jk}(x)=p_{jk}^{cvx}(x)+p_{jk}^{cve}(x)+\max_{1\le \ell\le L} p_{jk\ell}^{diff}(x).
\]
Here \(p_{jk}^{cvx}\) is convex, \(p_{jk}^{cve}\) is concave, and \(p_{jk\ell}^{diff}\) is \(C^1\), possibly nonconvex [2507.12413]. The framework is organized through four standing assumption types: Type I for differentiable outer \(\phi_j\), Type II for convex outer \(\phi_j\), Type III for dd-convex outer functions, and Type IV for outer functions decomposed as \(\phi_j=-\psi_j+\chi_j\) with \(\psi_j\) convex and \(\chi_j\) dd-convex [2507.12413].

A second canonical formulation arises in statistical estimation:
\[
F(\theta)=R(\theta)+\frac1N\sum_{i=1}^N \ell_i(\theta),
\]
with
\[
R(\theta)=g_r(\theta)-h_r(\theta),
\qquad
\ell_i(\theta)=g_{\ell,i}(\theta)-h_{\ell,i}(\theta),
\]
where all four component functions are convex, possibly nonsmooth [1803.00205]. Although \(F\) is then a DC function in principle, the framework does not insist on an explicit DC decomposition of \(F\). Instead it exploits a special pointwise-max structure in each component [1803.00205].

That pointwise-max structure is central. Any convex, piecewise-affine or piecewise-quadratic function can be written as
\[
g(\theta)=\max_{1\le j\le m}\{a_j^\top \theta+b_j\},
\qquad
h(\theta)=\max_{1\le k\le p}\{c_k^\top \theta+d_k\},
\]
and the same representation is used for regularizers and losses. The data explicitly list \(\ell_1\), group-\(\ell_1\), SCAD, MCP, and truncated-\(\ell_1\) as regularizers that can be written as a difference of two maxima of affine pieces; ReLU is a max of two affine forms; and a multi-layer ReLU network is a difference of two max-of-convex-PLQ functions [1803.00205]. This suggests that the phrase "composite quasi-DC" is used in the literature in at least two closely related senses: one centered on quasi-differentials and Bouligand derivatives, and another centered on composite empirical-risk models with diff-max structure.

## 3. Majorization, convexification, and descent algorithms

The 2025 quasi-dc framework develops an iterative convex-programming based descent algorithm in a "single-\(\xi\)" version. Given \(x^\nu\in X\), one chooses \(\xi^\nu=(\xi^{\nu;1},\dots,\xi^{\nu;J})\) from parameter sets \(\Xi^j(x^\nu)\), then computes the unique minimizer \(x^{\nu+\frac12}\) of the strongly convex subproblem
\[
(P_\nu)\quad
\min_{x\in X}
\left[
\max_{j\in M^E(x^\nu)} \theta_j(x;x^\nu;\xi^{\nu;j})
+\frac{\rho}{2}\|x-x^\nu\|^2
\right],
\]
where \(M^E(x^\nu)=\{j\mid \theta_j(x^\nu)\ge \Theta_{\max}(x^\nu)-\epsilon_\nu\}\). If \(x^{\nu+\frac12}=x^\nu\), the method stops and \(x^\nu\) is a weak directional stationary point. Otherwise it sets \(d^{\nu+1}=x^{\nu+\frac12}-x^\nu\) and performs an Armijo line-search to find the smallest \(m\ge 0\) such that
\[
\Theta_{\max}(x^\nu+\beta^m d^{\nu+1})-\Theta_{\max}(x^\nu)
\le -\frac{\sigma\rho}{2}\beta^m\|d^{\nu+1}\|^2,
\]
then updates \(x^{\nu+1}=x^\nu+\tau_{\nu+1}d^{\nu+1}\) with \(\tau_{\nu+1}=\beta^m\) [2507.12413]. A "full-\(\xi\)" version also minimizes over all \(\xi\in\Xi_\Theta(x^\nu)\); it is computationally heavier but yields true directional stationarity [2507.12413].

In the earlier composite quasi-DC framework for statistical estimation, the primary algorithm is a nonmonotone majorization-minimization method. For a representative summand \(\Psi(\theta)=\phi(g(\theta)-h(\theta))\), the outer univariate convex \(\phi\) is decomposed as
\[
\phi(t)=\phi^{(\uparrow)}(t)+\phi^{(\downarrow)}(t),
\]
with \(\phi^{(\uparrow)}\) convex non-decreasing and \(\phi^{(\downarrow)}\) convex non-increasing. At the current iterate \(\theta^\nu\), active-index sets are identified, convex majorants \(M\Psi_{i_1,i_2}(\theta;\theta^\nu)\) are formed for active pairs \((i_1,i_2)\), and a strongly convex subproblem in \((\theta,r,s)\) is solved after introducing slack variables \(r\) and \(s\) [1803.00205]. The update selects the active pair yielding the smallest surrogate-plus-regularizer value. Because of the quadratic regularization, the method does not insist on \(F(\theta^{\nu+1})\le F(\theta^\nu)\), but it does obtain decrease in the majorized sequence \(\phi^{(\uparrow)}(r)+\phi^{(\downarrow)}(s)\) [1803.00205].

The same work derives a dual formulation for the MM subproblems and proposes a semismooth Newton method for their solution. Owing to strong convexity in \(\theta,r,s\), the inner minimizations are unique, the dual objective is \(C^1\), and generalized Jacobians are available in closed form because the prox mappings and constraint functions are piecewise-affine or smooth [1803.00205]. This pairing of MM and semismooth Newton is one of the distinctive computational features of the pointwise-max composite quasi-DC framework.

## 4. Stationarity concepts and convergence theory

Directional stationarity is the principal optimality notion in the composite quasi-dc literature. In the diff-max framework, the directional derivative is
\[
F'(\theta;d)=\lim_{t\downarrow 0}\frac{F(\theta+td)-F(\theta)}{t},
\]
and \(\theta\) is called d-stationary if \(F'(\theta;d)\ge 0\) for all feasible directions \(d\in T_\Theta(\theta)\) [1803.00205]. The quasi-dc modernization distinguishes weak directional stationary points from directional stationary points, with the stronger conclusion attached to the full-\(\xi\) scheme and to certain regularity conditions [2507.12413].

For the nonmonotone MM scheme, the key convergence statement is that if \(F\) is bounded below on \(\Theta\) and \(z^\nu=(\theta^\nu,r^\nu,s^\nu)\), then
\[
\phi^{(\uparrow)}(r^{\nu+1})+\phi^{(\downarrow)}(s^{\nu+1})
+\frac{c}{2}\|z^{\nu+1}-z^\nu\|^2
\le
\phi^{(\uparrow)}(r^\nu)+\phi^{(\downarrow)}(s^\nu),
\]
so \(\|z^{\nu+1}-z^\nu\|\to 0\), and any accumulation point \(\theta^\infty\) is d-stationary for \(F\) on \(\Theta\) [1803.00205].

For the 2025 composite quasi-dc descent algorithm, subsequential convergence is established under bounded level sets. Any limit point \(x^\infty\) satisfies one of two conclusions: if \(\liminf_{\nu\to\infty}\tau_{\nu+1}>0\), then \(x^\infty\) is a weak directional stationary solution; if \(\liminf_{\nu\to\infty}\tau_{\nu+1}=0\) and uniform upper-approximation holds at \(x^\infty\), then \(x^\infty\) is weak stationary. Moreover, if \(\Xi_\Theta(x^\infty)\) is a singleton and uniform upper-approximation holds for each \(\theta_j\) at \(x^\infty\), then \(x^\infty\) is a directional stationary solution [2507.12413].

The same paper gives stronger sequential convergence under Lipschitz assumptions. If \(\phi_j\) and \(p_{jk}^{diff}\) are \(C^1\) with Lipschitz gradients on the bounded level set, \(p_{jk}^{ndff}\) are Lipschitz there, and either "componentwise composite convexity" \((C^3)\) or "aggregate convexity" \((AC^2)\) holds for all \((\phi_j,P^j)\), then for any \(\rho>2C\) one may take unit steps, obtaining
\[
\Theta_{\max}(x^{\nu+1})-\Theta_{\max}(x^\nu)
\le
-\left(\frac{\rho}{2}-C\right)\|x^{\nu+1}-x^\nu\|^2
\]
uniformly, and any accumulation point is a directional stationary point [2507.12413]. Under a uniform Kurdyka-\L{}ojasiewicz property with exponent \(\alpha\in[0,1)\), the convergence-rate trichotomy is explicit: finite convergence when \(\zeta=0\), linear rate when \(0<\zeta\le \tfrac12\), and sublinear rate \(O\!\left(\nu^{-(1-\zeta)/(2\zeta-1)}\right)\) when \(\tfrac12<\zeta<1\) [2507.12413].

## 5. Relation to composite DC optimization and smoothing methods

Composite quasi-dc programs sit near a broader family of composite DC optimization models. A representative DC-composite class is
\[
\Phi(x)=\vartheta_1(F(x))-\vartheta_2(G(x))+h(x),
\]
where \(F\) and \(G\) are \(C^1\), \(\vartheta_1\) and \(\vartheta_2\) are proper, lsc, convex, and \(h\) is proper, lsc, convex and simple [2303.16822]. For this class, an inexact linearized proximal algorithm computes an inexact minimizer of a strongly convex majorization constructed with a partial linearization of the objective, and global convergence is derived under a KL property of a potential function; a verifiable condition is also given for KL exponent \(1/2\), which yields a local R-linear convergence rate [2303.16822].

Another adjacent framework minimizes
\[
\Phi(x)=f(x)+g_1(h(x))-g_2(h(x)),
\]
with \(f\) smooth, \(h\) smooth, and \(g=g_1-g_2\) a DC decomposition with weakly convex, prox-friendly components [2503.13990]. The proposed variable smoothing algorithm replaces each weakly convex component by its Moreau envelope, forms the surrogate
\[
\Phi_\lambda(x)=f(x)+M_\lambda[g_1](h(x))-M_\lambda[g_2](h(x)),
\]
and performs gradient descent updates on \(\Phi_{\lambda_k}\) while driving \(\lambda_k\downarrow 0\). The method is inner-loop-free, and any cluster point is a DC-critical point of the original problem [2503.13990].

For linearly constrained DC programs, difference-of-Moreau-envelopes smoothing leads to the composite LCDC-ALM. In the formulation
\[
\min_x \; F(x)=\phi(x)-g(x)
\quad \text{s.t.}\quad A x=b,
\]
with \(\phi(x)=f(x)+h(x)\), the method combines smoothing with the augmented Lagrangian and yields an \(\epsilon\)-approximate stationary solution in \(\mathcal{O}(\epsilon^{-2})\) outer iterations [2104.01470]. These DC results are not stated as quasi-dc theorems. A plausible implication is that composite quasi-dc programs belong to a wider methodological continuum in which convexification, Moreau-envelope smoothing, and proximal-augmented descent are recurring design principles.

A second misconception is that composite quasi-dc methods are merely reformulations of classical DCA. The data support a more nuanced view. The 2025 quasi-dc framework is explicitly presented as a unified treatment of iterative convex-programming based descent algorithms for a broad class of composite quasi-dc programs [2507.12413], whereas the 2018 diff-max framework relies on nonmonotone MM with semismooth Newton subsolvers [1803.00205]. Classical DCA remains relevant, but it is one algorithmic strand among several.

## 6. Modeling domains, applications, and examples

The modeling range described in the literature is broad. In the statistical estimation framework, the data explicitly cite continuous piecewise affine regression and deep learning as examples. A continuous piecewise-affine model is written as
\[
\psi(x;\theta)=\max_{1\le i\le k_1}\{a_i^\top x+\alpha_i\}
-
\max_{1\le j\le k_2}\{b_j^\top x+\beta_j\},
\]
and the same framework covers deep networks with piecewise-affine activations, including two-layer ReLU networks that can be written in diff-max form [1803.00205]. Numerical results in that study state that piecewise-affine regression outperforms linear regression on synthetic and UCI data, converges reliably to d-stationary points, and that the semismooth Newton subsolver typically needs fewer than 10 Newton steps per MM subproblem [1803.00205].

The quasi-dc modernization enumerates a different, but overlapping, set of examples: single-ratio fractional programming with \(\phi(y,z)=y/z\), products with \(\phi(y,z)=y\cdot z\), norm-based objectives with \(\phi(y)=\|y\|_p\), robust deviations composed with Huber or SCAD loss, and piecewise affine DC models \(\theta(x)=\max_i g_i(x)-\max_j h_j(x)\), for which Algorithm 1 specializes to proximal DCA [2507.12413]. It also mentions Heaviside composites as ongoing work [2507.12413].

Composite DC methods closely related to the quasi-dc setting have been applied to robust low-rank recovery and robust phase retrieval. For matrix completion with outliers and non-uniform sampling, the model
\[
\min_{U,V}\;
\vartheta(\mathcal A(UV^\top)-b)
+\lambda(\|U\|_{2,1}+\|V\|_{2,1})
\]
is treated by iLPA with a dPPASN subsolver, and the reported numerical highlights include relative error \(\mathrm{RE}\approx 10^{-4}\) or better on synthetic data, 20–100 iterations with wall-clock times 1–50 s for \(n\) up to 3000, Jester NMAE \(0.21\)–\(0.23\) with iLPA about \(5\times\) faster than PAM, and MovieLens-1M and Netflix NMAE \(\approx 0.20\)–\(0.23\) in tens of seconds [2303.16822]. In robust phase retrieval, a variable smoothing algorithm for a DC loss composed with a smooth mapping is proposed for quadratic measurements corrupted by outliers, and the numerical experiment is reported to show that DC loss functions are more robust against outliers than the \(\ell_1\) loss [2604.07686].

A further application of DC programming with a composite objective appears in dynamic panels with group-specific heterogeneity and spatially dependent errors. The Composite Quasi-Likelihood estimator is formulated as a mixed-integer d.c. program and solved by DCA; the estimator is stated to remain unbiased under misspecification of unobserved fixed effects and to achieve an oracle property for the group-specific slope parameters [1704.06613]. This is not presented as a composite quasi-dc program in the quasi-differential sense, but it shows how composite modeling, latent grouping, and DC programming intersect in econometric practice.

Taken together, these works portray composite quasi-dc programming not as a single algorithm or a single normal form, but as a technically structured optimization viewpoint. Its defining features are compositional modeling, pointwise-max or directional-difference structure, strongly convex local surrogates, and stationarity notions based on directional derivatives rather than classical smooth first-order conditions [2507.12413].

Source: https://www.emergentmind.com/topics/composite-quasi-dc-programs