---
title: Conflict-Aware Projected Gradient Ascent
url: https://www.emergentmind.com/topics/conflict-aware-projected-gradient-ascent
type: topic
---

# Conflict-Aware Projected Gradient Ascent

Conflict-Aware Projected Gradient Ascent (CAPGA) refers to a class of optimization techniques that resolve conflicts between multiple objectives during gradient-based optimization by explicitly adjusting, projecting, or reweighting gradient vectors associated with those objectives. The methodology is particularly significant in multitask learning, federated unlearning, multi-objective optimization, and reinforcement learning, where simultaneous improvement of several possibly competing objectives is inherently challenging. CAPGA schemes offer principled conflict resolution at the level of gradients, aiming to guarantee favourable tradeoffs, fairness, or constraints, while maintaining computational efficiency.

## 1. Multitask and Multi-Objective Optimization Problem Formulation

In canonical multitask learning (MTL), one optimizes a shared model with parameter vector $\theta\in\mathbb{R}^d$ over $K$ tasks, each associated with a loss function $L_i(\theta)$. The overall goal is to minimize a weighted sum or average:

$$
L(\theta) = \frac{1}{K} \sum_{i=1}^K L_i(\theta).
$$

Each task provides a gradient $g_i = \nabla_\theta L_i(\theta)$. If the gradients are aligned, naive gradient descent on $L(\theta)$ is efficient. However, when the gradients are not aligned (i.e., gradient conflicts), naive aggregation can degrade performance for some or all tasks, stall convergence, or induce negative transfer. This is formally observed when

$$
g_i^\top g_j < 0,
$$

indicating that improvement in one task may worsen another [2409.01793].

Similarly, in multi-objective optimization, one seeks Pareto-critical points where no descent direction improves all objectives. Gradient conflicts are again central, with a solution defined by the condition that no $d$ exists such that $\nabla f_i(\theta)^\top d < 0$ for all $i$ [2602.02495].

## 2. Detection and Definition of Gradient Conflict

Conflict-aware optimization strategies hinge on reliable detection of gradient conflict. The general criterion is an anti-correlation of gradients for different tasks or objectives:

- **Pairwise conflict:** Tasks $i$ and $j$ are in conflict if $g_i^\top g_j < 0$ [2409.01793, 2503.03438, 2601.09684].
- **Constraint violation:** In constrained or utility-preserving settings, e.g., federated unlearning, the ascent direction $g_{\mathrm{tar}}$ (for unlearning/forgetting) and reference direction $g_{\mathrm{ref}}$ (for utility) are in conflict if $\langle g_{\mathrm{tar}}, g_{\mathrm{ref}}\rangle > 0$, i.e., forgetting increases (rather than preserves) utility loss [2601.22589].
- **Conic or angular constraints:** ConicGrad restricts the allowable update direction $d$ to an angular cone around a reference gradient $g_0 = \sum_{i=1}^T g_i$, enforcing $\langle g_0, d\rangle \geq c \|g_0\| \|d\|$ for some $c = \cos\theta$ [2502.00217].

Module- or parameter-block-specific conflicts are also detectable (e.g., in Modular Gradient Conflict Mitigation (MGCM), conflict is checked locally within architectural modules) [2409.15911].

## 3. Projection-Based Conflict Resolution Schemes

The core of CAPGA is using projections to adjust conflicting gradients. The canonical update for resolving a pairwise task conflict is to orthogonally project one gradient onto the space perpendicular to the other, as in PCGrad and descendants:

$$
g_i^{\mathrm{proj}} = g_i - \frac{g_i^\top g_j}{\|g_j\|^2} g_j.
$$

This update enforces $g_i^{\mathrm{proj}} \perp g_j$, eliminating immediate negative interference [2409.01793, 2601.09684]. Modular schemes apply this at the module level, locally surgerying gradients only where conflict actually occurs [2409.15911].

Full deconfliction via Gram–Schmidt-like procedures projects each $g_i$ onto the complement of the subspace spanned by all other $g_j$, guaranteeing “strong non-conflict” for all $i,j$ [2503.03438].

ConicGrad seeks a direction $d^*$ maximizing the minimum improvement over all tasks subject to a cone constraint; the projection is given in closed form via Sherman–Morrison [2502.00217].

Federated unlearning employs a constrained quadratic program:

$$
\min_d \|d - g_{\mathrm{tar}}\|_2^2 \quad \text{subject to } \langle g_{\mathrm{ref}}, d\rangle \leq 0,
$$

with closed form:

$$
d = g_{\mathrm{tar}} - \frac{\max(0, \langle g_{\mathrm{tar}}, g_{\mathrm{ref}}\rangle)}{\|g_{\mathrm{ref}}\|^2 + \varepsilon} g_{\mathrm{ref}}
$$

[2601.22589].

In multi-objective/CAGrad-type schemes, the projection consists of directly solving a small quadratic program to find non-decreasing directions with guaranteed Pareto criticality. In the clipped CAGrad-Clip variant, the projection is clipped to respect user-provided preference bounds [2602.02495].

## 4. Probabilistic and Weighted Projection Schemes

The basic projection mechanism can be augmented to encode task priorities, dynamic loss weighting, or user-defined tradeoff preferences.

- **Probabilistic task prioritization:** In wPCGrad, a probability vector $\vec{p}$ is dynamically updated (e.g., via Dynamic Task Prioritization), and at each step a task is sampled as an “anchor” based on its most recent loss. Only gradients that conflict with the anchor are projected, and tasks with larger losses are more likely to be protected from adjustment. Explicitly,

  $$
  p_i = \frac{(L_i^{(t-1)})^\gamma}{\sum_{j=1}^K (L_j^{(t-1)})^\gamma}
  $$

  for focusing exponent $\gamma$ [2409.01793].

- **Trade-off traversal:** Weighted GradOPS uses a trade-off exponent $\alpha$ to control the final aggregation weights of the deconflicted gradients and efficiently explores the Pareto frontier [2503.03438].

- **Preference-respecting clipping:** In multi-objective LLM alignment under CAGrad-Clip (as in RACO), mixture weights are clipped to remain within user-specified quotas, preventing low-priority objectives from dominating the correction [2602.02495].

## 5. Theoretical Guarantees and Convergence Properties

CAPGA strategies typically rely on first-order smoothness and Lipschitz continuity. Core theoretical results include:

- **Monotonic improvement:** Under smoothness/Lipschitz conditions and sufficiently small step sizes, projected updates guarantee non-decreasing improvement in all objectives or (in the case of fairness) convergence of the gap between objectives to zero [2508.17696, 2409.01793].
- **Pareto-stationarity:** Deconflicted updates converge to Pareto-stationary points under appropriate decrease lemmas [2503.03438, 2602.02495].
- **Task utility protection:** In federated unlearning, projection-based ascent guarantees no first-order increase in utility loss on the reference set [2601.22589].
- **Computational complexity:** Principally first-order, with small overhead for projection (at worst $O(T^{3})$ in CAGrad-style QPs, or $O(T)$ for pairwise methods). Efficient implementations exist, e.g., via Sherman–Morrison for ConicGrad [2502.00217], or module-local projections for MGCM with minimal memory and compute costs [2409.15911].

## 6. Empirical Results and Impact

Conflict-aware projected gradient ascent methods consistently outperform naive or uniform-weighted variants, especially in scenarios characterized by severe gradient conflict:

| Method/Setting    | Task/Dataset         | Baseline (PCGrad/joint) | CAPGA Variant     | Performance Gain                |
|-------------------|---------------------|------------------------|-------------------|----------------------------------|
| wPCGrad+DTP       | nuScenes            | NDS=0.329              | NDS=0.344         | +4.6% NDS, +7.2% mAP            |
| wPCGrad           | CelebA (40 attr.)   | 0.846 (avg. acc.)      | 0.850             | +0.004 avg. acc                 |
| wPCGrad           | CIFAR-100           | 0.615                  | 0.624             | +0.009 avg. acc                 |
| Ortho-LoRA        | GLUE (multi-task)   | 88.4 (avg. acc, joint) | 89.6 (Ortho-LoRA) | Recovers 80–95% of LoRA gap     |
| MGCM              | SimulST (BLEU)      | 24.51 (beam5, DiSeg)   | 25.14 (MGCM)      | +0.63 BLEU, 95% less memory     |
| FedCARE (CAPGA)   | CIFAR-10 unlearn    | -                      | 82.7% R-Acc       | Minimal overhead, near retrain   |

All tests above confirm enhanced utility retention, accelerated convergence, and in several cases, improved fairness in multitask or multi-agent regimes [2409.01793, 2503.03438, 2601.22589, 2601.09684, 2409.15911].

## 7. Domain Extensions and Generalizations

Conflict-aware projected gradient ascent has been generalized beyond traditional MTL to a range of settings:

- **Federated Unlearning:** CAPGA is central to unlearning in federated learning, efficiently removing private information from models while protecting global utility. The local CAPGA update solves a constrained ascent direction at each client [2601.22589].
- **Multi-objective LLM alignment:** CAGrad-Clip directly incorporates human preference weights and resolves conflicts between safety, helpfulness, or user utility objectives, resulting in superior Pareto frontiers compared to naive weighting or reward-model-based approaches [2602.02495].
- **Module-level conflict mitigation:** MGCM precisely resolves local conflicts in simultaneous speech translation models, reducing both compute and GPU memory overhead [2409.15911].
- **Multi-agent RL and fairness:** CAPGA, via gradient projection, guarantees monotonic non-decreasing improvement and achieves agent-equitable returns [2508.17696].
- **Parameter-efficient transfer:** In LoRA-based multi-task LLM adaptation, projection in the low-dimensional subspace delivers near single-task performance with order-of-magnitude less inference overhead [2601.09684].

The flexibility and first-order efficiency of CAPGA make it suitable for complex, large-scale, and resource-constrained optimization regimes encountered in contemporary machine learning. As a consequence, CAPGA has become a foundational tool for robust and principled multi-objective optimization across diverse applications.

Source: https://www.emergentmind.com/topics/conflict-aware-projected-gradient-ascent