---
title: Plug-and-Play Bregman Proximal Gradient
url: https://www.emergentmind.com/topics/plug-and-play-bregman-proximal-gradient-pnp-bpgm
type: topic
---

# Plug-and-Play Bregman Proximal Gradient

Plug-and-Play Bregman Proximal Gradient Methods (PnP–BPGM) constitute a class of optimization algorithms designed for inverse problems with non-Euclidean data-fidelity terms, particularly those arising in Poisson and other non-Gaussian noise models. By systematically replacing the quadratic norm in traditional Proximal Gradient Methods with a Bregman divergence adapted to the problem geometry, and integrating learned denoisers parametrized to this geometry, PnP–BPGM generalizes plug-and-play frameworks for a broader class of signal restoration settings. The approach is grounded in convex and nonconvex optimization theory and features explicit convergence guarantees, efficient algorithms, and strong empirical performance, especially for Poisson inverse problems [2306.03466], [2202.02388].

## 1. Mathematical Foundations and Bregman Geometry

The Bregman divergence $D_h(x, y)$, defined for a strictly convex, differentiable function $h: C \subseteq \mathbb{R}^n \to \mathbb{R}$, captures non-Euclidean geometry intrinsic to many inverse problems. For $h$ $\mu$-strongly convex with $L_h$-Lipschitz $\nabla h$, the divergence is
\[
D_h(x, y) = h(x) - h(y) - \langle \nabla h(y),\, x-y \rangle, \quad x, y \in \operatorname{dom} h,
\]
admitting lower and upper quadratic bounds:
\[
\frac{\mu_h}{2}\|x-y\|^2 \le D_h(x, y) \le \frac{L_h}{2}\|x-y\|^2.
\]
If $h(x) = \frac12\|x\|^2$, $D_h$ specializes to the standard Euclidean norm. For Poisson noise and non-negativity constraints ($x \in \mathbb{R}_+^n$), Burg entropy $h(x) = -\sum_i \log x_i$ yields $D_h(u, v) = \sum_i[u_i/v_i - \log(u_i/v_i) - 1]$, closely tracking the local structure of the Kullback–Leibler data fidelity [2306.03466], [2202.02388].

## 2. Problem Formulation and Classical Methods

Inverse problems are formulated as minimizations of composite functionals,
\[
\min_x \Phi(x) := f(x) + r(x),
\]
where $f(x)$ encodes the data-fidelity term—often a negative log-likelihood such as, for Poisson statistics,
\[
f(x) = \sum_{i=1}^m [ y_i \log(y_i/(\alpha (A x)_i)) + \alpha (A x)_i - y_i ],
\]
with $y \sim \mathrm{Poisson}(\alpha A x)$—and $r(x)$ imposes a (possibly nonconvex) regularizer.

Classical Proximal Gradient Methods (PGM) assume $f$ is $L$-smooth (Lipschitz gradient), leading to a majorize–minimize update,
\[
x^{k+1} = \arg\min_x \left\{
\langle \nabla f(x^k), x-x^k\rangle + \frac{L}{2} \|x-x^k\|^2 + r(x)
\right\}.
\]
In the Plug-and-Play (PnP) paradigm, proximal operators are replaced by powerful Gaussian denoisers, yielding iterates $x^{k+1} = \mathcal{D}_\sigma(z^k)$ with $z^k = x^k - \gamma\nabla f(x^k)$. However, this Euclidean setting is ill-suited for non-Gaussian models or settings lacking efficient proximal maps [2202.02388].

## 3. Bregman Proximal Gradient and Plug-and-Play Integration

The Bregman Proximal Gradient Method (BPGM) generalizes PGM by using $h$-adapted geometry. Assuming $f$ is $L$-smooth relative to $h$ ($L h - f$ convex), the update is
\[
x^{k+1} \in \arg\min_x \left\{
r(x) + \langle \nabla f(x^k), x-x^k\rangle + \frac{1}{\tau} D_h(x, x^k)
\right\}.
\]
This decomposes into a mirror-descent step $z^k = \nabla h^*(\nabla h(x^k) - \gamma \nabla f(x^k))$, followed by a Bregman proximal step $x^{k+1} = \operatorname{prox}_r^h(z^k) = \arg\min_x \{ D_h(x, z^k) + r(x) \}$.

Plug-and-Play BPGM (PnP–BPGM) replaces the Bregman proximal operation with a learned denoiser $\mathcal{D}_\theta$ tuned to the geometry,
\[
\begin{aligned}
z^k & = \nabla h^*(\nabla h(x^k) - \gamma \nabla f(x^k)), \\
x^{k+1} & = \mathcal{D}_\theta(z^k).
\end{aligned}
\]
For Poisson models, the denoiser is parameterized to respect the Bregman noise model: $\mathcal{D}_\gamma(y) = y - (\nabla^2 h(y))^{-1} \nabla g_\gamma(y)$, with $g_\gamma$ a learnable potential, ensuring $\mathcal{D}_\gamma$ approximates the MMSE estimator under Bregman noise [2306.03466].

## 4. Algorithmic Framework and Variants

Two principal algorithms are established:

- **Bregman RED (B-RED)**: Employs a Bregman descent with backtracking and explicit update,
  ```
  For k = 0, 1, 2, ...
      τ ← τ₀
      Repeat
          x⁺ = argmin_x ⟨∇F_{λ,γ}(x^k), x-x^k⟩ + (1/τ) D_h(x, x^k)
          If decrease insufficient: τ ← ητ
      Until decrease OK
      x^{k+1} = x⁺
  End
  ```
- **Bregman PnP (B-PnP)**: Fixed-step implementation with plug-and-play denoising,
  ```
  For k = 0, 1, 2, ...
      w = ∇h(x^k) - τλ∇f(x^k)
      z = ∇h*(w)
      x^{k+1} = 𝒟_γ(z)
      If stopping criterion: break
  End
  ```
B-RED allows adaptive step-size adjustment; B-PnP enforces $\lambda L_f < 1$ for fixed-τ convergence [2306.03466]. Both leverage Burg entropy for Poisson problems but can accommodate other choices of $h(x)$ for different noise or constraints [2202.02388].

## 5. Theoretical Analysis: Convergence Guarantees

Convergence is established under the following:
- $h$ is Legendre, $\mathcal{C}^2$, strongly convex;
- $f$ is semialgebraic, proper, coercive, and $\mathcal{C}^1$ on $\operatorname{int} \operatorname{dom} h$;
- The “NoLip” property: $L_f h - f$ convex;
- $\nabla h$ and $\nabla f$ Lipschitz on sublevel sets;
- Learnable potentials $g_\gamma$, $\varphi_\gamma$ lower bounded, semialgebraic.

Invoking the Kurdyka–Łojasiewicz property, the following is shown:
- The sequence $\{\Psi(x^k)\}$ is nonincreasing and converges.
- Iterates $\{x^k\}$ remain bounded in a compact sublevel set.
- $\sum_k D_h(x^{k+1}, x^k) < \infty$, with $D_h(x^{k+1}, x^k) = O(1/k)$.
- All accumulation points are stationary for the explicit global functional,
  - $\Psi(x) = i_C(x) + \lambda f(x) + g_\gamma(x)$ for B-RED,
  - $\Psi(x) = \lambda f(x) + \varphi_\gamma(x)$ for B-PnP [2306.03466].

In the strongly convex case, Lipschitz-averaged denoiser conditions yield global contraction, and step-size bounds can be explicitly characterized [2202.02388].

## 6. Implementation and Empirical Evaluation

When specialized to Poisson deblurring, the forward model $y \sim \mathrm{Poisson}(\alpha A x)$ is paired with Burg entropy, yielding closed-form mirror steps. For practical denoising, DnCNN-type architectures are trained according to Bregman noise and integrated as $\mathcal{D}_\gamma$ [2306.03466], [2202.02388].

Experimental evaluation on CBSD68 (color images) with four blur kernels (real camera shakes, uniform $9 \times 9$, Gaussian $25 \times 25$) demonstrates:

| Noise Level (α) | B-RED PSNR (dB) | B-PnP PSNR (dB) |
|:---:|:----------:|:------------:|
| 20  |   23.58    |    23.29     |
| 40  |   24.54    |    24.54     |
| 60  |   24.90    |    24.80     |

Both methods exhibit monotonic decrease of $\Phi(x^k)$ and convergence rate $O(1/k)$, achieving effective noise and blur removal without visual artifacts. In comparative studies, PnP–BPGM outperforms Euclidean PnP and direct U-Net baselines for Poisson denoising [2306.03466], [2202.02388].

## 7. Broader Significance and Research Directions

PnP–BPGM generalizes plug-and-play inverse problem solvers beyond the Euclidean setting, adapting the optimization geometry to the statistical structure of the data-fidelity term and the implied signal constraints. This flexibility is critical for Poisson models, nonnegativity, simplex constraints, and other scenarios where the standard quadratic proximal geometry is poorly matched. Theoretical results cover both strongly convex and certain nonconvex settings, but extensions to fully general convex/nonconvex cases, automated selection or learning of $h$, and integration with more complex noise or signal geometries are active research topics. Limitations include the need for tractable forms of $\nabla h^*$ and strong convexity assumptions in current theory [2202.02388]. 

PnP–BPGM thus represents a principled framework for optimizing and learning in non-Euclidean statistical inverse problems, with rigorous theoretical guarantees and practical efficacy validated in Poisson linear imaging and beyond [2306.03466], [2202.02388].

Source: https://www.emergentmind.com/topics/plug-and-play-bregman-proximal-gradient-pnp-bpgm