---
title: Relaxed Inertial Proximal Splitting (RIPSA)
url: https://www.emergentmind.com/topics/relaxed-inertial-proximal-splitting-algorithm-ripsa
type: topic
---

# Relaxed Inertial Proximal Splitting (RIPSA)

Relaxed Inertial Proximal Splitting Algorithm (RIPSA) denotes a class of proximal splitting schemes that combine inertial extrapolation with relaxed updates, and, in several formulations, resolvent or proximal computations for monotone operators or bifunctions. In the 2025 nonlinear Forward–Backward setting, RIPSA is the relaxed inertial specialization of the Nonlinear Forward-Backward (NFB) algorithm, also known as warped resolvent iterations, for finding zeros of sums of monotone operators; in particular cases, this framework reduces to Forward–Backward, Forward–Backward–Forward, Chambolle–Pock, and Condat–Vu [2507.18856]. The acronym also appears in earlier and later literature for related but non-identical inertial–relaxed proximal schemes, including inexact proximal-point/Douglas–Rachford/ADMM variants, relaxed inertial Forward–Backward–Forward methods, and hierarchical equilibrium algorithms [1904.10502] [2003.07886] [2509.23817].

## 1. Canonical monotone-inclusion formulation

In the formulation emphasized in "Relaxed and inertial nonlinear Forward-Backward algorithm" [2507.18856], RIPSA is posed on a real Hilbert space \(H\) with a maximally monotone operator \(A:H\rightrightarrows H\), a \(\beta\)-cocoercive operator \(B:H\to H\) with \(\beta>0\), and resolvent
\[
J_{\gamma A}=(\mathrm{Id}+\gamma A)^{-1}.
\]
The target problem is the monotone inclusion
\[
0\in A(x)+B(x),
\]
and, more generally, the NFB framework treats warped resolvent formulations involving sums of maximally monotone, cocoercive, monotone and Lipschitz operators as well as linear compositions terms [2507.18856].

Given \(x_{-1},x_0\in H\), inertial parameters \((\alpha_n)\subset[0,1[\), relaxation parameters \((\lambda_n)\subset[\underline\lambda,2[\), and a stepsize \(\gamma\), the Relaxed Inertial Proximal Splitting Algorithm is
\[
\begin{cases}
\hat x_n = x_n + \alpha_n (x_n-x_{n-1}),\\[4pt]
y_n = J_{\gamma A}\bigl(\hat x_n-\gamma B(\hat x_n)\bigr),\\[4pt]
x_{n+1} = x_n + \lambda_n (y_n-x_n)+\alpha_n(x_n-x_{n-1}).
\end{cases}
\]

The standing assumptions are explicit. The operator \(A\) is maximally monotone, \(B\) is \(\beta\)-cocoercive in the sense that
\[
\langle u-v,B(u)-B(v)\rangle \ge \beta \|B(u)-B(v)\|^2 \quad \text{for all }u,v,
\]
and the stepsize satisfies \(\gamma\in]0,2\beta]\), often with \(\gamma<2\beta\). Relaxation obeys \(\lambda_n\in[\underline\lambda,2[\) for some \(\underline\lambda>0\), with \(\lambda_n\to\lambda<2\), while inertia satisfies \(\alpha_n\in[0,\alpha[\) for \(\alpha<1\) [2507.18856].

The same paper also states a more general warped resolvent setting in which one introduces a linear \(S\succ0\) and a single-valued \(M\) satisfying Lipschitz and strong-monotonicity conditions; in the simplest case one sets \(M=S/\gamma\) [2507.18856].

## 2. Inertial and relaxation mechanisms

RIPSA is organized around two interacting accelerative devices. The first is inertia, implemented through the extrapolated point
\[
\hat x_n=x_n+\alpha_n(x_n-x_{n-1}),
\]
which uses the previous displacement \(x_n-x_{n-1}\) as a momentum-like direction. The second is relaxation, implemented through the factor \(\lambda_n\) in the update from \(x_n\) toward the resolvent point \(y_n\). With \(\lambda_n=1\), the update is unrelaxed; with \(\lambda_n\neq1\), the method allows under-relaxation or over-relaxation, provided \(\lambda_n<2\) [2507.18856].

A distinctive feature of the 2025 analysis is that it considers both nondecreasing and decreasing sequences of inertial parameters. The two regimes are:

- **Nondecreasing inertia**: \(\alpha_n\uparrow \alpha\) and \(\sum_n(\alpha_n-\alpha_{n-1})=+\infty\), with constant inertia \(\alpha_n\equiv\alpha\) as an example.
- **Decreasing inertia**: \(\alpha_n\downarrow \alpha\) and \(\sum (\alpha_n-\alpha)<+\infty\), which allows larger \(\alpha\) in early iterates [2507.18856].

The paper identifies the decreasing-inertia regime as a novel approach in the context of inertial algorithms [2507.18856]. This suggests that RIPSA is not only an abstract extension of NFB but also a parameterized acceleration strategy in which early-iteration aggressiveness and asymptotic stability are separated by design.

## 3. Convergence theory

The principal convergence statements in the NFB-based RIPSA analysis are weak convergence theorems under both nondecreasing and decreasing inertia. For nondecreasing inertia, Theorem 3.2 assumes that there exist \(\epsilon>0\), \(\delta>0\), and \(N\) such that for all \(n\ge N\),
\[
1-\zeta_n^2-\epsilon>\delta,\qquad 2\beta\epsilon-\gamma_n\ge0,\qquad \rho_n\ge0,
\]
and that the derived quantities \(\delta_n\) satisfy \(\liminf \delta_n>0\), while \(\alpha_n\) is nondecreasing. Under these conditions,
\[
\sum \|x_{n+1}-x_n\|^2<+\infty,
\]
for any \(x^*\in\operatorname{zer}(A+B)\) the sequence \(\|x_n-x^*\|\) converges, and
\[
x_n \rightharpoonup x_\infty \in \operatorname{zer}(A+B).
\]
The proof constructs a Lyapunov sequence \(H_n\) combining \(\|x_n-x^*\|^2\) and inertial cross terms, establishes
\[
H_{n+1}\le H_n-\delta_n\|x_{n+1}-x_n\|^2,
\]
and then invokes Fejér monotonicity and Opial’s lemma [2507.18856].

Theorem 3.3 treats decreasing inertia. If \(\alpha_n\downarrow\alpha\), \(\sum(\alpha_n-\alpha)<\infty\), and the same stepsize and relaxation conditions hold, then the conclusions of Theorem 3.2 remain valid [2507.18856]. In other words, the decreasing-inertia strategy preserves the same weak convergence guarantees while changing the transient dynamics.

Related RIPSA-type analyses in adjacent literatures use closely allied proof templates. The inexact 2019 scheme derives a quasi-Fejér monotonicity estimate for a gap measure involving inertia and relaxation, then uses the relative-error condition and a mutual constraint on \((\alpha,\lambda)\) to obtain boundedness and weak convergence to a point in \(A^{-1}(0)\); moreover, \(u_k\to0\) and \(e_k\to0\) [1904.10502]. The relaxed inertial Forward–Backward–Forward analysis likewise proves boundedness, a discrete descent inequality, and weak convergence via Opial’s lemma under monotonicity and Lipschitz assumptions [2003.07886]. In the hierarchical equilibrium setting, RIPSA yields weak ergodic and weak convergence without a contraction factor, strong convergence under strong monotonicity, and strong convergence via a Browder–Halpern contraction factor [2509.23817].

## 4. Reductions and algorithmic relatives

One of the central reasons RIPSA is technically useful is that the NFB formulation subsumes several standard splitting methods as special cases. The reductions stated in the 2025 paper are summarized below.

| Method | Specialization | Relation to RIPSA |
|---|---|---|
| Forward–Backward (FB) | \(A\) maximally monotone, \(B\) cocoercive, \(\lambda_n\equiv1\), \(\alpha_n\equiv0\) | Direct recovery |
| Forward–Backward–Forward (FBF) | \(A+B\) maximal monotone, \(C\equiv0\) | Inertial/relaxed update yields Tseng’s FBF |
| Chambolle–Pock (CP) | Choose \(S\), \(M\), and \(B\) as block operators | With \(\alpha=0\), general RIPSA recovers CP with \(\lambda_n\) relaxation |
| Condat–Vu | Preconditioned FB on a primal–dual pair | Particular choice of \(S\) and \(C\) reduces RIPSA to Condat–Vu with inertial/relaxed steps |

These reductions are exact statements of specialization, not merely analogies [2507.18856]. They place RIPSA inside a broad unifying operator-splitting perspective in which inertial and relaxation terms can be added to established primal, dual, and primal–dual recursions.

The same unifying tendency appears in related literature, but with different base operators. The 2020 relaxed inertial FBF scheme treats the inclusion \(0\in A x + B x\) when \(A\) is maximally monotone and \(B\) is monotone and \(L\)-Lipschitz, and reduces to Tseng’s original FBF when \(\alpha_n\equiv0\) and \(\lambda_n\equiv1\) [2003.07886]. The 2019 inexact RIPSA is instead built around an inexact resolvent satisfying a relative-error criterion and serves as the basis for inexact Douglas–Rachford and ADMM variants [1904.10502]. The 2025 hierarchical-equilibrium RIPSA replaces monotone operators by bifunction resolvents \(J_{r_kG}\) and \(J_{r_kA^F}\), and also includes a contraction term \(g(x_k)\) [2509.23817].

A common source of confusion is therefore terminological rather than mathematical: the acronym RIPSA is used for multiple inertial–relaxed proximal constructions, not for a single universally fixed recursion. This suggests that the stable conceptual core is the combination of inertia, resolvent/proximal structure, and relaxation, while the surrounding operator model varies by problem class.

## 5. Numerical behavior and parameter selection

The 2025 NFB paper reports two classes of numerical experiments. The first concerns optimization with affine constraints through a Forward-Backward-Half-Forward instance. The tested problem has the form
\[
\min \ \iota_{[0,1]^N}(x)+\tfrac12\|Mx-b\|^2
\]
subject to linear inequalities. In these experiments, the Relaxed Inertial FBHF (FBHFRI) and Decreasing-Inertia FBHF (FBHFID) were compared. The reported findings are that standard FBHF often outperforms naive constant-inertia variants in CPU time and iterations, while decreasing inertia sequences such as \(\alpha_n=(c+n\cdot\log n)^{-1}\) achieve up to 30% fewer iterations and CPU time than nonincreasing or constant-\(\alpha\) schemes, especially on large problems [2507.18856].

The second set of experiments concerns image restoration through a Forward-Primal–Dual-Half-Forward instance applied to TV/Huber regularized CT deblurring. Using adaptive initialization with tunable \(\tau,\sigma\) via Initialization 4.1, decreasing inertia reduced by 20–50% the number of iterations and wall-clock time compared to classical FPDHF and constant-\(\alpha\) variants, with negligible loss in PSNR [2507.18856].

The practical parameter recommendations are also explicit. For primal–dual settings, Initialization 4.1 chooses \(t\in]0,1]\) and sets
\[
\bar\epsilon = \frac{2}{1+\sqrt{1+16\beta^2\zeta^2}},\qquad
\chi=\frac{4\beta}{1+\sqrt{1+16\beta^2\zeta^2}},
\]
\[
\tau=t\chi,\qquad
\sigma=\frac{1-\tau/\chi}{\tau\|L\|^2}.
\]
Relaxation may be chosen so that \(\lambda_n\to\lambda<\psi=(2-\epsilon+\nu)/(1+\zeta^2+\nu)\), or simply \(\lambda_n\equiv1\) if no over-relaxation is desired. For constant inertia,
\[
\alpha_n\equiv\alpha,\qquad \alpha<\alpha_{\max},
\]
with
\[
\alpha_{\max}
=
\frac{2(\psi/\lambda-1)}
{(2\psi/\lambda-1)+\sqrt{8\psi/\lambda-7}}.
\]
For decreasing inertia, one may choose \(\alpha_n\) decreasing to \(\alpha\) with \(\sum(\alpha_n-\alpha)<\infty\), for example \(\alpha_n=(c+n)^{-1}\), setting \(\alpha\) near \(\alpha_{\max}\) but tapering off to speed up early iterates. The guideline stated in the paper is to start with moderate \(\gamma\) near the upper bound \(2\beta\), set \(\lambda\) close to \(1\), choose \(\alpha\approx0.5\,\alpha_{\max}\), and, if aggressive acceleration is needed, use a decreasing \(\alpha_n\). The recommended diagnostic is to monitor \(\|x_{n+1}-x_n\|\); if stagnation or oscillations occur, reduce \(\alpha\) or \(\lambda\) [2507.18856].

## 6. Broader variants and scope of application

The acronym RIPSA has been extended beyond the cocoercive NFB setting. In "Relative-error inertial-relaxed inexact versions of Douglas-Rachford and ADMM splitting algorithms," RIPSA blends three effects in each iteration: inertial extrapolation, an inexact proximal subproblem satisfying a relative-error criterion, and relaxation or overrelaxation. With
\[
\tilde x_k=x_k+\alpha_k(x_k-x_{k-1}),
\]
the inexact step finds \(y_k\in\mathbb R^n\) and \(u_k\in A(y_k)\) such that
\[
y_k+\mu u_k=\tilde x_k+e_k,\qquad \|e_k\|\le \sigma\|y_k-\tilde x_k\|,
\]
followed by
\[
x_{k+1}=\tilde x_k-\lambda_k u_k.
\]
Under maximal monotonicity, \(A^{-1}(0)\neq\emptyset\), parameter bounds \(0\le \alpha_k\le\alpha<1\), \(0<\lambda_-\le\lambda_k\le\lambda_+<2\), \(\sigma\in[0,1)\), and a mutual bound on \((\alpha,\lambda_+)\), the iterates converge weakly; the same framework yields inexact Douglas–Rachford and inexact ADMM algorithms, with numerical experiments on LASSO and logistic regression problems [1904.10502].

In "A Relaxed Inertial Forward-Backward-Forward Algorithm for Solving Monotone Inclusions with Application to GANs," the relaxed inertial FBF method—also called RIPSA in some contexts—is
\[
y_n=x_n+\alpha_n(x_n-x_{n-1}),\qquad
u_n=J_{\gamma_n A}(y_n-\gamma_n B(y_n)),
\]
\[
t_n=u_n-\gamma_n(B(u_n)-B(y_n)),\qquad
x_{n+1}=y_n+\lambda_n(t_n-y_n),
\]
for \(A\) maximally monotone and \(B\) monotone and \(L\)-Lipschitz. The paper provides a weak-convergence theorem under monotonicity, a variational-inequality result for pseudo-monotone \(B\), an adaptive stepsize rule that does not require prior knowledge of \(L\), and numerical illustrations on a bilinear saddle-point problem and GAN training [2003.07886].

In "Weak and strong convergence of a relaxed inertial proximal splitting algorithm for solving hierarchical equilibrium problems," RIPSA is formulated for bifunctions \(F,G:C\times C\to\mathbb R\) over a nonempty closed convex set \(C\), with iteration
\[
y_k=(1-\eta_k)x_k+\eta_k x_{k-1},\qquad
u_k=J_{r_kG}(y_k),\qquad
z_k=J_{r_kA^F}(u_k),
\]
\[
x_{k+1}=\alpha_k x_k+\beta_k z_k+(1-\alpha_k-\beta_k)g(x_k),
\]
where \(g:C\to C\) is a \(\theta\)-contraction. The paper establishes weak ergodic and weak convergence without a Browder–Halpern contraction factor, strong convergence under a strong monotonicity assumption, and strong convergence via the contraction factor without strong monotonicity; it also discusses convex minimization, monotone variational inequalities, and fixed-point problems as special cases [2509.23817].

Taken together, these formulations show that RIPSA functions as a recurrent design template across monotone inclusions, saddle-point systems, inexact splitting, primal–dual imaging models, hierarchical equilibrium problems, and fixed-point formulations. The shared structure is the systematic coupling of inertial extrapolation with a proximal or resolvent step and a relaxed terminal update, while the precise operator model, admissible parameter regime, and convergence mode depend on the surrounding problem class.

Source: https://www.emergentmind.com/topics/relaxed-inertial-proximal-splitting-algorithm-ripsa