---
title: Double-Preconditioning (DoPr) Techniques
url: https://www.emergentmind.com/topics/double-preconditioning-dopr
type: topic
---

# Double-Preconditioning (DoPr) Techniques

Searching arXiv for the cited DoPr usages to ground the article in the relevant papers.
Double-preconditioning, commonly abbreviated **DoPr**, is not a single universally standardized construction but a recurring name for several technically distinct preconditioning paradigms across numerical linear algebra, interval analysis, operator preconditioning, saddle-point Krylov methods, and deep-learning optimization. Across these settings, the shared motif is the coordinated use of two complementary transformations—most often left/right matrix scalings, nested Schur complements, or dual perturbation controls—to improve conditioning, regularity checks, solver robustness, or downstream rollout performance. In the optimization literature, DoPr denotes the search for positive diagonal row and column scalings $D_\ell$ and $D_r$ minimizing $\kappa(D_\ell A D_r)$ [2209.00809]. In interval-parametric linear systems, it denotes splitting $(A^c)^{-1}$ into two factors and preconditioning from both sides to sharpen strong-regularity tests and solution enclosures [2004.09209]. In PDE-constrained optimization, it refers to a double Schur-complement preconditioner for a $3\times 3$ saddle-point system [2112.05020]. In Petrov–Galerkin operator preconditioning, a bi-parametric framework controls perturbations in both the original form and the preconditioner [2011.05028]. In recent deep-learning work, DoPr combines gradient-wise and activation-wise preconditioning to target test-time performance under feedback dynamics rather than one-step validation loss [2606.06418].

## 1. Terminological scope and recurring structure

The term **double-preconditioning** is used in multiple research programs for constructions that involve two coordinated preconditioning actions rather than a single left preconditioner or a single adaptive scaling. This shared naming convention is substantive rather than merely linguistic: each usage introduces a paired mechanism designed to address a limitation of one-sided or single-parameter conditioning.

In the diagonal-scaling setting, a “double-preconditioner” is explicitly “a pair of positive diagonal matrices $D_\ell\in\mathbb R^{m\times m}$ and $D_r\in\mathbb R^{n\times n}$ so that we replace $A$ by $D_\ell A D_r$” [2209.00809]. In interval-parametric systems, the midpoint inverse is split into two factors, yielding a left-right transformation $H(p)=L\,A(p)\,R$ [2004.09209]. In the double saddle-point setting, the “double” component arises from two nested Schur complements,
$$
S_1 = A_2 + B_1A_1^{-1}B_1^T,\qquad
S_2 = A_3 + B_2S_1^{-1}B_2^T,
$$
which define the block-diagonal preconditioner $M_D=\operatorname{diag}(A_1,S_1,S_2)$ [2112.05020]. In bi-parametric operator preconditioning, the dual structure is encoded by two perturbation parameters, $\delta$ for the original form and $\epsilon$ for the preconditioner [2011.05028]. In deep learning, DoPr is defined as the composition of activation preconditioning and gradient-wise preconditioning, with the first stage computing $M_\ell=G_\ell\bar\Sigma_\ell^{-1}$ and the second stage applying a base optimizer such as AdamW or Muon [2606.06418].

This plurality matters for interpretation. A common misconception is that DoPr refers to one specific algorithm. The literature instead supports a broader encyclopedic reading: **DoPr is a family of two-stage or two-sided preconditioning designs whose exact mathematical content depends on domain-specific structure**. This suggests that the unifying principle is architectural rather than formal: two complementary conditioning operations are used to target quantities that a one-sided method leaves poorly controlled.

## 2. Optimal diagonal preconditioning in numerical linear algebra

In "Optimal Diagonal Preconditioning" [2209.00809], DoPr is the systematic search for the best possible row and column scalings of a full-rank matrix with respect to the spectral condition number. Let $A$ be an $m\times n$ real or complex matrix. The objective is to choose positive diagonal matrices $D_\ell$ and $D_r$ to minimize
$$
\kappa(D_\ell A D_r),
$$
where $\kappa(M)=\|M\|_2\cdot\|M^{-1}\|_2$ for invertible $M$.

The paper formulates the problem as
$$
\begin{aligned}
& \min_{D_\ell,\,D_r}\;\;
\|D_\ell\,A\,D_r\|_2\;\bigl\|\,(D_\ell\,A\,D_r)^{-1}\bigr\|_2,\\
& \text{subject to}\quad D_\ell\succ 0,\quad D_r\succ 0.
\end{aligned}
$$
Although this objective is nonconvex jointly in $(D_\ell,D_r)$, the relevant feasibility sets are quasi-convex in the pair. For any $t>1$, the constraint $\kappa(D_\ell A D_r)\le t$ can be rewritten through two spectral-norm inequalities and then as linear matrix inequalities:
$$
A\,D_r^2\,A^T \;\preceq\; t\,D_\ell^{-2},\qquad
A^T\,D_\ell^2\,A \;\preceq\; t\,D_r^{-2}.
$$
This produces a bisection scheme on $t$, initialized with $t_{\text{low}}\leftarrow 1$ and $t_{\text{high}}\leftarrow \kappa(A)$ or another upper bound, with each midpoint checked through the LMI feasibility problem [2209.00809].

The same work develops an interior-point method for the feasibility subproblem. Writing the diagonal entries of $D_\ell$ and $D_r$ as $u\in\mathbb R^m$ and $v\in\mathbb R^n$, and defining
$$
X_1 = A\,\operatorname{diag}(v)^2\,A^T,\quad Z_1=\operatorname{diag}(u)^{-2},
$$
$$
X_2 = A^T\,\operatorname{diag}(u)^2\,A,\quad Z_2=\operatorname{diag}(v)^{-2},
$$
the barrier is
$$
\Phi(u,v) \;=\;
-\sum_{i=1}^m\log(u_i)
-\sum_{j=1}^n\log(v_j)
-\tfrac12\log\det\bigl(tZ_1 - X_1\bigr)
-\tfrac12\log\det\bigl(tZ_2 - X_2\bigr).
$$
Newton steps are then computed from the Hessian of $\Phi$, with line search preserving positivity of $u$, $v$, and the slack matrices. Because the feasibility problem lives in a self-scaled cone, the Nesterov–Todd direction yields $O(\log(1/\epsilon))$ iteration complexity for certifying feasibility to accuracy $\epsilon$ [2209.00809].

The paper also identifies a one-sided specialization. If $D_\ell=I$ and only right-scaling is allowed, then
$$
\min_{D_r\succ0}\kappa(A D_r)
$$
reduces to the convex SDP
$$
\begin{aligned}
&\min_{t,D_r}\;t,\\
&\text{s.t.}\;\;A\,D_r^2\,A^T\preceq t\,I,\quad D_r\succ0,\;D_r\text{ diagonal}.
\end{aligned}
$$
Empirically, the work reports that optimal diagonal preconditioners can significantly improve on heuristic diagonal preconditioners for reducing condition numbers and speeding up iterative methods, and that customized solvers with random row/column sampling can find near-optimal diagonal preconditioners for matrices up to size $200{,}000$ in reasonable time [2209.00809]. The associated summary further states that, against standard one-sided equilibration, DoPr typically achieves another $2\times$–$5\times$ reduction in spectral condition number, and that on sparse $10^5\times 10^5$ PDE matrices, DoPr-preconditioned CG ran in roughly $30\%$–$50\%$ of the iterations and wall-clock time needed with row-only scaling [2209.00809].

## 3. Double preconditioning for interval-parametric linear systems

In "On preconditioning and solving an extended class of interval parametric linear systems" [2004.09209], double preconditioning is introduced for interval-parametric linear systems
$$
\{\,A(p)\,x=b(p)\mid p\in\underline p,\overline p\,\},
$$
with particular emphasis on affine-linear dependence,
$$
A(p)=A^{(0)}+\sum_{k=1}^K A^{(k)}p_k,\qquad
b(p)=b^{(0)}+\sum_{k=1}^K b^{(k)}p_k.
$$
The goal is to enclose the united solution set
$$
S(\inum p)=\{\,x\in\mathbb R^n\mid \exists\,p\in\inum p:\;A(p)x=b(p)\,\},
$$
preferably through a parametric, or $p$-solution,
$$
\inum x(p)=F\,p+\inum a.
$$

The usual starting point is single left preconditioning by the midpoint inverse. With midpoint parameter $p^c$ and midpoint matrix $A^c=A(p^c)$, one sets $R=(A^c)^{-1}$ and forms
$$
H(p)x=d(p),\qquad H(p)=R\,A(p),\qquad d(p)=R\,b(p).
$$
In the affine-linear case, this yields an interval hull
$$
\inum H=I_n+H^\Delta[-1,1],\qquad
H^\Delta=\sum_{k=1}^K |R\,A^{(k)}|\,p_k^\Delta,
$$
and a standard sufficient condition for strong regularity is $\rho(H^\Delta)<1$. The paper’s central point is that failure of this test under single left preconditioning does not imply failure of the original system; instead, two-sided splitting may recover tractability [2004.09209].

DoPr splits the midpoint inverse as
$$
(A^c)^{-1}=R\,L,
$$
and then preconditions from both sides:
$$
H(p)=L\,A(p)\,R,\qquad g(p)=L\,b(p).
$$
In the affine-linear case,
$$
H(p)=I_n+\sum_{k=1}^K |L\,A^{(k)}\,R|\,p_k^\Delta[-1,1],
\qquad
H^\Delta=\sum_{k=1}^K |L\,A^{(k)}\,R|\,p_k^\Delta.
$$
Strong regularity is again checked by $\rho(H^\Delta)<1$, after which the transformed variable $y=R^{-1}x$ is solved and mapped back as $x=R\,y$ [2004.09209].

The algorithmic procedure given in the paper comprises midpoint computation, a nonsingularity check on $A^c$, a choice of factors $R$ and $L$ such that $R\cdot L=(A^c)^{-1}$, formation of $H^\Delta$, rejection if $\rho(H^\Delta)\ge 1$, application of an interval-affine solver such as Parametric Krawczyk to the transformed system, and final recovery of $x(e)=R\,y(e)$ [2004.09209].

A key illustrative example uses
$$
A(p)=
\begin{pmatrix}
1-0.5\,p & -p\\
0.5\,p   & 1+p
\end{pmatrix},\qquad p\in[-1,1].
$$
With midpoint $A^c=I_2$, single preconditioning gives
$$
\inum H
=I+
\begin{pmatrix}
0.5&1\\
0.5&1
\end{pmatrix}[-1,1],
\qquad \rho(H^\Delta)=1.5\ge 1,
$$
so the method fails. Choosing instead
$$
R=
\begin{pmatrix}
1&1\\
0&1
\end{pmatrix},\qquad
L=R^{-1}=
\begin{pmatrix}
1&-1\\
0&1
\end{pmatrix},
$$
yields
$$
\inum H
=I_2+
\begin{pmatrix}
0&0.5\\
0&0.5
\end{pmatrix}[-1,1],
\qquad \rho(H^\Delta)=0.5<1,
$$
so the transformed system becomes solvable [2004.09209].

The paper explicitly argues that splitting $(A^c)^{-1}$ into $L$ and $R$ can reduce the size of the interval coefficients in $L A^{(k)}R$ relative to $A^c{}^{-1}A^{(k)}$, thereby reducing $\rho(H^\Delta)$ and decreasing overestimation in interval computations [2004.09209]. It also notes that the choice of $(R,L)$ is not unique, that LU-based splitting is advocated as the best trade-off in practice, and that one may also consider SVD- or spectral-based splittings when the coefficient matrices have special structure [2004.09209]. A plausible implication is that, in this literature, DoPr functions less as a conditioning tool in the classical $\kappa(\cdot)$ sense than as a mechanism for reshaping interval dependence so that spectral-radius regularity criteria become informative.

## 4. Double Schur-complement preconditioning for saddle-point systems

In "Double Saddle-Point Preconditioning for Krylov Methods in the Inexact Sequential Homotopy Method" [2112.05020], DoPr denotes a block preconditioner for the $3\times 3$ system arising after elimination of trivial active-set rows and a symmetric permutation. For the remaining unknowns $x=(\Delta\bar q,\Delta\tilde y,\Delta u)^T$, the linear system is
$$
\mathcal A =
\begin{pmatrix}
A_1 & B_1^{T} & 0 \\
B_1 & -A_2 & B_2^{T} \\
0 & B_2 & A_3
\end{pmatrix},
\qquad
\mathcal A x=b.
$$
The blocks satisfy
$$
A_1=\lambda\tilde M_Q+\tilde H_Q,\qquad
A_2=\frac{\lambda}{1+\rho\lambda}M_Y,\qquad
A_3=\lambda M_U+H_U,
$$
with corresponding Jacobian blocks $B_1=\tilde G_Q$ and $B_2=G_U^T$ [2112.05020].

The defining construction is the use of two nested Schur complements,
$$
S_1 = A_2 + B_1A_1^{-1}B_1^T,\qquad
S_2 = A_3 + B_2S_1^{-1}B_2^T.
$$
From these, the ideal block-diagonal preconditioner is
$$
M_D=\operatorname{diag}(A_1,S_1,S_2).
$$
Under the assumptions
$$
A_1\succ 0,\quad A_2\succeq 0,\quad A_3\succeq 0,\quad
\operatorname{rank}(B_1)=m,\quad \operatorname{rank}(B_2)=n_U,
$$
one has $S_1\succ 0$ and $S_2\succ 0$, so that $M_D$ is SPD and $M_D^{-1}\mathcal A$ is diagonalizable with real spectrum [2112.05020].

Theorem 3.3, as summarized in the supplied material, gives tight spectral bounds:
$$
\sigma(M_D^{-1}\mathcal A)\subset
[-1.618,-0.618]\cup[0.445,1.802],
$$
implying
$$
\operatorname{cond}(M_D^{-1}\mathcal A)\le \tfrac{1.802}{0.445}\approx 4.05,
$$
independently of mesh size, $\lambda$, or $\rho$ [2112.05020]. This spectral information is central for Krylov performance. The summary further states that MINRES or CG on the symmetric base system converges at a rate bounded by
$$
\rho_{\inf}=\frac{\sqrt{\kappa}-1}{\sqrt{\kappa}+1},
\qquad
\kappa\le 4.05,
$$
so that in practice fewer than $\mathcal O(\sqrt{\kappa}\log\epsilon^{-1})\approx \mathcal O(3\log\epsilon^{-1})$ iterations are needed, independent of mesh size [2112.05020].

Application of $M_D^{-1}$ requires three block solves: approximately solving with $A_1$, with $S_1$, and with $S_2$. The paper emphasizes that $S_1$ and $S_2$ are not formed explicitly. Instead, $S_1^{-1}$ is approximated through a solve with
$$
(\lambda/(1+\rho\lambda))M_Y + (\lambda+\gamma)^{-1}M_Q,
$$
while $S_2^{-1}$ is applied via a matching factorization
$$
S_2\approx D\,\hat S_1^{-1}\,D^T,
$$
leading to two nested sparse solves or AMG applications [2112.05020].

The numerical results reported for a nonlinear $3$D benchmark problem reach up to $12.5$M degrees of freedom on $32$ cores. The provided table gives, for $N=160$, $12\,519\,843$ DOFs, $35$ outer iterations, $760$ total MINRES iterations, and $63.2$ minutes total time; even at this scale, average MINRES iterations remain about $22$ per Newton step [2112.05020]. By contrast, the summary states that a direct factorization on the largest mesh would require several hundred GB of memory and tens of hours [2112.05020]. In this usage, DoPr is therefore a structure-exploiting Schur-complement preconditioner rather than a left-right scaling method.

## 5. Bi-parametric operator preconditioning

In "Bi-Parametric Operator Preconditioning" [2011.05028], the relevant DoPr framework arises in an abstract Petrov–Galerkin setting and formalizes two distinct sources of approximation: perturbations in the original sesquilinear form and perturbations in the preconditioner. Let $X,Y$ be reflexive Banach spaces, with a continuous sesquilinear form $a\in L(X\times Y;\mathbb C)$ and operator $A\in L(X;Y')$ defined by $\langle Au,v\rangle=a(u,v)$. The discrete problem on finite-dimensional spaces $X_h\subset X$, $Y_h\subset Y$ is assumed to satisfy the Banach–Nečas–Babuška condition with discrete inf-sup constant $\gamma_A>0$ [2011.05028].

The operator-preconditioning construction introduces a model operator $C:V\to W'$ and pairings $M:X\to W'$, $N:V\to Y'$, leading to the exact preconditioner
$$
P:=M^{-1}CN^{-1}.
$$
Discretely,
$$
(P_hA_h)x=(M_h^{-1}C_hN_h^{-1}A_h)x=M_h^{-1}C_hN_h^{-1}b_h.
$$
The “double” aspect here is not left-right matrix scaling but the simultaneous treatment of two perturbation parameters:
$$
\delta\in[0,1) \quad\text{for the original form},\qquad
\epsilon\in[0,1)\quad\text{for the preconditioner}.
$$
An $(h,\delta)$-perturbation $a_\delta$ satisfies
$$
|a(u_h,v_h)-a_\delta(u_h,v_h)|\le
\delta\,\gamma_A\,\|u_h\|_X\|v_h\|_Y,
$$
and the analogous condition for $c_\epsilon$ uses $\gamma_C$ [2011.05028].

The perturbed bi-parametric system is
$$
P_{h,\epsilon}A_{h,\delta}u_{h,\delta}=P_{h,\epsilon}b_{h,\delta},
$$
with
$$
P_{h,\epsilon}:=M_h^{-1}C_{\epsilon,h}N_h^{-1},\qquad
A_{h,\delta}:=A_{\delta,h}.
$$
In a Krylov method such as GMRES, applying the preconditioner requires three steps:
$$
N_h v_k=r_k,\qquad
w_k=C_{\epsilon,h}v_k,\qquad
M_h q_k=w_k,
$$
so that $q_k=P_{h,\epsilon}r_k$ [2011.05028].

The principal quantitative statement is a bi-parametric condition-number bound. With
$$
K_0:=\frac{\|m\|\|n\|\|c\|\|a\|}{\gamma_M\gamma_N\gamma_C\gamma_A},
$$
the perturbed condition numbers satisfy
$$
\kappa_S(P_{\epsilon}A_{\delta})\le
K(\epsilon,\delta),\qquad
\kappa_2(P_{\epsilon}A_{\delta})\le
K(\epsilon,\delta)\,K_{\Lambda_h}^2,
$$
where
$$
K(\epsilon,\delta):=
K_0\cdot \frac{1+\epsilon}{1-\epsilon}\cdot\frac{1+\delta}{1-\delta}.
$$
In the Hilbert setting, under field-of-values assumptions, GMRES residuals satisfy
$$
\|r_k\|_H/\|r_0\|_H\le (1-1/K(\epsilon,\delta))^{k/2},
$$
and, when $K_{\Lambda_h}$ remains bounded and the forms remain uniformly well posed, this convergence is $h$-independent [2011.05028].

The same paper also develops a super-linear regime for second-kind Fredholm operators. If $P_\epsilon A_\delta=I+K_{\epsilon,\delta}$ with $K_{\epsilon,\delta}$ compact or in a Carleman class $C^p$, then the no-restart GMRES residual satisfies
$$
\|r_k\|_H^{1/k}\le
\frac{\|n\|}{\gamma_C\gamma_A\gamma_M}\,
\frac{\overline\sigma_k(K_{\epsilon,\delta})}{(1-\epsilon)(1-\delta)},
$$
and, for $K_{\epsilon,\delta}\in C^p$, the rate is $O(k^{-1/p})$ [2011.05028].

The practical discussion emphasizes a cost-accuracy trade-off: one may choose $\delta=O(h^r)$ to match Galerkin discretization error while allowing $\epsilon=O(1)$, including aggressive compression of the preconditioner, without losing $h$-independent convergence [2011.05028]. The supplied summary states that this can reduce memory and setup cost by factors of $5$–$20$ in practice while keeping $K(\epsilon,\delta)$ typically below $10$–$20$ and GMRES iteration counts in $O(20$–$50)$ independent of $h$ [2011.05028]. This suggests a domain-general interpretation of DoPr as a framework for **separately budgeting approximation error in the operator and in the preconditioner**.

## 6. Double preconditioning in test-time-feedback optimization

The 2026 paper "Double Preconditioning (DoPr): Optimization for Test-Time Performance, not Validation Loss" [2606.06418] introduces a distinct use of DoPr in machine learning. The motivating setting is **test-time feedback** (TTF): training minimizes a one-step supervised loss on expert-distributed samples, but deployment rolls the model out on its own predictions, inducing a shifted state or token distribution. The paper states that this mismatch grows with task length and can degrade downstream metrics such as cumulative reward, pass@k, success rate, or FID even when validation loss is low [2606.06418].

In this formulation, DoPr combines two classes of optimizer geometry. Gradient-wise preconditioners such as Adam, Muon, Shampoo, and related methods adapt update magnitudes using gradient statistics but are described as blind to activation distributions. Activation preconditioners such as one-sided KFAC, LoCoProp, or right-side-only Fisher rescale layer gradients by the inverse activation covariance
$$
\Sigma_z=E[zz^T],
$$
promoting uniform feature updates across activation directions [2606.06418]. The paper’s core claim is that adding activation preconditioning improves downstream performance in TTF settings even when validation loss does not improve correspondingly.

For a layer weight $W_\ell\in\mathbb R^{d_{\text{out}}\times d_{\text{in}}}$, the method computes the raw minibatch gradient $G_\ell=\nabla_{W_\ell}\mathcal L(f_{\theta^{(k)}})$ and the empirical activation covariance
$$
\Sigma_\ell=(1/n)\sum_{i=1}^n z_{\ell,i}z_{\ell,i}^T.
$$
With damping parameter $\gamma>0$, the damped covariance is
$$
\bar\Sigma_\ell=\Sigma_\ell+\gamma\cdot \operatorname{tr}(\Sigma_\ell)\cdot I_{d_{\text{in}}}.
$$
Stage 1 applies activation preconditioning:
$$
M_\ell=G_\ell\cdot \bar\Sigma_\ell^{-1}.
$$
Stage 2 applies a base gradient-wise preconditioner:
$$
D_\ell=\operatorname{GP}(M_\ell;\text{state}),
$$
for example AdamW with the usual $(m_\ell,v_\ell)$ recursions and bias correction, followed by
$$
W_\ell^{(k+1)}=(1-\eta\lambda)\cdot W_\ell^{(k)}-\eta\cdot D_\ell.
$$
The algorithm is presented as a per-layer wrapper and described as a “plug-in” two-stage update [2606.06418].

The paper attributes DoPr’s effect to geometry under feedback dynamics. Standard GD or GP is said to bias feature updates toward directions of large activation variance, potentially neglecting low-variance but TTF-sensitive directions. Activation preconditioning “whitens” activations by making the update equivalent to steepest descent under the inner product weighted by $\Sigma_z^{-1}$, thereby enforcing more uniform subspace contraction [2606.06418]. Pure AP is described as potentially numerically unstable; the addition of GP is intended to restore stability, momentum, and adaptive step-size control.

The reported computational overhead per layer is
$$
O(n\,d_{\text{in}}^2 + d_{\text{in}}^3/3 + d_{\text{out}}\,d_{\text{in}}^2),
$$
with end-to-end overhead approximately $1.2$–$1.3\times$ standard backprop in large-batch regimes, and memory sufficient to store $\bar\Sigma_\ell$ and the base optimizer state [2606.06418]. Approximation strategies listed in the summary include spatially uncorrelated activation approximations for Conv2d, rank-1-plus-diagonal inverses via Sherman–Morrison, and diagonal treatment of one-hot embedding activations [2606.06418].

Empirical evaluation spans four TTF domains. In continuous-control imitation learning on Humanoid-v5 and Half-Cheetah-v5, DoPr variants are reported to increase terminal return, with examples of $+5$–$15\%$ on Humanoid despite similar or worse validation loss. In Robomimic pixel-based imitation tasks such as Tool-Hang and Transport, DoPr-AdamW and DoPr-Muon improve success rate by $+3$–$10$ percentage points. In language-model SFT on GSM8K and OpenMathInstruct-2.1M, DoPr shifts peak accuracy upward by $+2$–$5$ percentage points in one setting and by $+2$–$14$ percentage points in a high-learning-rate regime, while the baseline AdamW exhibits learning rates whose lower NLL degrades downstream accuracy. In generative flows on SiT-S for ImageNet-256, DoPr-AdamW and DoPr-Muon produce faster FID convergence, including examples of $25$–$50\%$ FID reduction at the midpoint [2606.06418]. The central interpretive point is explicit in the paper’s title: optimization is being tuned for test-time performance, not validation loss.

## 7. Comparison, misconceptions, and open directions

A comparative reading of these papers shows that DoPr is a **domain-dependent design pattern** rather than a transferable algorithmic object. The numerical linear algebra version minimizes the two-norm condition number by left/right diagonal scalings [2209.00809]. The interval-analysis version sharpens strong-regularity checks by factorizing the midpoint inverse and transforming both sides [2004.09209]. The saddle-point version exploits nested Schur complements to build a mesh-robust SPD block preconditioner [2112.05020]. The operator-preconditioning version controls two perturbation channels, $\delta$ and $\epsilon$, within a Petrov–Galerkin framework [2011.05028]. The deep-learning version composes activation-wise and gradient-wise preconditioners to improve downstream rollout behavior under train-test mismatch [2606.06418].

Several misconceptions are therefore best addressed directly. First, DoPr is not synonymous with diagonal equilibration, even though one influential paper uses that interpretation [2209.00809]. Second, DoPr is not always a matrix preconditioner for a linear system; it may instead be a solver framework, a perturbation calculus, or an optimizer update rule [2011.05028; 2606.06418]. Third, the “double” aspect does not always mean literal left and right multiplication. In different literatures it denotes two-sided matrix actions, two nested Schur complements, or two perturbation parameters [2004.09209; 2112.05020; 2011.05028].

At the same time, there is a coherent cross-domain theme. In every case, a one-sided or single-statistic procedure is judged insufficient for the quantity of interest: heuristic diagonal scaling may not minimize $\kappa$, midpoint-inverse left preconditioning may not pass the $\rho(H^\Delta)<1$ test, a single Schur complement may not fully exploit $3\times 3$ saddle structure, a single perturbation budget may not describe inexact operator preconditioning, and gradient-wise adaptation alone may not address test-time feedback [2209.00809; 2004.09209; 2112.05020; 2011.05028; 2606.06418]. This suggests that the enduring value of the term lies in a methodological principle: **pair two complementary preconditioning mechanisms so that the target performance criterion—condition number, strong regularity, Krylov spectrum, perturbation robustness, or rollout quality—is controlled more directly than under a one-sided design**.

The open directions also differ by field. The interval paper notes that optimizing $R$ and $L$ to minimize $\rho(H^\Delta)$ directly would be a nonconvex problem on the Lie group of invertible matrices, and mentions sparsity-preserving splittings and block-wise DoPr as open directions [2004.09209]. The operator-preconditioning work highlights aggressive approximation of the preconditioner without sacrificing robustness [2011.05028]. The deep-learning paper lists extension to online or active data collection, adaptive damping and low-rank pseudoinverses per layer, and theoretical analysis of generalization and TTF-shift reduction in nonlinear settings [2606.06418]. A plausible implication is that the future of DoPr research will remain plural: advances are likely to emerge through domain-specific exploitation of paired conditioning structures rather than through convergence toward a single canonical formalism.

Source: https://www.emergentmind.com/topics/double-preconditioning-dopr