---
title: Distributed Pull-Push Force (DPPF) Overview
url: https://www.emergentmind.com/topics/distributed-pull-push-force-dppf
type: topic
---

# Distributed Pull-Push Force (DPPF) Overview

Searching arXiv for the cited papers to ground the article in the current record.
Distributed Pull-Push Force (DPPF) denotes a class of distributed optimization procedures in which an explicit “pull” mechanism promoting consensus is counterbalanced by a “push” mechanism promoting either dispersion of worker parameters or propagation of gradient information, depending on the formulation. In the 2025 centralized data-parallel deep-learning setting of “Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning” [2507.20424], DPPF is introduced as a communication-efficient training algorithm that augments local SGD with a flatness-seeking regularizer so that workers collaboratively span wide minima. In an earlier and distinct 2018 network-optimization context, “Push-Pull Gradient Methods for Distributed Optimization in Networks” [1810.06653] uses the term “push-pull” for a distributed gradient-tracking method over directed graphs, where decision variables are pulled and gradient information is pushed. The shared nomenclature reflects an opposition of forces or information flows, but the objectives, assumptions, and update rules differ substantially across the two lines of work.

## 1. Conceptual scope and nomenclature

In [2507.20424], DPPF is a centralized distributed data-parallel training method for deep neural networks with \(M\) workers, each holding an i.i.d. data shard \(\mathcal{D}_m\). Its stated aim is to improve the trade-off between communication efficiency and model performance of local gradient methods by leveraging the flat-minima hypothesis, according to which models with better generalization tend to lie in flatter regions of the loss landscape. The core mechanism is a push regularizer that counteracts the usual consensus pull at communication time, producing a pull-push dynamics over worker parameters.

In [1810.06653], the term “push-pull gradient methods” refers to algorithms for distributed convex optimization over networks, especially directed graphs. Each node maintains an estimate of the optimal decision variable and an estimate of the gradient for the average objective. From the viewpoint of an agent, decision-variable information is pulled from neighbors, while gradient information is pushed to neighbors. The method is designed for strongly convex and smooth objective functions and covers synchronous and asynchronous random-gossip settings.

These two usages should not be conflated. In [2507.20424], “push” is a geometric force that pushes workers apart to seek flat optima. In [1810.06653], “push” describes the directionality of gradient-information exchange. A plausible implication is that “DPPF” is best treated as a contextual term whose exact meaning depends on whether the setting is centralized data-parallel deep learning or directed-network distributed optimization.

## 2. Centralized data-parallel formulation for flat optima

The 2025 DPPF formulation begins from the standard distributed training objective
\[
\min_{x\in\mathbb{R}^d}\;
\frac{1}{M}\sum_{m=1}^M f_m(x),
\qquad
f_m(x)=\mathbb{E}_{\xi\sim\mathcal{D}_m}\bigl[F_m(x;\xi)\bigr].
\tag{1}
\]
Here \(x_m\) denotes the local model on worker \(m\), and
\[
x_A=\tfrac1M\sum_{m=1}^M x_m
\]
is the consensus average [2507.20424].

To promote flat minima, the paper introduces the Mean Valley (MV) measure. After full convergence, in each worker direction
\[
\delta_m=\frac{x_m-x_A}{\|x_m-x_A\|},
\]
one considers a boundary point \(x_m^b=x_A+\beta_m\delta_m\) satisfying \(f(x_m^b)\approx \kappa f(x_A)\) for some \(\kappa>1\), and defines
\[
\mathrm{MV}=\frac1M\sum_{m=1}^M \|x_m^b-x_A\|_2,
\qquad
\mathrm{Inv.\,MV}=-\mathrm{MV}.
\tag{2}
\]
Larger MV corresponds to a wider basin, whereas larger Inv. MV corresponds to sharper solutions [2507.20424].

Because exact MV or Inv. MV requires costly line-searches, the paper replaces true boundary points with current iterates \(x_m\), yielding the regularizer
\[
\lambda_r\,\mathcal{R}(x_1,\dots,x_M)
=
-\frac{\lambda_r}{M}\sum_{m=1}^M \|x_m-x_A\|_2.
\tag{3}
\]
The resulting worker-wise loss is
\[
\ell_m(x_m)
=
f_m(x_m)
+
\lambda_r\Bigl(-\tfrac1M\sum_{i=1}^M\|x_i-x_A\|\Bigr).
\tag{5}
\]

A direct differentiation gives the approximate push direction
\[
-\,\lambda_r\frac{\partial \mathcal{R}}{\partial x_m}
\approx
\lambda\,
\frac{x_m-x_A}{\|x_m-x_A\|_2},
\qquad
\lambda=\frac{\lambda_r}{M}.
\tag{4}
\]
This construction formalizes the central intuition of DPPF in [2507.20424]: consensus alone collapses workers toward a narrow basin, whereas a controlled repulsive force can preserve a nonzero spread and thereby encourage exploration of a wide valley.

## 3. Pull-push update rule and algorithmic mechanics

In [2507.20424], DPPF alternates local SGD with a communication step in which the pull and push act simultaneously. Each worker performs \(\tau\) local SGD steps with learning rate \(\eta\), and then communication computes the consensus \(x_A\) and applies
\[
x_m
\leftarrow
x_m
+
\underbrace{(x_A-x_m)}_{\rm pull}\,\alpha
-
\underbrace{\lambda\,\tfrac{x_m-x_A}{\|x_m-x_A\|}}_{\rm push}
=
x_m+(x_A-x_m)\Bigl(\alpha-\tfrac{\lambda}{\|x_m-x_A\|}\Bigr).
\tag{6}
\]
The algorithm therefore depends on a pull strength \(\alpha\in(0,1]\), a push strength \(\lambda\ge 0\), a communication period \(\tau\), and a learning rate \(\eta\) [2507.20424].

Several limiting cases organize the method’s relation to standard distributed training. When \(\lambda=0\) and \(\alpha=1\), the update reduces to synchronous averaging (DDP-SGD). When \(\lambda=0\) and \(\alpha<1\), it becomes a soft-consensus variant of Local SGD. The distinctive DPPF regime is \(\lambda>0\), where the push term is intended to “push” workers apart to seek flat optima [2507.20424].

The paper characterizes this as a balanced tug-of-war. Weakening the pull alone, with \(\alpha\ll 1\) and \(\lambda=0\), cannot prevent valley collapse; workers still coalesce and generalization degrades. Only the joint pull-push dynamics maintains a nonzero consensus distance and recovers flat minima. Performance is reported to be robust across a wide grid of \((\alpha,\lambda)\), with best results when \(\lambda/\alpha\) matches the target valley radius [2507.20424].

This suggests that the essential control variable is not \(\lambda\) or \(\alpha\) in isolation but their ratio, which governs the equilibrium spread of workers around the consensus.

## 4. Theory: valley width, PAC-Bayes generalization, and non-convex convergence

The theoretical analysis in [2507.20424] addresses three properties: asymptotic valley width, generalization, and non-convex convergence.

For asymptotic valley width, let \(\Delta^{+}_{m,k}=x_{A,k}-x_{m,k}^+\) denote the post-communication gap after the \(k\)th pull-push step. Under unbiased gradient-noise assumptions \(\mathbb{E}\|g-\nabla f\|^2\le \sigma_0^2\), Theorem 1 states
\[
\lim_{k\to\infty}
\mathbb{E}\bigl\|\Delta^{+}_{m,k}\bigr\|
=
\frac{\lambda}{\alpha}
+
\mathcal{O}\!\bigl(\eta\,\sigma_0 + M^{-1/2}\bigr).
\tag{7}
\]
Accordingly, the final valley width is governed by the interplay between push and pull strengths, and the pull-push dynamics is described as self-stabilizing [2507.20424].

For generalization, the paper constructs a PAC-Bayes argument over a grid of candidate ratios \(r_j=\lambda_j/\alpha_j\), with priors \(P_{r_j}=N(0,r_j\sigma_0^2I)\) and posteriors \(Q_{r_j}=N(\mu_{r_j},c_{r_j}r_j\sigma_0^2I)\). Under the bounded-drift assumption
\[
\|\mu_{r_j}\|^2\le D_0\,r_j^\beta,\qquad \beta<1,
\]
Theorem 2 gives, with probability \(1-\delta\) over samples \(S\) of size \(n\), for all \(r_j\),
\[
\mathbb{E}_{x\sim Q_{r_j}}\bigl[L_{\mathcal D}(x)\bigr]
\le
\mathbb{E}_{x\sim Q_{r_j}}\bigl[L_S(x)\bigr]
+
\sqrt{
\frac{
\tfrac d2\,(c_{r_j}-1-\ln c_{r_j})
+\tfrac{D_0}{2\,r_j^{\,1-\beta}\,\sigma_0^2}
+\ln\!\tfrac{nJ}{\delta}
}{2(n-1)}
}.
\tag{8}
\]
Because \(1-\beta>0\), the complexity term strictly decreases as \(r_j\) grows. The paper therefore links wider valleys, induced by larger \(\lambda/\alpha\), to tighter PAC-Bayes generalization guarantees [2507.20424].

For optimization, under \(L\)-smoothness, bounded variance \(\sigma^2\), and bounded domain \(\mathbb{E}\|x_i-x_A\|^2\le \Delta^2\), the expected squared gradient averaged over \(T\) iterations satisfies
\[
\frac1T\sum_{t=1}^T \mathbb{E}\|\nabla f(x^t)\|^2
\le
\frac{2(f(x^0)-f(x^*))}{\eta T}
+
3L\eta(\alpha^2\Delta^2+\lambda^2+\sigma^2)
+
\alpha\Delta^2+\lambda.
\tag{9}
\]
The conclusion stated in the paper is that DPPF converges to approximate stationary points at the usual \(O(1/\sqrt{T})\) rate, up to \(\lambda\)- and \(\alpha\)-dependent offsets [2507.20424].

## 5. Empirical profile in deep-learning training

The empirical evaluation in [2507.20424] covers standard vision benchmarks—CIFAR-10, CIFAR-100, and ImageNet—and architectures including ResNet-18, ResNet-50, PyramidNet, and WRN. The reported comparison set includes fully synchronous DDP-SGD, LocalSGD with fixed \(\tau\), and LocalSGD + QSR.

A representative result is given for a 4-worker CIFAR-10 ResNet-18 configuration:

| Method | Communication | Error |
|---|---:|---:|
| DDP-SGD (\(\tau=1\)) | 100 % comms | 4.33 % |
| LocalSGD \(\tau=4\) | 25 % comms | 4.36 % |
| LocalSGD + QSR | 42.8 % comms | 4.21 % |
| DPPF \(\tau=4\) | 25 % comms | 3.93 % |

Across CIFAR-100 and ImageNet, the paper states that DPPF at \(\tau=4\) or \(8\) always matches or beats the best baselines and often outperforms DDP-SGD while using \(4\times\)–\(8\times\) fewer synchronizations [2507.20424]. Communication volume is defined as \((\#\text{ rounds})/(\#\text{ local iters})\), and DPPF reduces this volume to 25 %, 12.5 %, and 6.3 % at \(\tau=4,8,16\), respectively, while test errors remain the lowest [2507.20424].

The paper also reports loss-landscape visualizations. In 2D contour plots around the final solution, SimpleAvg collapses all workers to a narrow valley and test error rises sharply off the center, whereas DPPF leaves workers straddling a wide basin and error remains low over a broad region. Corresponding 3D surface views are reported to confirm that DPPF solutions lie in flatter, wider valleys [2507.20424].

The article’s concluding quantitative summary states that DPPF reduces communication by up to \(16\times\) while matching or outperforming synchronous averaging and other communication-efficient schemes [2507.20424]. This supports the paper’s framing of DPPF as an explicit communication–generalization trade-off mechanism rather than only a systems-level synchronization reduction.

## 6. Relation to push-pull gradient methods on directed networks

The 2018 push-pull framework in [1810.06653] addresses a different optimization problem:
\[
\min_{x\in\mathbb R^p} F(x):=\sum_{i=1}^n f_i(x),
\]
where each agent \(i\) knows only its own convex cost \(f_i\), and each \(f_i\) is assumed \(\mu\)-strongly convex and \(L\)-smooth. Communications are modeled by two directed graphs on the same node set: a pull graph \(\mathcal G_R\) with row-stochastic matrix \(R\), and a push graph \(\mathcal G_C\) with column-stochastic matrix \(C\). Each contains a spanning tree, and the root sets must intersect [1810.06653].

Each agent maintains \(x_{i,k}\), an estimate of the optimizer, and \(y_{i,k}\), an estimate of the average gradient, initialized by
\[
x_{i,0}\;\text{arbitrary},\qquad
y_{i,0}=\nabla f_i(x_{i,0}).
\]
With local step-sizes \(\alpha_i\ge 0\), the synchronous updates are
\[
x_{i,k+1}=\sum_{j=1}^n R_{ij}\bigl(x_{j,k}-\alpha_j y_{j,k}\bigr),
\]
\[
y_{i,k+1}
=\sum_{j=1}^n C_{ij}y_{j,k}
+\nabla f_i(x_{i,k+1})-\nabla f_i(x_{i,k}).
\]
In matrix form,
\[
\x_{k+1}=R(\x_k-\Alpha \y_k),
\qquad
\y_{k+1}=C\y_k+\nabla F(\x_{k+1})-\nabla F(\x_k).
\]
By column-stochasticity of \(C\), one has \(\tfrac1n\mathbf 1^T\y_k=\tfrac1n\mathbf 1^T\nabla F(\x_k)\) for all \(k\) [1810.06653].

The main theorem shows linear convergence in the synchronous strongly convex case. Tracking the three error sequences
\[
e^x_k=\|\bar x_k-x^*\|,\qquad
e^c_k=\|\x_k-\bar x_k\|_R,\qquad
e^g_k=\|\y_k-v\bar y_k\|_C,
\]
the paper proves the existence of a nonnegative \(3\times 3\) matrix \(A\) with spectral radius \(\rho(A)<1\) such that
\[
\begin{pmatrix}
e^x_{k+1}\\
e^c_{k+1}\\
e^g_{k+1}
\end{pmatrix}
\le
A
\begin{pmatrix}
e^x_k\\
e^c_k\\
e^g_k
\end{pmatrix}.
\]
Consequently, all three errors decay geometrically, and when the maximum step-size is small, \(\rho(A)\approx 1-\alpha'\mu\), recovering a centralized-GD rate [1810.06653].

The paper also gives a randomized gossip extension, G-Push-Pull, with random matrices \(R_k\) and \(C_k\), and proves geometric convergence in expectation under suitably small \(\alpha\) and \(\gamma\). It further emphasizes that push-pull unifies decentralized, centralized, and semi-centralized architectures through separate row-stochastic and column-stochastic mixing operators [1810.06653].

## 7. Distinctions, misconceptions, and research significance

A common misconception is that all “push-pull” or “pull-push” methods represent the same algorithmic family. The two cited arXiv works indicate otherwise. In [2507.20424], DPPF is a centralized data-parallel deep-learning method whose defining mechanism is a flatness regularizer that induces worker separation in parameter space. In [1810.06653], push-pull denotes a directed-network gradient-tracking protocol with two mixing graphs and no flat-minima objective.

Another potential source of confusion is the role of “push.” In the deep-learning DPPF of [2507.20424], push is a repulsive force proportional to
\[
\frac{x_m-x_A}{\|x_m-x_A\|},
\]
introduced specifically to counteract consensus collapse and recover wide valleys. In the network-optimization method of [1810.06653], push refers to the dissemination of scaled gradient estimates through a column-stochastic graph. The former is geometric and regularization-based; the latter is informational and mixing-based.

The research significance of the 2025 formulation lies in connecting communication-efficient distributed training to flat-optima recovery via an explicit parameter-space mechanism, with theoretical links among equilibrium worker spread, PAC-Bayes generalization, and non-convex convergence [2507.20424]. The significance of the 2018 framework lies in extending gradient tracking to directed graphs with synchronous and gossip variants, linear convergence under strong convexity, and a unified treatment of decentralized, centralized, and semi-centralized architectures [1810.06653].

Taken together, these works show that “distributed pull-push” is not a single canonical algorithm but a recurring design principle: useful distributed optimization procedures can be built by assigning complementary roles to attractive and dispersive operators, or to pull-based and push-based information flows. This suggests a broader methodological theme in which asymmetry, when controlled, is exploited rather than eliminated.

Source: https://www.emergentmind.com/topics/distributed-pull-push-force-dppf