---
title: Federated Linear Stochastic Approximation
url: https://www.emergentmind.com/topics/federated-linear-stochastic-approximation-lsa
type: topic
---

# Federated Linear Stochastic Approximation

Searching arXiv for recent and foundational papers on federated linear stochastic approximation.
Federated Linear Stochastic Approximation (LSA) is a class of distributed stochastic recursive methods for solving a global linear fixed-point or linear root-finding problem when data are split across multiple agents and only intermittent communication is permitted. In its most direct formulation, each client \(c\) has access to stochastic linear observations whose expectations define a local system \(\bar A^{[c]}\theta=\bar b^{[c]}\), while the federated objective is the global linear system
\[
\mathbf A \theta_\star = \bar b, \qquad \mathbf A = \frac1N \sum_{c=1}^N \mathbf A^{[c]}, \qquad \bar b = \frac1N \sum_{c=1}^N \bar b^{[c]}.
\]
A federated LSA algorithm alternates between local stochastic approximation steps and server-side aggregation, typically through periodic averaging or control-variate correction. The topic lies at the intersection of stochastic approximation, federated learning, distributed linear algebra, and reinforcement learning, especially temporal-difference (TD) learning with linear function approximation. Recent work has clarified three central issues: the effect of local training under client heterogeneity, the role of Markovian sampling, and the communication–computation trade-off induced by multiple local steps [2402.04114][2504.11645][2206.10185].

## 1. Conceptual and mathematical framework

Federated LSA is most naturally posed as a global linear SA problem over \(N\) clients. In the abstract matrix form emphasized by recent work, each client \(c\) has local mean quantities \((\mathbf A^{[c]},\bar b^{[c]})\), local stochastic estimators \(\mathbf A^c(Z)\) and \(\mathbf b^c(Z)\), and a local root
\[
\theta_\star^{[c]} \in \mathbb R^d, \qquad \mathbf A^{[c]} \theta_\star^{[c]} = \bar b^{[c]}.
\]
The federated target is instead the global solution
\[
\theta_\star = \mathbf A^{-1}\bar b,
\]
when \(\mathbf A\) is invertible [2605.19629]. This distinction between local roots and the root of the averaged system is the defining structural issue of heterogeneous federated LSA [2402.04114][2504.11645].

A standard single-stream LSA recursion takes the form
\[
\theta_{t+1}=\theta_t+\alpha\big(A(x_t)\theta_t+b(x_t)\big)
\]
or, equivalently,
\[
\theta_t=\theta_{t-1}+\alpha(b_t-A_t\theta_{t-1}),
\]
with target determined by the mean equation \(\bar A\theta^\ast+\bar b=0\) or \(A_P\theta_*=b_P\) [2210.00953][1709.04073][2312.10894]. In the federated setting, local copies evolve separately and are periodically synchronized. One canonical client/server recursion is
\[
\theta_{t,h}^c = \theta_{t,h-1}^c - \eta\big( A^c(Z^c_{t,h})\theta_{t,h-1}^c - b^c(Z^c_{t,h})\big),
\qquad
\theta_{t+1} = \frac1N\sum_{c=1}^N \theta_{t,H}^c,
\]
which is the baseline FedLSA scheme analyzed in detail in "SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning" [2402.04114]. In a broader stochastic-approximation notation, federated methods can also be written as local recursions for client-specific operators \(F_i\) or \(G_i\), followed by averaging at a centralized coordinator [2006.13460][2206.10185].

This abstract viewpoint covers several problem classes. In optimization language, the mean field may be linear with \(h^{(i)}(w)=A_i w+b_i\), so the limiting ODE is \(\dot w=\bar A w+\bar b\) [2402.12945]. In reinforcement learning, linear TD updates generate precisely this structure after suitable centering [2206.10185][2006.13460]. In row-action linear system solvers, randomized Kaczmarz becomes a stochastic projection method whose mean operator is linear in the classical single-row case and state-dependent in federated variants [2505.09061]. This suggests that federated LSA is less a single algorithm than a family of federated root-finding procedures with a shared linear mean-field structure.

## 2. Baseline local-update methods and their drift pathology

The simplest federated LSA protocol is a local-update method analogous to FedAvg or local SGD: broadcast a global model, run \(H\) local stochastic approximation steps at each client, and average the local endpoints. This template appears in several forms. "Local Stochastic Approximation: A Unified View of Federated Learning and Distributed Multi-Task Reinforcement Learning Algorithms" [2006.13460] studies the recursion
\[
\theta_i^{k,t+1}
= \theta_i^{k,t} - \alpha_{k+t} F_i(\theta_i^{k,t};X_i^{k+t}),
\qquad
\bar\theta^{k+1} = \frac{1}{N}\sum_{i=1}^N \theta_i^{k,H},
\]
under Markovian local data. "Federated Stochastic Approximation under Markov Noise and Heterogeneity" introduces FedSAM, a periodic averaging algorithm
\[
\theta_{t+1}^i = \theta_t^i+\alpha\big(G^i(\theta_t^i,Y_t^i)-\theta_t^i+b^i(Y_t^i)\big),
\]
with synchronization every \(K\) steps [2206.10185]. In the explicit federated linear SA treatment of [2402.04114], the same structure is analyzed directly in matrix form.

The central difficulty is that local training is unbiased only in the single-local-step regime. In FedLSA, the global iterate admits the exact decomposition
\[
\theta_t-\theta^\star = \bar\Phi_{t,H}(\theta_{t-1}-\theta^\star) +\tau_H+\tilde\tau_t^H+\zeta_t^H,
\]
where \(\tau_H\) is a deterministic heterogeneity bias, \(\tilde\tau_t^H\) is a random fluctuation of that bias, and \(\zeta_t^H\) is the usual stochastic noise term [2402.04114]. The deterministic bias satisfies
\[
\tau_H = \frac1N\sum_{c=1}^N \Big(I-(I-\eta\barA^c)^H\Big)(\theta_\star^c-\theta^\star),
\]
and vanishes when \(H=1\):
\[
\tau_1 = \tfrac1N \sum_{c=1}^N \barA^c(\theta_\star^c-\theta^\star) =0
\]
[2402.04114]. For \(H\ge 2\), however, local training drives each client toward \(\theta_\star^c\) rather than \(\theta^\star\), producing drift that cannot be removed by plain averaging.

A sharper negative result appears in "Achieving Tighter Finite-Time Rates for Heterogeneous Federated Stochastic Approximation under Markovian Sampling" [2504.11645]. In the noiseless linear case with \(H=2\), vanilla local SA satisfies
\[
\lim_{t\to\infty} e_t = \eta v,
\]
where
\[
e_t=\bar\theta^{(t)}-\theta^\star,\qquad
v=\frac{1}{M}(2\bar A+\eta \bar A')^{-1} \sum_{i\in[M]} \bar A_i^2(\theta_i^\star-\theta^\star), \qquad \bar A':=\frac{1}{M}\sum_{i\in[M]} \bar A_i^2.
\]
This establishes that under heterogeneity, plain local training can converge to the wrong point even without stochastic noise [2504.11645].

A plausible implication is that federated LSA should not be understood as a direct linear generalization of centralized SA with parallel variance reduction. The dominant obstacle is not merely noise aggregation but the incompatibility between local equilibria and the global target.

## 3. Heterogeneity, control variates, and bias-corrected algorithms

The first dedicated matrix-level response to client drift in federated LSA is SCAFFLSA [2402.04114]. Its starting point is the ideal control variate
\[
\xi_\star^c = \barA^c\theta^\star-\barb^c = \barA^c(\theta^\star-\theta_\star^c),
\]
which would exactly recenter client \(c\)'s local dynamics around the global solution rather than the local one. Since \(\xi_\star^c\) is unknown, SCAFFLSA learns client-specific controls \(\xi_k^c\) and performs corrected local steps
\[
\hat\theta_k^c = \hat\theta_{k-1}^c - \eta\big(A^c(Z_k^c)\hat\theta_{k-1}^c - b^c(Z_k^c)-\xi_{k-1}^c\big)
\]
[2402.04114]. In the deterministic block-communication version, clients run \(H\) corrected local steps, average endpoints, and update the controls by
\[
\xi_{t+1}^c = \xi_t^c+\frac{1}{\eta H}(\theta_{t+1}-\hat\theta_{t,H}^c).
\]
This produces a Lyapunov recursion in
\[
\psi_t = \|\theta_t-\theta^\star\|^2 + \frac{\eta^2 H^2}{N}\sum_{c=1}^N \|\xi_t^c-\xi_\star^c\|^2,
\]
leading to logarithmic communication complexity in \(1/\epsilon\) [2402.04114].

FedHSA generalizes the same principle beyond linear SA and makes the linear case explicit [2504.11645]. The key local update is
\[
\theta_{i,\ell+1}^{(t)} = \theta_{i,\ell}^{(t)} + \eta\Big( G_i(\theta_{i,\ell}^{(t)},o_{i,\ell}^{(t)}) + G(\bar\theta^{(t)}) - G_i(\bar\theta^{(t)},o_{i,0}^{(t)}) \Big),
\]
followed by
\[
\bar\theta^{(t+1)} = \bar\theta^{(t)}+\frac{\alpha_g}{M}\sum_{i\in[M]} \Delta_{i,H}^{(t)},
\qquad
\Delta_{i,H}^{(t)} := \theta_{i,H}^{(t)}-\bar\theta^{(t)}.
\]
In linear SA notation \(G_i(\theta,o)=A_i(o)\theta-b_i(o)\), this is a heterogeneity-corrected affine recursion whose fixed point is the root of the averaged operator, not the local roots [2504.11645]. The correction term
\[
G(\bar\theta^{(t)})-G_i(\bar\theta^{(t)},o_{i,0}^{(t)})
\]
plays the same conceptual role as the client-specific control variate in SCAFFLSA: it removes first-order drift toward \(\theta_i^\star\).

The contrast between FedLSA and SCAFFLSA in [2402.04114], and between vanilla local SA and FedHSA in [2504.11645], resolves a common misconception. The difficulty with local training under heterogeneity is not merely slower convergence; it is convergence to the wrong limit unless local drift is explicitly neutralized.

## 4. Markovian sampling and reinforcement-learning structure

A distinctive feature of federated SA, compared with classical federated optimization, is that local sampling is often Markovian rather than i.i.d. This is fundamental in reinforcement learning, streaming data, and on-device sequential logs. "Federated Stochastic Approximation under Markov Noise and Heterogeneity" [2206.10185] and "Local Stochastic Approximation" [2006.13460] both formulate federated or local SA with agent-specific ergodic Markov chains. FedSAM assumes each client \(i\) has a Markov process \(Y_t^i\), local operator \(G^i(\cdot,Y_t^i)\), additive term \(b^i(Y_t^i)\), and expected operator \(\bar G^i\), with geometric mixing:
\[
\|\bar G^i(\theta)-\mathbb E[G^i(\theta,Y_t^i)]\|_c \le m_1\|\theta\|_c \rho^t,
\qquad
\|\mathbb E[b^i(Y_t^i)]\|_c \le m_2 \rho^t
\]
[2206.10185].

The linear TD specialization is especially important because it is a bona fide federated LSA instance. In the on-policy case with linear function approximation,
\[
\bar G^i(\theta)
= \theta+\frac1\beta \Phi^\top D^\pi\big(\gamma^n(P^\pi)^n\Phi-\Phi\big)\theta,
\]
so after centering around \(\theta^\pi\), the expected operator is linear and the fixed point is \(0\) [2206.10185]. In "Local Stochastic Approximation" [2006.13460], distributed TD(0) is written explicitly in local-SA form with
\[
A_i(X_i^k)=\phi(s_i^k)\big(\gamma\phi(s_i^{k+1})-\phi(s_i^k)\big)^T,
\qquad
b_i(X_i^k)=R_i^k\phi(s_i^k),
\]
and root equation
\[
\sum_{i=1}^{N}A_i\theta^* + b_i = 0
\]
[2006.13460].

Recent federated RL analyses sharpen this connection. [2504.11645] maps federated TD with linear function approximation into a general heterogeneous SA framework through
\[
\bar g_i(\theta^{(t)}) = \Phi_i^\top D_i(T_i\Phi_i\theta^{(t)}-\Phi_i\theta^{(t)}),
\]
which is linear in \(\theta\). [2512.17688] shows that federated SARSA with linear function approximation can be viewed as federated linear SA with a parameter-dependent mean field. Conditional on the frozen policy during a communication block, the local SARSA update is
\[
\theta^{(c)}_{t,h+1}
=
\theta^{(c)}_{t,h}
+
\alpha_t\big(A^{(c)}_{Z^{(c)}_{t,h+1}}\theta^{(c)}_{t,h}+b^{(c)}_{Z^{(c)}_{t,h+1}}\big),
\]
with blockwise mean operator \(\bar A_c(\theta_t)\theta+\bar b_c(\theta_t)\) [2512.17688]. This suggests that federated LSA is not confined to static linear systems; it also serves as the local linear backbone of policy-evaluation and control algorithms with periodically frozen policies.

The contrast with centralized Markovian LSA is also instructive. [2210.00953] proves that constant-stepsize LSA with Markovian data converges not to \(\theta^\ast\) but to a stationary law whose mean has bias
\[
\mathbb E[\theta_\infty^{(\alpha)}]-\theta^*
=
\alpha B^{(1)}+O(\alpha^2),
\]
with \(B^{(1)}\) proportional to Markov mixing in the reversible setting [2210.00953]. Averaging reduces variance but not this bias. This suggests that in federated settings with Markovian local sampling, there are two distinct bias mechanisms: client-drift bias from heterogeneity and stationary Markovian bias from constant local steps. A plausible implication is that control variates solve only the first of these unless stepsizes or extrapolation schemes also address the second.

## 5. Finite-time rates, sample complexity, and communication complexity

The modern federated LSA literature is organized around a three-way complexity trade-off between the number of clients, the number of local steps, and the desired accuracy.

In FedLSA, the key finite-time quantities are the local-noise scale
\[
\sigma^2 = E_c[\operatorname{Tr}(\Gamma_\varepsilon^c)]
\]
and the heterogeneity fluctuation term
\[
v = E_c\!\big[\|\Gamma_A^c\|\,\|\theta_\star^c-\theta^\star\|^2\big].
\]
The MSE bound shows that variance-like terms improve with \(1/N\), but the deterministic heterogeneity bias \(\tau_H\) must itself be kept below the target accuracy [2402.04114]. This yields the characteristic FedLSA result:

- **Sample/oracle complexity**: with \(H\) chosen carefully, total local updates satisfy
  \[
  TH= \mathcal{O}\!\left( \frac{v\vee \sigma^2}{Na^2\epsilon^2} \log\frac{\|\theta_0-\theta^\star\|}{\epsilon} \right),
  \]
  which exhibits linear speed-up in \(N\) [2402.04114].

- **Communication complexity**: the number of communication rounds contains a polynomial \(1/\epsilon\) term because \(H\) must scale like \(1/(N\epsilon)\) to keep \(\tau_H\) small [2402.04114].

SCAFFLSA changes this picture. In the randomized-communication setting, the Lyapunov recursion
\[
\mathbb{E}\!\left[\frac1N\sum_{c=1}^N \|\theta_K^c-\theta^\star\|^2\right] \le (1-\zeta)^K \psi_0 + \frac{2\eta^2}{\zeta}\tilde\sigma^2,
\qquad
\zeta = \min(\eta a,p^2),
\]
shows that heterogeneity no longer appears as a persistent bias floor [2402.04114]. In the deterministic block version,
\[
\mathbb{E}\|\theta_T-\theta^\star\|^2 \le \left(1-\frac{\eta a H}{4}\right)^T \mathbb{E}[\psi_0] + \frac{16}{a}\eta \tilde\sigma^2,
\]
from which the number of communication rounds becomes
\[
T = \mathcal{O}\!\left( \frac{C_A^2}{a^2} \log\left(\frac{\psi_0}{\epsilon^2}\right) \right)
\]
[2402.04114]. The logarithmic dependence on \(1/\epsilon\) is the principal communication improvement over FedLSA.

FedHSA obtains an analogous no-bias finite-time result in a broader SA setting with Markovian sampling. Under strong monotonicity of the average operator and geometric mixing, Theorem 2 of [2504.11645] yields
\[
d_T \le \exp\!\left(-\frac{\mu}{4}\alpha T\right)(d_0+\sigma^2)
+ \frac{\bar\tau \alpha L^2}{\mu MH(1-\rho)}
+ \frac{\alpha^2L^4}{\mu^2}\sigma^2,
\]
where \(d_T=\mathbb E\|\bar\theta^{(t)}-\theta^\star\|^2\), \(\bar\tau=\tau(\alpha^2)\), and \(\rho=\max_i\rho_i\) [2504.11645]. The dominant variance term scales as \(1/(MH)\), and the linear-speedup corollary gives
\[
d_T \le \tilde{\mathcal O}\!\left( d_0 + \frac{\bar\tau L^2\sigma^2}{\mu^2(1-\rho)}\cdot \frac{1}{MHT} \right).
\]
This is one of the strongest currently available finite-time statements for heterogeneous federated SA with Markovian sampling [2504.11645].

A recurring point of comparison is FedSAM [2206.10185]. Its finite-time error bound
\[
\mathbb E\|\bar\theta_{\hat T}\|_c^2
\le
\mathcal C_1\frac1\alpha c_{FSAM}^{T-2\tau_\alpha+1}
+\mathcal C_2\frac{\alpha\tau_\alpha^2}{N}
+\mathcal C_3(K-1)\alpha^2\tau_\alpha
+\mathcal C_4\alpha^3\tau_\alpha^2
\]
exhibits the same decomposition into transient decay, \(1/N\) variance reduction, and local-update penalty [2206.10185]. Although not formulated in matrix LSA notation, it provides a closely related communication–computation trade-off for contractive Markovian SA.

## 6. Statistical fluctuations, Gaussian approximation, and inference

Recent work extends federated LSA theory beyond convergence rates to distributional approximation and statistical inference. "Gaussian Approximation and Multiplier Bootstrap for Federated Linear Stochastic Approximation" [2605.19629] studies the last iterate in a federated local-update recursion
\[
\theta_{t,h}^c = \theta_{t,h-1}^c - \eta_t \big( \mathbf A^c(Z_{t,h}^c)\theta_{t,h-1}^c - \mathbf b^c(Z_{t,h}^c)\big),
\qquad
\theta_t = \frac1N \sum_{c=1}^N \theta_{t,H_t}^c,
\]
under i.i.d. local samples and full participation. The analysis decomposes the last-iterate error into transient, deterministic heterogeneity bias, heterogeneity-induced fluctuations, and stochastic fluctuation:
\[
\theta_t-\theta_\star
=
\tilde\theta_t^{(\mathrm{tr})}
+
\tilde\theta_t^{(\mathrm{bi,bi})}
+
\tilde\theta_t^{(\mathrm{fl,bi})}
+
\tilde\theta_t^{(\mathrm{fl})}
\]
[2605.19629]. Heterogeneity is quantified by
\[
\zeta_1^2 = \frac1N \sum_{c=1}^N \big\| \mathbf A^{[c]}(\theta_\star^{[c]}-\theta_\star) \big\|^2,
\qquad
\zeta_2^2 = \frac1N \sum_{c=1}^N \|\mathbf A^{[c]}-\mathbf A\|^2.
\]
The main Gaussian approximation theorem states that for polynomial stepsize and local-step schedules,
\[
d\!\left( \eta_t^{-1/2}\Sigma_t^{-1/2}(\theta_t-\theta_\star),\,Y \right)
\lesssim
N^{-1/2}(1+t)^{-\gamma_\eta/2}
+
N^{1/2}(1+t)^{-\gamma}
+
(1+t)^{-(3\gamma-\gamma_\eta)/2},
\]
where \(Y\sim\mathcal N(0,I_d)\) and \(\gamma=\gamma_\eta-\gamma_H\) [2605.19629]. This explicitly shows how increasing local steps worsens distributional accuracy through the heterogeneity-dependent remainder terms.

The same paper develops an online multiplier bootstrap. Bootstrap local updates take the form
\[
\theta_{t,h}^{b,c}
=
\theta_{t,h-1}^{b,c}
-
\eta_t w_{t,h,c}
\big( \mathbf A^c(Z_{t,h,c})\theta_{t,h-1}^{b,c} - \mathbf b^c(Z_{t,h,c}) \big),
\]
with i.i.d. multipliers \(w_{t,h,c}\), and conditional validity is proved for the law of \(\eta_t^{-1/2}(\theta_t^b-\theta_t)\) as an approximation to that of \(\eta_t^{-1/2}(\theta_t-\theta_\star)\) [2605.19629]. This is the first fully federated inference result for LSA in the available literature.

These developments connect back to centralized LSA inference. [2405.16644] gives Berry–Esseen and bootstrap results for Polyak–Ruppert averaged centralized LSA with decreasing step sizes, and [2004.04719] derives a fixed-stepsize CLT whose covariance is the sum of the classical PR covariance and a stepsize correction term. A plausible implication is that the federated Gaussian approximation in [2605.19629] plays the same role for local-update schemes that [2004.04719] plays for centralized fixed-step SA: it exposes the exact statistical cost of persistent local dispersion.

## 7. Related projection-based and ODE-based perspectives

Not all federated linear SA methods are expressed as affine recursions. "A federated Kaczmarz algorithm" [2505.09061] studies FedRK, a projection-based method for distributed linear systems \(Ax=b\) with rows partitioned across clients. At round \(t\), selected clients run \(\tau\) local randomized Kaczmarz steps, produce displacements \(\Delta_i^{(t)}\), and the server constructs a surrogate system \(\Delta^{(t)}x=d\) and applies \(\tau_g\) server-side Kaczmarz steps. In the idealized \(\tau=\infty\), \(\tau_g=1\) regime, the conditional mean update is
\[
\mathbb{E}X^{(t+1)}
=
\sum_{s\in S^{(t)}}
\frac{1}{|S^{(t)}|}
\left(
I-\frac{(X^{(t)}-P_{C_s}X^{(t)})(X^{(t)}-P_{C_s}X^{(t)})^T}{\|X^{(t)}-P_{C_s}X^{(t)}\|^2}
\right)X^{(t)}.
\]
This is state-dependent and therefore outside canonical linear SA, but classical randomized Kaczmarz appears as a special case where the mean operator is linear [2505.09061]. This suggests an alternative geometric route to federated linear system solving in which communication exchanges projected constraints rather than model averages.

At the opposite end of the abstraction spectrum, "Stochastic Approximation Approach to Federated Machine Learning" [2402.12945] formulates periodic aggregation in a general SA form and shows that the synchronized averages track the ODE
\[
\dot w = \frac1L\sum_{i=1}^L h^{(i)}(w).
\]
Specializing \(h^{(i)}(w)=A_iw+b_i\) yields the linear ODE \(\dot w=\bar A w+\bar b\) [2402.12945]. The paper is not about LSA specifically, but it provides an ODE-based conceptual bridge from local SA recursions to federated mean-field dynamics.

These two perspectives clarify a methodological split in the literature. Some work treats federated linear SA as a matrix perturbation problem with exact finite-time recursions [2402.04114][2605.19629]. Other work embeds it into broader operator-SA or ODE-tracking frameworks [2206.10185][2402.12945]. The two views are complementary rather than competing.

## 8. Scope, limitations, and open directions

Current federated LSA theory remains precise but narrow in several respects. Most matrix-level analyses assume i.i.d. local samples across time [2402.04114][2605.19629], while Markovian analyses often work at the level of general operators or RL specializations rather than canonical \(\bar A\theta=\bar b\) matrix theory [2206.10185][2504.11645]. Full participation is the dominant setting; partial participation, asynchronous communication, and compression are generally absent [2402.04114][2605.19629]. Last-iterate distribution theory exists for the homogeneous i.i.d. setting with heterogeneity-aware remainders [2605.19629], but an equally sharp treatment for Markovian federated LSA remains open.

Several technical gaps are explicit in the literature. [2402.04114] shows that FedLSA preserves linear speed-up in sample complexity while SCAFFLSA restores communication efficiency, but no current analysis achieves both simultaneously. [2504.11645] removes heterogeneity bias and proves linear speed-up in a broader SA framework, but its theorems are not specialized to the matrix-structured constants of pure LSA. [2605.19629] develops bootstrap inference under i.i.d. local data, but not under Markovian sampling or client subsampling. Centralized Markovian LSA work shows that constant stepsizes induce an \(O(\alpha)\) stationary bias [2210.00953][2312.10894][2508.05570], yet a full federated synthesis of that bias with heterogeneity-induced local drift has not been established.

A common misconception is that federated LSA is now a solved analogue of local SGD for linear systems. Existing results instead suggest a more delicate picture. Heterogeneity changes the target of naive local training; Markovian sampling creates a distinct stationary bias under constant local steps; and communication reduction is statistically costly unless local drift is corrected. The main unresolved problem is to combine four properties in a single theorem: heterogeneity robustness, Markovian sampling, linear speed-up in the number of clients, and logarithmic communication dependence on \(1/\epsilon\).

A plausible implication is that future progress will require hybrid techniques: matrix-level exact expansions as in [2402.04114], operator-level drift correction as in [2504.11645], and bias-cancellation mechanisms inspired by Markovian constant-step extrapolation [2210.00953][2508.05570]. In reinforcement learning, the exact multi-step expansions recently developed for federated SARSA [2512.17688] suggest that such synthesis may be possible for broader classes of projected and policy-dependent linear SA recursions.

Source: https://www.emergentmind.com/topics/federated-linear-stochastic-approximation-lsa