---
title: 'iZoSGA: Gradient-Free IRS Beamforming'
url: https://www.emergentmind.com/topics/izosga
type: topic
---

# iZoSGA: Gradient-Free IRS Beamforming

iZoSGA is a data-driven learning algorithm for joint passive long-term intelligent reflective surface (IRS)-aided beamforming and active short-term precoding in wireless networks. It is based on a zeroth-order stochastic quasigradient ascent methodology designed for tackling two-stage nonconvex stochastic programs with continuous uncertainty and objective functions with “black-box” terms, and where second-stage optimization is inexact. In its canonical formulation, the outer variable is the IRS configuration, the inner variable is the access-point precoder, and the objective is expected weighted sum-rate maximization under continuously varying channel realizations. The defining methodological feature of iZoSGA is that it uses inexact precoding oracles—implemented in the paper with truncated WMMSE—while retaining non-asymptotic convergence to a neighborhood of a stationary solution of the original exact problem under minimal assumptions [2509.16776].

## 1. Two-stage stochastic program and IRS-aided system model

The algorithm is formulated for a downlink multiuser MISO system aided by a passive IRS. The access point (AP) has \(M\) transmit antennas, there are \(K\) single-antenna users, and the IRS has \(S\) passive reflecting elements. Each IRS element has a tunable complex reflection coefficient parameterized by \(\bm{\theta} \in \Theta \subset \mathbb{R}^S\), where \(\Theta\) is convex and compact. The operational model is explicitly two-timescale: IRS configuration is optimized in the long term, whereas AP precoding is optimized in the short term for each realized channel state [2509.16776].

The effective channel for user \(k\) is denoted
\[
\bm{h}_k(\bm{\theta},\omega) \in \mathbb{C}^{M},
\]
where \(\omega \in \Omega\) is a random state of nature capturing small-scale fading, geometry, and IRS-related propagation randomness. The stacked channel representation is
\[
\bm{H}(\bm{\theta},\omega) \triangleq \mathrm{vec}\big( [\bm{h}_1(\bm{\theta},\omega), \ldots, \bm{h}_K(\bm{\theta},\omega)]\big) \in \mathbb{C}^{M_U},\quad M_U = MK.
\]
The AP precoder is similarly vectorized as
\[
\bm{W} = \mathrm{vec}\big( [\bm{w}_1, \bm{w}_2, \ldots, \bm{w}_K]\big) \in \mathbb{C}^{M_U},
\]
under the total power constraint
\[
\bm{W} \in \mathcal{W}, \quad \text{where} \quad \mathcal{W} \triangleq \left\{\bm{W} : \|\bm{W}\|_F^2 \le P\right\}.
\]

Performance is measured through weighted sum rate:
\[
F(\bm{W},\bm{H}(\bm{\theta},\omega)) \triangleq \sum_{k=1}^K \alpha_k \log_2\left(1 + \text{SINR}_k\big(\bm{W}, \bm{h}_k(\bm{\theta}, \omega)\big)\right),
\]
with user weights \(\alpha_k>0\) and
\[
\text{SINR}_k(\bm{W}, \bm{h}_k(\bm{\theta}, \omega )) \triangleq \frac{\left|\bm{h}_k^\hermtr(\bm{\theta}, \omega)\bm{w}_k\right|^2} {\sum_{j\in \mathbb{N}_K^+ \setminus k}\left|\bm{h}^\hermtr_k(\bm{\theta}, \omega)\bm{w}_j\right|^2 + \sigma_k^2}.
\]

The resulting design problem is a nonconvex two-stage stochastic program with continuous uncertainty. The short-term subproblem is
\[
\max_{\bm{W}\in \mathcal{W}} \left\{G(\bm{W},\bm{\theta},\omega) \triangleq F\big(\bm{W},\bm{H}(\bm{\theta},\omega)\big)\right\},
\]
and the long-term problem is
\[
\max_{\boldsymbol{\theta} \in \Theta} f(\bm{\theta}) \triangleq \mathbb{E}_{\omega}\left\{\max_{\boldsymbol{W} \in \mathcal{W}} F\big(\bm{W},\boldsymbol{H}(\boldsymbol{\theta},\omega)\big) \right\}.
\]
The outer expectation is taken over an unknown continuous distribution of channel states. The inner maximization is itself nonconvex because weighted sum rate is coupled through interference. This combination is the central motivation for a stochastic, model-free, gradient-free outer method.

## 2. Zeroth-order stochastic quasigradient construction

iZoSGA adopts zeroth-order stochastic quasigradient ascent because neither the channel mapping \(\bm{H}(\bm{\theta},\omega)\) nor the optimizer mapping \(\bm{W}^*(\bm{\theta},\omega)\) is assumed available in closed form. The method is model-free in the precise sense that it uses observed effective channels and function evaluations rather than analytical derivatives, and it is agnostic to channel models or channel statistics [2509.16776].

The zeroth-order component is based on two-point Gaussian smoothing. For \(\bm{U} \sim \mathcal{N}(\bm{0},\bm{I})\) and smoothing parameter \(\mu>0\), the paper defines
\[
\nabla_{\bm{\theta}} \bm{H}_\mu(\bm{\theta},\omega) \triangleq \mathbb{E}\left\{ \frac{\bm{H}(\bm{\theta} + \mu \bm{U},\omega) - \bm{H}(\bm{\theta} - \mu \bm{U},\omega)}{2\mu} \bm{U}^\top \,\bigg\vert\, \omega \right\}^\top.
\]
Using Wirtinger calculus, this is chained with the co-gradient of \(F\) with respect to the complex channel variable. The resulting compound zeroth-order approximation is written as
\[
\begin{aligned}
\nabla_{\bm{\theta}}^{\mu} F\big(\bm{W},\bm{H}(\bm{\theta},\omega)\big) \triangleq\,&
2 \nabla_{\bm{\theta}} \bm{H}_{\mu}^R(\bm{\theta},\omega)
\left(\Re\left( \frac{\partial^{\circ}}{\partial \bm{z}} F(\bm{W},\bm{z}) \bigg\vert_{\bm{z} = \bm{H}(\bm{\theta},\omega)} \right)\right)^\top \\
&+ 2 \nabla_{\bm{\theta}} \bm{H}_{\mu}^I(\bm{\theta},\omega)
\left(\Re\left( j\,\frac{\partial^{\circ}}{\partial \bm{z}} F(\bm{W},\bm{z}) \bigg\vert_{\bm{z} = \bm{H}(\bm{\theta},\omega)} \right)\right)^\top.
\end{aligned}
\]

In implementation, the expectation is not evaluated exactly. Instead, iZoSGA uses the single-sample estimator
\[
\begin{aligned}
\bm{D}_{\mu}(\bm{\theta},\omega,\bm{U};\bm{W}) \triangleq&\; \bm{\Delta}_{\mu}^R
\left(\Re\left( \frac{\partial^{\circ}}{\partial \bm{z}} F(\bm{W},\bm{z}) \bigg\vert_{\bm{z} = \bm{H}(\bm{\theta},\omega)} \right)\right)^\top \\
&+ \bm{\Delta}_{\mu}^I
\left(\Re\left( j\,\frac{\partial^{\circ}}{\partial \bm{z}} F(\bm{W},\bm{z}) \bigg\vert_{\bm{z} = \bm{H}(\bm{\theta},\omega)} \right)\right)^\top,
\end{aligned}
\]
where \(\bm{\Delta}_{\mu}^R\) and \(\bm{\Delta}_{\mu}^I\) are the two-point finite-difference evaluations of the real and imaginary channel Jacobian components. Operationally, the method probes the channel at \(\bm{\theta}+\mu\bm{U}\) and \(\bm{\theta}-\mu\bm{U}\), approximates directional sensitivity of the effective channel, and composes that estimate with the analytic Wirtinger derivative of the utility.

The algorithmic recursion is correspondingly simple. At iteration \(t\), it samples \(\omega_t\) and \(\bm{U}_t\), obtains an approximate precoder \(\widetilde{\bm{W}}_t\), forms
\[
\bm{D}_{\mu,t} \equiv \bm{D}_{\mu}(\bm{\theta}_t,\omega_t,\bm{U}_t; \widetilde{\bm{W}}_t),
\]
and updates the IRS parameter through projection:
\[
\bm{\theta}_{t+1}
=
\textnormal{proj}_{\Theta}\left(\bm{\theta}_t + \eta\bm{D}_{\mu,t}\right).
\]
After \(T\) iterations, it samples \(t^*\) uniformly from \(\{0,\ldots,T\}\) and returns \(\bm{\theta}_{t^*}\). This randomized output rule is standard in nonconvex stochastic approximation and is the object appearing in the convergence theorem.

## 3. Inexact precoding oracle and two-stage decomposition

The adjective “inexact” in iZoSGA refers specifically to the second-stage precoding solve. The inner problem is not assumed to be solved exactly at each coherence interval; instead, the method accesses an inexact precoding oracle that returns a feasible approximate solution \(\widetilde{\bm{W}} \in \mathcal{W}\) [2509.16776].

Formally, for any \(\bm{\theta} \in \Theta\) and almost every \(\omega \in \Omega\), the oracle satisfies
\[
\mathrm{dist}\Big(\widetilde{\bm{W}},
\arg\max_{\bm{W} \in \mathcal{W}} F(\bm{W},\bm{H}(\bm{\theta},\omega))\Big)
\leq \varepsilon(\bm{\theta},\omega),
\]
so that if \(\bm{W}^*(\bm{\theta},\omega)\) is some maximizer of the second-stage problem, then
\[
\|\widetilde{\bm{W}} - \bm{W}^*\| \leq \varepsilon(\bm{\theta},\omega).
\]
In the paper’s main instantiation, WMMSE is used as this oracle, and running WMMSE for \(T_{\text{WMMSE}}\) iterations produces an approximation whose error depends on the iteration budget.

A central analytical device is the relationship between functional suboptimality and distance to the optimizer set. The paper states that the function
\[
\bm{W} \mapsto \max_{\bm{W}\in\mathcal{W}}F(\bm{W},\cdot) - F(\bm{W},\cdot)
\]
is subanalytic and therefore satisfies a Łojasiewicz inequality with uniform exponent \(\xi>0\). Concretely, there exists a positive subanalytic function \(C(\bm{H})\) and exponent \(\xi>0\) such that
\[
\textnormal{dist}\Big(\bm{W}, \arg\max_{\bm{W} \in \mathcal{W}} F(\bm{W},\bm{H}(\bm{\theta},\omega))\Big)
\leq C(\bm{H}) \big( \max_{\bm{W} \in \mathcal{W}} F(\bm{W},\bm{H}(\bm{\theta},\omega)) - F(\bm{W},\bm{H}(\bm{\theta},\omega)) \big)^{\xi}.
\]
Assuming a uniform constant \(C_{\bm{H}}\) that upper-bounds \(C(\bm{H}(\bm{\theta},\omega))\), any approximate solver with functional gap
\[
\max_{\bm{W} \in \mathcal{W}} F(\bm{W},\bm{H}(\bm{\theta},\omega)) - F\big(\widetilde{\bm{W}},\bm{H}(\bm{\theta},\omega)\big) \leq \widetilde{\varepsilon}(\bm{\theta},\omega)
\]
satisfies
\[
\|\widetilde{\bm{W}} - \bm{W}^*\| \leq C_{\bm{H}}\, \widetilde{\varepsilon}(\bm{\theta},\omega)^{\xi}.
\]

This two-level error model is important for interpretation. The outer IRS adaptation is not analyzed against the performance of the approximate inner problem; rather, it is analyzed against the original exact two-stage stochastic program. The inexactness of the short-term oracle therefore appears as a quantifiable perturbation of the exact long-term learning problem, rather than as a reformulation of that problem.

## 4. Convergence theory and stationarity guarantees

The convergence analysis proceeds under minimal smoothness assumptions on the black-box channel mapping. The paper assumes that for almost every \(\omega\), the map \(\bm{H}(\cdot,\omega)\) is twice continuously differentiable, uniformly bounded, Lipschitz continuous, and Lipschitz smooth as a function of \(\bm{\theta}\), and that the Łojasiewicz constant is uniformly bounded. Under these conditions, prior work implies that the outer objective \(f(\bm{\theta})\) is \(\rho\)-weakly convex [2509.16776].

The analysis therefore uses the Moreau envelope as a stationarity surrogate. With
\[
\phi(\bm{\theta}) \triangleq -f(\bm{\theta}) + \delta_{\Theta}(\bm{\theta}),
\]
and for \(\lambda>0\),
\[
\phi^{1/\lambda}(\bm{u}) \triangleq \min_{\bm{\theta} \in \mathbb{R}^S} \left\{ \phi(\bm{\theta}) + \frac{\lambda}{2}\|\bm{u}-\bm{\theta}\|^2 \right\},
\]
the gradient norm \(\|\nabla \phi^{1/\lambda}(\bm{u})\|\) becomes the relevant stationarity measure whenever \(\lambda > \rho\). Small Moreau-envelope gradient implies proximity to a Clarke-stationary point of the original constrained nonconvex problem.

The main theorem states that if
\[
\varepsilon_t(\bm{\theta}_t,\omega_t) = \|\widetilde{\bm{W}}_t - \bm{W}_t^*\|
\]
is the oracle error at iteration \(t\), and if the number of outer iterations and smoothing parameter are chosen as
\[
T = \mathcal{O}(\sqrt{S}\,\epsilon^{-4}),
\qquad
\mu = \mathcal{O}\big(1/\sqrt{M_U T}\big),
\]
then
\[
\mathbb{E}\left\{\left\|\nabla \phi^{1/(2{\rho})}(\bm{\theta}_{t^*})\right\|^2\right\} = \mathcal{O}\left(\epsilon^2 + \bar{\varepsilon}\right),
\]
where
\[
\bar{\varepsilon} \triangleq \frac{1}{T+1} \sum_{t=0}^T \mathbb{E}\left\{\varepsilon(\bm{\theta}_t,\omega_t)\right\}
\]
is the averaged oracle error. Using the functional-gap bound above, this can be refined to
\[
\mathbb{E}\left\{\left\| \nabla \phi^{1/(2\rho)}(\bm{\theta}_{t^*})\right\|^2 \right\} = \mathcal{O}\left( \epsilon^2 + \frac{1}{T+1}\sum_{t=0}^T \mathbb{E}\left\{\widetilde{\varepsilon}(\bm{\theta}_t,\omega_t)^\xi\right\} \right).
\]

The theoretical message is exact and limited. If the oracle is exact, the previous ZoSGA rate is recovered. If the oracle is inexact, iZoSGA converges to a neighborhood of a stationary solution of the original exact problem, and the neighborhood size is controlled additively by averaged oracle inexactness. This suggests that moderate inner error is tolerable, but large persistent second-stage inaccuracies directly inflate the stationarity residual.

## 5. Implementation profile and numerical behavior

The algorithm is designed to be practically lightweight at the outer level. Each iteration uses exactly three channel estimations: one at \(\bm{\theta}_t\) for precoding, and two at \(\bm{\theta}_t \pm \mu \bm{U}_t\) for the finite-difference estimate. Projection onto \(\Theta\) is assumed easy, and the remaining cost is dominated by WMMSE, whose per-iteration complexity is described as typically \(\mathcal{O}(M_U^3)\). The claimed iteration complexity
\[
T = \mathcal{O}(\sqrt{S}\epsilon^{-4})
\]
grows only like \(\sqrt{S}\) in IRS dimension \(S\), which the paper presents as one reason the method remains viable for large IRSs [2509.16776].

The representative simulation setup uses an AP with \(M=6\) antennas, \(K=32\) single-antenna users, and an IRS with \(S=1000\) purely phase-shift elements. Amplitudes are fixed to unity, phases vary in \([-2\pi,2\pi]^{1000}\), and the effective channel is modeled as
\[
\bm{h}_k(\bm{\theta},\omega)
=
\underbrace{
\bm{G}^\hermtr \operatorname{Diag}(\bm{A} \circ e^{j\bm{\phi}})\,\bm{h}_{r,k}
}_{\text{non-LOS via IRS}}
+
\underbrace{\bm{h}_{d,k}}_{\text{direct LOS}}.
\]
The paper notes that the total number of cascaded links is about 38,192 and that each curve is averaged over 60 independent runs. iZoSGA is explicitly described as oblivious to these structural details because it uses only effective channels in its gradient estimates.

The numerical findings are organized around oracle accuracy. For 10 or more WMMSE iterations, the oracle error is small and iZoSGA achieves similar performance across 10–50 iterations. For 1–3 WMMSE iterations, the oracle is quite inexact and final performance drops significantly. The most practically notable regime is 5 WMMSE iterations: while WMMSE alone with random IRS exhibits a noticeable gap relative to 10 iterations, iZoSGA tuning of IRS parameters closes this gap after about 2500 outer iterations and ultimately matches the higher-accuracy oracles. This is presented as empirical confirmation that sufficiently accurate long-term IRS adaptation can compensate for moderate short-term precoding inexactness.

The paper also studies dynamic WMMSE schedules. One schedule, \(20 \to 10 \to 7 \to 6 \to 5\) iterations, converges smoothly to the best achievable weighted sum rate; another, \(20 \to 5 \to 4 \to 3 \to 2\), degrades once the WMMSE iteration budget falls below a threshold around 5 iterations. A plausible implication is that the averaged oracle error \(\bar{\varepsilon}\) admits an operational “safe regime” below which outer adaptation remains effective and above which the long-term learning process becomes visibly impaired.

A second family of experiments replaces the idealized IRS parameterization with a physical electromagnetic model based on varactor diodes, where each element is controlled through a tunable coupling capacitance \(C^s_{\text{var}}\) and amplitude-phase coupling reduces the effective design degrees of freedom. The same qualitative trend is observed: weak performance for 1–3 WMMSE iterations, strong performance for 5–50 iterations, and lower absolute sum rate than the ideal phase-only model because of hardware constraints. This suggests robustness of the method across both abstract and hardware-constrained IRS descriptions.

## 6. Conceptual position, novelty, and acronym disambiguation

Within the algorithmic landscape, iZoSGA sits at the intersection of stochastic approximation, zeroth-order optimization, and two-stage stochastic programming. It is a stochastic method because it uses random channel realizations and random perturbation directions; it is zeroth-order because it relies on finite-difference probing rather than analytic differentiation through the channel law or the inner optimizer; and it is a two-stage method because the outer objective is the expectation of an inner optimal-value function [2509.16776].

The main novelty claimed for iZoSGA is not merely gradient-free IRS tuning, but gradient-free IRS tuning with explicit accommodation of inexact second-stage optimization. The paper states that the method is truly model-free for IRS-aided beamforming, applies to arbitrary IRS/network configurations, and proves non-asymptotic convergence under inexactness with a clean additive oracle-error term. It also emphasizes practical deployability: three channel estimations per outer iteration, black-box compatibility with WMMSE, and strong empirical performance for moderate inner accuracy.

The principal limitations are equally specific. The convergence neighborhood depends on the average oracle error \(\bar{\varepsilon}\); the analysis is carried out for sum-rate maximization; and the theoretical rates are worst-case and conservative. The paper identifies extensions to other metrics such as fairness, energy efficiency, and secrecy, as well as alternative inexact inner solvers, as open directions.

The acronym can also invite confusion. A separate paper on zero-sum partially observable stochastic games remarks that the query “iZoSGA” sounds like “iterative zero-sum game algorithm” for zs-POSGs or “improved zs-POSG algorithm,” but that paper’s actual named algorithms are SeqPBVI and SimPBVI, not iZoSGA [2602.24092]. In the established sense documented here, iZoSGA denotes “inexact Zeroth-order Stochastic Quasigradient Ascent” for two-stage IRS-aided sum-rate maximization rather than a zero-sum game solver.

In summary, iZoSGA is best understood as a black-box outer-loop optimizer for long-term IRS control in a two-timescale architecture, with the short-term beamforming stage delegated to an approximate oracle. Its theoretical contribution is the coupling of zeroth-order quasigradient learning with a quantified inexact-oracle model; its practical contribution is the demonstration that passive IRS tuning can remain effective even when inner WMMSE beamforming is solved only approximately.

Source: https://www.emergentmind.com/topics/izosga