---
title: 'Unbalanced Optimization: Theory and Applications'
url: https://www.emergentmind.com/topics/unbalanced-optimization
type: topic
---

# Unbalanced Optimization: Theory and Applications

Searching arXiv for recent papers on unbalanced optimization and closely related formulations.
Unbalanced optimization denotes a family of optimization formulations in which a standard balance condition is absent, relaxed, or intentionally replaced by an asymmetric model. In power systems, unbalanced optimal power flow is a class of optimization problems subject to the steady state physics of three-phase power grids with nonnegligible phase unbalance [2106.06186]. In distributed optimization over digraphs, “unbalanced” means that \(1^T L \neq 0^T\), or more generally that only row-stochastic or column-stochastic mixing is available, so standard consensus protocols do not preserve averages [2211.16977]. In optimal transport, unbalanced formulations relax hard marginal constraints and permit mass to be created or destroyed at a penalty [2306.04116]. In combinatorial optimization and classification, the term also appears in asymmetric penalty encodings of inequality constraints and in optimization methods tailored to imbalanced data [2211.13914], [2410.11171]. A plausible organizing view is that these literatures share a common move: they replace a convenient symmetry assumption by a model that matches the governing physics, communication topology, data distribution, or constraint geometry more faithfully.

## 1. Structural meanings of unbalance

In three-phase distribution networks, unbalance is physical. The network is steady-state, three-phase, radial or weakly meshed; conductor transposition is neglected, so lines may be phase-unbalanced. Voltages \(V_i \in \mathbb{C}^3\), branch currents \(I_{ij} \in \mathbb{C}^3\), shunt currents, and complex-power flows are all phase-indexed, and the optimization must respect phase-specific Kirchhoff–Ohm relations rather than a balanced single-phase surrogate [2106.06186].

In multi-agent optimization, unbalance is topological. For a fixed strongly-connected directed graph with Laplacian \(L\), “unbalanced” means \(1^T L \neq 0^T\); incoming and outgoing total weights at each node do not match, and consensus mechanisms built for doubly-stochastic mixing cease to be exact. This is the source of push-sum corrections, topology balancing estimators, and row/column stochastic split schemes [2211.16977], [1612.09029].

In optimal transport, unbalance is measure-theoretic. Classical OT imposes exact marginal constraints; unbalanced OT instead penalizes deviations of transported marginals from prescribed source and target measures by divergences such as KL, or, in dynamical formulations, augments the continuity equation with a reaction term \(w\mu\) that encodes mass creation or dissipation [2306.04116], [2504.03301].

In QUBO encodings, unbalance is penalization asymmetry. The penalty is larger when an inequality constraint is not achieved than when it is, so one avoids slack variables and still places the optimal feasible solution near the ground-state cost Hamiltonian [2211.13914]. In imbalanced-data learning, unbalance refers to class proportions and to subset-selection rules that reject majority datapoints unable to improve model loss [2410.11171].

## 2. Three-phase unbalanced power-system optimization

The core formulations for three-wire unbalanced OPF are the branch-flow model and the bus-injection model. For a branch \(i \to j\), Ohm’s law is
\[
V_i - V_j = Z_{ij} I_{ij},
\]
with shunt currents and power-flow matrices defined phase-wise; nodal balance is enforced by
\[
\sum_{\ell:i\to j}\operatorname{diag}(S_{ij}) + \sum_{\ell:k\to i}\operatorname{diag}(S_{ki})
+ \sum_{u\in \mathrm{Units}(i)} [P_{u,i}+jQ_{u,i}]
+ \operatorname{diag}(V_i Y_i^H V_i^H)=0.
\]
Because most solvers do not natively accept complex-valued variables, these equations are rewritten in real form. Rectangular coordinates split voltages and currents into real and imaginary parts, polar coordinates yield trigonometric nonconvexities, and lifted SDP formulations use \(W_i = V_i V_i^H\) with \(W_i \succeq 0\) and \(\operatorname{rank}(W_i)=1\) [2106.06186].

A distinctive contribution of the same line of work is the explicit treatment of engineering bounds across formulations. Voltage-magnitude bounds become quadratic constraints in rectangular coordinates and diagonal bounds in lifted SDP variables; current-magnitude, apparent-power, and voltage-angle-difference bounds are likewise translated into semantically consistent forms. The paper emphasizes that consensus on bound semantics is a pressing need for benchmarking. Its formulations were validated against OpenDSS on the IEEE 13-node, 34-node and 123-node unbalanced test feeders using PowerModelsDistribution.jl, with worst maximum phase-voltage error \(<1\mathrm{e}{-7}\) pu for the baseline AC-NLP, exact rank-1 SDP relaxations on all radial feeders tested, and runtimes of \(\sim 0.3\) s for Ipopt and \(\sim 1.5\) s for Mosek on IEEE-123 [2106.06186].

Scalability and feasibility motivate a second thread. In distribution-level OPF, the nonlinear programming model can have convergence issues and may not scale well for unbalanced systems. The proposed PSLP method uses successive linear approximation and solves multiple LP subproblems, while ISOCP uses SOCP relaxations with directional constraints so that feasible power-flow solutions are recovered over multiple iterations. On the IEEE 123-bus feeder, the reported runtime is approximately \(342\) s for NLP, \(3.9\) s for PSLP, and \(98\) s for ISOCP; on the R3-12.47-2 feeder, NLP requires \(2500\)–\(3400\) s, PSLP \(20\)–\(50\) s, and ISOCP \(180\)–\(380\) s, with all methods agreeing on substation power within \(0.002\) MW [2103.00692].

Operational control problems inherit the same unbalanced structure. In the two-layer Volt/VAR framework, the upper layer solves a receding-horizon MIQP using a generalized linearized branch-flow model that removes the bilinear term \(v_i \cdot n_{\mathrm{tap}}\), while the lower layer deploys a decentralized integral-like reactive-power update
\[
q_{inv,i}^\phi(t+1)=\operatorname{Proj}\{q_{inv,i}^\phi(t)-\gamma[v_i^\phi(t)-v_{ref,i}^\phi]\},
\]
with sufficient stability condition \(0<\gamma<2/\lambda_{\max}(M)\). On the unbalanced IEEE 123-Node Test Feeder, the upper-layer solve time is \(0.5\) s for \(T_H=1\) h and \(1.3\) s for \(T_H=5\) h, versus \(>5\) s and \(>760\) s for the non-convex formulation, and the two-layer scheme holds all phases within \([0.95,1.05]\) p.u. at all times [1912.11173].

Rolling-horizon microgrid energy management extends the same philosophy. The framework in a modified IEEE 34-bus three-phase microgrid preserves full current-based unbalanced physics, derives a convex QCP and a linearized LP from a nonlinear nonconvex model, and replans over windows with \(T_w \approx 11\) h and discount factor \(\beta \approx 0.997\). Over \(1{,}000\) Monte Carlo runs, the convex QCP average cost is approximately \(123\) kr/day, the 4-sided LP approximately \(125\) kr/day, and a two-stage stochastic baseline approximately \(148\) kr/day, implying rolling-horizon savings of approximately \(17\%\); voltage stays in \([0.95,1.05]\) p.u. in \(99.7\%\) of hours [2503.15394].

## 3. Distributed optimization over unbalanced directed networks

The distributed-optimization literature treats unbalance as a property of the communication graph rather than the objective. A representative continuous-time formulation considers
\[
\min_{s\in\mathbb{R}^n} F(s)=\sum_{i=1}^N f_i(s),
\]
where each \(f_i\) is differentiable with globally Lipschitz gradient, possibly nonconvex, and the global minimizer \(s^\star\) is unique. The graph is fixed, strongly connected, directed, and unbalanced, so the left eigenvector \(\xi\) satisfying \(\xi^T L=0^T\) is generally unknown to the nodes. The proposed fully distributed algorithm uses a topology-balancing estimator \(w_i\), divides \(\nabla f_i(x_i)\) by \(w_i^i\), and introduces adaptive gains \(\rho_i\) and \(\sigma_i\). Its analysis passes through a perturbed-system form, input-to-state stability with vanishing perturbation, and asymptotic convergence of every \(x_i(t)\) to \(s^\star\), without requiring knowledge of the smallest strong convexity constant or of \(\xi\) [2211.16977].

For strongly convex smooth objectives, linear-rate methods have been constructed directly on row-stochastic or column-stochastic networks. The ADBB method combines Barzilai–Borwein step-sizes,
\[
\alpha_k^i=\frac{1}{m}\frac{(s_k^i)^Ts_k^i}{(s_k^i)^Tv_k^i}
\quad\text{or}\quad
\alpha_k^i=\frac{1}{m}\frac{(s_k^i)^Tv_k^i}{(v_k^i)^Tv_k^i},
\]
with multi-consensus inner loops and gradient tracking. Under Lipschitz-gradient and strong-convexity assumptions, each \(\alpha_k^i\) lies in \([1/(mL_f),\,1/(m\mu)]\), and the iterates converge linearly. In mushroom classification with \(m=20\) agents on an unbalanced graph, ADBB achieves the highest test accuracy after \(k=100\) and \(k=1000\) iterations, approximately \(0.98\) average versus \(\le 0.97\) for the benchmarks ABm, AB, ADD-OPT, FROST, and DEXTRA [2305.11469].

Online convex optimization over unbalanced networks adds temporal variation and global constraints. DUST addresses
\[
\min \sum_{t=1}^T \sum_{i=1}^N f_{i,t}(x_i)
\quad\text{subject to}\quad
\sum_{i=1}^N g_i(x_i)\le 0,
\]
over time-varying directed graphs with column-stochastic mixing. Each agent maintains a primal variable \(x_{i,t}\), a constraint-tracking variable \(y_{i,t}\), a local dual estimate \(\mu_{i,t}\), and a push-sum weight \(c_{i,t}\), with \(\lambda_{i,t}=\mu_{i,t}/c_{i,t}\). With \(\alpha_t=\sqrt{t}\) and \(\eta_t=t\), DUST attains dynamic regret
\[
R_T = O(\sqrt{T}) + O(V_T),
\]
and cumulative constraint violation \(R_T^c = O(T^{3/4})\), improved to \(O(\sqrt{T})\) under Slater’s condition [2309.01509].

Time-varying unbalanced topologies with local constraints have also been handled by paired row-stochastic and column-stochastic matrix sequences. Liu et al. combine a row-stochastic state-mixing step, a Polyak-style projection-correction for local inequality constraints, and a column-stochastic gradient-tracking variable \(y_i(t)\). Under uniformly jointly strongly connected graph sequences, compact local sets, and a diminishing step-size \(\alpha(t)\), the method achieves consensus, feasibility, and convergence to an optimal solution, with averaged rate \(O(\ln t/\sqrt t)\) for the optimality gap and consensus violation [2208.12123].

When explicit subgradients are unavailable, the push-sum idea persists. Xiong et al. construct row-stochastic matrices from a column-stochastic \(A_t\) by an auxiliary scalar \(\phi_{i,t}\), then combine consensus with a local randomized zeroth-order oracle. With \(\alpha_t=1/(m\sqrt{t+1})\), \(\mu=r/\sqrt{T+1}\), and \(\xi=1/\sqrt{T+1}\), the dynamic regret is \(O(\sqrt{T})\), and the paper reports that the zeroth-order version has essentially the same rate as the subgradient-based counterpart [2202.11313].

A different resolution is epigraph reformulation. Xie et al. transform \(\min_x \sum_i f_i(x)\) with local inequality constraints into an epigraph form where all nodes share the same linear objective \(\frac{1}{N}\mathbf{1}_N^T t\), thereby eliminating the Perron-weight issue of unbalanced graphs. The resulting distributed random-fixed projection algorithm uses only row-stochastic weights and converges almost surely to a common optimal solution over uniformly jointly strongly connected time-varying digraphs [1612.09029].

For finite-sum problems, Push-LSVRG-UP combines push-sum, loopless SVRG, and uncoordinated triggered probabilities \(p_i\). Under a constant step-size
\[
0<\alpha\le \min\Bigl\{\frac{(1-\sigma)p_{\min}}{6\mu},\,
\frac{(1-\sigma)^2 p_{\min}}{480\,\delta\,Q^2\,p_{\max}}\Bigr\},
\]
the method converges linearly and requires only \(O(n)\) storage per agent. This places unbalanced digraph optimization in the same algorithmic class as modern variance-reduced distributed learning [2305.09181].

## 4. Unbalanced optimal transport and related control formulations

In optimal transport, unbalance is formalized by relaxing the marginal constraints. For source and target fertilities \(a \in \mathbb{R}_+^n\), \(b \in \mathbb{R}_+^m\), cost matrix \(C\), entropic regularization \(\varepsilon>0\), and KL penalties \(\tau_a,\tau_b>0\), unbalanced OT solves
\[
\min_{P\ge 0}\;\langle P,C\rangle + \varepsilon H(P)
+\tau_a D(P\mathbf{1}_m\|a)+\tau_b D(P^T\mathbf{1}_n\|b).
\]
Balanced OT enforces \(P\mathbf{1}_m=a\) and \(P^T\mathbf{1}_n=b\), partial OT imposes hard inequalities plus a fixed transported mass, and unbalanced OT penalizes marginal deviations instead of enforcing them exactly. The corresponding generalized Sinkhorn–Knopp scaling algorithm converges linearly to the unique optimum [2306.04116].

This relaxation is useful in applications where null alignment or unequal information content is intrinsic. In monolingual word alignment, the same formulation is used to accommodate words with no corresponding counterparts. The paper reports that balanced, partial, and unbalanced OT are natural and powerful approaches even without tailor-made techniques, and that the generic OT-based methods are competitive against state-of-the-art systems specially designed for word alignment, particularly on datasets with high null alignment frequencies [2306.04116].

Gazdieva et al. develop a continuous unbalanced entropic OT solver that avoids minimax training. Their plan class has the form
\[
\gamma_{\theta,w}(x,y)=u_w(x)\,\gamma_\theta(y|x),
\quad
\gamma_\theta(y|x)\propto \exp(\langle x,y\rangle/\varepsilon)\,v_\theta(y),
\]
and the key result is a tight upper bound that turns the UEOT problem into a single-level objective
\[
\mathcal{L}(\theta,w)=(A)+(B)+\varepsilon\|u_w\|_1.
\]
With unnormalized Gaussian mixtures for \(u_w\) and \(v_\theta\), the method has no inner loops, no adversarial critic, and no nested maximizations. The paper proves universal approximation of UEOT solutions and gives generalization bounds of order \(O_p(N^{-1/2}+M^{-1/2})\). Reported runtimes are a few minutes on a 4-core CPU for 2-D toy mixtures and under ten minutes on CPU for \(d=512\), \(K=L=50\), and \(5\times 10^3\) steps [2303.07988].

Dynamical unbalanced OT pushes the same idea into PDE-constrained control. The primal variables are a nonnegative measure \(\mu(t,\cdot)\), a transport velocity \(v(t,x)\), and a mass creation/dissipation rate \(w(t,x)\), linked by
\[
\partial_t \mu + \nabla\cdot(\mu v)=w\mu.
\]
The cost is \(\int_0^1\int_X L(t,x,v,w)\,d\mu\,dt\) subject to \((v,w)\in F(t,x)\). After relaxation through Young measures and Fenchel–Rockafellar duality, the problem becomes an HJB-type supremum over smooth subsolutions,
\[
\partial_t \phi + H(t,x,\nabla\phi,\phi)\le 0,
\]
and the paper proposes a first-order augmented-Lagrangian algorithm in which each iteration solves one linear PDE and performs one pointwise projection onto a convex set [2504.03301].

Reinforcement learning admits an analogous UOT formulation over occupancy measures. For a policy \(\pi\), the discounted occupancy measure is \(\mu^\pi(s,a)=\rho^\pi(s)\pi(a|s)\), and the optimization augments reward maximization by marginal penalties on state visitations and action executions. The objective is written as a Bregman-divergence problem
\[
\min_{\mu}\;D_\Gamma(\mu\|\xi)+\sum_{i=1}^N \phi_i(\mu),
\]
and solved by Dykstra’s algorithm via Bregman projections. In large state or action spaces, the paper derives an actor–critic saddle-point form in dual potentials \(u(s)\), \(v(a)\), and \(Q(s,a)\), thus importing unbalanced transport directly into constrained policy optimization [2102.07889].

## 5. Learning-based and stochastic optimization under imbalance

Recent work embeds unbalance directly into learned surrogates rather than approximating it away. For real-time BESS dispatch in unbalanced three-phase grids, a heterogeneous graph \(G=(\mathcal{N},\mathcal{E})\) is built with node types for buses, storage units, external-grid connections, loads, and lines, and with features that include phase voltages, unbalanced loads, BESS states, and line mutual couplings. A physics-informed loss adds soft penalties for SoC, voltage, and external-grid constraints. On the CIGRE 18-bus distribution system, the reported bus voltage MSEs are \(6.92\times10^{-7}\) for GCN, \(1.21\times10^{-6}\) for GAT, \(3.29\times10^{-5}\) for GPS, and \(9.04\times10^{-7}\) for SAGE; the constraint-violation MSE for SoC and C-rate is reduced from \(O(1)\)–\(O(10^2)\) without the physics loss to nearly zero with it [2512.09780].

A different learning-based acceleration appears in stochastic Volt-VAR optimization. In the two-stage stochastic VVO model for a modified IEEE 123-bus three-phase unbalanced network with 4 OLTCs, 6 tie switches, and 14 PVs, the second-stage recourse
\[
Q(\mathbf{x},\boldsymbol{\xi}_s)=\min_{\mathbf{y}_s\in\mathcal{Y}}\;\mathbf{q}^T\mathbf{y}_s
\quad\text{s.t.}\quad
\mathbf{W}\mathbf{y}_s\ge \mathbf{h}(\boldsymbol{\xi}_s)-\mathbf{H}\mathbf{x}
\]
is approximated by a neural network embedded into a MILP through big-\(M\) ReLU constraints. Across 100 test instances with \(S\in\{10,50,100\}\), the average solve times are \(1{,}720\) s for the full extensive MILP, \(265\) s for Progressive Hedging, and \(32\) s for the neural MILP. The average optimality gap of the neural method versus exact is \(0.216\%\), always \(<0.30\%\), and the surrogate MILP time is essentially constant regardless of scenario count [2510.23867].

Optimization for imbalanced data uses a different mechanism. In the bilevel formulation for classification, the upper level selects a majority subset \(S_M\subset \mathcal{S}_M\), while the lower level trains network weights
\[
w^\star=\arg\min_w \mathcal{L}(S_m\cup S_M;z(w)).
\]
The MUBO heuristic accepts a candidate majority batch \(S_M^{(t)}\) if the resulting majority-only loss \(J^{(t)}\) is no larger than the previous threshold \(\gamma_{t-1}\). The paper reports average F1 improvements on several UCI datasets: Gisette \(0.96\) versus best prior \(0.94\), Abalone \(0.86\) versus \(0.83\), Connect4 \(0.99\) versus \(0.95\), Spambase approximately \(0.92\), and Ionosphere \(0.87\) versus a GAN baseline \(0.98\), the last serving as an explicit small-data limitation [2410.11171].

A plausible implication is that learning-based unbalanced optimization now splits into two regimes. In one regime, the learned model is constrained to respect physical feasibility through penalty terms or MILP embeddings; in the other, the optimization itself is a mechanism for selecting or reweighting data under class asymmetry. The data block supports both patterns, but they address different meanings of “unbalanced.”

## 6. Constraint encoding, misconceptions, and open directions

A recurring misconception is that “unbalanced” names one unified mathematical object. The surveyed papers instead use the term for at least four non-equivalent departures from balance: phase asymmetry in power networks, non-doubly-stochastic directed communication, relaxed measure conservation, and asymmetric inequality penalization. Another misconception is that relaxing a balanced model automatically preserves feasibility. In unbalanced D-OPF, the literature explicitly notes that existing relaxation techniques do not guarantee a feasible power flow solution, which is why iterative LP and SOCP schemes are designed to recover optimal and feasible solutions over multiple iterations [2103.00692].

Constraint handling illustrates the same diversity. In QUBO models, inequality constraints are commonly encoded with slack variables, but this increases the number of qubits and operations. The unbalanced penalization method replaces the slack-variable encoding of
\[
g(x)=\sum_i l_i x_i \le b
\]
by
\[
P_{\mathrm{unb}}(x)=-\lambda_1 h(x)+\lambda_2 h(x)^2,
\qquad
h(x)=b-\sum_i l_i x_i,
\]
with larger penalization when the inequality constraint is not achieved than when it is. On D-Wave hybrid solvers for bin packing, the paper reports solutions for up to 29 items with unbalanced penalization, whereas the slack-variables approach handles up to 11 items [2211.13914].

Benchmarking and semantics remain central. In unbalanced OPF, the lack of definitions of current and voltage bounds across different classes of representations is identified as a key problem, and benchmarks are described as a cornerstone for the development and validation of scalable and reproducible optimization models and tools [2106.06186]. In distributed optimization, open directions explicitly include time-varying or switching digraphs, discrete-time counterparts, event-triggered communication, and more general agent dynamics [2211.16977]. In neural stochastic VVO, the remaining approximation gap is attributed to finite training data and MLP expressivity, with larger networks, more data, or end-to-end fine-tuning proposed as extensions [2510.23867]. In quantum unbalanced penalization, open questions include rigorous penalty-weight selection and theoretical performance guarantees [2211.13914].

Across these literatures, the dominant methodological pattern is not merely “handling imbalance,” but making imbalance first-class in the optimization model. In power systems that means retaining three-phase couplings and explicit bound semantics; in networked optimization it means correcting nonconservative mixing rather than assuming doubly-stochastic communication; in transport it means penalizing marginal mismatch or adding source/sink dynamics; and in combinatorial or data-imbalance settings it means asymmetric penalties or bilevel subset selection. This suggests that unbalanced optimization is best understood as a modeling stance: balance is treated as a special case, not the default.

Source: https://www.emergentmind.com/topics/unbalanced-optimization