---
title: Fractional Programming Overview
url: https://www.emergentmind.com/topics/fractional-programming-fp
type: topic
---

# Fractional Programming Overview

Fractional programming (FP) is a class of mathematical optimization concerned with problems in which the objective and possibly the constraints contain functions that are ratios of other functions. Such programs appear pervasively in signal processing, wireless communications, machine learning, combinatorial optimization, energy systems, operations research, and finance due to the prevalence of quantities such as SINR, energy efficiency, Sharpe ratio, Cramér–Rao bound, and data throughput per resource. FP directly models problems where trade-offs or efficiencies are naturally expressed as ratios, enabling formulation and solution strategies aligned with underlying physical or operational principles.

## 1. Fundamental Fractional Programming Problem Classes

The canonical FP problem seeks to optimize an objective involving ratios:
\[
\max_{x\in\mathcal X}\; f(x)=\frac{A(x)}{B(x)},
\]
with $A: \mathbb{R}^n\to\mathbb{R}$ and $B: \mathbb{R}^n\to\mathbb{R}_{++}$, and possibly further constraints. Key classes include:

- **Single-ratio optimization:** Maximize or minimize $A(x)/B(x)$.
- **Max–min-ratio:** Maximize $\min_{i} \frac{A_i(x)}{B_i(x)}$.
- **Sum-of-ratios (Multi-ratio):** Maximize $\sum_i \frac{A_i(x)}{B_i(x)}$ or other combinations.
- **Sum-of-log-ratios:** $\sum_i w_i\log(1+A_i(x)/B_i(x))$ prominent in network information theory and resource allocation.
- **Matrix-ratio problems:** Optimization of trace, determinant, or other matrix functionals of the form $\mathrm{Tr}(\sqrt{A(x)}^H B(x)^{-1}\sqrt{A(x)})$ common in MIMO, precoding, or sensing [2503.09977].

Scalar single-ratio and max–min-ratio problems with certain convexity/concavity properties admit efficient global solution techniques (notably, Charnes–Cooper and Dinkelbach’s methods), whereas multi-ratio, sum-of-ratios, and matrix-ratio instances are generally NP-hard and only local or approximate solutions are tractable [2503.09977].

## 2. Transformations and Algorithmic Frameworks

Several foundational transformations have been developed to reformulate nonconvex ratio objectives into tractable surrogates:

### 2.1 Dinkelbach’s and Charnes–Cooper Methods

- **Dinkelbach’s Algorithm:** Converts single-ratio $\max_x\frac{A(x)}{B(x)}$ into a sequence of parametric convex programs by iteratively solving $\max_x\{A(x)-\lambda B(x)\}$ and updating $\lambda$ [1508.04805, 1601.08166]. This approach extends to robust and stochastic settings by embedding the parameter search in an outer loop [1508.04805].

- **Charnes–Cooper Transformation:** For linear or convex-quasiconvex cases, rewrites the problem as a convex program after homogenization, leveraging variable substitution to linearize the ratio [1601.08166].

### 2.2 Quadratic Transform (QT)

The quadratic transform is central for multi-ratio, sum-of-ratios, and matrix-valued problems [1802.10192, 2503.09977, 2305.02704]:
\[
\frac{A(x)}{B(x)} = \max_{y} \left\{ 2y\sqrt{A(x)} - y^2 B(x) \right\}, \quad y = \frac{\sqrt{A(x)}}{B(x)}.
\]
This equivalence lifts each ratio to a biconvex surrogate and exposes a block coordinate ascent structure: alternating updates of $(x, y)$. When applied to $n$ ratios, $n$ auxiliary variables $y_i$ are introduced, producing a sum of concave-quadratic surrogates in block variables. 

The transform admits analogues for the minimization case and for matrix-ratio functions, resulting in surrogate problems with closed-form auxiliary updates and tractable alternating optimization [1808.05678, 2305.02704, 2503.09977].

### 2.3 Lagrangian Dual and Generalized Transforms

For objectives involving compositions such as sums of logarithms of ratios, a Lagrangian dual or multiplier transform is used [1802.10192, 2305.02704]:
\[
\log(1+\Gamma_i) = \max_{\gamma_i\geq 0} \log(1+\gamma_i) - \gamma_i + (1+\gamma_i)A_i/(A_i+B_i).
\]
This step is typically followed by the quadratic transform, yielding block-coordinate updates in $\gamma$, $x$, and $y$.

### 2.4 Minorization–Maximization (MM) and Block Coordinate Descent

The above transforms produce surrogates that satisfy the MM principle: the surrogate function is a global lower bound (for maximization problems) that coincides with the original objective at the current iterate. The optimization proceeds by alternately maximizing over different blocks, producing nondecreasing objective sequences and guaranteeing convergence to stationary points under standard regularity conditions [1808.05678, 2312.05726].

### 2.5 Extensions: Acceleration, Nonhomogeneous and Manifold Techniques

- **Nesterov-style acceleration:** By viewing the QT $x$-step as gradient projection, Nesterov’s extrapolation delivers quadratic rate improvements, reducing iteration complexity from $O(1/\epsilon)$ to $O(1/\sqrt{\epsilon})$ for target $\epsilon$-accuracy [2312.05726]. 
- **Nonhomogeneous transforms:** Enable elimination of large matrix inverses for massive MIMO, further lowering per-iteration cost [2601.02822, 2507.06944].
- **Manifold optimization:** For fractional objectives defined over matrix manifolds (e.g., unitary or Stiefel constraints), transforms are combined with Riemannian optimization to solve problems such as RIS scattering matrix design [2511.07683].

## 3. Theoretical Properties and Convexification

### 3.1 Convergence and Optimality

- **Single-ratio and certain max–min problems:** Strong duality and global optimality hold when the numerator is convex, the denominator is concave, and the feasible set is convex [1508.04805, 1601.08166].
- **Multi-ratio/sum-of-ratios and matrix ratios:** For general (NP-hard) classes, the quadratic transform with MM guarantees stationary-point convergence but not global optimality [2503.09977, 2507.06944, 2312.14341].
- **Robust FP:** Robust optimization can be integrated directly, with conditions that guarantee reduction to a convex or iterative convex program [1508.04805].

### 3.2 Convexification and Convex Hull Tightening

Advanced convexification techniques enable tighter relaxations for discrete and polynomial FP:

- **Projective liftings:** Relate the convex hull of fractional functions to the convex hull of their polynomial analogues [2310.08424].
- **Boolean quadric polytopes:** Exact and tight relaxations for 0–1 ratio-of-affines, using BQP inequalities (McCormick, triangle, odd-cycle) to strengthen relaxations for binary variables [2310.08424].
- **Copositive programming:** Used for ratio-of-quadratics and conic quadratic programming in high-dimensional cases [2310.08424].
- **Moment-hull representations:** Moments-based SDP formulations for univariate fractional polynomials yield strong relaxations and exactness for small problem instances [2401.16716, 2310.08424].

### 3.3 Splitting and Proximal Methods

Recent work has introduced operator-splitting and proximal schemes for FP with nonsmooth, composite, and nonconvex structure:
- Proximal-gradient methods for $f(x)/g(x)$ in Hilbert spaces—proximal step for $f$, gradient step for $g$—with global convergence under concave denominators, and criticality under convex denominators and KL [1601.08166].
- Full-splitting, adaptive, and nonmonotone-line-search algorithms for nonconvex and nonsmooth FPs with composed linear operators achieve subsequential and, with the KL property, global convergence [2312.14341].
- Parameter-free SDP relaxations yield global solutions for sum-of-squares-convex semi-algebraic FPs via a single SDP [2401.16716].

## 4. Extensions: Mixed, Stochastic, and Robust FP

### 4.1 Mixed Max-and-Min FP

Problems with interleaved maximization and minimization over ratios (e.g., maximizing legitimate receiver SINR while minimizing eavesdropper SINR) are handled by a unified extension of the quadratic transform, yielding joint surrogates for both objectives with MM convergence [2305.02704].

### 4.2 Stochastic and Robust Settings

- **Stochastic FP:** Ergodic-sum-rate or expectation-constrained FP arises in MIMO precoding under channel uncertainty. Direct application of FP inside expectation is infeasible; instead, exchanging the order of expectation and surrogate yields a tractable lower-bound amenable to block-MM updates [2507.06944].
- **Robust FP:** Extends FP to uncertainty in numerator, denominator, and constraints, with single-shot or iterative convexification depending on independence/structure of uncertainty [1508.04805].

## 5. Applications in Communications, Machine Learning, and Engineering

### 5.1 Communication Systems

- **Beamforming and power control:** FP, and in particular the quadratic transform, underpins algorithms for max-rate, min-power, and energy-efficient beamforming in MISO/MIMO, NOMA, RIS, and D2D networks, including robust designs under imperfect channel state information [1802.10192, 2001.00655, 2511.07683, 2601.02822].
- **Scheduling and resource allocation:** Discrete and mixed-integer FP (e.g., user association, offloading, matching) utilize FP surrogates in conjunction with combinatorial optimization, matching, or penalty-based relaxations [1802.10197, 2312.06202].

### 5.2 Signal Processing and Machine Learning

- **SVM and normalized cut:** Margins, robust ratios, and spectral clusterings are cast as FP and solved via QT or MM [2503.09977].
- **Kullback–Leibler divergence optimization:** Sensing and detection waveform design with KLD objectives is accelerated from cubic to quadratic per-iteration complexity via FP + nonhomogeneous relaxation, yielding order-of-magnitude runtime improvements [2601.00564].
- **Graph clustering and combinatorial biclustering:** Fractional ratio objectives in graph cuts and biclustering are tackled through matrix QT, BQP relaxations, and specialized branch-and-bound [1603.04597, 2310.08424].

### 5.3 Energy Systems and Operations Research

- **Fuel efficiency and power systems:** Deployment of FP for large-scale sum-of-ratios objectives in fuel consumption, dispatch, and resource allocation ensures convergence and scalability unattainable for direct NLP approaches [2310.17913].
- **SOS-convex and generalized FPs:** SDP relaxations and moment-based representations provide tractable and globally optimal solutions for classes of nonconvex algebraic FPs [2401.16716].

## 6. Practical, Numerical, and Complexity Considerations

- **Per-iteration cost:** Classical FP often requires matrix inversions; nonhomogeneous relaxations and deep-unfolded approaches have eliminated cubic complexity in massive MIMO and large architectures [2601.02822, 2507.06944].
- **Parallelizability and decentralization:** The block-coordinate and auxiliary-variable structure of FP surrogates admit parallel and distributed implementations, significant for large networks [2312.05726].
- **Convergence rates:** QT and block-MM typically yield $O(1/k)$ objective gap decay; Nesterov-style acceleration and STEM-type fixed-point schemes yield $O(1/k^2)$ or superlinear convergence [2312.05726, 2601.00564].

## 7. Directions for Theory and Open Problems

- **Global optimality in NP-hard classes:** Integrating hierarchy-based relaxations (SOS, moment, RLT) with FP surrogates to close the relaxation gap for multi-ratio and discrete FPs remains an open challenge [2310.08424, 2401.16716].
- **Integration with learning:** Deep-unfolded FP architectures (as in DeepFP) bridge physics-inspired and data-driven paradigms for beamforming, resource allocation, and detection in high-dimensional nonconvex scenarios [2601.02822].
- **Stochastic, online, and multi-agent FP:** Open problems include streaming and stochastic cases, dynamic problem data, and extensions to decentralized or federated optimization [2312.05726, 2507.06944].
- **Bilevel and multi-objective FP:** Unifying FP in hierarchical or multi-fidelity contexts.

In summary, FP unifies the modeling and solution of optimization problems characterized by fractional structures, from classical cases to modern multilayered, mixed, matrix, and learning-accelerated paradigms. Central innovations, such as the quadratic transform, MM/MM-based alternations, convexification hierarchies, and joint optimization with machine learning, provide a comprehensive methodical and algorithmic foundation capable of addressing many of the most intricate problems seen in contemporary engineering, statistics, and data science [1802.10192, 2503.09977, 2312.05726, 2305.02704, 2601.02822].

Source: https://www.emergentmind.com/topics/fractional-programming-fp