NSGA-II: Balanced Multi-objective Genetic Algorithm

• NSGA-II is a multi-objective evolutionary algorithm that approximates Pareto fronts via fast non-dominated sorting and crowding distance mechanisms.
• It integrates a rarity-based tie-breaking rule to promote diverse, rare objective values and improve convergence in high-dimensional search spaces.
• The balanced selection approach offers provable polynomial runtime improvements over classic NSGA-II, mitigating sensitivity to population size and exponential delays in many-objective setups.

The Non-dominated Sorting Genetic Algorithm II (NSGA-II) is the most widely adopted multi-objective evolutionary algorithm (MOEA) for approximating Pareto fronts in discrete and continuous search spaces. NSGA-II employs fast non-dominated sorting to organize the population into Pareto fronts, followed by a crowding distance mechanism to ensure diversity and uniform spread. However, recent mathematical analyses have detected fundamental limitations in the standard NSGA-II, particularly in high-dimensional (many-objective) settings and in its pronounced sensitivity to population size on classical combinatorial benchmarks. The "Balanced NSGA-II" introduces a rarity-based tie-breaking rule that provably circumvents both these pathologies, enabling polynomial-time convergence in settings where classic NSGA-II fails.

1. The Classic NSGA-II Workflow and Its Limitations

Standard NSGA-II maintains a population of fixed size $N$. In each generation:

• Variation: Each individual produces one offspring via standard bit mutation (each bit flipped independently with probability $1/n$) or with a crossover operator, depending on problem domain and implementation.
• Population Union: Parents and offspring are merged, forming $R = P\cup Q$ of size $2N$.
• Non-dominated Sorting: $R$ is decomposed into fronts $\mathcal{F}_1,\mathcal{F}_2,\dots$ by Pareto rank.
• Survivor Selection: Next parent generation $P'$ is filled with entire Pareto fronts in order until adding the next would overflow $N$; any overflow in the final partial front is resolved by descending crowding distance.
• Crowding Distance: For each front $F$, the crowding distance of individual $x$ is the sum, over objectives $1/n$0, of normalized gaps between its immediate neighbors in $1/n$1 sorted by $1/n$2; boundaries receive infinite distance to preserve extremal solutions.

Critically, inside the partially accepted front $1/n$3, any ties in crowding distance are resolved uniformly at random. This leads to loss of rare objective vectors and poor coverage of the Pareto front when $1/n$4 and many solutions have identical (usually zero) crowding distance. Mathematical analyses rigorously establish two deficiencies in this scheme (Doerr et al., 2024):

• Many-objective (m > 2) Hardness: For classic NSGA-II, even with $1/n$5 linear in the Pareto front size, the runtime to cover all Pareto points is exponential in $1/n$6 for $1/n$7 (Doerr et al., 2024).
• Population-size Sensitivity: In the bi-objective regime, runtime scales at least linearly with $1/n$8 (e.g., $1/n$9 on the OneJumpZeroJump problem), so "oversizing" the population significantly degrades performance (Doerr et al., 2024).

2. The Balanced Tie-breaking Rule: Rarity-Based Survivor Selection

The sole modification in balanced NSGA-II is the survivor selection among equally ranked and equally crowded individuals in the critical (overflowed) front. The algorithm replaces uniform-at-random tie-breaking with a rarity-aware group sampling procedure:

1. Grouping: Partition the tied set $R = P\cup Q$0 (with $R = P\cup Q$1 individuals to select) by unique objective vector values, yielding groups $R = P\cup Q$2 for each distinct value $R = P\cup Q$3.
2. Quotas: For $R = P\cup Q$4 (number of distinct objective vectors), select at most $R = P\cup Q$5 individuals uniformly at random from each $R = P\cup Q$6. The union $R = P\cup Q$7 accumulates these picks.
3. Fill-up: If $R = P\cup Q$8, assign any remaining slots by uniform random draws from $R = P\cup Q$9.

This rarity-based selection ensures every surviving front value is retained as evenly as possible, promoting rare objective vectors and preventing their elimination by the pancaking effect of purely random tie-breaking.

Pseudocode for the balanced tie-breaker:

$N$7 (Doerr et al., 2024)

3. Proven Runtime Guarantees for Balanced NSGA-II

The "balanced" tie-breaking enables polynomial-time convergence on benchmarks where standard NSGA-II exhibits exponential slowdown. Let $2N$0 be the size of the Pareto front, $2N$1 the maximum incomparability set, and $2N$2 ($2N$3 = problem dimensionality; $2N$4 = objectives):

Many-Objective (m ≥ 3) Polynomial Bounds

For OneMinMax ($2N$5-objective): Expected generations $2N$6.

For LeadingOnesTrailingZeros ($2N$7-objective): $2N$8.

For OneJumpZeroJump$2N$9 ($R$0-objective): $R$1.

The required population is $R$2, which is polynomial in $R$3 for constant $R$4 (Doerr et al., 2024).

Bi-Objective Improved Bounds

• OneMinMax: Runtime $R$5. For minimal $R$6, recovers $R$7.
• OneJumpZeroJump$R$8: Runtime $R$9. For $\mathcal{F}_1,\mathcal{F}_2,\dots$0, recovers $\mathcal{F}_1,\mathcal{F}_2,\dots$1 vs. classical $\mathcal{F}_1,\mathcal{F}_2,\dots$2.
• LeadingOnesTrailingZeros: $\mathcal{F}_1,\mathcal{F}_2,\dots$3.

Significantly, runtime plateaus for $\mathcal{F}_1,\mathcal{F}_2,\dots$4 in a wide range (e.g., $\mathcal{F}_1,\mathcal{F}_2,\dots$5 to $\mathcal{F}_1,\mathcal{F}_2,\dots$6 in OneJumpZeroJump$\mathcal{F}_1,\mathcal{F}_2,\dots$7), eliminating the linear-in-$\mathcal{F}_1,\mathcal{F}_2,\dots$8 penalty of the classic version (Doerr et al., 2024).

4. Empirical and Theoretical Impact

Empirical results confirm that with balanced NSGA-II, increasing $\mathcal{F}_1,\mathcal{F}_2,\dots$9 moderately above the cardinality of the Pareto front yields only a mild increase in computational cost (function evaluations), whereas the classic NSGA-II can suffer drastic slowdowns (Doerr et al., 2024).

The following table summarizes asymptotic runtimes:

Benchmark	Standard NSGA-II	Balanced NSGA-II
OneMinMax (bi)	$P'$0	$P'$1
LOTZ (bi)	$P'$2	$P'$3
OJZJ$P'$4 (bi)	$P'$5	$P'$6
OMM ($P'$7)	$P'$8	$P'$9
LOTZ ($N$0)	suspected exp	$N$1
OJZJ$N$2 ($N$3)	unknown/exp	$N$4

Adding the "prefer rare objective values" rule fixes both the exponential runtime in many-objective settings and the inefficiency for large $N$5 in the bi-objective regime (Doerr et al., 2024).

5. Analysis Techniques and Theoretical Insights

All proofs in (Doerr et al., 2024) crucially exploit the following properties:

• Persistence Lemma: Once a given objective vector enters the first rank/front, its frequency in the population does not drop below a positive bound, provided survivor selection preferences rare values rather than breaking ties at random.
• Drift and Coupon-Collector Arguments: Population diversity, maintained by the rarity-based tie-breaker, ensures that discovering all members of the Pareto front proceeds geometrically (i.e., in expected $N$6 rounds) rather than being repeatedly set back by random culling.
• Breakdown of Classic NSGA-II: On discrete fronts with large numbers of ties, classic NSGA-II's random tie-breaking loses rare values, leading to plateaus or exponential expected times to reach full coverage. Balanced NSGA-II blocks this.

6. Contextualization and Relation to Broader MOEA Landscape

These results address and mathematically resolve two root deficiencies that had impeded the scalability of NSGA-II in discrete high-dimensional objective settings. The rarity-based tie-breaking yields provable polynomial runtime even where hypervolume- or reference-point-based methods (e.g., SMS-EMOA, NSGA-III) had previously been required for tractable scaling. The approach achieves this with a minimal code change and negligible computational overhead, making it a drop-in enhancement for existing NSGA-II implementations (Doerr et al., 2024).

The theoretical guarantees align with recent advances in runtime analysis of MOEAs and clarify the connection between survivor selection micro-mechanisms and macroscopic scalability. Unlike classic crowding distance, rarity-based selection directly maintains objective space coverage, providing deterministic guarantees for both diversity and convergence in a wide range of multi-objective combinatorial settings.