---
title: 'MOID: Multi-Objective Infeasibility Diagnosis'
url: https://www.emergentmind.com/topics/multi-objective-infeasibility-diagnosis-moid
type: topic
---

# MOID: Multi-Objective Infeasibility Diagnosis

Multi-Objective Infeasibility Diagnosis (MOID) is a framework that combines an automatic routing solver with multi-objective optimization and LLM agents to diagnose routing models whose feasible set is empty [2508.03406]. It treats “constraint violation” as a soft objective, optimizes it jointly with the original path-cost objective to generate a set of trade-off solutions, and then uses an LLM-generated solution analysis function to translate those solutions into actionable model modification suggestions [2508.03406]. In the routing setting studied in "Multi-Objective Infeasibility Diagnosis for Routing Problems Using Large Language Models" [2508.03406], MOID is designed for real-world vehicle routing problems (VRPs) in which users often specify conflicting or unreasonable requirements, such as overly tight or contradictory time windows, vehicle capacity limits that are too small relative to demand, route length limits that cannot be respected given geography, pickup-and-delivery precedence constraints, same-vehicle requirements, and priority ordering constraints. The broader constrained multi-objective perspective is informed by the multi-objective-violation landscape developed in "An Instance Space Analysis of Constrained Multi-Objective Optimization Problems" [2203.00868], which formalizes how feasibility structure and objective trade-offs interact.

## 1. Conceptual basis and problem setting

Infeasibility in routing arises when the imposed constraints produce an empty feasible solution set. In the MOID formulation, this is not treated as a terminal failure state but as a diagnostic object: the system searches for routes that jointly expose the trade-off between path cost and the degree of constraint violation [2508.03406]. This distinguishes MOID from LLM-based infeasibility-diagnosis methods that pursue minimal adjustments to restore feasibility and typically ignore the original cost objective, and from ARS (Automatic Routing Solver), which can seek solutions that minimize violation when infeasible but remains single-objective [2508.03406].

The routing model in the paper is defined on a graph $\mathcal{G}=(\mathcal{V},\mathcal{E})$, with depot $0$ and customers $\{1,\ldots,n\}$. Costs $c_{ij}$ are defined on edges $(i,j)$, and binary routing decisions are $x_{ij}\in\{0,1\}$, indicating whether arc $(i,j)$ is used [2508.03406]. The objective is

$$
\min \sum_{i \in \mathcal{V}} \sum_{j \in \mathcal{V}} c_{ij} x_{ij}, \quad \text{subject to } \mathbf{x} \in C,
$$

where $C$ encodes routing constraints such as capacity, distance or length limits, time windows, pickup-and-delivery or precedence, same-vehicle coupling, and priority [2508.03406].

The paper enumerates six constraint families used to build 50 VRP variants [2508.03406]:

| Constraint family | Abbreviation | Description in the routing model |
|---|---:|---|
| Vehicle Capacity | C | Capacity limits |
| Distance Limits | L | Distance/length limits |
| Time Windows | TW | Time-window requirements |
| Pickup and Delivery | PD | Pickup-and-delivery/precedence |
| Same Vehicle | S | Same-vehicle coupling |
| Priority | P | Priority ordering constraints |

These constraints are enforced through LLM-generated “constraint checking and scoring programs” [2508.03406]. Incorrect parameterization, such as shrinking time windows, can create an empty feasible set [2508.03406].

## 2. Multi-objective formulation and infeasibility representation

MOID adopts the standard multi-objective optimization problem (MOP) form

$$
\text{minimize}\quad \mathbf{f}(\mathbf{x}) = (f_1(\mathbf{x}), \ldots, f_m(\mathbf{x}))^{\intercal},\quad \text{subject to } \mathbf{x}\in\Omega,
$$

and instantiates it as the bi-objective routing vector

$$
\mathbf{f}(\mathbf{x}) = \big(f_{cost}(\mathbf{x}),\; f_{violation}(\mathbf{x})\big)^{\intercal},
$$

where $f_{cost}(\mathbf{x})$ is the total path cost and $f_{violation}(\mathbf{x})$ is a violation score computed by the LLM-generated constraint scoring program [2508.03406]. MOID minimizes both objectives simultaneously.

The paper does not fix a closed-form penalty for violation. Instead, an LLM-generated “constraint scoring program” returns $f_{violation}(\mathbf{x})$ by aggregating violations across all constraints specified in natural language, and this scoring acts as a soft objective guiding multi-objective search [2508.03406]. Constraints are therefore treated as soft via $f_{violation}(\mathbf{x})$, while the metaheuristic uses destroy/repair operators and local search to iteratively reduce both cost and violation [2508.03406].

Pareto dominance and Pareto optimality are used in the standard sense. Dominance is defined by $\mathbf{u} \prec \mathbf{v}$ iff $u_i \le v_i$ for all $i$ and there exists $j$ with $u_j < v_j$, and $\mathbf{x}^*$ is Pareto-optimal if there is no $\mathbf{x}$ such that $\mathbf{f}(\mathbf{x})$ dominates $\mathbf{f}(\mathbf{x}^*)$ [2508.03406]. The output of MOID is therefore an approximation to a Pareto front of cost–violation trade-offs rather than a single repaired model.

The second paper provides a broader CMOP formalization in which infeasibility is represented through aggregate constraint violation [2203.00868]. For a CMOP with inequality and equality constraints, it defines

$$
CV(x) = \sqrt{\sum_{j=1}^{J} G_j(x)^2 + \sum_{k=1}^{K} H_k(x)^2},
$$

with

$$
G_j(x) = \max\{0,\, g_j(x)\}, \quad H_k(x) = \max\{0,\, |h_k(x)| - \epsilon\},
$$

and $\epsilon = 10^{-4}$ [2203.00868]. It also introduces the combined map

$$
L : X \to \mathbb{R}^{M+1}, \quad L(x) = \big(f_1(x),\ldots,f_M(x),\, CV(x)\big),
$$

which treats infeasibility and objective quality jointly in a “multi-objective-violation landscape” [2203.00868]. This suggests a useful conceptual interpretation of MOID: the routing-specific violation scorer plays the role of a domain-instantiated violation coordinate in a joint objective–violation space.

## 3. Pipeline and algorithmic components

The MOID pipeline contains three modules [2508.03406]. In the generation stage, LLM agents produce constraint-aware heuristic code: a constraint checker and a violation scorer tailored to the natural-language routing description. In the optimization stage, a multi-objective metaheuristic, called the Augmented Multi-objective Solver, searches over routes while minimizing both cost and violation to build a diverse final population approximating the Pareto front. In the analysis stage, an LLM agent generates a “solution analysis function” that processes each trade-off solution and outputs concrete model adjustments to render that solution feasible under a modified model [2508.03406].

The optimization framework uses NSGA-II for non-dominated sorting and diversity via crowding distance, and the paper also compares MOEA/D [2508.03406]. The reported settings are population size $N=10$ and iterations $T=100$ [2508.03406]. Each iteration has three phases.

First, destroy–repair is applied. Destroy operators are selected via roulette wheel among random removal and string removal, and greedy repair reinserts removed customers [2508.03406]. The repair operator attempts to restore feasibility where possible or reduce violation when feasibility is impossible [2508.03406].

Second, single-point Pareto local search (SPLS) is executed with 2-OPT, SWAP, and SHIFT [2508.03406]. Each operator attempts modifications at each node, producing $3n$ candidate solutions [2508.03406]. Dominance selection replaces the current solution with a dominating neighbor, and ties are broken using minimum crowding distance to promote diversity [2508.03406]. SPLS runs until no improvement or a 1-second timeout [2508.03406].

Third, population update is performed with NSGA-II by non-domination rank and crowding distance [2508.03406]. The condensed algorithmic outline is: initialize a population $\mathcal{P}_0$ of size $N$; for $t=1,\ldots,T$, apply destroy–repair and SPLS to each solution; combine improved solutions with the current population; apply NSGA-II to select $\mathcal{P}_{t+1}$; and return the final population as an approximate Pareto front, after which each solution is fed to the LLM analysis function to produce suggestions [2508.03406].

The paper reports that NSGA-II converges to better HV and IGD metrics, whereas MOEA/D exhibits more stable convergence [2508.03406]. The broader CMOP literature represented by [2203.00868] provides a related vocabulary for interpreting such behavior, emphasizing the effect of infeasible regions and the interaction between constraints and objectives on search dynamics.

## 4. Analysis stage, inverse formulations, and suggestion generation

A defining feature of MOID is that it does not stop at producing trade-off routes. It also generates a solution analysis function that takes the original problem description, the constraint-checking code, and a single solution $\hat{\mathbf{x}}$ from the Pareto set, and returns numerical adjustments plus a succinct natural-language suggestion [2508.03406]. The function’s purpose is to infer the minimal constraint changes that would make $\hat{\mathbf{x}}$ feasible and, in Strategy 2, optimal for a revised model [2508.03406].

The analysis stage is described using forward and inverse optimization models [2508.03406]. The forward model is

$$
\text{FOP-LP}(\theta) := \min_{\mathbf{x}} \;\big\{\;\theta^{\top}\mathbf{x}\;\mid\; \mathbf{A}\mathbf{x} \le \mathbf{b},\; \mathbf{x}\in \Omega\;\big\},
$$

where $\theta$ encodes the cost vector and $(\mathbf{A},\mathbf{b})$ are constraint parameters [2508.03406]. In infeasible cases, $\Omega$ is empty [2508.03406]. The inverse optimization formulation estimates parameters so that a provided decision becomes feasible or optimal:

$$
\text{IOP-LP}(\hat{\mathbf{x}}) := \big\{(\mathbf{A}',\mathbf{b}') \;\big|\; \mathbf{A}'\hat{\mathbf{x}} \le \mathbf{b}',\; \hat{\mathbf{x}} \in \Omega' \big\}.
$$

For linear problems, the paper gives the KKT-based inverse-feasible set used in Strategy 2:

$$
\Theta_{\text{inv}}(\hat{\mathbf{x}}) = \big\{(\mathbf{A},\mathbf{b})\;\big|\;\exists \boldsymbol{\lambda}\ge \mathbf{0}:\; \mathbf{A}^{\top}\boldsymbol{\lambda}=\mathbf{c},\;\mathbf{c}^{\top}\hat{\mathbf{x}}=\boldsymbol{\lambda}^{\top}\mathbf{b}\big\},
$$

together with a convex estimation formulation

$$
\begin{aligned}
\min_{(\mathbf{A}',\mathbf{b}')} \quad & \|(\mathbf{A}',\mathbf{b}')-(\mathbf{A},\mathbf{b})\|_{p} \\
\text{s.t.}\quad & \mathbf{A}'\hat{\mathbf{x}} \le \mathbf{b}', \\
& (\mathbf{A}',\mathbf{b}') \in \Theta,
\end{aligned}
$$

where $\Theta$ captures admissible parameters and $1\le p<\infty$ [2508.03406].

Two design strategies are specified for the solution analysis function [2508.03406]. Strategy 1, Direct Constraint Relaxation (DCR), computes for each violated constraint indexed by $k$ a change $(\Delta \mathbf{A}_k, \Delta \mathbf{b}_k)$ that places $\hat{\mathbf{x}}$ on the boundary:

$$
(\mathbf{A}_k + \Delta \mathbf{A}_k)^{\top}\hat{\mathbf{x}} = \mathbf{b}_k + \Delta \mathbf{b}_k.
$$

It aggregates across all violations and returns the single most demanding final value per unique constraint [2508.03406]. Strategy 2, Estimating Constraint Parameters (ECP), solves the inverse-optimization-based minimal parameter change problem

$$
\min_{(\mathbf{A}', \mathbf{b}')} \;\|(\mathbf{A}', \mathbf{b}')-(\mathbf{A}, \mathbf{b})\|_1
\quad \text{s.t.}\;\; \mathbf{A}' \hat{\mathbf{x}}\le \mathbf{b}',\;\; (\mathbf{A}', \mathbf{b}')\in\Theta.
$$

The Appendix provides structured prompts for DCR and ECP that instruct the LLM to test the solution against every constraint, compute per-violation relaxations, aggregate to the most demanding final value per constraint, and append recommendations to the original description [2508.03406].

The concrete suggestion types include widening time windows by $\Delta t$, increasing vehicle capacity to at least total load on routes in $\hat{\mathbf{x}}$, relaxing per-route maximum length so that each route is within the new bound, adjusting precedence slack or allowing certain relaxations consistent with $\hat{\mathbf{x}}$, and merging or splitting assignments to satisfy same-vehicle requirements or allow exceptions if desired [2508.03406]. The paper does not introduce explicit ranking or clustering of suggestions; users instead perceive trade-offs by inspecting different Pareto solutions and their associated suggestions [2508.03406].

## 5. Empirical evaluation, metrics, and ablations

The experimental evaluation uses 50 types of infeasible VRP variants constructed from the six constraint families C, L, TW, PD, S, and P [2508.03406]. Instances are based on Solomon C103 with 25 nodes, and for time windows the start and end times are divided by 10 to induce infeasibility [2508.03406]. The reported environment is Intel i7-9700, 32 GB RAM, Windows 10, with DeepSeek V3 as the LLM and 3 runs per experiment [2508.03406].

The metrics are Hypervolume (HV), Inverted Generational Distance (IGD), and Analysis Success Rate (ASR) [2508.03406]. The paper defines hypervolume as

$$
\mathrm{HV}(\mathcal{F}, \mathbf{z}^{h}) = \mathrm{vol}\Big(\bigcup_{\mathbf{z}\in\mathcal{F}} [z_1, z_1^{h}] \times \ldots \times [z_m, z_m^{h}] \Big),
$$

with normalization via approximated ideal $\mathbf{z}^{\mathrm{ideal}}$ and nadir $\mathbf{z}^{\mathrm{nadir}}$, and reference point $\mathbf{z}^{h}=(1.1,\ldots,1.1)^{\top}$ [2508.03406]. IGD is

$$
\mathrm{IGD}(\mathcal{F}, \mathcal{F}^{*}) = \frac{1}{|\mathcal{F}^{*}|}\sum_{\mathbf{z}^{*}\in\mathcal{F}^{*}} \min_{\mathbf{z}\in\mathcal{F}} \mathrm{dist}(\mathbf{z}, \mathbf{z}^{*}).
$$

Against OptiChat and ARS on four VRP variants, the paper reports that MOID yields clear cost–violation trade-offs, whereas ARS tends to prioritize minimal violation ignoring cost [2508.03406]. Both converge in approximately 20 iterations, and MOID achieves better HV and IGD [2508.03406].

The quantitative HV and IGD results reported in the paper are as follows [2508.03406]:

| Variant | HV (OptiChat / ARS / MOID) | IGD (OptiChat / ARS / MOID) |
|---|---|---|
| CVRP | $1.10\mathrm{e}{-01} \pm 0$ / $8.26\mathrm{e}{-01} \pm 5.08\mathrm{e}{-02}$ / $1.09\mathrm{e}{+00} \pm 3.32\mathrm{e}{-03}$ | $9.40\mathrm{e}{-01} \pm 0$ / $3.50\mathrm{e}{-01} \pm 5.98\mathrm{e}{-02}$ / $3.91\mathrm{e}{-02} \pm 2.83\mathrm{e}{-03}$ |
| CVRP-L | $1.83\mathrm{e}{-01} \pm 0$ / $8.68\mathrm{e}{-01} \pm 1.79\mathrm{e}{-02}$ / $1.12\mathrm{e}{+00} \pm 6.25\mathrm{e}{-03}$ | $8.63\mathrm{e}{-01} \pm 0$ / $2.96\mathrm{e}{-01} \pm 4.00\mathrm{e}{-02}$ / $3.13\mathrm{e}{-02} \pm 5.20\mathrm{e}{-03}$ |
| DCVRP | $1.35\mathrm{e}{-01} \pm 0$ / $8.51\mathrm{e}{-01} \pm 5.25\mathrm{e}{-02}$ / $1.07\mathrm{e}{+00} \pm 1.41\mathrm{e}{-03}$ | $9.57\mathrm{e}{-01} \pm 0$ / $3.79\mathrm{e}{-01} \pm 5.90\mathrm{e}{-02}$ / $4.48\mathrm{e}{-02} \pm 1.04\mathrm{e}{-02}$ |
| DCVRP-L | $4.37\mathrm{e}{-01} \pm 0$ / $8.64\mathrm{e}{-01} \pm 3.25\mathrm{e}{-02}$ / $1.08\mathrm{e}{+00} \pm 5.10\mathrm{e}{-03}$ | $7.37\mathrm{e}{-01} \pm 0$ / $4.11\mathrm{e}{-01} \pm 4.68\mathrm{e}{-02}$ / $6.21\mathrm{e}{-02} \pm 2.22\mathrm{e}{-02}$ |

Runtime is reported as similar to ARS, while OptiChat uses a 300 s default Gurobi limit [2508.03406]. The case studies on CVRP-L in the Appendix show suggested changes that extend beyond mere feasibility restoration, covering varying degrees of adjustments and associated cost impacts [2508.03406].

The ablation results identify three patterns [2508.03406]. First, NSGA-II is more likely to converge to better HV and IGD, while MOEA/D shows smoother, more stable progress. Second, across 100 solution analysis examples, Strategy 1 (DCR) achieves higher ASR than Strategy 2 (ECP) due to simpler computation and coding demands. Third, DeepSeek-V3 consistently generates more correct analysis functions than ChatGPT-4o, and the violation scoring program is stable across runs, with score ranges remaining relatively fixed over 10 repetitions on CVRP and CVRP-L.

## 6. Theoretical position, limitations, and broader relevance

MOID is a metaheuristic method and provides no global optimality guarantees; it empirically approximates the Pareto front [2508.03406]. Its per-iteration computational structure comprises destroy/repair on $N$ solutions, SPLS generating $3n$ candidates per solution, and NSGA-II sorting across combined candidates. With $N=10$, $T=100$, and SPLS limited by a 1 s timeout, runtime remains practical according to the reported experiments [2508.03406].

Its practical strengths derive from combining multi-objective generation with post hoc inverse-analysis. Instead of producing a single repaired formulation, it returns multiple representative actionable suggestions from one run [2508.03406]. This is significant because infeasible routing models often admit multiple plausible revisions rather than one uniquely preferred modification. A plausible implication is that MOID is especially useful when model revision is a decision-support process involving stakeholder preferences over cost degradation and rule relaxation.

The method also has explicit limitations [2508.03406]. It is focused on routing. Its reliability depends on the LLM’s ability to correctly generate constraint-checking and scoring programs and analysis functions. Strategy 2 (ECP) is computationally and programmatically harder, and the quality of the Pareto-front approximation depends on solver hyperparameters, local search richness, and heuristic diversity.

The second paper supplies a broader theoretical context for understanding when infeasibility-aware multi-objective methods are likely to succeed or fail [2203.00868]. It concludes that two key characteristics, the isolation of the non-dominated set and the correlation between constraints and objectives evolvability, have the greatest impact on algorithm performance. It quantifies these properties through features such as $cpo\_upo\_n$, $hv\_uhv\_n$, $GD\_{cpo\_upo}$, $cover\_{cpo\_upo}$, $corr\_cf$, $corr\_{cobj\_min/max}$, $nhv\_{avg\_rws}$, and $dist\_{f\_c\_dist\_x\_avg\_rws}$ [2203.00868]. This suggests a principled interpretation of MOID’s performance differences across routing variants: instances with strong isolation of feasible trade-offs or strong conflict between objective progress and violation reduction should be more difficult for any multi-objective diagnostic solver.

The papers also delimit future directions. The routing paper states that the paradigm of multi-objective generation plus LLM inverse-analysis is applicable to other COPs such as scheduling and bin packing, provided that constraint-checking and scoring code can be generated [2508.03406]. It also notes that MOID can integrate other MOEAs, decomposition strategies, richer repair operators, and retrieval-augmented prompting for more reliable code generation [2508.03406]. The CMOP instance-space paper argues that current benchmarks do not provide enough diversity to fully reveal the efficacy of constrained multi-objective algorithms, and recommends expanding instance generators to vary PF isolation, constraint–objective alignment, and equality-constraint structure [2203.00868]. Taken together, these results place MOID at the intersection of infeasibility diagnosis, constrained multi-objective search, and LLM-mediated model revision: a routing-specific framework whose general form is compatible with a wider class of constrained optimization problems [2508.03406][2203.00868].

Source: https://www.emergentmind.com/topics/multi-objective-infeasibility-diagnosis-moid