Layout-Quality Score (LQS): Metrics & Applications

• Layout-Quality Score (LQS) is a multi-faceted metric that quantifies layout quality by assessing label accuracy, spatial, and area consistency across various domains.
• It integrates both rule-based and learned approaches, using components like label recall, precision, relative consistency, and human preference models.
• Diverse applications—from text-to-layout synthesis to quantum computing—highlight LQS’s domain-specific adaptations and the challenges in standardizing its interpretation.

Searching arXiv for papers on "Layout Quality Score" and related layout evaluation metrics. Layout-Quality Score (LQS) denotes a family of quantitative constructs used to assess the quality of a layout, but its meaning is domain-dependent rather than universal. In the layout-generation literature, the term is used explicitly for generated object layouts in text-to-layout synthesis, where it summarizes label correctness, spatial consistency, and area consistency (Liang et al., 2022). In chart design, a closely related usage appears as the scalar score predicted by the Layout Quality Quantifier (LQ2), learned from crowdsourced pairwise aesthetic judgments (Wu et al., 2021). In quantum layout optimization, LQS denotes a fidelity-like scalar for selected physical qubit layouts, computed from readout and two-qubit gate errors (Bazayeva et al., 25 Jun 2026). More recent benchmarks for layout-guided text-to-image generation do not use the acronym LQS, but introduce metrics that play the same functional role, most notably the layout-alignment score $s_{layout}$, which measures spatial faithfulness of generated images to target bounding-box layouts (Izzo et al., 18 Aug 2025). The term therefore refers less to a single standardized metric than to a recurring evaluative idea: a compact measure of layout quality adapted to a particular representation, task, and failure model.

1. Terminological scope and problem setting

The notion of layout quality arises wherever a system must arrange elements subject to structural, semantic, aesthetic, or physical constraints. The central difficulty is that “quality” is multidimensional. A layout may contain the correct elements but place them incorrectly; it may satisfy geometric constraints while violating reading order or semantic grouping; or it may be structurally valid yet aesthetically poor. This motivates scalar scores that compress multiple aspects of quality into a usable evaluation signal.

In the text-to-layout setting, LQS was introduced because prior metrics such as DocSim were described as mainly measuring absolute bounding-box errors while ignoring mutual spatial relationships between boxes (Liang et al., 2022). In chart layout recommendation, the problem was framed differently: existing charting systems relied on predefined heuristics, but layout quality was described as subjective, hard to encode with hand-crafted rules, and dependent on parameter interactions, motivating a learned scalar score from human preference data (Wu et al., 2021). In layout-guided text-to-image generation, the benchmarking problem is again distinct: semantic alignment had been studied, but layout alignment was said to remain overlooked, making spatial faithfulness a critical missing dimension (Izzo et al., 18 Aug 2025).

This suggests that LQS is best understood as an evaluative role rather than a fixed formula. A plausible implication is that any LQS-like metric must be interpreted with respect to three design choices: the layout representation being scored, the downstream use case, and the failure modes deemed important.

2. Explicit LQS in text-to-layout generation

A formal metric named Layout Quality Score was introduced in “Layout-Bridging Text-to-Image Synthesis” (Liang et al., 2022). There, LQS is defined for generated image layouts and is intended to measure both absolute placement errors of bounding boxes and their mutual spatial relationships.

The score is composed of four terms: $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$ with $\text{LQS} \in [0,4]$ (Liang et al., 2022).

The four components are:

Component	Meaning
LR	Label Recall
LP	Label Precision
LC	Location Consistency
AC	Area Consistency

Label Recall and Label Precision measure object-category correctness. If $\mathbf{d}$ is the set of ground-truth object labels and $\hat{\mathbf{d}}$ the predicted set, the paper defines

$$\text{LR} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{T_o}, \quad \text{LP} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{\hat T_o}.$$

These terms reward generating the right object categories while discouraging redundant or spurious boxes (Liang et al., 2022).

Location Consistency is split into Absolute Location Consistency and Relative Location Consistency. Absolute Location Consistency measures average Euclidean error between matched object centers, whereas Relative Location Consistency measures preservation of pairwise relative position vectors: $\mathbf{r}_{i,j} = \mathbf{g}_i - \mathbf{g}_j.$ The raw distances are converted into bounded similarity-like terms by Gaussian kernels, and combined as

$$\text{LC} = \gamma_{\text{lc}} \exp\left(-\frac{\text{ALC}}{2\sigma_l^2}\right) + (1-\gamma_{\text{lc}})\exp\left(-\frac{\text{RLC}}{2\sigma_l^2}\right).$$

The paper states $\gamma_{\text{lc}}=0.25$, thereby placing greater emphasis on relative than absolute consistency (Liang et al., 2022). This weighting reflects the claim that a text description may admit multiple valid absolute placements, making relative structure more informative.

Area Consistency similarly combines absolute and relative size quality. Absolute Area Consistency compares predicted and ground-truth box areas through normalized differences, while Relative Area Consistency checks whether pairwise size orderings are preserved: $\text{RAC} = \frac{ \sum_{i \in \mathbf{m}} \sum_{j \in \mathbf{m},\, i \neq j} \Big(1 - \big| \mathbbm{1}_{u_i > u_j} - \mathbbm{1}_{\hat u_i > \hat u_j} \big| \Big) }{ |\mathbf{m}| \times (|\mathbf{m}| - 1) }.$ These are combined as

$$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$0

with $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$1 (Liang et al., 2022).

Experimentally, the metric was used as the main layout-evaluation score on COCO, COCO-stuff, and LN-COCO. Reported LQS values were 2.5662, 2.5690, and 2.5912 for the proposed method, exceeding the compared Obj-GANs and Text2Scene baselines on all three datasets (Liang et al., 2022). The paper interprets these improvements as evidence of better object-category prediction, better relative spatial relationships, and more realistic structured layouts.

3. Learned and preference-based layout quality scores

A second line of work treats layout quality as a latent scalar learned from human preferences rather than as a hand-designed geometric metric. “Learning to Automate Chart Layout Configurations Using Crowdsourced Paired Comparison” defines the Layout Quality Quantifier (LQ2), a model that predicts a Layout-Quality Score for chart layouts from layout parameters (Wu et al., 2021).

The formulation is ranking-based. For a chart instance $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$2, represented by layout parameters $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$3, the model predicts

$$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$4

with the training objective that preferred layouts should receive higher scores: $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$5 The model uses a Siamese neural network with two identical fully connected subnetworks, shared weights, 6 hidden layers, ReLU activations, dropout layers, and min-max normalization on input parameters (Wu et al., 2021). Training uses a hinge-style pairwise ranking loss: $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$6

The score is not computed from rendered images but from layout parameters, which the authors report was more compact and more effective than CNNs on chart images (Wu et al., 2021). Ground truth is obtained from two-alternative forced choice comparisons on Amazon Mechanical Turk, with only pairs receiving full agreement among 3 raters retained. The study reports 416 unique MTurk participants total (Wu et al., 2021).

Prediction accuracy under Monte Carlo cross-validation reached 76.60% in a 3-parameter experiment and 78.27% in a 6-parameter experiment, outperforming RankSVM and several hand-crafted metrics including White Space, Scale, Unity, Balance, and All combined (Wu et al., 2021). The score was then used in a brute-force optimization over candidate parameter combinations: $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$7 User studies further reported that layouts selected by the learned score were preferred over Human, Default, and Random baselines in one scenario, and that LQ2 reached human-level performance in another responsive-layout scenario (Wu et al., 2021).

This usage differs fundamentally from the geometric LQS above. Here, the score encodes perceived aesthetic preference rather than explicit spatial correctness. This suggests two major LQS paradigms: rule-based decomposition of layout properties, and learned latent scoring from preference judgments.

A related recent approach in graphic layout generation again avoids an explicit “LQS” acronym but uses a hybrid of heuristic filtering and pairwise aesthetic preference. “AesthetiQ” defines a combined quality heuristic

$$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$8

used to filter higher-quality layouts before preference alignment, alongside a judge-based win-rate metric for evaluating whether generated layouts are aesthetically preferred to ground-truth layouts (Patnaik et al., 1 Mar 2025). The paper does not name this LQS, but it functions as a layout-quality proxy in the same sense.

4. LQS analogues in layout-guided text-to-image evaluation

In layout-guided text-to-image synthesis, recent work has shifted from scoring layouts themselves to scoring whether generated images respect a prescribed layout. “7Bench: a Comprehensive Benchmark for Layout-guided Text-to-image Models” introduces a two-metric protocol consisting of a text-alignment score $$\text{LQS} = \text{LR} + \text{LP} + \text{LC} + \text{AC},$$9 and a layout-alignment score $\text{LQS} \in [0,4]$0 (Izzo et al., 18 Aug 2025). The latter is the closest direct analogue to an LQS in this setting.

Each benchmark sample contains a text prompt and a target layout of one bounding box per object: $\text{LQS} \in [0,4]$1 with coordinates normalized to $\text{LQS} \in [0,4]$2 (Izzo et al., 18 Aug 2025). The benchmark includes 224 samples, divided evenly into seven scenarios of 32 prompts each: Object Binding, Small Bboxes, Overlapping Bboxes, Color Binding, Attribute Binding, Object Relationship, and Complex Composition (Izzo et al., 18 Aug 2025).

The semantic score $\text{LQS} \in [0,4]$3 is TIFA, based on LLM-generated questions and VQA accuracy, with values in $\text{LQS} \in [0,4]$4 (Izzo et al., 18 Aug 2025). The spatial score $\text{LQS} \in [0,4]$5 is defined using object detection outputs. For a generated image $\text{LQS} \in [0,4]$6, an object detector such as OWL-ViT produces detections

$\text{LQS} \in [0,4]$7

where $\text{LQS} \in [0,4]$8 is a detected box, $\text{LQS} \in [0,4]$9 a label, and $\mathbf{d}$0 a confidence score (Izzo et al., 18 Aug 2025). For each target object $\mathbf{d}$1, detections are filtered by label, and the highest-confidence detection is chosen. Its overlap with the target box $\mathbf{d}$2 is measured by $\mathbf{d}$3.

Spatial correctness is then evaluated across thresholds

$\mathbf{d}$4

via

$\mathbf{d}$5

The final layout score is the area under the accuracy@k curve, i.e. the AUC over multiple IoU thresholds (Izzo et al., 18 Aug 2025).

This design has several consequences. First, the score is detector-mediated rather than based on ground-truth segmentation. Second, it evaluates spatial fidelity over a range of strictness levels rather than at a single threshold. Third, it is reported jointly with, rather than merged into, the semantic score. The paper explicitly treats $\mathbf{d}$6 and $\mathbf{d}$7 as complementary dimensions rather than combining them into a single weighted leaderboard metric (Izzo et al., 18 Aug 2025).

The reported results underline why such an LQS analogue is needed. Across five evaluated models—GLIGEN, Attention Refocusing (G_AR), BoxDiff (G_BD), Cross Attention Guidance (SD_CAG), and Stable Diffusion v1.4 (SD)—text-alignment typically ranged from about 0.55 to 0.9, whereas layout-alignment ranged from about 0.05 to 0.5 (Izzo et al., 18 Aug 2025). Models struggled most with Small Bboxes, performed relatively better on Overlapping Bboxes, and degraded as the number of objects increased (Izzo et al., 18 Aug 2025). These findings indicate that semantic fidelity can substantially exceed spatial fidelity, so a text-only evaluation would obscure an important failure mode.

5. Domain-specific extensions beyond vision generation

Outside image generation and graphic design, LQS-like notions appear in other layout-intensive domains. In quantum computing, “I-QMapper” defines an explicit Layout-Quality Score for physical qubit layouts on NISQ hardware (Bazayeva et al., 25 Jun 2026). Here the layout is a selected subgraph of qubits and couplers, and quality is meant to summarize calibration-derived error characteristics.

The metric is defined as

$\mathbf{d}$8

where $\mathbf{d}$9 is the set of selected physical qubits, $\hat{\mathbf{d}}$0 the set of couplers with both endpoints in the layout, $\hat{\mathbf{d}}$1 the readout assignment error, and $\hat{\mathbf{d}}$2 the two-qubit gate error (Bazayeva et al., 25 Jun 2026). The paper describes the score as a fidelity-like quantity in $\hat{\mathbf{d}}$3, updated live as the layout changes.

This LQS includes only readout assignment error and two-qubit gate error; it explicitly excludes single-qubit gate errors, coherence-time effects, crosstalk, and circuit-duration effects (Bazayeva et al., 25 Jun 2026). It is thus a lightweight heuristic rather than a full execution-fidelity predictor. The paper emphasizes that it is computed directly on the layout, unlike mapomatic-style compiled-circuit scoring (Bazayeva et al., 25 Jun 2026).

A related but distinct approach to quantum layout quality avoids static calibration proxies and instead uses a circuit-specific probe. “Lightweight Targeted Estimation of Layout Noise in a Quantum Computer using Quality Indicator Circuits” proposes Quality Indicator Circuits (QICs), whose deviation from a known ideal output is used to rank candidate layouts (Srivastava et al., 23 Sep 2025). The most direct score is the empirical success frequency

$\hat{\mathbf{d}}$4

where $\hat{\mathbf{d}}$5 is the number of ideal outcomes observed in $\hat{\mathbf{d}}$6 shots (Srivastava et al., 23 Sep 2025). The paper characterizes this as a lightweight real-time method for assessing layout quality and reports that it outperforms Mapomatic in the quality of layout selection while reducing the hardware overhead of JIT by 79 percent on average (Srivastava et al., 23 Sep 2025). Although not named LQS, it is clearly an LQS-like targeted layout-quality estimator.

These examples illustrate a broader pattern: once a layout corresponds to a physical substrate rather than a visual canvas, LQS shifts from aesthetic or semantic plausibility to error aggregation, hardware suitability, and execution fidelity.

6. Composite versus decomposable scoring frameworks

A recurrent tension in LQS design is whether layout quality should be reported as a single scalar or as a decomposed profile of failure modes. Composite scores are convenient for ranking and optimization, but they can hide why a layout is poor. Decomposable frameworks preserve diagnostic value at the expense of simplicity.

The decomposable approach is exemplified by “The COTe score: A decomposable framework for evaluating Document Layout Analysis models” (Bourne et al., 13 Mar 2026). The paper does not use the acronym LQS, but explicitly proposes COTe as a layout-quality score for document layout analysis. It argues that IoU, F1, and mAP are misaligned with natively 2D printed media, where critical errors include repeated parsing of the same region, semantic boundary breaches, and spillover into whitespace (Bourne et al., 13 Mar 2026).

COTe consists of Coverage, Overlap, Trespass, and Excess. The overall score is

$\hat{\mathbf{d}}$7

with Excess reported separately as a support metric (Bourne et al., 13 Mar 2026). Coverage measures how much ground-truth structural semantic unit area is covered by predictions; Overlap penalizes duplicate parsing of the same region; Trespass penalizes crossing semantic boundaries; Excess measures prediction area outside all structural semantic units (Bourne et al., 13 Mar 2026). The paper reports that COTe reduces the interpretation-performance gap by up to 76% relative to the F1 and reveals failure modes obscured by standard object-detection metrics (Bourne et al., 13 Mar 2026).

This decomposed philosophy contrasts with LQS in text-to-layout synthesis, where LR, LP, LC, and AC are summed into a single number (Liang et al., 2022), and with the quantum LQS, where multiplicative aggregation produces one scalar (Bazayeva et al., 25 Jun 2026). The choice reflects different priorities. When a score is used for optimization or UI feedback, scalarization is attractive. When the goal is scientific diagnosis, decomposition is often preferable.

A plausible implication is that a high-quality LQS framework should separate the representation used for decision-making from the representation used for analysis. 7Bench partially embodies this idea by reporting $\hat{\mathbf{d}}$8 and $\hat{\mathbf{d}}$9 separately but jointly (Izzo et al., 18 Aug 2025).

7. Limitations, comparability, and interpretation

The principal limitation of the term “Layout-Quality Score” is lack of standardization. Scores bearing that name may be based on geometric overlap, human preference, calibration error aggregation, or detector-mediated image analysis. Their numerical ranges are therefore not comparable across domains: text-to-layout LQS lies in $$\text{LR} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{T_o}, \quad \text{LP} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{\hat T_o}.$$0 (Liang et al., 2022), chart-layout LQS is an unconstrained latent scalar learned by LQ2 (Wu et al., 2021), quantum LQS is a product-based fidelity-like score in $$\text{LR} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{T_o}, \quad \text{LP} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{\hat T_o}.$$1 (Bazayeva et al., 25 Jun 2026), and 7Bench’s $$\text{LR} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{T_o}, \quad \text{LP} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{\hat T_o}.$$2 is an AUC over accuracy@k thresholds in $$\text{LR} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{T_o}, \quad \text{LP} = \frac{|\mathbf{d} \cap \hat{\mathbf{d}}|}{\hat T_o}.$$3 (Izzo et al., 18 Aug 2025).

A second limitation concerns hidden assumptions. In the text-to-layout LQS, matched objects are paired by category, and when an object category appears multiple times, the combination with the lowest ALC is selected (Liang et al., 2022). In 7Bench, the layout score depends on the detector’s ability to localize the specified object labels, meaning detector failure can degrade the measured layout score even when the generative model performed better than the score suggests (Izzo et al., 18 Aug 2025). In the quantum LQS, the independent-error product ignores crosstalk, coherence, and circuit-specific usage patterns (Bazayeva et al., 25 Jun 2026). In learned preference-based scoring, the predicted scalar reflects human preference data or judge-model priors rather than physical correctness (Wu et al., 2021, Patnaik et al., 1 Mar 2025).

A third limitation is scalar collapse. Composite metrics can mask trade-offs. The 7Bench results show that a model can score well on text alignment but poorly on layout alignment, demonstrating why a single aggregate score can be misleading (Izzo et al., 18 Aug 2025). Similarly, COTe argues that high coverage may coexist with severe overlap and trespass, producing poor downstream OCR quality despite superficially good detection performance (Bourne et al., 13 Mar 2026).

Accordingly, LQS should be interpreted as task-specific evidence rather than as a universal measure of layout goodness. The most defensible usage is local: within a fixed task, representation, and evaluation protocol, it can rank models, guide optimization, and reveal which aspects of layout quality are being captured. Across tasks, however, the term is best treated as an umbrella label for structured scoring approaches to layout quality rather than as a single metric family.