Intensified Morris-Mitchell Criterion
- Intensified Morris-Mitchell Criterion is a size-invariant metric that normalizes pairwise distances to allow fair comparisons across different design sizes.
- It preserves the lexicographic max–min emphasis of the original metric while enabling continuous monitoring and improvement of space-filling designs.
- Its efficient algorithmic implementation, as featured in packages like spotoptim, supports both batch and sequential updates in multi-objective optimization.
The intensified Morris–Mitchell criterion is a size-invariant generalization of the original Morris–Mitchell space-filling metric, designed to provide a standardized and scalable means of quantifying design coverage in multi-dimensional input spaces. By introducing a normalization over the number of pairwise distances, this criterion enables direct and fair comparison of experimental designs irrespective of the number of samples, a feature indispensable in adaptive or incremental optimization workflows. It preserves the lexicographic max–min emphasis of the original metric while ensuring its scale remains stable as the design size changes, thus serving as a robust tool for monitoring and guiding space-filling improvements in sequential and batch design construction (Bartz-Beielstein et al., 26 Dec 2025).
1. Mathematical Formulation and Properties
The classical Morris–Mitchell criterion for a design is defined as
where are the distinct pairwise Minkowski distances sorted in ascending order, is the multiplicity of each distance , and is an exponent that intensifies the max–min emphasis as .
The intensified (size-invariant) Morris–Mitchell criterion is: with being the number of unordered pairs. Equivalently,
This intensive normalization yields a criterion that remains on a consistent scale, regardless of the number of design points.
| Formula | Description | Scale Dependence |
|---|---|---|
| Standard Morris–Mitchell criterion | Grows with | |
| Intensive, size-invariant criterion | Stable across |
2. Algorithmic Implementation
Batch and sequential calculation of are straightforward. The batch pseudocode involves:
- Compute all pairwise distances and sort them.
- Group unique distances into each with multiplicity .
- Calculate by summing .
- Normalize by , yielding .
Efficient sequential updates allow rapid computation when adding points:
- Compute new distances from to all existing points.
- Update multiplicities and possibly create new distinct distances.
- Increment by .
- Update the summed value and recompute and .
The Python package spotoptim implements both batch and efficient update routines:
1 2 3 4 5 6 |
import numpy as np from spotoptim import mmphi_intensive, mmphi_intensive_update X = np.array([[0.0, 0.0], [1.0, 0.0], [0.0, 1.0]]) phi_int, J, d = mmphi_intensive(X, q=2, p=2) new_point = np.array([0.5,0.5]) phi_new, J_new, d_new = mmphi_intensive_update(X, new_point, J, d, q=2, p=2) |
3. Space-Filling Properties and Theoretical Context
preserves all max–min and anti-clustering characteristics of the original Morris–Mitchell criterion, with the critical distinction that its scale is insensitive to the size of . Lower values of correspond to more uniform coverage and reduced clustering. As , the criterion is governed by the minimum pairwise distance, then the number of instances at that distance, and so forth. The monotonicity between and ensures that the ranking of designs is unchanged for fixed size, but comparability and interpretability across varying sizes are significantly improved.
Empirical studies confirm that for Latin Hypercube Sampling (LHS) in two dimensions, standard increases linearly with , while remains tightly bounded—facilitating longitudinal monitoring and cross-comparison of evolving designs.
4. Applications in Multi-Objective Optimization
The intensified Morris–Mitchell criterion is directly employed in multi-objective optimization scenarios, where industry experimental designs often lack representative coverage of input space. By integrating into multi-objective desirability functions, practitioners can jointly optimize experimental outcome predictions (from surrogate models such as Random Forest) and the space-filling quality of the design. The spotdesirability package leverages this approach, combining model-based desirability with the intensified Morris–Mitchell improvement metric into a unified score for candidate infill points.
Case study application in compressor development demonstrates optimization of performance objectives alongside , producing designs with improved input coverage and balancing exploration–exploitation trade-offs (Bartz-Beielstein et al., 26 Dec 2025).
5. Practical Implementation and Numerical Behavior
A numerical example illuminates the stability and comparability of : For in , :
- Pairwise distances:
Adding , shifts in a manner that reflects the spatial configuration but does not change scale drastically, allowing comparability across sizes.
6. Interpretation and Significance
The key innovation of the intensified Morris–Mitchell criterion is its statistical intensiveness, achieved by normalizing the -norm over unordered pairs, thus enabling operational use in adaptive sampling designs and real-time monitoring of space-filling improvements. This property is particularly relevant in scenarios where the number of design points is not fixed a priori or is expected to evolve, as in sequential optimization, surrogate-based experimental design, and active learning frameworks.
The robust, monotonic linkage between standard and intensive metrics ensures backward compatibility in ranking for fixed design sizes. A plausible implication is that size-invariance supports meta-optimization routines where batch and incremental improvements must be assessed on a unified scale, which is a recurring challenge in practical multi-objective design optimization.
7. Related Criteria and Generalization
While the intensified Morris–Mitchell criterion is specialized for space-filling assessment, its statistical normalization principle is generically applicable to other coverage metrics that depend on exhaustive pairwise or set-wise enumeration. The methodology outlined in Bartz-Beielstein (2025b) extends readily to other Minkowski norms, various exponents, and arbitrary input dimensionality . Its implementation within spotoptim facilitates efficient usage even for large design sets, with computational complexity of in batch mode and amortized for sequential updates.
The widespread utility and straightforward implementation of the intensified criterion suggest it will remain central to modern design of experiments and surrogate-based optimization methodologies (Bartz-Beielstein et al., 26 Dec 2025).