Structure-Preserving Consensus-Based Optimization

• Structure-preserving consensus-based optimization (CBO) is defined as a method that modifies consensus rules to directly incorporate constraints and native geometry into the optimization dynamics.
• It employs mechanisms such as reflective boundaries, manifold geodesics, Hermitian-preserving dynamics, and proximal consensus steps to maintain the integrity of the underlying problem structure.
• Its convergence analysis demonstrates global convergence with quantitative rates even in few-particle regimes, enabling robust application in quantum entanglement and composite optimization.

Searching arXiv for the cited papers to ground the article in current preprints. Structure-preserving consensus-based optimization (CBO) denotes a class of interacting-particle optimization methods in which the consensus mechanism, stochastic exploration, and feasibility enforcement are designed to respect the native structure of the optimization problem. In the recent literature, this principle appears in several distinct but related forms: reflecting-boundary dynamics for constrained optimization on domains with boundary, intrinsic formulations on Riemannian manifolds, Hermitian- and unitary-preserving dynamics for quantum-information problems on matrix manifolds, and proximal consensus rules for composite objectives with nonsmooth or constraint terms (Beddrich et al., 2024, Huang et al., 12 Jun 2026, Herty et al., 5 May 2026, Zhang et al., 10 Apr 2026). Across these settings, the common objective is not merely to find low-energy consensus points, but to do so without destroying boundary conditions, manifold geometry, algebraic invariants, or composite objective structure during the evolution.

1. Scope and defining principle

Consensus-based optimization is described as a versatile multi-particle optimization method for performing nonconvex and nonsmooth global optimizations in high dimensions (Beddrich et al., 2024). Its standard mechanism combines a Gibbs-weighted consensus point with contractive drift and stochastic diffusion. Structure-preserving variants retain that consensus logic, but replace generic Euclidean updates by dynamics that encode the admissible geometry directly.

In the constrained Euclidean setting, particles evolve in $\bar\Omega$ and feasibility is enforced by reflective boundary conditions or by projection onto $\bar\Omega$ (Beddrich et al., 2024). On Riemannian manifolds, the consensus direction is built from $\log_x(y)$ and updates are applied through $\exp_x$, so the dynamics are formulated directly in terms of the Riemannian structure rather than through ambient embeddings (Huang et al., 12 Jun 2026). In entanglement computation, the relevant structures are Hermiticity and semi-unitarity on the complex Stiefel manifold, and the algorithms are built to preserve them exactly under the stochastic evolution (Herty et al., 5 May 2026). In composite optimization, the preserved object is the decomposition $F=g+h$ with convex proximable $h$, handled by a proximal consensus map rather than by smoothing or penalty substitution (Zhang et al., 10 Apr 2026).

Setting	Preserved structure	Mechanism
Constrained Euclidean domains	Boundary feasibility	Skorokhod reflection; orthogonal projection onto $\bar\Omega$
Riemannian manifolds	Intrinsic geodesic geometry	$\log_x$, $\exp_x$, manifold Brownian motion
Quantum entanglement optimization	Hermiticity; $U^\dagger U=I_r$	Hermitian SDEs; skew-Hermitian exponential updates
Composite optimization	Composite term $\bar\Omega$0	Proximal consensus $\bar\Omega$1

A plausible implication is that “structure-preserving” is best understood not as a single algorithmic template but as a design criterion: the consensus law is modified so that feasibility and geometry are part of the dynamics themselves, rather than external corrections applied after the fact.

2. Reflective constrained CBO on domains with boundary

For constrained optimization on a bounded domain $\bar\Omega$2 with possibly nonsmooth boundary, the constrained CBO formulation introduces a Skorokhod-type SDE for particles $\bar\Omega$3 in $\bar\Omega$4 (Beddrich et al., 2024):

$\bar\Omega$5

with anisotropic diffusion matrix $\bar\Omega$6, empirical law $\bar\Omega$7, and Gibbs-weighted consensus point

$\bar\Omega$8

The reflection term $\bar\Omega$9 enforces $\log_x(y)$0 through the Skorokhod condition

$\log_x(y)$1

where $\log_x(y)$2 is any outward unit normal to $\log_x(y)$3 at $\log_x(y)$4.

In the many-particle limit, the model yields a mean-field SDE with the same reflection law and a nonlinear Fokker–Planck equation with zero-flux boundary condition. The paper emphasizes that this closes a relevant gap in the literature by providing a global convergence proof for the many-particle regime comprehensive of convergence rates (Beddrich et al., 2024).

The convergence statement assumes: $\log_x(y)$5 is convex, compact (or mildly unbounded), with reflecting boundary; $\log_x(y)$6 is locally Lipschitz, bounded below, has a unique minimizer $\log_x(y)$7, quadratic growth at infinity, and polynomial growth near $\log_x(y)$8; and $\log_x(y)$9 (Beddrich et al., 2024). For the mean-square error

$\exp_x$0

the analysis derives a dissipative estimate and then a mass-concentration estimate implying

$\exp_x$1

which leads to

$\exp_x$2

For the projected Euler–Maruyama discretization,

$\exp_x$3

with $\exp_x$4, the error bound at $\exp_x$5 is

$\exp_x$6

This formulation is “structure-preserving” in a strict sense: the domain constraint is carried by the stochastic dynamics and the zero-flux law, not delegated to an unconstrained surrogate problem.

3. Intrinsic CBO on Riemannian manifolds

The intrinsic manifold formulation extends CBO to complete Riemannian manifolds with bounded sectional curvature by replacing ambient Euclidean differences with logarithmic and exponential maps defined by the intrinsic geodesic distance (Huang et al., 12 Jun 2026). Let $\exp_x$7 be complete, with pole $\exp_x$8 and cutoffs determined by radii $\exp_x$9. For particles $F=g+h$0 with empirical measure $F=g+h$1, the intrinsic consensus vector at $F=g+h$2 is

$F=g+h$3

The particle system then evolves by a Stratonovich or Itô SDE,

$F=g+h$4

where $F=g+h$5 is manifold Brownian motion in $F=g+h$6.

The associated mean-field law solves a nonlinear McKean–Vlasov SDE and an intrinsic PDE,

$F=g+h$7

The geometric assumptions are explicit: $F=g+h$8 is complete, simply-connected on balls $F=g+h$9 with sectional curvature $h$0 and injectivity radius $h$1; $h$2 is globally Lipschitz and bounded below; and for convergence there is a unique global minimizer $h$3 together with local growth and separation conditions (Huang et al., 12 Jun 2026).

The main convergence theorem defines the variance functional

$h$4

and the curvature-dependent constant

$h$5

For any $h$6, there exists $h$7 such that for all $h$8 there is a time

$h$9

with

$\bar\Omega$0

The paper contrasts this intrinsic construction with extrinsic CBO, where $\bar\Omega$1 is embedded into $\bar\Omega$2 and ambient differences are projected back. The intrinsic method is stated to be independent of any embedding, to preserve manifold dimension, to respect true geodesics, and to yield estimates that explicitly track curvature (Huang et al., 12 Jun 2026). One recurring misconception is therefore that manifold CBO is merely Euclidean CBO plus projection; the intrinsic formulation is presented precisely to avoid dependence on a particular embedding and the distortions that may arise from ambient geometry.

4. Structure preservation for matrix manifolds and composite objectives

In entanglement computation, the optimization variable is constrained by semi-unitarity. For a bipartite mixed state $\bar\Omega$3 with spectral decomposition $\bar\Omega$4, the Entanglement of Formation is formulated as

$\bar\Omega$5

a nonconvex high-dimensional problem on the complex Stiefel manifold

$\bar\Omega$6

(Herty et al., 5 May 2026).

Two structure-preserving CBO constructions are proposed. The Hermitian-matrix-based method evolves Hermitian particles $\bar\Omega$7 and defines $\bar\Omega$8 as the first $\bar\Omega$9 columns of $\log_x$0. Its consensus matrix is

$\log_x$1

and each particle obeys

$\log_x$2

The paper states that Hermiticity of $\log_x$3 is preserved by this SDE. The unitary-manifold method instead evolves $\log_x$4 directly by the Stratonovich SDE

$\log_x$5

with skew-Hermitian noise, and proves that $\log_x$6 is preserved for all $\log_x$7 if it holds at initialization (Herty et al., 5 May 2026).

The same work also introduces multi-species, cross-dimensional interaction, allowing particles with different matrix dimensions $\log_x$8 to share information through embedding and truncation operators. The cross-dimensional consensus is

$\log_x$9

This is a structure-preserving extension in a second sense: it accommodates variable feasible-set dimension while retaining the algebraic representation of admissible states.

For composite optimization, ProxiCBO addresses problems of the form

$\exp_x$0

where $\exp_x$1 is differentiable with Lipschitz gradient and $\exp_x$2 is proper, lower semicontinuous, convex, and proximable (Zhang et al., 10 Apr 2026). The structure-preserving step is the proximal consensus

$\exp_x$3

The continuous-time particle dynamics combine consensus drift, proximal-gradient drift, and two exploratory diffusions:

$\exp_x$4

Its alternating discrete scheme first computes Gibbs weights using $\exp_x$5, then forms $\exp_x$6, then applies the proximal map of $\exp_x$7, and only afterwards performs the particle update. The paper states that this single proximal computation ensures that the non-differentiable $\exp_x$8-term is treated exactly and that consensus respects constraints or composite regularizers (Zhang et al., 10 Apr 2026).

5. Convergence mechanisms and the few-particle regime

Although the specific proofs vary with the underlying structure, the recent structure-preserving CBO literature exhibits a common analytic pattern: a dissipative estimate for a variance-like functional, a quantitative control of the consensus error, persistence or concentration of mass near the global minimizer, and a finite-particle-to-mean-field approximation argument.

In the reflective constrained setting, the key steps are a differential inequality for $\exp_x$9, a mass-concentration estimate of the form

$U^\dagger U=I_r$0

and a Gibbs-weight argument turning local mass into a bound on $U^\dagger U=I_r$1 (Beddrich et al., 2024). In the manifold setting, the proof is organized around a dissipative estimate for $U^\dagger U=I_r$2, a quantitative Laplace principle controlling $U^\dagger U=I_r$3, and persistence of local mass $U^\dagger U=I_r$4 (Huang et al., 12 Jun 2026). In ProxiCBO, the theorem relies on well-posedness, propagation of chaos, long-time decay in $U^\dagger U=I_r$5, consensus-stability estimates for $U^\dagger U=I_r$6, and an importance-sampling MSE bound; the paper summarizes the resulting behavior as

$U^\dagger U=I_r$7

under the stated assumptions (Zhang et al., 10 Apr 2026).

A central practical issue is the few-particle regime. The constrained-domain paper states explicitly that, for the sake of minimizing running cost, it is desirable to keep the number of particles small, but reducing the number of particles implies a diminished capability of exploration of the algorithm; hence numerical heuristics are needed to ensure convergence of CBO in the few-particle regime (Beddrich et al., 2024). Two such heuristics are singled out.

The first is adaptive-region control. At iteration $U^\dagger U=I_r$8, the instantaneous diameter

$U^\dagger U=I_r$9

is computed, and each unconstrained step is replaced by its projection onto $\bar\Omega$00. The intended effect is to force particles to stay in a shrinking neighborhood of the consensus point, mimicking the mean-field collapse (Beddrich et al., 2024).

The second is geometry-specific and hierarchical noise. In the Euclidean constrained formulation, anisotropic noise

$\bar\Omega$01

is preferred over isotropic radial noise $\bar\Omega$02, exploiting the fact that diffusion only in the radial direction suffices for contraction (Beddrich et al., 2024). In PDE-based applications with nested FEM spaces $\bar\Omega$03, noise is generated first in coarse subspaces and only later enriched to finer ones, so that particles first explore large scales and only later smaller scales. The paper states that this dramatically improves efficiency (Beddrich et al., 2024).

A related misconception is that any projection-based correction is equivalent to a structure-preserving dynamics. The entanglement paper reports that projection-based variants, such as projecting to Hermitian matrices or re-orthonormalizing by Gram–Schmidt after an unconstrained step, perform significantly worse and can be unstable (Herty et al., 5 May 2026). This does not imply that projection is always ineffective; rather, it suggests that post hoc correction and intrinsic preservation are analytically and numerically distinct design choices.

6. Applications and empirical behavior

The constrained-domain framework is coupled with a multigrid finite element method to compute global minimizers of a constrained $\bar\Omega$04-Allen–Cahn energy with obstacle constraints (Beddrich et al., 2024). In one dimension, the energy is

$\bar\Omega$05

After discretizing $\bar\Omega$06 into $\bar\Omega$07 segments and writing $\bar\Omega$08, the problem becomes a $\bar\Omega$09-dimensional optimization over a convex hypercube. The CBO–multigrid scheme starts on a coarse mesh, applies CBO–Euler updates with anisotropic noise restricted to the current space, projects onto the convex set $\bar\Omega$10, and prolongates stabilized particle distributions to finer meshes. Numerical tests show that with only $\bar\Omega$11 particles and $\bar\Omega$12 total iterations one converges robustly to the global minimizer of $\bar\Omega$13, including cases with multiple local minima and obstacles (Beddrich et al., 2024).

The intrinsic manifold formulation is tested on the sphere $\bar\Omega$14, hyperbolic space $\bar\Omega$15, and the special orthogonal group $\bar\Omega$16 (Huang et al., 12 Jun 2026). On $\bar\Omega$17, with $\bar\Omega$18, $\bar\Omega$19, $\bar\Omega$20, $\bar\Omega$21, $\bar\Omega$22, and $\bar\Omega$23, the swarm collapses to the minimizer and the empirical variance decays linearly on a semilog plot, matching $\bar\Omega$24. On $\bar\Omega$25, with $\bar\Omega$26, $\bar\Omega$27, $\bar\Omega$28, and $\bar\Omega$29, the swarm escapes infinite local rings and collapses to the minimizer, with variance decaying exponentially up to a discretization plateau. On $\bar\Omega$30, again with $\bar\Omega$31 and the same $\bar\Omega$32, the swarm collapses to the target rotation and the variance decays exponentially (Huang et al., 12 Jun 2026).

For quantum entanglement computation, the structure-preserving Hermitian- and unitary-based methods are evaluated on $\bar\Omega$33 Horodecki states, $\bar\Omega$34 Werner states, $\bar\Omega$35 isotropic states, and $\bar\Omega$36 Horodecki states (Herty et al., 5 May 2026). Under typical settings

$\bar\Omega$37

both structure-preserving methods reach the correct entanglement within $\bar\Omega$38–$\bar\Omega$39 error; errors decrease as $\bar\Omega$40 increases; and multi-species CBO improves both speed of convergence and final accuracy by sharing information across matrix dimensions $\bar\Omega$41 (Herty et al., 5 May 2026).

In composite optimization, ProxiCBO is tested on one-bit quantized sparse recovery and single-photon lidar parameter estimation (Zhang et al., 10 Apr 2026). For sparse recovery, with $\bar\Omega$42, $\bar\Omega$43, $\bar\Omega$44, and $\bar\Omega$45, the reported metrics are success rate and reconstruction SNR, and the paper states that ProxiCBO with $\bar\Omega$46 particles outperforms PG/APG with $\bar\Omega$47 in success rate and yields higher SNR over wide $\bar\Omega$48 and $\bar\Omega$49 ranges. For single-photon lidar, in both the static target and Doppler scenarios, the reported metrics are success rate and RMSE, and ProxiCBO is said to achieve higher success rates with far fewer particles, to closely approach the Cramér–Rao bound in the static case, and to outperform all baselines in Doppler velocity estimation (Zhang et al., 10 Apr 2026).

Taken together, these examples indicate that structure preservation in CBO is not restricted to one kind of constraint. It encompasses reflecting boundaries, intrinsic manifold geometry, matrix invariants, variable dimension, and composite regularization. This suggests that the main contribution of recent work is methodological unification: consensus, diffusion, and feasibility are adapted to the native problem structure while retaining global-convergence analyses and particle-based numerical behavior characteristic of CBO.