Mixture-of-Geometry-Experts (MoGE) Overview

• Mixture-of-Geometry-Experts (MoGE) is a research direction integrating expert specialization, routing strategies, and geometry-preserving aggregation for advanced geometric inference.
• Implementations span dense monocular geometry estimators, sparse MoE methods for motion field decomposition, and novel aggregation operators tailored to embedding geometry.
• Empirical studies report strong performance across monocular, two-view, and 3D reconstruction tasks while highlighting trade-offs in architecture and expert decomposition.

Searching arXiv for papers directly relevant to “Mixture-of-Geometry-Experts (MoGE)” and closely adjacent formulations. Mixture-of-Geometry-Experts (MoGE) does not yet denote a single standardized architecture in the recent literature. Instead, the phrase is most accurately treated as an umbrella over several neighboring developments: dense monocular geometry estimators whose name “MoGe” refers to monocular geometry estimation rather than mixture-of-experts; sparse Mixture-of-Experts systems applied directly to geometric prediction; geometry-preserving aggregation rules for expert outputs; mechanistic analyses showing that routers and experts co-organize geometrically; and geometry-aware expert decompositions of dynamical fields. Taken together, these works suggest that MoGE is less a settled model family than a research direction concerned with how expert specialization, routing, aggregation, and representation geometry should interact in geometric inference (Wang et al., 2024, Wang et al., 3 Jul 2025, Le et al., 1 Aug 2025, Gao et al., 31 Oct 2025, Kachuee et al., 15 Feb 2026, Caro et al., 9 May 2026, Ahrac et al., 12 May 2026).

1. Terminological scope and competing uses of “MoGe”

The literature distinguishes sharply between MoGe as a proper model name and Mixture-of-Geometry-Experts as an interpretive label. In “MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervision” (Wang et al., 2024), “MoGe” names a monocular geometry estimator that predicts an affine-invariant 3D point map from a single image. The paper explicitly does not expand MoGe as “Mixture-of-Geometry-Experts.” “MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details” is a direct successor to that line and again centers affine-invariant monocular geometry rather than expert routing (Wang et al., 3 Jul 2025).

By contrast, several other papers are directly relevant to a MoGE interpretation even when they do not adopt the exact phrase. “GeoMoE: Divide-and-Conquer Motion Field Modeling with Mixture-of-Experts for Two-View Geometry” applies sparse MoE to heterogeneous motion sub-fields in two-view geometry (Le et al., 1 Aug 2025). “MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Experts” inserts routed FFN experts into a dense 3D geometry transformer (Gao et al., 31 Oct 2025). “Geometry-Preserving Aggregation for Mixture-of-Experts Embedding Models” studies whether the mixture rule itself should preserve the geometry of expert outputs (Kachuee et al., 15 Feb 2026). “FLUX: Geometry-Aware Longitudinal Flow Matching with Mixture of Experts” combines a shared learned geometry with a mixture of expert vector fields (Caro et al., 9 May 2026). “Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts” provides a mechanistic account of how standard sparse MoEs already partition hidden-state space geometrically (Ahrac et al., 12 May 2026).

This distribution of usage has an important consequence. The phrase “Mixture-of-Geometry-Experts” should not be read as naming one consensus blueprint. Rather, it designates a family resemblance across papers that differ in whether the “geometry” resides in the output representation, the routing decision, the aggregation operator, the learned manifold, or the expert specialization itself.

2. Affine-invariant monocular geometry: the MoGe and MoGe-2 lineage

MoGe formulates monocular geometry estimation (MGE) as dense 3D point-map prediction from a single RGB image $\mathbf I \in \mathbb R^{H\times W\times 3}$, producing $\mathbf P \in \mathbb R^{H\times W\times 3}$ in camera-related coordinates. Its central representational choice is an affine-invariant point map, meaning that the prediction is defined only up to a global scale and a global translation. This is motivated by focal-distance ambiguity in monocular reconstruction: scene size and focal length can trade off while leaving image evidence similar. The global geometry loss is

$$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$

where $(s^*,\mathbf t^*)$ are the optimal alignment parameters and $1/z_i$ reweights the loss by inverse depth. MoGe further adds multi-scale local supervision on spherical regions

$${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$

and uses the ROE solver—described as robust, optimal, and efficient—to compute the alignment used in training. The method is trained on a mixed corpus of 21 public datasets and, in the reported zero-shot evaluation, achieves average affine-invariant point-map performance of Rel$^p = 6.43$, $\delta_1^p = 94.4$, average local point-map performance of Rel$^p = 5.33$, $\delta_1^p = 95.8$, and average camera FOV error of mean $\mathbf P \in \mathbb R^{H\times W\times 3}$0, median $\mathbf P \in \mathbb R^{H\times W\times 3}$1 (Wang et al., 2024).

MoGe-2 preserves this affine-invariant core and adds metric scale in a deliberately decoupled manner. The model uses a DINOv2 ViT-Large backbone, a shared convolutional neck, a dense geometry head that predicts the same affine-invariant point map as MoGe, and a separate global scale head. The preferred metric formulation is scale and relative geometry decomposition: $\mathbf P \in \mathbb R^{H\times W\times 3}$2 where $\mathbf P \in \mathbb R^{H\times W\times 3}$3 is predicted by a CLS-token-conditioned MLP, and $\mathbf P \in \mathbb R^{H\times W\times 3}$4 is the optimal online scale from the ROE solver. The stop-gradient enforces the decoupling: the scale target supervises the scale head without backpropagating through alignment into the geometry branch. The final metric point map is obtained by multiplying the affine-invariant point map by the predicted global scale. The paper explicitly states that this design is not a new expert mixture in the classical mixture-of-experts sense; architecturally it is a shared encoder plus dense geometry head plus global scale head (Wang et al., 3 Jul 2025).

MoGe-2 also introduces a unified real-data refinement pipeline motivated by the observation that LiDAR and SfM supervision contain noise, incompleteness, and RGB-depth misalignment that suppress sharp detail learning. A synthetic-only model $\mathbf P \in \mathbb R^{H\times W\times 3}$5 provides sharp pseudo-geometry used for local mismatch filtering and logarithmic-space Poisson completion. The mismatch-filtering stage constructs local neighborhoods

$\mathbf P \in \mathbb R^{H\times W\times 3}$6

aligns real points locally to pseudo-predictions with the ROE solver, removes outliers, and then completes missing geometry by matching gradients of $\mathbf P \in \mathbb R^{H\times W\times 3}$7 while preserving boundary depth. The resulting model is trained on 24 datasets and is evaluated along three axes: relative geometry, metric geometry, and boundary sharpness. Averaged over 10 datasets, it improves relative-geometry average rank from MoGe’s $\mathbf P \in \mathbb R^{H\times W\times 3}$8 to $\mathbf P \in \mathbb R^{H\times W\times 3}$9; averaged over 7 metric datasets, it reports metric point-map Rel$$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$0, $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$1, and average rank $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$2; for metric depth without GT intrinsics it reports Rel$$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$3, $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$4; and for boundary sharpness it ranks second overall behind Depth Pro, with average rank $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$5 (Wang et al., 3 Jul 2025).

Within a MoGE encyclopedia, the MoGe lineage is therefore foundational but terminologically atypical. Its importance lies in showing that geometry-aware representation design—especially affine invariance and alignment-aware supervision—can dominate architectural novelty. A plausible implication is that later expert-based systems inherit many of the same concerns: ambiguity management, scale decoupling, and local-versus-global geometric supervision.

3. Explicit Mixture-of-Experts formulations for geometric prediction

GeoMoE is among the clearest instances where a standard sparse MoE is used as a geometry model. It operates on two-view correspondences $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$6, converts them into motion vectors $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$7, embeds them, and refines the resulting motion field through a layered pipeline comprising Local Orthogonal Context (LOC), Probabilistic Prior-Guided Decomposition (PPGD), MoE-Enhanced Bi-Path Rectifier (MBPR), graph-based reconstruction, and layer-wise inlier prediction. The MoE component uses sparse routing

$$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$8

with 4 experts and 2 active experts per sub-field. The decomposition is prior-guided by previous-layer inlier probabilities, which act as soft masks during refinement. GeoMoE reports $$\mathcal L_G = \sum_{i\in \mathcal M}{1\over z_i}\left\|s^*\hat{\mathbf p}_i+\mathbf t^*-\mathbf p_i\right\|_1,$$9 layers, feature dimension $(s^*,\mathbf t^*)$0, maximum $(s^*,\mathbf t^*)$1 correspondences, and $(s^*,\mathbf t^*)$2 motion sub-fields. On YFCC100M it reports AUC values $(s^*,\mathbf t^*)$3 at $(s^*,\mathbf t^*)$4 using weighted eight-point estimation, and on SUN3D it reports $(s^*,\mathbf t^*)$5. It also reports HPatches homography accuracy $(s^*,\mathbf t^*)$6 with DLT at $(s^*,\mathbf t^*)$7 px, 3DMatch registration recall $(s^*,\mathbf t^*)$8, and an efficiency profile of $(s^*,\mathbf t^*)$9M parameters, $1/z_i$0G FLOPs, $1/z_i$1MB memory, and $1/z_i$2ms inference time (Le et al., 1 Aug 2025).

Conceptually, GeoMoE instantiates a divide-and-conquer view of geometry: the input correspondence field is treated as a mixture of latent motion regimes rather than as one globally smooth field. The experts are not explicitly named as “foreground,” “background,” or “planar,” but the paper states that visualizations show different experts responding to different objects, spatial regions, and characteristic motion patterns. This is a strong, though still emergent rather than hand-specified, MoGE interpretation.

MoRE extends sparse MoE into dense 3D visual geometry reconstruction from unposed image sequences $1/z_i$3, predicting $1/z_i$4 for camera parameters, pointmaps, depth, dense tracking features, and normals. It is built on VGGT, a dense visual transformer with alternating global and frame attention, and inserts MoE by replicating pretrained FFNs into expert sets $1/z_i$5. Routing is standard sparse conditional computation: $1/z_i$6 with a load-balancing objective

$1/z_i$7

The paper does not fully specify the number of experts $1/z_i$8, the number of MoE layers, or parameter/FLOP counts, but it is explicit that MoE is introduced in a second stage after initial dense training (Gao et al., 31 Oct 2025).

MoRE couples its MoE backbone to geometry-specific additions. A confidence-based depth refinement module uses MoGev2 as a teacher prior and defines a binary confidence mask

$1/z_i$9

with $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$0 and $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$1, to filter unreliable depth supervision. A normal-prediction branch fuses globally aligned 3D backbone features $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$2 with dense semantic features $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$3 from DINOv2 via $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$4. Quantitatively, the paper attributes gains to both the tailored geometry losses and the MoE specialization: a VGGT-like baseline without MoE reports DTU Acc./Comp./N.C. $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$5, NYUv2 depth $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$6, and RealEstate10K AUC@30 $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$7; adding tailored losses but no MoE improves to $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$8, $${\mathcal S}_j = \{ i \mid \|{\mathbf p}_i - {\mathbf p}_j\| \leq r_j,i\in {\mathcal M} \},$$9, and $^p = 6.43$0; full MoRE further improves to $^p = 6.43$1, $^p = 6.43$2, and $^p = 6.43$3 (Gao et al., 31 Oct 2025).

Across GeoMoE and MoRE, the salient MoGE pattern is explicit sparse routing inside a geometry pipeline. GeoMoE decomposes motion sub-fields before expert refinement; MoRE routes dense visual tokens inside a multi-task 3D backbone. In both cases, expert specialization is latent and data-driven rather than manually typed by geometry primitive.

4. Geometry-preserving aggregation and hyperspherical expert representations

A different branch of the literature asks whether MoGE should be defined not only by which experts are selected but by how their outputs are mixed. “Geometry-Preserving Aggregation for Mixture-of-Experts Embedding Models” studies sparse MoE embedding systems in which the conventional output is the weighted linear sum

$^p = 6.43$4

The paper argues that this rule is geometrically mismatched for embedding models because the expert outputs empirically lie on a shared hyperspherical manifold: norms are tightly concentrated, while active experts are directionally separated, with most pairwise angles above $^p = 6.43$5. Under this geometry, linear mixing causes aggregation-induced inward collapse, formally expressed for approximately equal norms as

$^p = 6.43$6

This degrades both norm and direction, and therefore embedding comparability (Kachuee et al., 15 Feb 2026).

The proposed remedy is Spherical Barycentric Aggregation (SBA), which decomposes each expert output into radius and direction,

$^p = 6.43$7

aggregates radius linearly,

$^p = 6.43$8

and aggregates angular coordinates with norm-aware weights,

$^p = 6.43$9

before reconstructing

$\delta_1^p = 94.4$0

The paper is explicit that this is an operational geometry-preserving rule, not a rigorous intrinsic Fréchet mean on $\delta_1^p = 94.4$1. It does not modify the experts or the router; it modifies only the aggregation operator (Kachuee et al., 15 Feb 2026).

Empirically, the paper compares a linear MoE baseline and SBA MoE on selected MTEB tasks using nomic-ai/nomic-embed-text-v2-moe with top-2 routing. Reported scores are $\delta_1^p = 94.4$2 on STSBenchmark, $\delta_1^p = 94.4$3 on StackExchangeClustering, and $\delta_1^p = 94.4$4 on SprintDuplicateQuestions. Ablations show that a norm-free angular variant performs similarly and that a unit-normalized output degrades strongly, including a reported $\delta_1^p = 94.4$5 on StackExchangeClustering (Kachuee et al., 15 Feb 2026).

For a MoGE synthesis, the importance of this paper is architectural minimalism. It treats geometry-awareness as a property of the mixture operator rather than the expert modules themselves. This suggests that some MoGE gains may come from preserving the geometry of expert representations during aggregation, even when routing and expert internals are left unchanged.

5. Router–expert geometric coupling in sparse MoE

A mechanistic account of MoGE is developed in “Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts” (Ahrac et al., 12 May 2026). The setting is a standard sparse MoE layer in which the router computes

$\delta_1^p = 94.4$6

and the sparse output is

$\delta_1^p = 94.4$7

The central result is that, for a routed token $\delta_1^p = 94.4$8, the selected router vector and the selected expert’s input-side weights receive gradients along the same input direction: $\delta_1^p = 94.4$9 The scalar coefficients differ, but the directional component is shared. The paper’s interpretation is that matched router–expert directions accumulate the same routed token history (Ahrac et al., 12 May 2026).

This geometric-coupling view is supported empirically in a $^p = 5.33$0B SMoE trained from scratch with $^p = 5.33$1 SMoE layers, hidden size $^p = 5.33$2, $^p = 5.33$3 routed experts, top-$^p = 5.33$4 routing, $^p = 5.33$5 shared experts, and expert hidden width $^p = 5.33$6. For routed token–expert pairs, higher raw router scores correlate with stronger gate-neuron activations inside the selected expert, with pooled correlation

$^p = 5.33$7

The paper therefore argues that routing decisions are mirrored inside the selected expert rather than being merely external control signals (Ahrac et al., 12 May 2026).

The same paper also analyzes how auxiliary load-balancing losses alter this geometry. Under the standard balancing loss

$^p = 5.33$8

every router row receives input-directed updates from every token: $^p = 5.33$9 The reported effect is router homogenization: mean off-diagonal router-row cosine similarity rises to $\delta_1^p = 95.8$0 at layers $\delta_1^p = 95.8$1 with auxiliary loss, versus $\delta_1^p = 95.8$2 under loss-free bias balancing. The paper characterizes this as making router directions “nearly three times more similar” (Ahrac et al., 12 May 2026).

To test whether routing can be reduced to explicit geometry, the authors introduce a parameter-free online K-Means router that scores experts by cosine similarity to running centroids: $\delta_1^p = 95.8$3 with centroid update

$\delta_1^p = 95.8$4

This router achieves the lowest reported load imbalance, MaxVio $\delta_1^p = 95.8$5, compared with $\delta_1^p = 95.8$6 for Loss-Free, $\delta_1^p = 95.8$7 for Loss-Free + Seq-Aux, and $\delta_1^p = 95.8$8 for Aux-Loss, at the cost of modestly worse perplexity. In MoGE terms, this paper argues that sparse MoEs already behave like latent geometry-partitioning systems: experts occupy regions or directions in hidden-state space, and routers learn corresponding geometric descriptors.

6. Shared learned geometry with expert decomposition: FLUX

FLUX extends the MoGE discussion beyond vision and embeddings into longitudinal dynamical modeling. The problem is to infer a continuous-time velocity field from ordered but unpaired snapshot marginals $\delta_1^p = 95.8$9, with samples $\mathbf P \in \mathbb R^{H\times W\times 3}$00. The model learns

$\mathbf P \in \mathbb R^{H\times W\times 3}$01

using adjacent-marginal flow matching. Geometry enters through a learned data-dependent metric, specifically an RBF-MLP scalar manifold score inducing an isotropic metric tensor

$\mathbf P \in \mathbb R^{H\times W\times 3}$02

which is then used to construct geometry-aware conditional paths between adjacent marginals (Caro et al., 9 May 2026).

The expert decomposition acts on the velocity field rather than on the geometry itself: $\mathbf P \in \mathbb R^{H\times W\times 3}$03 where $\mathbf P \in \mathbb R^{H\times W\times 3}$04 are expert vector fields and $\mathbf P \in \mathbb R^{H\times W\times 3}$05 are produced by a Straight-Through Gumbel-Softmax router

$\mathbf P \in \mathbb R^{H\times W\times 3}$06

The training loss is the flow-matching regression

$\mathbf P \in \mathbb R^{H\times W\times 3}$07

augmented by an extensive routing objective involving batch diversity, sparsity, temporal consistency, load balancing, confidence, DEC-style clustering, and segment-level regularization (Caro et al., 9 May 2026).

FLUX is especially informative because it isolates the role of shared geometry in enabling expert specialization. The paper explicitly states that the metric is not an additional input to the velocity network; instead, it changes the conditional paths, training locations, and target tangents used for supervision. Ablations compare full FLUX with “FLUX without Geometric Learning,” holding the MoE architecture and routing objective fixed while replacing geometry-aware paths with Euclidean ones. On the regime-switching Lorenz system, full FLUX reports ARI $\mathbf P \in \mathbb R^{H\times W\times 3}$08, NMI $\mathbf P \in \mathbb R^{H\times W\times 3}$09, whereas FLUX without geometry reports ARI $\mathbf P \in \mathbb R^{H\times W\times 3}$10, NMI $\mathbf P \in \mathbb R^{H\times W\times 3}$11. On NeuralTable, the corresponding values are $\mathbf P \in \mathbb R^{H\times W\times 3}$12 versus $\mathbf P \in \mathbb R^{H\times W\times 3}$13. On Embryoid Body, both variants report ARI $\mathbf P \in \mathbb R^{H\times W\times 3}$14, NMI $\mathbf P \in \mathbb R^{H\times W\times 3}$15, which the paper interprets as a case where stages are already spatially separable (Caro et al., 9 May 2026).

For MoGE, FLUX clarifies an important conceptual boundary. It is best described as a mixture of dynamics experts on a shared learned geometry, not as a system in which each expert owns a separate metric or manifold. The paper itself makes this distinction explicit: a stronger “true” MoGE would require per-expert geometries, per-expert path constructors, or routing over geometry families rather than only over vector fields.

7. Misconceptions, limits, and unresolved design questions

A recurrent misconception is to treat all occurrences of “MoGe” as references to mixture-of-experts geometry. That is incorrect. The MoGe and MoGe-2 papers are monocular geometry estimators built around affine-invariant point maps, optimal alignment, and decoupled metric-scale prediction; MoGe-2 explicitly notes that its scale head is not a separate “expert mixture” in the classical MoE sense (Wang et al., 2024, Wang et al., 3 Jul 2025). Conversely, several papers that are central to a MoGE reading—GeoMoE, MoRE, SBA, FLUX, and router–expert coupling—do not define a unified canonical MoGE architecture (Le et al., 1 Aug 2025, Gao et al., 31 Oct 2025, Kachuee et al., 15 Feb 2026, Caro et al., 9 May 2026, Ahrac et al., 12 May 2026).

A second misconception is that geometry-aware expert systems necessarily require geometry-specific expert modules. The literature is more heterogeneous. GeoMoE uses standard sparse experts but applies them to decomposed motion sub-fields (Le et al., 1 Aug 2025). MoRE uses FFN experts inside a dense 3D transformer without explicitly labeling them by geometry primitive (Gao et al., 31 Oct 2025). SBA changes only the aggregation operator and leaves experts and router untouched (Kachuee et al., 15 Feb 2026). The router-coupling work suggests that even a conventional sparse MoE already learns a geometric partition of hidden-state space (Ahrac et al., 12 May 2026). FLUX uses a shared learned metric plus expert vector fields, but not per-expert metrics (Caro et al., 9 May 2026).

The current literature also leaves several technical gaps. GeoMoE does not provide the exact weighted eight-point formulation, the exact form of $\mathbf P \in \mathbb R^{H\times W\times 3}$16, the exact BCE expression, or the KNN neighborhood size $\mathbf P \in \mathbb R^{H\times W\times 3}$17 in the main text (Le et al., 1 Aug 2025). MoRE does not report the number of experts, top-$\mathbf P \in \mathbb R^{H\times W\times 3}$18, parameter counts, or FLOP overhead, and does not analyze what its experts learn (Gao et al., 31 Oct 2025). SBA motivates hyperspherical consistency strongly but does not provide a rigorous spherical Fréchet mean or intrinsic manifold optimization formalism (Kachuee et al., 15 Feb 2026). FLUX fixes the number of experts and trains geometry, bend network, and velocity network in separate stages, which reinforces shared geometry but limits expert-specific geometric adaptation (Caro et al., 9 May 2026). MoGe-2 still struggles with extremely fine structures such as thin lines and hair, with preserving perfectly straight and aligned structures under large foreground–background scale differences, and with real-world metric-scale ambiguity in out-of-distribution settings (Wang et al., 3 Jul 2025).

These limitations indicate that MoGE remains a partially consolidated field. A plausible implication is that a more explicit next-generation formulation would combine several threads that are currently separate: affine- or metric-aware geometric representations; geometry-conditioned routing; geometry-preserving aggregation; mechanistically stable router–expert coupling; and, potentially, per-expert geometry rather than only per-expert function specialization. The present literature establishes the components of that program, but not yet a single definitive synthesis.