Multi-Granularity Experts Collaborative Learning

• MECL is a collaborative expert-learning paradigm that trains concurrent coarse, base, and fine conceptual experts to capture hierarchical semantic variations.
• It employs a concept alignment matrix and cross-expert consistency loss to synchronize predictions across experts and bolster fine-grained category discovery.
• The framework is versatile, with implementations spanning fine-grained discovery, domain generalization, and accented speech recognition, each showing measurable performance gains.

Multi-Granularity Experts Collaborative Learning (MECL) is a collaborative expert-learning paradigm whose most explicit formulation in the recent literature appears as the second main module of the Multi-Granularity Conceptual Experts (MGCE) framework for generalized fine-grained category discovery (Zheng et al., 30 Sep 2025). In that setting, MECL extends a single-expert conceptual learner into a multi-expert paradigm in which coarse, base, and fine conceptual experts are trained simultaneously and aligned through a concept alignment matrix and a cross-expert consistency loss. The acronym has also been used earlier for a distinct framework, “Multiple Domain Experts Collaborative Learning,” in multi-source domain generalization for person re-identification, where the collaboration is between domain experts and a universal expert rather than between granularity levels (YU et al., 2021). Taken together, the literature uses MECL to denote expert specialization combined with explicit inter-expert collaboration, but not a single canonical architecture.

1. Terminology and scope

The term “MECL” is not semantically uniform across the cited literature. In "Generalized Fine-Grained Category Discovery with Multi-Granularity Conceptual Experts" (Zheng et al., 30 Sep 2025), Multi-Granularity Experts Collaborative Learning is a module for jointly learning multiple conceptual partitions at different semantic resolutions. In "Multiple Domain Experts Collaborative Learning: Multi-Source Domain Generalization For Person Re-Identification" (YU et al., 2021), the same acronym denotes a domain-generalization framework with one expert per source domain and a universal expert used at inference. A further, explicitly marked reinterpretation appears in accented speech recognition, where a three-stage LoRA-expert system is described in “MECL terms” as expert collaboration across accent, modality, and linguistic granularity rather than as a method named MECL (Mu et al., 12 Jul 2025).

Paper	Expansion or interpretation	Core expert structure
(Zheng et al., 30 Sep 2025)	Multi-Granularity Experts Collaborative Learning	fine, base, and coarse conceptual experts
(YU et al., 2021)	Multiple Domain Experts Collaborative Learning	one expert per source domain plus a universal expert
(Mu et al., 12 Jul 2025)	reinterpretation in MECL terms	mono-accent LoRA experts plus word/phoneme granularity fusion

A common misconception is that MECL always denotes a multi-granularity module. That is not the case. The 2021 DG-ReID paper states that it does not use the phrase multi-granularity experts; its experts are at the domain level, with a higher-level universal expert supervising and aggregating them (YU et al., 2021). Conversely, the 2025 MGCE paper makes granularity the defining organizing principle of MECL (Zheng et al., 30 Sep 2025).

2. MECL within generalized fine-grained category discovery

In the MGCE framework, generalized category discovery is formulated with a labeled set

$$\mathcal{D}_L = \{(\mathbf{x}_i^l, y_i^l)\}_{i=1}^N,\quad y_i^l \in \mathcal{Y}_L$$

and an unlabeled set

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$

where the unlabeled label space includes both known and novel categories, $\mathcal{Y}_L \subset \mathcal{Y}_U$ (Zheng et al., 30 Sep 2025). The paper positions MECL as a response to two limitations: single-granularity concept supervision and the lack of explicit exploitation of the hierarchical structure of fine-grained visual data. Coarse concepts encode broad similarity, while fine concepts encode subtle intra-class variation; MECL is designed to leverage both simultaneously.

MGCE comprises two tightly coupled modules. The first is Dynamic Conceptual Contrastive Learning (DCCL), which alternates between Dynamic Concept Generation and Dual-level Representation Learning. The second is MECL, which extends DCCL from one expert to multiple experts of different granularity per epoch (Zheng et al., 30 Sep 2025). MECL itself has two sub-components. Multi-Expert Conceptual Learning generates multiple conceptual experts by varying the neighborhood size $k_{\text{nn}}$ in Semi-Infomap, thereby producing coarse, base, and fine-grained partitions. Collaborative Learning introduces a concept alignment matrix and a cross-expert consistency loss.

The multi-granularity structure is explicit. MECL uses three conceptual experts: a base expert with adaptively selected $k_{\text{nn}}^1$, a fine-grained expert with

$$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$

and a coarse-grained expert with

$$k_{\text{nn}}^3 = \frac{k_{\text{nn}}^1}{\mathcal{R}},$$

where typically $\mathcal{R} = 0.6$ (Zheng et al., 30 Sep 2025). Smaller $k_{\text{nn}}$ yields more communities and finer concepts; larger $k_{\text{nn}}$ yields fewer communities and coarser concepts. The base expert serves as the reference expert, and its concepts are used as final category assignments at inference.

Feature extraction is shared across experts. With a ViT-B/16 backbone pretrained with DINO,

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$0

and each expert $\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$1 has a concept projection head

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$2

implemented as a 2-layer MLP $\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$3 (Zheng et al., 30 Sep 2025). Each expert maintains its own concept memory buffer

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$4

where $\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$5 is the number of discovered concepts for that granularity. This design makes MECL a shared-backbone, multi-head, multi-partition learner rather than an ensemble of fully separate models.

3. Concept alignment, collaborative loss, and the learning objective

For each expert $\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$6, Semi-Infomap produces concept labels

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$7

and concept prototypes are initialized as mean features:

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$8

Each expert then optimizes a concept-level contrastive loss

$\mathcal{D}_U = \{\mathbf{x}_i^u\}_{i=1}^M,$9

where $\mathcal{Y}_L \subset \mathcal{Y}_U$0 and $\mathcal{Y}_L \subset \mathcal{Y}_U$1 on the fine-grained datasets (Zheng et al., 30 Sep 2025). The total concept-level loss is

$\mathcal{Y}_L \subset \mathcal{Y}_U$2

The central collaborative mechanism is the concept alignment matrix between expert $\mathcal{Y}_L \subset \mathcal{Y}_U$3 and the reference expert 1:

$\mathcal{Y}_L \subset \mathcal{Y}_U$4

This matrix measures cosine similarity between concept prototypes across granularities (Zheng et al., 30 Sep 2025). For each sample, expert-specific similarity distributions are computed via softmax over cosine similarities to the expert’s own prototypes, and for $\mathcal{Y}_L \subset \mathcal{Y}_U$5 the distribution is projected into expert 1’s concept space:

$\mathcal{Y}_L \subset \mathcal{Y}_U$6

The collaborative loss is then a symmetric KL divergence:

$\mathcal{Y}_L \subset \mathcal{Y}_U$7

This construction gives MECL its distinctive semantics. Fine-grained experts can split subtle categories, but their predictions are regularized to remain compatible with the base partition. Coarse-grained experts can impose high-level structure, but they are discouraged from collapsing distinct fine categories. The paper characterizes this as explicit cross-level regularization among multiple hierarchical clusterings of the same data (Zheng et al., 30 Sep 2025).

MECL is not trained in isolation. The full MGCE objective is

$\mathcal{Y}_L \subset \mathcal{Y}_U$8

where $\mathcal{Y}_L \subset \mathcal{Y}_U$9 is the instance-level loss inherited from DCCL, and $k_{\text{nn}}$0 on the fine-grained datasets (Zheng et al., 30 Sep 2025). In this formulation, MECL acts as a concept-level regularizer layered on top of instance-level supervision.

4. Training workflow, prototype dynamics, and inference behavior

The MGCE training procedure begins with adaptive selection of the base neighborhood parameter $k_{\text{nn}}$1 using labeled data. Algorithm 1 performs a coarse search and then a fine search around the best candidate, evaluating clustering ACC and an error-adjusted ACC derived from the estimated number of clusters (Zheng et al., 30 Sep 2025). This is a distinctive aspect of the framework: the base granularity is not fixed heuristically but selected once per dataset and then used to derive the fine and coarse experts through the scaling factor $k_{\text{nn}}$2.

Within each epoch, MECL performs a two-stage cycle. First, for each expert $k_{\text{nn}}$3, the model computes features $k_{\text{nn}}$4 and projected features $k_{\text{nn}}$5, constructs an adjacency matrix with $k_{\text{nn}}$6, runs Semi-Infomap to obtain concept labels $k_{\text{nn}}$7, and initializes concept memory $k_{\text{nn}}$8 (Zheng et al., 30 Sep 2025). Second, during the inner optimization loop, minibatches are sampled from $k_{\text{nn}}$9, the instance-level loss $k_{\text{nn}}^1$0 is computed, each expert contributes its own $k_{\text{nn}}^1$1, the alignment matrices $k_{\text{nn}}^1$2 and $k_{\text{nn}}^1$3 are recomputed, and the collaborative loss $k_{\text{nn}}^1$4 is added before updating the backbone, classifier, and all concept projection heads by SGD.

Concept prototypes are not static. After backpropagation, the prototype associated with sample $k_{\text{nn}}^1$5 in expert $k_{\text{nn}}^1$6 is updated by momentum:

$k_{\text{nn}}^1$7

The paper notes that prototype-wise updating is more stable than storing all instances (Zheng et al., 30 Sep 2025). Re-initializing concept memory each epoch with center-crop images and using FAISS to build KNN graphs are part of the reported implementation recipe.

At inference, the base expert determines the final partition. When the number of unlabeled categories $k_{\text{nn}}^1$8 is unknown, Semi-Infomap is run on the learned features with the base $k_{\text{nn}}^1$9, and the resulting number of clusters is used as the category count after removing clusters with fewer than 4 samples (Zheng et al., 30 Sep 2025). MGCE reduces estimation error rate from DCCL by 26.6% on average, which the paper attributes to improved representation quality and multi-granularity constraints.

5. Relation to earlier and adjacent expert-collaboration frameworks

The 2021 DG-ReID work is the earlier major use of the acronym. There, MECL stands for Multiple Domain Experts Collaborative Learning, not multi-granularity learning (YU et al., 2021). The framework trains one expert network per source domain and a universal expert. Collaboration is organized through Domain-Domain Collaborative Learning (DDCL) and Universal-Domain Collaborative Learning (UDCL). DDCL uses domain-specific experts and a meta-learning strategy so that each expert does not over-fit its corresponding domain. UDCL introduces a universal expert that supervises the domain experts through alignment and uniformity losses and continuously gathers knowledge from all domain experts through an exponential moving average. Only the universal expert is used for inference (YU et al., 2021).

In formal terms, the DG-ReID setting has labeled source domains

$$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$0

and target domains

$$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$1

with disjoint label spaces across source domains. Each domain expert consists of a feature extractor $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$2, classifier $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$3, and projector $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$4; the universal expert is a feature extractor $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$5 (YU et al., 2021). The collaboration is therefore between domain-level experts and a cross-domain expert, rather than between fine, base, and coarse conceptual partitions. The paper explicitly notes that its own formulation does not use the phrase multi-granularity experts.

A broader reinterpretation appears in accented speech recognition. “Mixture of LoRA Experts with Multi-Modal and Multi-Granularity LLM Generative Error Correction for Accented Speech Recognition” proposes a three-stage pipeline that the provided analysis explicitly reinterprets as a MECL framework (Mu et al., 12 Jul 2025). In that reading, the experts are mono-accent LoRA modules, the collaboration mechanism is HDMoLE with hierarchical routing and dynamic thresholds, and the granularities are both modality granularity and linguistic granularity. The third stage uses N-best word-level and phoneme-level hypotheses as a multi-granularity GER, with reported ablations showing Words only $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$6 at WER 2.29%, Phonemes only $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$7 at WER 2.41%, and Words + phonemes $$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$8 at WER 2.07% (Mu et al., 12 Jul 2025). Because the paper itself does not name this system MECL, this connection is best read as an interpretive extension rather than a terminological equivalence.

This suggests a broader research pattern: MECL-like systems differ in whether experts are defined by domain, accent, concept resolution, or modality, but they repeatedly combine two ingredients—specialization and collaboration. In the MGCE formulation the collaboration is prototype alignment across granularities; in DG-ReID it is meta-learning plus EMA aggregation; in accented ASR it is routing and cross-granularity fusion. That commonality is an inference from the cited works rather than a shared author-defined doctrine.

6. Empirical behavior, misconceptions, and limitations

The empirical evidence reported for the MGCE formulation indicates that MECL contributes at two levels: simply adding multiple granularities helps, and adding explicit collaboration helps further (Zheng et al., 30 Sep 2025). In the ablation study, introducing multi-expert conceptual learning without collaborative learning improves over the single-expert variant by +2.6% All ACC and +3.3% New ACC. Adding the full collaborative learning component on top yields a further +0.9% All ACC and +1.2% New ACC. On small-scale fine-grained datasets in the known-$$k_{\text{nn}}^2 = k_{\text{nn}}^1 \cdot \mathcal{R},$$9 setting, the paper reports average All ACC improving from 49.0 for DCCL to 58.4 for MGCE, and average New ACC improving from 46.3 to 54.9. On large-scale fine-grained datasets, reported All ACC gains include 32.0 → 45.3 on Herbarium19, 36.3 → 49.7 on NABirds, and 22.8 → 30.5 on Reptilia (Zheng et al., 30 Sep 2025).

The earlier DG-ReID MECL also reports substantial gains, but in a different task formulation (YU et al., 2021). With a ResNet50-IBN backbone, the reported averages are 36.9 mAP / 51.6 top-1 for the MDE baseline and 43.4 mAP / 59.2 top-1 for MECL. With an SNR backbone, the reported averages are 34.9 mAP / 51.5 top-1 for SNR and 44.5 mAP / 60.9 top-1 for SNR + MECL. These results support the idea that collaborative expert training can improve generalization even when the collaboration is not formulated in terms of granularity.

Two misconceptions recur. First, MECL is not a single fixed algorithm across the literature. The acronym names at least two distinct frameworks, and one additional paper uses it only as an interpretive lens. Second, in the MGCE paper, multi-granularity does not refer to multimodality or to transformer depth; it refers specifically to different semantic or graph resolutions induced by different values of $$k_{\text{nn}}^3 = \frac{k_{\text{nn}}^1}{\mathcal{R}},$$0 in Semi-Infomap (Zheng et al., 30 Sep 2025).

The reported limitations are correspondingly context-dependent. In MGCE, gains depend on the existence of meaningful hierarchical structure; on generic datasets such as CIFAR-100 or ImageNet-100, improvements over strong baselines are smaller. Performance is also sensitive to the quality of dynamically discovered concepts; if Semi-Infomap fails because of extreme intra-class variance or noisy features, the benefit of multi-granularity may diminish (Zheng et al., 30 Sep 2025). In the DG-ReID framework, the main limitation is training cost: memory consumption and training time grow with the number of source domains because the method trains $$k_{\text{nn}}^3 = \frac{k_{\text{nn}}^1}{\mathcal{R}},$$1 full backbone networks plus a universal expert, even though inference uses only the universal expert (YU et al., 2021). Natural extensions proposed in the MGCE discussion include more than three experts, alternative alignment strategies such as graph matching or mutual information maximization, multimodal GCD, and related open-world discovery tasks (Zheng et al., 30 Sep 2025).

Across these formulations, MECL is best understood not as a single model family but as a research motif: explicit expert decomposition plus a mechanism that makes those experts agree, distill into one another, or route among one another. In the most literal and technically developed sense of the term, however, MECL denotes the multi-expert, multi-granularity conceptual module inside MGCE, where fine, base, and coarse experts are jointly optimized through concept-level contrastive learning and alignment-based cross-expert consistency (Zheng et al., 30 Sep 2025).