SCM-ReID: GAN-based Domain Adaptation

• SCM-ReID is a framework that combines GAN-based image translation and IQA reweighting to address appearance variations in cross-domain person re-identification.
• IQAGA utilizes StarGAN for style adaptation and a ResNet-50 backbone with IQA-weighted loss to achieve 32–36% mAP improvements on benchmarks like Market→Duke.
• DAPRH builds on IQAGA by integrating domain-invariant mapping, Vision Transformer-based holistic features, and pseudo-label refinement to boost mAP to over 70% on Market→Duke.

Person re-identification (ReID) under domain shift is a principal challenge for intelligent surveillance, primarily due to appearance variations and domain discrepancies between cameras or datasets. IQAGA (Image Quality–driven GAN Augmentation) and DAPRH (GAN Augmentation + Pseudo-Label Refinement + Holistic features) are two advanced unsupervised domain adaptation (UDA) methods that integrate generative augmentation, domain adaptation, and discriminative learning to improve cross-domain ReID performance. Both methods leverage StarGAN-based image translation, but they differ in their domain alignment and target-domain learning strategies, achieving substantial gains in mAP and Rank-1 accuracy compared to prior UDA approaches (Pham et al., 4 Jan 2026).

1. Architectural Overview and Workflow

1.1 IQAGA

IQAGA adopts a two-stage workflow:

• Stage I (Image-Level Adaptation): StarGAN is trained to translate source images $x_s$ into $C_t$ target camera styles $c$ by optimizing adversarial loss ($L_{adv}$), domain classification ($L_{cls}$), cycle reconstruction ($L_{rec}$), identity mapping ($L_{idt}$), and identity-preserving color loss ($L_{pid}$). For each $x_s$, $C_t$ style-transferred images are generated and combined with the original source set to form $C_t$0.
• Stage II (Supervised Training on Source): A ResNet-50 backbone extracts 2048-dimensional features. Supervised learning is performed using cross-entropy ($C_t$1) and triplet loss ($C_t$2), with sample-level reweighting based on normalized image quality assessment (IQA) scores $C_t$3. The IQA-weighted loss ($C_t$4) increases the contribution of high-quality samples.

1.2 DAPRH

DAPRH extends IQAGA with additional target-side adaptation modules:

• Stage I (Source Training): StarGAN-based augmentation is used, but only a fraction $C_t$5 of real:GAN images per batch (e.g., 4:1) are included to reduce GAN-induced noise. A domain-invariant mapping (DIM) module employs adversarial training between a domain classifier $C_t$6 and the feature extractor $C_t$7 to learn domain-confused features.
• Stage II (Target Unsupervised Training): Unlabeled target features are extracted and clustered (DBSCAN) to assign pseudo-labels $C_t$8. Enhanced queries $C_t$9 are generated through a Vision Transformer (ViT), integrating global (CLS token) and top-K local features. Pseudo-label refinement (CRL) updates labels with soft cluster probabilities and silhouette scores. Further, a teacher-student framework with EMA parameter transfer, camera-aware proxies (CAP), and contrastive objectives are employed for robust target learning.

2. Loss Functions and Optimization

2.1 IQAGA Losses

• StarGAN Generator Loss:

$c$0

• Discriminator Loss:

$c$1

• Source Training Loss:

For each sample, $c$2 with $c$3; $c$4 Total loss: $c$5

2.2 DAPRH Losses

• Domain-Invariant Mapping:

$c$6

$c$7

• Target Unsupervised Loss:
  • $c$9: Instance-to-cluster contrastive loss
  • $L_{adv}$0: Camera-aware contrastive loss
  • $L_{adv}$1: KL divergence loss between Teacher and Student
  • $L_{adv}$2: Soft triplet loss on features

3. Role of Pseudo-Labeling and Refinement

• IQAGA: Does not use pseudo-labels in its training; adaptation is achieved exclusively by GAN-based augmentation and IQA reweighting.
• DAPRH: Applies clustering (DBSCAN) to infer hard pseudo-labels, which are then refined using cluster soft probabilities $L_{adv}$3 (based on distance to cluster centers), silhouette scores for filtering, and label smoothing: $L_{adv}$4. The pseudo-label refinement is iteratively applied each epoch, with a Teacher-Student model facilitating stable target learning.

4. Integration of Domain-Invariant and Holistic Feature Modules

• IQAGA: Does not incorporate domain-invariant mapping or holistic features.
• DAPRH: Uses a domain classifier $L_{adv}$5 for adversarial domain confusion during source training. During target training, features are enhanced via ViT-based holistic representations, incorporating both global and local spatial tokens. Further, CAP (camera-aware proxies) decomposes clusters by camera, and contrastive losses are employed at both cluster and camera levels.

5. Training Protocols and Hyperparameters

IQAGA

• GAN Augmentation: StarGAN trained with Adam ($L_{adv}$6, $L_{adv}$7, $L_{adv}$8, $L_{adv}$9, $L_{cls}$0), batch size 16.
• Supervised Training: ResNet-50 pretrained on ImageNet, Adam ($L_{cls}$1, reduced by 0.1 at epochs 40,70), batch size 128 (16 IDs × 8 images), 120 epochs, triplet margin $L_{cls}$2, IQA reweighting $L_{cls}$3.

DAPRH

• GAN Augmentation: Same as IQAGA.
• Source & DIM: Batch size 128 (16 IDs × 8 images), $L_{cls}$4.
• Target Training: DBSCAN $L_{cls}$5 (Market), minPts=8 (Market), 16 (MSMT), top-K local tokens $L_{cls}$6 (top 40%), $L_{cls}$7, $L_{cls}$8, $L_{cls}$9, $L_{rec}$0, EMA momentum $L_{rec}$1, 50–80 epochs, SGD $L_{rec}$2.

6. Empirical Results and Comparative Analysis

Below are reported results on key cross-domain benchmarks, measuring mean Average Precision (mAP) and Rank-1 accuracy.

Method/Stage	Market→Duke (mAP / R1)	Duke→Market (mAP / R1)	Market→MSMT (mAP / R1)	Duke→MSMT (mAP / R1)
Baseline (ce+triplet)	25.8% / 43.7%	26.2% / 55.3%	–	–
+GAN only	31.5% / 54.2%	35.1% / 68.6%	–	–
+GAN+IQA (IQAGA final)	32.1% / 55.5%	36.3% / 70.2%	–	–
+GAN+DIM	35.4% / 58.2%	–	–	–
DAPRH final	72.0% / 83.7%	85.9% / 94.4%	35.8% / 64.8%	36.0% / 65.5%

GAN augmentation alone yields strong improvements over the baseline, with IQA-driven weighting (IQAGA) giving further 1% mAP gains. In DAPRH, the inclusion of holistic features, camera-aware proxies, CRL, and EMA achieves major additional improvements (e.g., 72.0% mAP Market→Duke). DAPRH narrows the gap to fully supervised methods (where SOTA achieves 98%+ locally) and surpasses earlier UDA results, which capped at ≤40 mAP on MSMT and ≤80 mAP on Market/Duke (Pham et al., 4 Jan 2026).

7. Qualitative Insights and Contributions

• GAN augmentation provides the largest early-stage gains in both methods, while DIM is computationally cheaper but less impactful alone.
• Additive combination of holistic representations (EIR/ViT backbone), camera-aware proxies, CRL, and Teacher-Student learning provides +2–4 mAP gains independently, with their combination yielding a further improvement of +1–2 mAP.
• Key hyperparameters such as $L_{rec}$3 (label smoothing), $L_{rec}$4 (CAP loss weight), and top-K local ratio exhibit optimal ranges: $L_{rec}$5–$L_{rec}$6, $L_{rec}$7, and top-K $L_{rec}$8.
• IQAGA demonstrates how simple GAN+IQA weighting yields a 32–36% mAP on Market→Duke, outperforming previous GAN-based UDA by 1–3 mAP. DAPRH, through integration of style-transfer, domain-alignment, advanced feature compositions, and robust pseudo-label refinement, achieves >70 mAP on Market→Duke and >85 mAP on Duke→Market (Pham et al., 4 Jan 2026).

The performance and methodology of IQAGA and DAPRH highlight that combining generative augmentation, domain-aligned representation learning, and sophisticated pseudo-labeling can bridge much of the cross-domain gap for ReID without requiring target-domain labels.