---
title: 'LReID-Hybrid: Lifelong Person ReID'
url: https://www.emergentmind.com/topics/lreid-hybrid-task
type: topic
---

# LReID-Hybrid: Lifelong Person ReID

LReID-Hybrid denotes lifelong person re-identification with hybrid clothing states, a continual ReID setting in which a model learns from a sequence of domains that may be either same-cloth (SC) or cloth-changing (CC), while preserving performance on previously seen domains and generalizing to unseen ones. In the formulation introduced for this task, the learner receives only the current domain at each step, cannot rely on data replay, and must cope simultaneously with catastrophic forgetting and clothing-state variation. The central methodological theme across the literature is that SC and CC domains induce mismatched supervision signals and representation biases, so effective systems increasingly use cross-modal structure—especially text-space alignment, prompt learning, prototype accumulation, or distribution rehearsal—to bridge old and new domains without storing raw historical images [2405.16600].

## 1. Formal problem setting

A standard formulation considers a sequence of ReID domains
$$
\mathcal D = \bigl\{\mathcal D^{(1)}, \mathcal D^{(2)}, \ldots, \mathcal D^{(T)}\bigr\},
$$
where each domain
$$
\mathcal D^{(t)}=\{(x_i^{(t)},y_i^{(t)})\}_{i=1}^{N_{\rm img}^{(t)}}
$$
is either a Same-Cloth domain, in which every identity wears a single clothing style across camera views, or a Cloth-Changing domain, in which identities may appear in different outfits. At step $t$, the model has access only to $\mathcal D_{\rm train}^{(t)}$, updates the image encoder from $\mathcal G_{t-1}$ to $\mathcal G_t$, and is evaluated after the final step on all seen domains $\{\mathcal D_{\rm test}^{(t)}\}_{t=1}^T$ as well as unseen domains $\{\mathcal D_{\rm test}^{(u)}\}_{u=1}^U$ [2405.16600].

A later CLIP-based formulation expresses the same objective with explicit clothing-state labels. At stage $t$, the model observes
$$
D_{t} = \{(I_{i}^{t}, y_{i}^{t}, s_{i}^{t})\}_{i=1}^{N_{t}},
$$
where $s_i^t\in\{\text{SC},\text{CC}\}$, and updates $\Theta^{t-1}$ to $\Theta^t$ while maintaining retrieval performance on all previously seen domains. Evaluation is reported as SC-Average, CC-Average, and Total-Average in terms of mean Average Precision (mAP) and Rank-1 [2509.11247].

This task should be distinguished from conventional CCReID and from standard LReID. CCReID isolates clothing change as a standalone retrieval problem; LReID emphasizes continual adaptation across domains; LReID-Hybrid makes both factors active at once. A plausible implication is that anti-forgetting mechanisms that work for same-cloth streams may fail when the incoming domain changes the semantic status of apparel cues.

## 2. Why hybrid clothing states are difficult

The original motivation for LReID-Hybrid is that existing LReID studies accumulate knowledge with the assumption that people would not change their clothes, whereas practical surveillance systems contain both cloth-consistent and cloth-changing domains [2405.16600]. Two failure modes are emphasized: **knowledge granularity mismatch** and **knowledge presentation mismatch**. In SC data, clothing often behaves as a stable identity cue; in CC data, the same cue becomes unreliable or even misleading. As a result, the model must preserve identity information while dynamically reweighting clothing-sensitive and clothing-invariant evidence.

The multimodal literature around person retrieval makes the same tension visible from another angle. Instruct-ReID treats “traditional ReID,” “clothes-changing,” “visible–infrared,” “text-to-image,” and “language-instructed” ReID as special cases of a unified instruction-driven retrieval problem, where a query image or template is fused with an instruction and matched against a gallery. The accompanying OmniReID benchmark aggregates twelve public datasets across six formulations and yields approximately $4.97$M training images of $328$k identities, with evaluation on held-out test splits without fine-tuning [2306.07520]. This suggests that clothing-state variation is not an isolated nuisance factor but one axis of a broader instruction-conditioned retrieval space.

A common misconception is that “hybrid” here refers only to multimodal input. In the LReID-Hybrid literature, the primary meaning is the coexistence of SC and CC domains in a lifelong stream. Multimodality becomes important because text space, prompts, or image–text alignment can provide a more stable intermediate representation than raw appearance alone.

## 3. Teata and the “image-text-image” closed loop

The first dedicated framework for LReID-Hybrid is *Teata*, which uses the consistency and generalization of the text space to align, transfer, and accumulate knowledge in an “image-text-image” closed loop [2405.16600]. Its optimization objective is written as
$$
\min_{\mathcal G_1,\dots,\mathcal G_T} \sum_{t=1}^T \Bigl[ \mathcal L_{\rm stage1}^{(t)}(\mathcal G_{t-1},\mathcal T,\Theta_{\rm prompt}) + \mathcal L_{\rm stage2}^{(t)}(\mathcal G_t,\mathcal T,\Theta_{\rm prompt}) \Bigr],
$$
subject to “no data replay,” with a frozen CLIP text encoder $\mathcal T$ and prompt parameters $\Theta_{\rm prompt}$ carried forward across tasks.

Stage 1 is **Structured Semantic Prompt learning**. For each identity $j$ in domain $t$, Teata constructs
$$
P_j^{(t)}
=\bigl[\text{"A photo of a"}\bigr]\;\bigl[X_1\,Y_1\bigr]\;\bigl[X_2\,Y_2\bigr]\cdots \bigl[X_M\,Y_M\bigr]\;\bigl[\text{"person."}\bigr],
$$
where the $Y_m$ are shared tokens and the $X_m$ are specific tokens. The previous image encoder $\mathcal G_{t-1}$ and the CLIP text encoder are frozen, and symmetric image-to-text and text-to-image contrastive losses align image features $f_i^{I,(t)}$ and prompt-derived text features $f_j^{T,(t)}$. During this stage, only the prompt tokens are updated.

Stage 2 is **Knowledge Adaptation and Projection**. The text embeddings become identity-level semantic prototypes, are L2-normalized, and are then adapted by a slow-paced learner while the image encoder is updated. Training uses projection-based ID loss, adapted-text distillation loss, image-space ID loss, and triplet loss, combined as
$$
\mathcal L_{\rm stage2}^{(t)}
= \lambda_1\,\mathcal L_{\rm proj}
+\lambda_2\,\bigl(\mathcal L_{\rm id}^b + \mathcal L_{\rm id}\bigr)
+\lambda_3\,\bigl(\mathcal L_{\rm tri}^b + \mathcal L_{\rm tri}\bigr),
$$
with $(\lambda_1,\lambda_2,\lambda_3)=(1,\,0.25,\,1)$.

On the LReID-Hybrid stream Market-1501 $\rightarrow$ LTCC $\rightarrow$ MSMT17 $\rightarrow$ PRCC, Teata reports, at the last step, $80.4/92.1$ on Market1501, $20.4/42.1$ on LTCC, $56.3/79.7$ on MSMT17, and $59.5/58.2$ on PRCC in mAP/Rank-1; the seen-domain SC average is $68.4/85.9$ and the CC average is $40.0/50.2$. On unseen domains, it reports $84.0/82.6$ on CUHK01, $77.0/75.3$ on CUHK02, $49.6/41.6$ on GRID, $62.5/54.2$ on SenseReID, $73.8/65.0$ on PRID, $41.0/40.2$ on VC-Clothes, and $17.7/35.3$ on Celeb-reID-light [2405.16600].

## 4. Subsequent frameworks and training paradigms

Later work broadens the design space rather than converging on a single solution. *CMLReID* is a CLIP-based framework with two modules: **Context-Aware Semantic Prompt** (CASP) and **Adaptive Knowledge Fusion and Projection** (AKFP). CASP forms contextualized text embeddings from a visual feature, a context encoder, base semantic prompts, and dynamic modulation prompts. AKFP maintains SC and CC prototypes, predicts clothing-state probabilities, and fuses two projection heads into
$$
f_{\mathrm{proj}}
=\hat{s}_{\mathrm{SC}}\,W_{\mathrm{proj}}^{\mathrm{SC}} f_v
+\hat{s}_{\mathrm{CC}}\,W_{\mathrm{proj}}^{\mathrm{CC}} f_v,
$$
trained with a Clothing-State-Aware Projection Loss plus identity and triplet losses. The method does not store raw past images and uses prototypes as compact memory [2509.11247].

*DASK* addresses exemplar-free lifelong ReID through **Distribution Rehearser Learning** and **Distribution Rehearsing-driven LReID Training**. A lightweight AKPNet predicts an instance-specific convolutional kernel $\Psi_t(x)\in\mathbb R^{C\times C\times k\times k}$ from augmented current-domain images and learns to reconstruct the original image with an $\ell_1$ loss. At the next step, the old AKPNet generates old-style images
$$
x_i^* = k_i \,\circledast\, x_i,
$$
which are used jointly with current data under ReID and similarity-knowledge-distillation objectives. DASK reports that, relative to DKP, it improves Seen-Avg by $+3.6\%$ to $+5.8\%$ mAP and UnSeen-Avg by $+6.1\%$ to $+6.5\%$ mAP across two curriculum orders [2412.09224].

*SPRED* extends lifelong ReID into the semi-supervised regime. Its setting uses domains
$$
D_t = (X_t^l,Y_t^l)\;\cup\;X_t^u,
$$
with few labeled images and many unlabeled ones, no replay, and disjoint identities across tasks. The framework introduces learnable identity prototypes, neighbor-prototype pseudo-labeling, old-knowledge aligning–based clustering, new knowledge clustering, and a structure-preserving knowledge-distillation loss
$$
\mathcal L = \mathcal L_{\rm base} + \alpha\,\mathcal L_s.
$$
At a $10\%$ label rate, SPRED reports Seen-Avg/UnSeen-Avg mAP of $43.2/51.7$, compared with $27.7/39.5$ for LSTKC and $37.7/52.5$ for HDC; SPRED$^+$ reports $44.8/47.6$ mAP [2507.01884].

These systems differ in memory assumptions. Teata uses no data replay, CMLReID does not store raw past images, DASK stores no exemplars, and SPRED is also no-replay. The shared pattern is that forgetting is addressed through text prototypes, distribution rehearsal, or prototype evolution rather than historical image buffers.

## 5. Benchmarks, metrics, and empirical patterns

The benchmark introduced with Teata uses four sequential domains: Market-1501 (SC), LTCC (CC), MSMT17 (SC), and PRCC (CC), with four sequential orders; detailed results are reported for Order 1, Market-1501 $\rightarrow$ LTCC $\rightarrow$ MSMT17 $\rightarrow$ PRCC. Metrics are mAP and Rank-1, together with averages over seen SC domains $(\bar s^s_{\rm mAP},\bar s^s_{\rm R1})$, seen CC domains $(\bar s^c_{\rm mAP},\bar s^c_{\rm R1})$, and similarly for unseen domains [2405.16600].

A later formulation reports six different sequences of the four domains and evaluates after each new domain on all seen domains, with final SC-Average, CC-Average, and Total-Average [2509.11247]. Exemplar-free and semi-supervised extensions use different domain streams and therefore are not numerically interchangeable with the original hybrid benchmark, even when they are conceptually relevant [2412.09224][2507.01884].

| Framework | Evaluation setting | Reported outcome |
|---|---|---|
| Teata | Order 1, last step | SC avg $68.4/85.9$, CC avg $40.0/50.2$ |
| CMLReID | Order 1, seen domains | SC avg $59.5/80.5$, CC avg $33.8/40.5$, Total avg $46.7/60.5$ |
| DASK | Two curriculum orders, exemplar-free | Seen-Avg up to $57.1/70.0$, UnSeen-Avg up to $65.5/57.9$ |
| SPRED | Semi-LReID, $10\%$ label rate | Seen-Avg $43.2/54.4$, UnSeen-Avg $51.7/44.6$ |

Several empirical regularities recur. First, cloth-changing performance remains substantially below same-cloth performance. In Teata, seen-domain SC average is $68.4/85.9$, whereas CC average is $40.0/50.2$; in CMLReID, the corresponding figures are $59.5/80.5$ and $33.8/40.5$ [2405.16600][2509.11247]. Second, memory-free or replay-free learning is feasible but typically requires a stronger intermediate structure than plain feature distillation. Third, joint training is not a proxy for lifelong learning: on Teata’s Order 1 table, Joint-Train achieves $79.7/90.8$ on SC average but only $29.7/38.2$ on CC average, whereas Teata achieves $68.4/85.9$ and $40.0/50.2$ respectively [2405.16600]. This suggests that simultaneous access to all data does not automatically resolve clothing-state mismatch.

## 6. Relation to multimodal and instruction-driven person retrieval

The hybrid-clothing-state literature sits within a broader shift toward multimodal person retrieval. Instruct-ReID defines a new task in which a query image or image-template is combined with an instruction that may be a short sentence, a full paragraph, or even another image. Existing six ReID tasks are treated as special cases by designing different instructions, and the baseline combines a frozen ViT image encoder, an instruction encoder, an Editing Transformer, and an adaptive triplet loss that modulates margin by instruction similarity. Its reported multi-task model improves mAP by $+0.5\%$, $+0.6\%$, and $+7.7\%$ on Market1501, MSMT17, and CUHK03 for traditional ReID; $+6.4\%$, $+7.1\%$, and $+11.2\%$ on PRCC, VC-Clothes, and LTCC for clothes-changing ReID; and $+24.9\%$ on COCAS+ real2 for language-instructed ReID [2306.07520].

*MLLMReID* adapts a pretrained multimodal large language model to ReID through a **Common Instruction** and a multi-task synchronization module called **DirectReID**. It uses a LLaMA-2-7B language core, a CLIP ViT-L/14 visual encoder, and a total loss
$$
L_{\mathrm{total}}(\theta)
= \lambda\,L_{\mathrm{instr}}(\theta)
+(1-\lambda)\bigl[L_{\mathrm{ID}}(\theta)+L_{\mathrm{tri}}(\theta)\bigr],
$$
with $\lambda=0.7$. On MSMT17 it reports $76.8\%$ mAP and $90.9\%$ Rank-1, compared with $72.7\%/88.3\%$ for its LLaVA+ReID baseline [2401.13201].

*LLaVA-ReID* introduces **interactive person re-identification (Inter-ReID)**, where retrieval is refined over dialogue rounds. It uses a CLIP dual-stream retriever, a selective visual context module, and a LLaVA-OneVision-Qwen2-7B questioner trained with looking-forward question supervision. On Interactive-PEDES it reports $63.96$ R@1, $84.70$ R@5, $91.27$ R@10, $48.45$ mAP, and $0.719$ BRI, and it improves standard text-to-image ReID backbones such as IRRA and RDE after five rounds of question answering [2504.10174].

These systems do not define LReID-Hybrid in the narrow clothing-state sense, but they clarify why text space, prompt adaptation, and instruction conditioning recur in hybrid lifelong work. A plausible implication is that future LReID-Hybrid systems may further integrate continual learning with instruction-following, dialogue, or MLLM-based semantic compression.

## 7. Limitations and open directions

Reported limitations remain substantial. For Teata, limitations include dependency on the CLIP text encoder, the possibility that fixed prompt length $M$ may not capture arbitrary attribute cardinalities, and the risk that the slow-paced learner may still cause slow drift of old semantics in extremely long task sequences [2405.16600]. For CMLReID, CC performance remains significantly lower than SC performance, reliance on an explicit SC/CC binary classifier may struggle with subtle “partial” clothing changes, and novel domain shifts far away from seen clothing styles may still degrade performance [2509.11247]. For SPRED, distribution alignment assumes color-style shift, prototypes may overfit scarce labels at extremely low label rates, and memory-free clustering adds overhead [2507.01884].

Future directions already proposed in the literature include dynamically growing or pruning prompt slots, multilingual or graph-structured semantic slots, text-to-image generative regularization, multi-level clothing-change quantification beyond binary SC/CC, and lightweight exemplar replay or generative rehearsal [2405.16600][2509.11247]. Taken together, these proposals indicate that LReID-Hybrid is evolving from a narrowly defined continual benchmark into a broader research program on stable identity representation under sequential domain shift, clothing variation, and restricted memory.

Source: https://www.emergentmind.com/topics/lreid-hybrid-task