Tag Guidance Module (TGM)

• Tag Guidance Module (TGM) is a family of mechanisms that inject semantic, task, or structural side-information into models to reduce ambiguity and improve performance.
• It acts as a structured augmentation tool during training without extra inference cost, as evidenced by improvements in robotic manipulation, image compression, and virtual try-on.
• TGM applications yield tangible gains, such as higher success rates in manipulation and enhanced semantic fidelity in generative tasks like image compression and captioning.

to=arxiv_search.search qq的天天中彩票 еиҭеиҳәеитjson {"^^^^^^^^3query3 Guidance Module\"^^^^^^^^3 OR ti:TGM OR abs:\3^^^^^^^^"Tag Guidance Module\"","max_results":^^^^3all:\3query3^^^^,"sort_by":"submittedDate","sort_order":"descending"} to=arxiv_search.search 天天彩票提现json {"^^^^^^^^3query3 OR id:(&&&^^^^3all:\3^^^^&&&) OR id:(&&&^^^^3 OR ti:TGM OR abs:\3^^^^&&&) OR id:(Chen et al., 2017)","max_results":^^^^3all:\3query3^^^^,"sort_by":"relevance","sort_order":"descending"} Tag Guidance Module (TGM) is a non-standard, context-dependent term in recent machine learning literature. In the papers surveyed here, it denotes several distinct guidance mechanisms that inject semantic, task, or structural side information into learning or inference: task-guided mixup for robotic manipulation, semantic tag conditioning for diffusion-based image compression, texture-guided latent diffusion for virtual try-on, handbook-guided tag generation for recommendation, and latent-topic guidance for video captioning (&&&^^^^3query3^^^^&&&, &&&^^^^3all:\3^^^^&&&, &&&^^^^3 OR ti:TGM OR abs:\3^^^^&&&, Chen et al., 23 Mar 2026, Chen et al., 2017).

^^^^3all:\3^^^^. Scope, terminology, and principal usages

The term is best understood as a family resemblance rather than a single canonical architecture. Across the literature considered here, TGM names modules that guide a model toward semantically relevant content, suppress ambiguity, or reshape supervision so that the model emphasizes task-consistent structure.

Context	Mechanism denoted by TGM	Representative paper
Robotic manipulation	Task-guided mixup over point clouds and action heatmaps	(&&&^^^^3query3^^^^&&&)
Generative image compression	Image-level tag conditioning for a diffusion decoder	(&&&^^^^3all:\3^^^^&&&)
Personalized virtual try-on	Texture Guidance Module in a two-stage try-on pipeline	(&&&^^^^3 OR ti:TGM OR abs:\3^^^^&&&)
Recommendation and captioning	Handbook-guided tag extraction or latent-topic guidance	(Chen et al., 23 Mar 2026, Chen et al., 2017)
Temporal graph ML	Temporal Graph Modelling, an unrelated library name	(&&&^^^^3all:\3^^^^4&&&)

This multiplicity matters because identically named or similarly abbreviated components solve different technical problems. In some cases TGM is a training-time augmentation mechanism; in others it is a decoder-side conditioning pathway, a latent diffusion conditioning module, or a structured prompting-and-distillation system. The acronym is therefore polysemous even within adjacent arXiv domains.

^^^^3 OR ti:TGM OR abs:\3^^^^. Task-guided mixup in robotic manipulation

In TGM-VLA, TGM is the paper’s name for a task-guided mixup strategy designed for 3D vision-language-action learning. Its motivation is twofold. First, RLBench-style pipelines are often trained on simplified scenes containing only task-relevant objects, which encourages over-reliance on visual shortcuts and weak use of language instructions. Second, some manipulation problems are intrinsically multi-modal or multi-goal, so a single deterministic action target creates conflicting supervision. The method addresses distractors, scene clutter, and multi-solution ambiguity by operating directly at the point-cloud and action-heatmap level, where heatmaps can represent multiple plausible targets as multiple peaks (&&&^^^^3query3^^^^&&&).

The mechanism has two variants. In intra-task mixup, two samples with the same language instruction PRESERVED_PLACEHOLDER_^^^^3query3^^^^ are fused by concatenating their point clouds and summing their heatmaps:

PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^

This changes the supervision into a multi-peak heatmap and forces the model to treat the instruction as mapping to a set-valued, multi-modal action space. In cross-task mixup, point clouds from different tasks are concatenated but only the heatmap for the current instruction is retained:

PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^

This simulates cluttered scenes with task-irrelevant objects and explicitly teaches instruction-guided distractor suppression.

TGM sits inside a larger 3D VLA pipeline that maps $(\mathcal{P}, \mathcal{L}) \rightarrow \mathcal{A}$, where the action output is

$\mathcal{A}=(\mathbf{T}, s, c),$

with $\mathbf{T} \in SE(3)$ the 6-DoF pose, $s \in \{0,1\}$ the gripper state, and $c \in \{0,1\}$ the collision-avoidance flag. Multi-camera point clouds are orthographically projected into multi-view images; a color inversion branch produces inverted-color views to improve contrast on dark objects; SAM^^^^3 OR ti:TGM OR abs:\3^^^^ encodes the views; CLIP encodes the language; a multi-view Transformer with cross-attention fuses the features; an upsampling head predicts orthogonal ^^^^3 OR ti:TGM OR abs:\3^^^^D action heatmaps; and the highest-scoring region is back-projected to 3D for refinement. TGM changes the training distribution rather than the inference pipeline, and the paper states that there is no extra inference cost from the module.

The reported gains are substantial. On RLBench, full TGM-VLA reaches a 9^^^^3query3^^^^.5% average success rate, compared with 88.^^^^3 OR ti:TGM OR abs:\3^^^^% without CTM and 88.8% without ITM. On real-robot evaluation, the distractor setting improves from 4^^^^3query3^^^^% without TGM to 9^^^^3query3^^^^% with TGM-VLA, and the background setting improves from 6^^^^3query3^^^^% to 8^^^^3query3^^^^%. On COLOSSEUM, TGM-VLA achieves 68.8% average success rate and ^^^^3all:\3^^^^.^^^^3all:\3 average rank, reported as the best among compared methods. These results support the intended interpretation of TGM as a structured augmentation and supervision device for distractor robustness and multi-goal learning.

3. Semantic tag conditioning in generative image compression

In Diff-ICMH, TGM is a decoder-side semantic control mechanism for learned image compression. The surrounding problem is a dual objective: reconstructed images should be realistic and visually pleasing for human perception, while also preserving the semantic information required by downstream machine tasks such as detection, segmentation, retrieval, and MLLM-based understanding. The paper’s diagnosis is that signal-fidelity-oriented codecs can preserve PSNR or SSIM while losing object identity or task-critical structure, whereas purely generative codecs can produce plausible images that drift semantically. TGM is introduced to reduce this semantic ambiguity by injecting explicit image-level tags into a pre-trained diffusion model (&&&^^^^3all:\3^^^^&&&).

The tags are extracted with RAM++, whose default vocabulary contains 4585 tags. For simplicity, tags are encoded with fixed-length IDs rather than entropy coding; each tag ID uses ^^^^3all:\33^^^^ bits, allowing up to 8^^^^3all:\3query3 OR ti:TGM OR abs:\3^^^^ tags. On 5^^^^3query3query3^^^^ sampled COCO images, the average number of predicted tags is 8.7 tags/image, yielding an average overhead of

$13 \times 8.7 = 113.1 \text{ bits/image}.$

The appendix states that the extracted tags $\mathbf{c}$ are injected as text prompts into both the control module and the diffusion model itself, so the tags act as a conditioning signal rather than passive metadata.

The compression framework is organized around a VAE latent space and a pre-trained diffusion prior. Distortion is computed in latent space:

PRESERVED_PLACEHOLDER_^^^^3all:\3query3^^^^

The control module is adapted from ControlNet by replacing the initial three stride-^^^^3 OR ti:TGM OR abs:\3^^^^ convolutions with a single stride-^^^^3all:\3^^^^ convolution to match the dimensionality of PRESERVED_PLACEHOLDER_^^^^3all:\3all:\3^^^^, and by using bilateral feature injection through zero-convolutions from both the encoder and decoder pathways. A Semantic Consistency loss is used to align semantic features extracted from clean latent features PRESERVED_PLACEHOLDER_^^^^3all:\3 OR ti:TGM OR abs:\3^^^^ and reconstructed latent features PRESERVED_PLACEHOLDER_^^^^3all:\33^^^^; a noisy-input variant adds the same noise to both paths at timestep PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^4, with PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^5 corresponding to the full ^^^^3all:\3query3query3query3^^^^-step noising process. The ablation training setting reported in the appendix uses LSDIR, batch size 8, 8^^^^3query3^^^^,^^^^3query3query3query3^^^^ total iterations, and learning rate PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^6.

TGM’s functional role is to trade a small semantic side-information cost for improved semantic fidelity and perceptual realism. Because the tags are generic image-level semantic descriptors rather than task-specific features, the paper argues that they help support multiple downstream tasks through a single codec and bitstream without task-specific adaptation. The enumerated tasks include object detection, instance segmentation, pose estimation, panoptic segmentation, image-text retrieval, referring expression comprehension, open-set segmentation, and MLLM-based understanding.

4. Texture guidance in personalized virtual try-on

In PE-VITON, TGM denotes the Texture Guidance Module, the second stage of a two-stage personalized virtual try-on system. The pipeline decouples garment attributes into shape and texture. The first stage, the Shape Control Module (SCM), predicts a target clothing segmentation PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^7 that aligns garment shape with the target pose. The second stage, TGM, uses that structure plus a clothing texture condition to generate the final try-on image with realistic garment texture, folds, shadows, and boundary details (&&&^^^^3 OR ti:TGM OR abs:\3^^^^&&&).

The module’s inputs are the source human image PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^8, the target shape garment PRESERVED_PLACEHOLDER_^^^^3all:\3^^^^9, and the target texture garment PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3query3^^^^, and the desired output is the final try-on image PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3all:\3^^^^. At test time, TGM receives the stitched image PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3 OR ti:TGM OR abs:\3^^^^, built from the SCM segmentation result and the human head, together with the texture condition PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\33^^^^. The stitching equation is given as

PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^4

This preserves identity information from the source person while replacing the clothing area with shape-controlled segmentation.

A central design choice is that garment texture is not copied pixelwise. Instead, the clothing image is parsed into a one-dimensional conditional embedding using CLIP features, RAT blocks, and layer normalization:

PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^5

The paper states that averaging is used to balance texture influence between upper and lower garments and to ensure reasonable texture distribution at garment junctions. The diffusion backbone then uses this conditioning to generate texture in a controlled latent-space direction.

TGM is formulated as a conditional latent diffusion decoder. The forward process is

PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^6

and the reverse process is presented in DDPM-style form using a predicted noise term PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^7. The conditioning sources are structural conditioning through PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^8, texture conditioning through the CLIP-based semantic embedding, mask conditioning, and two pretrained components: CLIP for semantic extraction and Stable Diffusion as the generative backbone.

Within the paper’s problem formulation, TGM is the component that addresses unclear texture styles, blurred clothing edges, weak reduction of clothing folds, poor generation effect under complex human posture, and artifacts near garment-body boundaries. The module is trained in the setting where the target shape garment and texture garment are the same garment, so the model learns to reconstruct the original person-clothing image under matched shape and texture conditions. This establishes TGM as a semantic texture-rendering stage rather than a geometric warping stage.

5. Handbook- and topic-guided generation in recommendation and captioning

A closely related use of TGM appears in note recommendation and video captioning, where the shared idea is to constrain open-ended generation with structured semantic intermediates. In TagLLM, there is no component explicitly named TGM, but the paper states that the guidance mechanism is implemented through the User Interest Handbook plus the multimodal CoT Extraction prompt pipeline. Notes are grouped into ^^^^3all:\3^^^^8 categories—Shoes, Dressing, Sports, Beauty, Digit, Fitness, Home, Toys, Food, Lifestyle, Entertainment, Education, Travel, Media, Dance, Game, Pets, and Arts—and each category receives a handbook describing the dimensions that matter to users. The multimodal input comprises images, sampled video frames, title, body text, associated product descriptions, and audio transcribed by SenseVoice and post-corrected by an LLM. The extraction process proceeds through Handbook-Based Generate, Low-Info Tag Merge, Importance Rank, and a final review step. The merge stage removes low-information, irrelevant, trivial, or inconsistent tags, and the ranking stage assigns importance scores from ^^^^3all:\3^^^^ to 5. The generated behavior is then transferred to smaller models through SFT followed by DPO-based Tag Knowledge Distillation. Reported online A/B gains for the full TagLLM system are +^^^^3query3^^^^.3^^^^3all:\3 AVDU, +^^^^3query3^^^^.96% AIU, +^^^^3query3^^^^.^^^^3all:\3 GMV, +^^^^3query3^^^^.^^^^3query3 UVCTR, and +^^^^3query3^^^^.^^^^3 OR ti:TGM OR abs:\3all:\3^^^^% VCU, with cold-start gains of +3^^^^3 OR ti:TGM OR abs:\3^^^^.37% PVCTR and +46.9^^^^3all:\3^^^^% PVIR (Chen et al., 23 Mar 2026).

In open-domain video captioning, MM TGM uses multimodal latent topics as guidance for caption generation. The method mines teacher topic distributions in an unsupervised manner with weighted kernel K-means over textual and visual features, using weight ^^^^3all:\3^^^^ for textual features and ^^^^3query3^^^^.^^^^3 OR ti:TGM OR abs:\3^^^^ for visual features. A student topic predictor, implemented as a two-layer perceptron, is trained to predict these latent topics from multimodal video contents. Caption generation is then treated as a mixture over topic variables, and the decoder is made topic-aware by replacing fixed LSTM weight matrices with topic-conditioned mixtures of topic-specific matrices. To control parameter growth, the topic-specific tensor is factorized as

PRESERVED_PLACEHOLDER_^^^^3 OR ti:TGM OR abs:\3^^^^9

The full model is trained with a joint loss combining caption loss and topic loss:

$(\mathcal{P}, \mathcal{L}) \rightarrow \mathcal{A}$^^^^3query3^^^^

On MSR-VTT, predicted multimodal latent topics improve CIDEr from 46.^^^^3query3^^^^6 for the vanilla model to 48.5^^^^3query3^^^^, and MM TGM further reaches 49.^^^^3 OR ti:TGM OR abs:\3^^^^6. On Youtube^^^^3 OR ti:TGM OR abs:\3^^^^Text, vanilla CIDEr rises from 7^^^^3 OR ti:TGM OR abs:\3^^^^.^^^^3all:\3 OR ti:TGM OR abs:\3^^^^ to 79.57 with predicted multimodal latent topics and to 8^^^^3query3^^^^.45 with MM TGM. In cross-dataset generalization from MSR-VTT to Youtube^^^^3 OR ti:TGM OR abs:\3^^^^Text, CIDEr improves from 5^^^^3all:\3^^^^.^^^^3query3 OR ti:TGM OR abs:\3^^^^ for vanilla to 55.39 for MM TGM (Chen et al., 2017).

These two lines of work show that TGM-like mechanisms can be implemented either as prompt-level structured guidance with handbook-defined dimensions or as latent-topic bottlenecks learned from multimodal data. In both cases, the module narrows the semantic space before final generation.

6. Disambiguation, related acronyms, and broader significance

Not every use of the acronym TGM refers to a guidance module. In temporal graph machine learning, TGM means Temporal Graph Modelling, a research-oriented library that unifies continuous-time dynamic graphs and discrete-time dynamic graphs. The library provides native support for dynamic node features, time-granularity conversions, and link-, node-, and graph-level tasks, and reports an average 7.8× speedup over DyGLib together with an average ^^^^3all:\3^^^^75× speedup on graph discretization (&&&^^^^3all:\3^^^^4&&&).

Closely related but distinct acronyms also appear in adjacent work. TAG can denote Target-Agnostic Guidance for vision-language-action policies, where the policy is evaluated on original and target-agnostic observations and the difference is used as a residual steering signal; Tangential Amplifying Guidance for diffusion sampling, where tangential components of the update are amplified to improve hallucination resistance; or a guidance-free open-vocabulary semantic segmentation pipeline that uses retrieval-based category assignment rather than user-provided text queries (&&&^^^^3 OR ti:TGM OR abs:\3all:\3^^^^&&&, &&&^^^^3 OR ti:TGM OR abs:\3 OR ti:TGM OR abs:\3^^^^&&&, &&&^^^^3 OR ti:TGM OR abs:\33^^^^&&&).

This suggests that the shared intellectual pattern behind TGM- and TAG-style methods is not a fixed architecture but a recurrent design principle: ambiguity is reduced by introducing an auxiliary semantic structure that a base model would otherwise treat only implicitly. Depending on the domain, that structure may be an instruction-conditioned mixup rule, image-level tags, garment texture embeddings, handbook-defined user-interest dimensions, latent topic distributions, or retrieved category names. The resulting modules differ substantially in implementation, yet they occupy a common methodological role as guidance mechanisms for semantically stable prediction or generation.