Semantic-Guided Color Enhancement

• Semantic-Guided Color Enhancement is a family of methods that use high-level semantic cues, such as segmentation maps and text prompts, to guide localized image color adjustments and prevent artifacts.
• These techniques incorporate diverse semantic priors—ranging from named-color probabilities to pseudo-classes—to enhance applications like low-light enhancement, underwater imaging, and colorization.
• They integrate semantic guidance at various stages including feature extraction, objective design, and transform parameterization to achieve improved metrics such as PSNR and SSIM while enhancing visual fidelity.

Semantic-Guided Color Enhancement denotes a family of image enhancement, colorization, retouching, and normalization methods in which color decisions are conditioned on high-level semantic information rather than on global low-level statistics alone. In this literature, semantic guidance has been instantiated as semantic segmentation maps, multi-scale semantic features, pseudo-classes from unsupervised segmentation, named-color probability maps, captions and text prompts, category labels, semantic palettes, and illumination-invariant self-supervised features. The common objective is to prevent context confusion, color shift, edge color bleeding, and semantically implausible corrections by making hue, saturation, tone, or illumination adjustments depend on what a region represents, not only on how it looks photometrically (Wu et al., 2023, Qi et al., 2022, Serrano-Lozano et al., 2024, Zhang et al., 2 Jun 2025, Jian et al., 3 Apr 2026).

1. Historical emergence and problem formulation

Early semantics-aware photo adjustment methods already framed color manipulation as a context-dependent mapping rather than a single global transform. In "Deep Semantics-Aware Photo Adjustment" (Nam et al., 2017), the adjustment is predicted in CIELab as a residual, $\mathbf{y} = \mathbf{x} + \hat{\mathbf{y}}$, where the residual is produced by a bilinear interaction between color features and contextual features. The paper’s central claim is that color adjustment depends jointly on what the pixel color is and where or what the region is, so multiplicative interaction is preferable to purely low-level global modeling (Nam et al., 2017). In parallel, semantic color constancy work used semantic masks to improve illuminant and gamma estimation, explicitly arguing that sky should be blue and grass green when estimating scene illumination (Afifi, 2018).

The same motivation reappeared in automatic colorization. "Pixel-level Semantics Guided Image Colorization" (Zhao et al., 2018) and "Pixelated Semantic Colorization" (Zhao et al., 2019) argued that context confusion and edge color bleeding persist when color is predicted without pixel-level object semantics. "Semantic-driven Colorization" (Ho et al., 2020) made the decomposition explicit: recognize first, then infer plausible colors, then colorize. Its two-stage design used GridNet for semantic segmentation and a modified U-Net for chroma prediction, with Instance Normalization applied only to the gray stream so that semantic feature ranges were preserved (Ho et al., 2020).

From 2022 onward, the same principle was extended from grayscale colorization to RGB enhancement tasks with stronger degradation models. In low-light enhancement, the motivating failure case is that globally and uniformly acting models make a black car gray, oversaturate sky regions, or drift clothing hues; "Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancement" (Wu et al., 2023) therefore introduced semantic priors to constrain feature learning, color statistics, and adversarial realism. In underwater enhancement, "SGUIE-Net" (Qi et al., 2022) used semantic region-wise enhancement because underwater degradations vary by semantic region and rare degradations can be linked to already well-learned ones according to semantic relevance. In ambient lighting normalization, "CANDLE" (Jian et al., 3 Apr 2026) argued that low-level and geometric priors are insufficient when illumination-induced chromatic bias dominates, motivating illumination-invariant semantic priors from DINOv3.

A broad formulation emerges from these works. Given an observed image and a semantic prior, the model predicts either an enhanced image directly, a residual color correction, a palette edit, or an illumination transform. In semantic white balance, the correction is global and diagonal,

$$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$

with $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$, but the regression of $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$ is conditioned on a semantic mask (Afifi, 2018). In semantic palette propagation, the edited color of a pixel is

$$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$

where the weights are semantic-color affinities to palette entries (Zhang et al., 2 Jun 2025). In all cases, semantics alter the feasible color transform.

2. Forms of semantic prior

The literature does not restrict semantic guidance to one representation. Instead, different tasks select priors that best match their control requirements, annotation regime, and degradation model.

Semantic prior	Representative use	Paper
Semantic maps and multi-scale semantic features	Low-light enhancement, underwater enhancement	(Wu et al., 2023, Qi et al., 2022)
Pixel-level class labels or predicted semantic masks	Colorization, semantic white balance	(Zhao et al., 2018, Afifi, 2018)
Pseudo-classes from unsupervised segmentation	Exemplar-based colorization	(Chen et al., 2023)
Named-color probability maps	Learned image enhancement via color naming	(Serrano-Lozano et al., 2024)
Captions, category labels, segmentation masks, text prompts	Diffusion-based colorization and prompt-driven enhancement	(Zabari et al., 2023, Wang et al., 2024, Zhang et al., 11 Mar 2025)
Illumination-invariant self-supervised features	Ambient lighting normalization	(Jian et al., 3 Apr 2026)
Semantic palettes in fused color-semantic space	Local edit propagation	(Zhang et al., 2 Jun 2025)

Segmentation-based priors remain the most common. SKF uses a frozen HRNet segmentation model trained on PASCAL-Context to provide semantic maps and multi-scale intermediate feature maps (Wu et al., 2023). SGUIE-Net obtains semantic maps either by manual annotation or by a pre-trained segmentation network, SUIM-Net, over underwater categories such as fish, reefs, plants, wrecks or ruins, divers, robots, and sea-floor (Qi et al., 2022). Pixel-level semantics guided colorization uses VOC2012 and COCO-stuff labels to couple segmentation and color prediction (Zhao et al., 2018), while semantic white balance appends a single-channel semantic mask as a fourth input channel to an AlexNet-based regressor (Afifi, 2018).

Other lines avoid manual labels. SPColor uses STEGO, an unsupervised semantic segmentation model, to produce pseudo-class maps and confidence maps, then restricts correspondence search to within pseudo-class regions (Chen et al., 2023). NamedCurves bypasses object segmentation entirely and uses the color naming model of Van de Weijer et al. (2009), first producing 11 basic color-name probabilities and then grouping them into six categories: red, green, blue, orange-brown-yellow, pink-purple, and achromatic (Serrano-Lozano et al., 2024). This is semantic in the sense of human-interpretable color categories rather than object identity.

Recent diffusion-based systems broaden semantics further into multimodal conditioning. "Diffusing Colors" (Zabari et al., 2023) uses granular text prompts and a CLIP-based vividness ranking model. "Multimodal Semantic-Aware Automatic Colorization with Diffusion Prior" (Wang et al., 2024) combines categories from EfficientNet, captions from BLIP, and segmentation from Mask Transfiner, injecting text embeddings through cross-attention and segmentation via masked conditioning. TSCnet uses GPT-4o to parse natural-language prompts into target objects and quantitative brightness intent, then couples those parsed semantics to a Retinex-based localization and diffusion pipeline (Zhang et al., 11 Mar 2025). CANDLE replaces explicit masks with DINOv3 features whose patch-wise cosine similarity remains high between colored-light inputs and ambient-lit ground truth, treating that consistency as an illumination-robust semantic prior (Jian et al., 3 Apr 2026).

3. Mechanisms of semantic conditioning

Semantic guidance enters enhancement pipelines at several levels: feature representation, objective design, transform parameterization, and user-facing control.

At the feature level, SKF inserts a semantic-aware embedding module into multiple decoder stages. With image features $F_i^b$ and semantic features $F_s^b$, it computes a transposed-attention map,

$$A^b = \mathrm{Softmax}\!\left(\frac{W_k(F_i^b)\,W_q(F_s^b)}{\sqrt{C}}\right),$$

and then refines features by

$F_o^b = FN\!\big(W_v(F_i^b)A^b + F_i^b\big).$

This cross-modal interaction is intended to produce a semantic-aware feature representation that avoids color drift in semantically coherent areas (Wu et al., 2023). SGUIE-Net uses a different mechanism: a Semantic Region-wise Enhancement Module built on a U-Net extracts multi-scale residual features $\mathcal{R}_k$ for each semantic region $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$0, and a Semantic Guidance Extraction and Fusion module gates cropped global features $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$1 with region attention maps $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$2, yielding $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$3 (Qi et al., 2022).

At the objective level, some systems directly impose semantic consistency on color distributions. SKF’s semantic-guided color histogram loss computes differentiable 256-bin RGB histograms per semantic class after excluding edge pixels, then minimizes an $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$4 distance between class-channel histograms of the enhanced and ground-truth images (Wu et al., 2023). Its semantic-guided adversarial loss further conditions both a global discriminator and a local discriminator on semantic priors, with the local discriminator focusing on the most suspicious class region. SPColor similarly uses semantics to constrain correspondence and then builds a Similarity Masked Perceptual loss, $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$5, so that regions with high-confidence correspondence preserve transferred colors while low-confidence regions receive stronger perceptual regularization (Chen et al., 2023).

At the transform level, semantic priors modulate explicit color operators. NamedCurves predicts a monotonic Bezier tone curve $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$6 for each named color $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$7 and RGB channel $$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$8, then fuses the resulting six branch outputs with thresholded and renormalized named-color probability maps (Serrano-Lozano et al., 2024). Semantic white balance regresses illuminant and gamma from RGB plus semantic mask, then applies a semantically informed global white-balance transform (Afifi, 2018). Deep Semantics-Aware Photo Adjustment models semantics-aware adjustment through low-rank bilinear pooling,

$$\hat{\mathbf{I}} = \big(\mathbf{I}\,\hat{\mathbf{M}}\big)^{\,1/\hat{\gamma}},$$9

which allows the same color to be adjusted differently depending on contextual features or on a semantic adjustment map (Nam et al., 2017). Semantic palette-guided propagation uses semantic-color radial basis weights so that user edits are propagated only to semantically similar regions rather than globally (Zhang et al., 2 Jun 2025).

Diffusion-based methods add conditioning through denoising dynamics. In "Diffusing Colors" (Zabari et al., 2023), classifier-free guidance is applied to residual prediction in latent space, while candidate outputs with different vividness scales $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$0 are ranked by a CLIP-based scorer. In the SJTU diffusion-prior pipeline (Wang et al., 2024), luminance conditional guidance concatenates the grayscale latent $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$1 with $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$2 at every denoising step, and multimodal semantics are injected through cross-attention and instance-conditioned masked diffusion. TSCnet conditions a ControlNet-style diffusion model on ACC-fused multimodal features, an adjustment map, and the raw prompt, thereby translating text semantics into localized illumination control (Zhang et al., 11 Mar 2025). "Fine color guidance in diffusion models" (Bordin et al., 2024) addresses a different problem—training-free global color control—but is relevant because it derives guidance terms that keep the output close to a target color map while semantics are provided by CLIP conditioning rather than by an explicit semantic gradient.

4. Representative task domains and reported performance

Semantic-guided color enhancement now spans a heterogeneous set of tasks. In low-light enhancement, SKF reports average improvements across baselines of +1.750 dB on LOL and +1.611 dB on LOL-v2 in PSNR, with +0.041 and +0.037 in SSIM, as well as better LPIPS and NIQE. Its LLFlow-L-SKF variant reports PSNR 26.798, SSIM 0.879, LPIPS 0.105 on LOL, and PSNR 28.451, SSIM 0.905, LPIPS 0.112 on LOL-v2 (Wu et al., 2023). TSCnet addresses a different low-light problem—customized, prompt-driven semantic-level lighting control—and reports PSNR 25.78 on LOL, SSIM 0.94, and PSNR 29.92 on MIT-Adobe FiveK (Zhang et al., 11 Mar 2025).

In underwater enhancement, SGUIE-Net uses semantic region-wise enhancement to address wavelength-dependent attenuation and scattering. On SUIM-E it reports $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$3, PSNR $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$4, SSIM $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$5, UIQM $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$6, and UCIQE $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$7. On UIEB it reports $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$8, PSNR $$\hat{\mathbf{M}} = \mathrm{diag}(1/\hat{r},1/\hat{g},1/\hat{b})$$9, SSIM $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$0, UIQM $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$1, and UCIQE $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$2 (Qi et al., 2022). The method also reports AE $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$3 on SQUID and average $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$4 on Color-Checker7, linking semantic guidance to measurable color restoration (Qi et al., 2022).

In learned photo enhancement and retouching, NamedCurves uses named-color semantics rather than object classes. On MIT-Adobe-5K, it reports PSNR 24.91, SSIM 0.927, LPIPS 0.038, $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$5, and 26 ms per 480p image on the DPE split; PSNR 25.20 and $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$6 on UPE; and PSNR 25.59 with $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$7 on UEGAN (Serrano-Lozano et al., 2024). On PPR10K it reports, for expert A, PSNR 26.81 and $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$8, with SSIM 0.957, LPIPS 0.031, and $(\hat{r},\hat{g},\hat{b},\hat{\gamma})$9 (Serrano-Lozano et al., 2024). Deep Semantics-Aware Photo Adjustment, on a smaller Flickr retouching benchmark, reduces Lab $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$0 error to 5.92 for Foreground Pop-Out and 6.66 for Local Xpro when Huber loss and multi-task parsing are used (Nam et al., 2017).

In colorization and exemplar transfer, pixel-level semantics guided colorization reports mean PSNR values of 22.7 without semantics or JBU, 22.3 with semantics only, and 22.0 with semantics and JBU on VOC2012 validation, while human evaluation favored the semantic method on semantic correctness and edge keeping (Zhao et al., 2018). Pixelated Semantic Colorization reports 70.3% mean-IoU when segmenting its colorized outputs, versus 72.1% for ground-truth RGB and 66.9% for grayscale, supporting the claim that colorization and segmentation reinforce one another (Zhao et al., 2019). SPColor reports FID 3.73, Top-1 72.25%, and Top-5 91.25% on ImageNet 10k, outperforming exemplar-based competitors while using pseudo-classes from unsupervised segmentation (Chen et al., 2023). Text-guided diffusion colorization shifts the evaluation emphasis: on ImageNet 10k its automatic pipeline with ranker reports FID approximately 3.69, and with ground-truth captions FID approximately 2.60 (Zabari et al., 2023).

In white balance and illumination normalization, semantic white balance reports RMSE 31.1355 on the full ADE20K-derived test set with semantics, versus 53.8815 without semantics, and 20.1450 versus 51.8160 on the $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$1 subset, which the paper describes as a reduction exceeding 40% in average RMSE on the full test set (Afifi, 2018). CANDLE reports PSNR 21.066 dB, SSIM 0.7788, and LPIPS 0.2325 on CL3AN, which is a +1.22 dB PSNR gain over the strongest prior method RLN2-Lf (Jian et al., 3 Apr 2026). It also achieved 3rd place on the NTIRE 2026 ALN Color Lighting Challenge and 2nd place in fidelity on the White Lighting track with the lowest FID (Jian et al., 3 Apr 2026).

5. Evaluation criteria, ablations, and recurring misconceptions

A first recurring issue is that the metric depends strongly on the task. Paired enhancement settings typically report PSNR, SSIM, LPIPS, and NIQE, as in SKF (Wu et al., 2023). Underwater enhancement often adds UIQM, UCIQE, angular error, and $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$2 (Qi et al., 2022). Editor-retouching benchmarks emphasize PSNR, SSIM, LPIPS, and color-difference measures such as $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$3 and $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$4 (Serrano-Lozano et al., 2024). Diffusion colorization work explicitly notes that PSNR, SSIM, and LPIPS are less meaningful for color choice, favoring FID, $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$5-Colorfulness, CLIP image-text similarity, and user study instead (Zabari et al., 2023). This suggests that semantic-guided color enhancement is not a single evaluation regime but a family of related problems with different fidelity–plausibility trade-offs.

A second misconception is that semantic guidance necessarily means hard segmentation masks. The literature is broader. NamedCurves uses color naming probabilities rather than object labels (Serrano-Lozano et al., 2024). Diffusion methods rely on captions, prompts, category labels, or CLIP latents (Zabari et al., 2023, Wang et al., 2024). CANDLE uses DINOv3 features specifically because their patch-wise cosine similarity remains consistent under severe colored illumination (Jian et al., 3 Apr 2026). Semantic palette-guided propagation clusters pixels in a fused six-dimensional color-semantic space, then edits palette entries rather than segmentation regions directly (Zhang et al., 2 Jun 2025).

A third misconception is that semantics only affect feature extraction. Ablation studies consistently show that objective design matters. In SKF, the semantic-aware embedding module yields substantial PSNR gains, the semantic-guided color histogram loss improves color fidelity, and semantic-guided adversarial loss improves NIQE relative to a classic GAN (Wu et al., 2023). In SGUIE-Net, removing the Semantic Region-wise Enhancement Module drops SUIM-E PSNR from 24.82 to 21.94 and using random region splits instead of semantic splits drops performance to 22.84 PSNR, confirming that semantic regionization rather than arbitrary patch processing is critical (Qi et al., 2022). In SPColor, replacing global non-local matching with class-restricted SPC improves FID from 4.98 to 4.24 before the addition of SMP, and full SPC+SMP reaches 3.73 (Chen et al., 2023). In NamedCurves, using color naming to condition the Bezier Control Point Estimator and to weight the final average both improve PSNR and $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$6 in the reported ablations (Serrano-Lozano et al., 2024).

A fourth misconception is that semantic priors solve correspondence and control perfectly. Several papers explicitly describe failure modes. Incorrect masks degrade correction in semantic white balance (Afifi, 2018). Imperfect segmentation in SUIM-Net can weaken semantic guidance or cause slight boundary inconsistencies in SGUIE-Net (Qi et al., 2022). SKF notes reliance on accurate segmentation and acknowledges that unknown categories or ambiguous regions can degrade guidance under domain shift (Wu et al., 2023). TSCnet reports mislocalization under extreme noise, ambiguous references when multiple similar objects are present, and halo risk under extreme adjustments (Zhang et al., 11 Mar 2025). CANDLE notes that semantic priors can mislead when DINO features ambiguously map different materials or when highlight saturation clips information irreversibly (Jian et al., 3 Apr 2026). The persistent conclusion is that semantics constrain color enhancement but do not remove ambiguity.

6. Limitations, open directions, and broader significance

Several unresolved axes recur across the field. One is the tension between class-wise guidance and finer instance-level control. SKF explicitly states that its semantic-guided color histogram loss is class-wise and that true instance-level histograms would require instance or panoptic segmentation (Wu et al., 2023). SPColor introduces a Category Manipulation Process to reassign pseudo-classes when a user wants non-standard cross-class matching, implying that class partitions can be too coarse for all editing intents (Chen et al., 2023). Semantic palette-guided propagation similarly depends on the granularity of palette extraction, with $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$7, $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$8, and threshold $$I'_i.C = I_i.C + \sum_{j=1}^{|P|} w_j(I_i)\big(P'_j.C - P_j.C\big),$$9 controlling whether regions are over-merged or over-split (Zhang et al., 2 Jun 2025).

Another axis is controllability. Text-driven systems move semantic guidance from regularization toward explicit interaction. "Diffusing Colors" supports prompts such as object-level targets, scene-level mood, and style adjectives, then ranks vividness automatically (Zabari et al., 2023). TSCnet generalizes this idea to prompt-driven low-light enhancement with semantic-level and quantitative brightness adjustments (Zhang et al., 11 Mar 2025). This suggests a convergence between enhancement and interactive image editing, where semantics are not only priors learned from labels or self-supervision but also user-specified constraints.

A third axis is robustness under distribution shift. Multiple works point toward open-vocabulary, foundation, or self-supervised priors as a response. SKF lists adaptation to domain-shifted scenes or unknown categories using open-vocabulary or foundation semantic models as a future direction (Wu et al., 2023). SGUIE-Net recommends domain-adapted segmenters, soft masks, uncertainty-weighted fusion, and self-training in new domains (Qi et al., 2022). CANDLE’s use of DINOv3 features can be read as one concrete realization of that trajectory, replacing task-specific class masks with illumination-invariant semantic descriptors (Jian et al., 3 Apr 2026).

A fourth axis is temporal and multimodal extension. SKF explicitly proposes extending semantic guidance to video low-light enhancement with temporal semantic consistency and to related low-level tasks such as HDR or tone mapping, denoising, and dehazing (Wu et al., 2023). Diffusion colorization papers note that temporal consistency is not addressed and would require latent trajectory smoothing or video-diffusion extensions (Zabari et al., 2023). Semantic white balance suggests local or multi-illuminant estimation and RAW or HDR pipelines as natural next steps (Afifi, 2018). These directions imply that semantic-guided color enhancement is increasingly treated as a general conditioning principle for low-level vision rather than as a specialized trick for one task.

Taken together, the literature establishes a consistent technical thesis: color enhancement becomes more stable, more interpretable, and more controllable when the model conditions its transforms on semantically meaningful structure. Whether that structure is represented by segmentation logits, pseudo-classes, named-color probabilities, language prompts, semantic palettes, or self-supervised DINO features, the practical effect is to replace uniform global correction with content-aware color reasoning (Nam et al., 2017, Wu et al., 2023, Serrano-Lozano et al., 2024, Jian et al., 3 Apr 2026).