Intra-Image Pixel-Level Contrastive Loss

• Intra-image pixel-level contrastive loss is a family of dense contrastive objectives that leverages pixel-level spatial features within individual images to preserve local semantics and structure.
• It employs methods like geometric correspondence, same-class grouping, and structure-guided partitioning to construct reliable positive pairs for improved learning.
• Empirical evaluations show that incorporating intra-image contrast significantly boosts performance in tasks such as segmentation, detection, and forgery localization.

Intra-image pixel-level contrastive loss denotes a family of dense contrastive objectives in which the contrasted entities are spatial features attached to pixels or feature-map locations, and the primary positive relation is defined within one source image or within multiple views derived from that same image. In the literature, this family appears in several distinct forms: correspondence-based self-supervision across augmentations of a single image, label-based same-class attraction within one image, structure-guided grouping by superpixels or manipulation masks, and multi-view extensions in which all views still originate from one image (Islam et al., 2022). The term is therefore narrower than generic pixel contrastive learning, but broader than a single loss formula. A central unifying theme is that dense prediction tasks require representations that preserve spatial structure, local semantics, and region boundaries more explicitly than image-level instance discrimination typically does (Islam et al., 2022).

1. Definition and conceptual scope

The most precise use of the term refers to a contrastive objective whose positives are constructed from pixels or dense feature locations belonging to the same image identity. In self-supervised settings, this usually means two transformed views of the same source image, with a positive pair formed either by exact geometric correspondence across views or by a view-conditioned local neighborhood. In supervised settings, it often means that for an anchor pixel, other same-label pixels from the same image are treated as positives and different-label pixels are treated as negatives. In structure-guided variants, same-region features—such as forged-region features, superpixel members, or same-class pixels under silver-standard masks—play the role of positives (Zhao et al., 2020).

The literature also makes clear that “intra-image” does not always imply that every term in the loss is image-internal. A representative self-supervised formulation enforces local consistency between corresponding image regions across two transformed views of the same image, but uses a queue or memory bank for negatives; in that case the positives are strictly intra-image, while the full denominator is not exclusively intra-image (Islam et al., 2022). By contrast, some supervised formulations are fully image-internal, because both positives and negatives are sampled from the same image and are defined directly by class labels or binary masks (Lou et al., 2024).

A second scope issue concerns the phrase “pixel-level.” Across these works, it usually means dense feature-map locations rather than raw RGB pixels. Local descriptors are extracted from a convolutional or transformer feature map, sometimes after a projection head, and the contrastive computation is performed on those dense embeddings. Several papers state this explicitly, emphasizing that the practical object of contrast is a feature-map location whose supervision is pixel-level, not a raw image pixel vector (Islam et al., 2022).

2. Correspondence-based self-supervised formulations

A canonical self-supervised example is the local contrastive loss introduced for detection and semantic segmentation, where two random transformations of the same image produce two views, a convolutional backbone yields spatial feature maps, and the positive for a location in one view is the feature at the geometrically corresponding location in the other view (Islam et al., 2022). The loss is written in InfoNCE form: $$\ell_s = - \log \frac{ \exp\left(\mathrm{sim}(q_s,k_{s^+})/\tau\right) }{ \sum_{i=0}^{K} \exp\left(\mathrm{sim}(q_s,k_i)/\tau\right) }, \qquad \mathcal{L}_{\text{LC}} = \frac{1}{|S|}\sum_{s\in S} \ell_s,$$ and is added to a global image-level objective as

$$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$

Its motivation is explicit: image-level instance discrimination learns global invariances, but dense downstream tasks also require representations that retain where things are, including object parts, boundaries, and region-level consistency (Islam et al., 2022).

The same paper makes the geometric problem central. If two views are produced by crop, resize, and flip, correspondence is obtained analytically from the known augmentations. Conceptually, if $T_1$ and $T_2$ are the two transforms, correspondence is given by

$p_2 = T_2\bigl(T_1^{-1}(p_1)\bigr),$

followed by conversion from image coordinates to feature-map coordinates via the backbone stride. This produces a location-aware contrastive objective rather than a generic local consistency penalty (Islam et al., 2022).

Semi-supervised segmentation uses a closely related but not identical construction in PC$^2$Seg. There, the positive for an anchor feature $z_i$ is the corresponding pixel under weak/strong augmentation of the same unlabeled image, and the contrastive loss is

$$\ell^\mathrm{ce}_i = - \log \frac{ e^{\cos(z_i, z_i^+) / \tau} } { e^{\cos(z_i, z_i^+) / \tau} + \sum_{n=1}^N e^{\cos(z_i, z_{in}^-) / \tau} } ,$$

with $\tau = 0.07$ (Zhong et al., 2021). This remains intra-image for positives, but the paper argues that same-image negatives are hazardous because segmentation suffers from false negatives; its best strategy samples negatives from different images and debiases them with pseudo-label probabilities (Zhong et al., 2021). That result sharply limits an overly simple reading of intra-image pixel contrast as “same-image for everything.”

A further correspondence-based extension appears in counterfactual dense contrastive learning for medical segmentation. In DVD-CL and MVD-CL, all dense contrastive comparisons are built from multiple views of the same chest X-ray, including counterfactual images generated by changing scanner type, pleural effusion presence, or both (Lafargue-Hauret et al., 17 Mar 2026). The unsupervised version uses same spatial location across views as the positive relation, while supervised variants replace exact-location matching with same-class matching across the multi-view set of the same image (Lafargue-Hauret et al., 17 Mar 2026). This suggests that intra-image pixel contrast can be made invariant not only to augmentations, but also to causal interventions that preserve image identity.

3. Supervised same-image semantic formulations

A distinct line of work defines intra-image pixel-level contrast directly through labels. In label-efficient semantic segmentation, the within-image loss uses an image $I$ and a distorted version $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$0, with anchor pixel $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$1 in $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$2, same-class pixels in $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$3 as positives, and different-class pixels in $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$4 as negatives through the denominator (Zhao et al., 2020). The paper gives the explicit within-image loss: $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$5 with unit-normalized features and temperature $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$6 (Zhao et al., 2020). Unlike self-supervised correspondence loss, the positive relation is semantic rather than geometric: any same-class pixel in the transformed counterpart can be positive. The full method uses this as a pretraining stage, followed by standard cross-entropy fine-tuning, and the two-stage strategy is reported to be much better than joint training (Zhao et al., 2020).

A related but broader supervised formulation appears in “Exploring Cross-Image Pixel Contrast for Semantic Segmentation,” where the main method is explicitly not restricted to same-image pairs. Its core loss is

$$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$7

with $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$8, and the paper states that positive and negative samples are “not restricted to being from a same image” (Wang et al., 2021). It nevertheless includes an “Intra-Image Contrast” ablation, which improves Cityscapes val with HRNetV2-W48 from 78.1 mIoU to 78.9 mIoU, while “Inter-Image Contrast” reaches 81.0 mIoU (Wang et al., 2021). The result is significant because it shows that intra-image pixel contrast is beneficial but, in that supervised formulation, is a weaker special case than cross-image contrast.

Forgery localization provides a binary same-image version of the idea. MPC defines a within-image loss $$\mathcal{L} = \mathcal{L}_{\text{global}} + \lambda\,\mathcal{L}_{\text{LC}}.$$9 over the highest-resolution feature map $T_1$0, where positives are other pixels from the same image with the same tampered/pristine label and negatives are pixels with the opposite label (Lou et al., 2024). The paper gives

$T_1$1

and uses it as one component of a larger multi-view pretraining scheme (Lou et al., 2024). Its ablation is especially stark: removing the within-image term causes a severe collapse in performance, much worse than removing the other contrastive views (Lou et al., 2024). This makes explicit that, for dense binary localization, same-image feature geometry can be the dominant source of discriminative structure.

4. Structure-guided and region-partitioned variants

Several methods depart from exact pixel correspondence or same-class labels and instead define intra-image positives through an image-internal partition. In prompt-based AI image forgery localization, ICL-Net concatenates features from a Noise backbone and a Main backbone, uses the ground-truth manipulation mask to split the dense features into forged and real sets, and applies an “Intra-Image Contrastive Loss” that treats forged features as anchors (Wang et al., 31 Mar 2026). The loss is

$T_1$2

where $T_1$3 and $T_1$4 are forged and real dense feature sets and $T_1$5 is cosine similarity (Wang et al., 31 Mar 2026). This is entirely image-internal: no memory bank, queue, or batch-wide negatives are described. The formulation is asymmetric, because only forged anchors appear explicitly, but the reported ablation indicates that removing the contrastive loss reduces performance from 75.20 / 62.45 to 59.63 / 45.07 in F1 / IoU (Wang et al., 31 Mar 2026).

SuperCL replaces same-location matching with same-superpixel grouping. Its Intra-image Local Contrastive Pairs (ILCP) are generated from two non-spatially augmented views, and a pair $T_1$6 is positive if $T_1$7 and $T_1$8 belong to the same superpixel cluster $T_1$9 (Zeng et al., 20 Apr 2025). The intra-image loss is a multi-positive dense contrastive objective: $T_2$0 with $T_2$1 and a default setting of 100 superpixel clusters (Zeng et al., 20 Apr 2025). The rationale is explicit: ordinary pixel-to-pixel contrast can create many false negatives, whereas same-superpixel pixels provide a structural prior for local similarity. The ablations show that adding ILCP yields larger gains than adding the inter-image branch alone in several settings (Zeng et al., 20 Apr 2025).

PixDepth modifies PixPro at the level of positive-mask construction. The baseline positive mask is determined by 2D proximity across two crops of the same image,

$T_2$2

and the paper adds a depth-consistency mask

$T_2$3

combined as

$T_2$4

(Saad et al., 2022). The resulting loss remains a multi-positive InfoNCE-style pixel loss, but depth prevents nearby-yet-different objects from becoming positives. The paper further introduces a channel-wise multi-threshold version to cope with object scale variation (Saad et al., 2022). This exemplifies an important design pattern: intra-image pixel contrast can be altered less by changing the objective family than by changing the rule that defines valid positives.

5. Architectural patterns and computational strategies

A recurrent architectural pattern is the separation between a dense backbone feature map and a contrastive projection space. The local-contrastive self-supervised method for dense transfer uses a ResNet-style encoder in a MoCo-like framework with a query encoder, momentum key encoder, global projection head, and an additional local feature branch projected from the final convolutional feature map before global pooling (Islam et al., 2022). Cross-image supervised pixel contrast for segmentation uses a two-$T_2$5-convolution projection head with output dimension 256 and $T_2$6-normalization, applied only during training (Wang et al., 2021). Label-efficient within-image contrastive pretraining also uses a projection head with three $T_2$7 convolution layers, each with 256 channels, and discards that head before segmentation fine-tuning (Zhao et al., 2020). Across these examples, the dense contrastive branch is auxiliary to the segmentation or detection backbone rather than a separate dense model.

Another shared pattern is that dense pixel contrast is computationally expensive, so nearly every method introduces a reduction strategy. The self-supervised local contrastive method samples a subset of spatial locations from a lower-resolution feature map and reuses the existing momentum encoder and queue to keep overhead minimal (Islam et al., 2022). Label-efficient semantic segmentation downsamples features from $T_2$8 to $T_2$9 before computing the within-image loss because the cost is quadratic in the number of pixels (Zhao et al., 2020). Semi-supervised medical segmentation proposes stride-based downsampling and block division, reducing the supervised local contrast complexity from $p_2 = T_2\bigl(T_1^{-1}(p_1)\bigr),$0 to lower-order approximations while still contrasting dense semantic embeddings (Hu et al., 2021). MPC and related forensic methods state that positives and negatives are randomly sampled rather than exhaustively contrasted (Lou et al., 2024).

A further design choice concerns whether contrastive learning is joint with the end task or staged. Some methods add pixel-level contrast as an auxiliary term to the standard objective, such as $p_2 = T_2\bigl(T_1^{-1}(p_1)\bigr),$1 in self-supervised dense transfer (Islam et al., 2022) or $p_2 = T_2\bigl(T_1^{-1}(p_1)\bigr),$2 in supervised segmentation (Wang et al., 2021). Others use a distinct pretraining stage followed by cross-entropy fine-tuning, such as the within-image supervised contrastive pretraining of label-efficient segmentation (Zhao et al., 2020) and the contrastive-then-head-training regime of MPC (Lou et al., 2024). The empirical results reported in those works suggest that the staging decision is not secondary; in some settings it materially changes effectiveness (Zhao et al., 2020).

6. Tasks, empirical effects, and recurrent misconceptions

The immediate empirical motivation for intra-image pixel-level contrastive loss is transfer to dense or localization-sensitive tasks. In self-supervised dense transfer, adding local contrastive loss improves downstream performance by 1.9% on COCO object detection, 1.4% on PASCAL VOC detection, and 0.6% on CityScapes segmentation (Islam et al., 2022). In label-efficient segmentation, the explicit within-image loss improves over cross-entropy alone on both Cityscapes and PASCAL VOC 2012, while the cross-image extension is usually slightly better (Zhao et al., 2020). In forgery localization, within-image supervised contrast is central to robustness and generalization, and removing it can cause catastrophic degradation (Lou et al., 2024). These findings consistently support the same claim: dense prediction benefits when the representation is explicitly organized at the feature-location level rather than only at the image level.

A common misconception is that “pixel-level contrastive learning” automatically means “purely intra-image.” The surveyed literature does not support that simplification. Some methods are explicitly cross-image by design and treat intra-image contrast only as an ablation or restricted special case (Wang et al., 2021). Others have intra-image positives but inter-sample negatives through a queue or minibatch sampler (Islam et al., 2022). Still others are fully image-internal because both positive and negative sets are defined inside a single image by labels, masks, or partitions (Lou et al., 2024). The correct interpretation therefore depends on how positives and negatives are each constructed, not on the phrase “pixel-level” alone.

A second misconception is that “intra-image” necessarily means same-view, same-image contrast. Some recent work explicitly warns against that reading. “Within-image” may in fact mean cross-view same-scene matching, where a pixel in one view is paired with its corresponding transformed pixel in another view of the same image or same scene, rather than with arbitrary pixels from the same raster (Pogorelyuk et al., 4 Dec 2025). This distinction matters because correspondence-based cross-view contrast and same-image same-class contrast impose different invariances.

Finally, the literature repeatedly indicates that the quality of the positive relation is more important than merely making the loss denser. Geometric alignment across augmentations, label-based semantic grouping, uncertainty filtering, superpixel structure, depth masks, and counterfactual view construction all serve the same end: reducing false positives and false negatives in the contrastive relation itself (Saad et al., 2022). A plausible implication is that intra-image pixel-level contrastive loss is best understood not as one fixed formula, but as a design space for defining dense positive and negative relations that respect spatial structure, semantics, and task-specific priors.