---
title: 'REAL275: 6D Pose Benchmark for NOCS'
url: https://www.emergentmind.com/topics/real275
type: topic
---

# REAL275: 6D Pose Benchmark for NOCS

Searching arXiv for recent REAL275-related papers to ground the article.
arxiv_search(query="REAL275 NOCS category-level 6D pose estimation", max_results=10, sort_by="submittedDate")
REAL275 is the real-image benchmark released with NOCS for category-level 6D object pose and size estimation. Across the literature, it is described as the real-world subset, or real-world test subset, of NOCS, and it is used to evaluate real-world scenes with clutter, occlusion, and intra-class variability across six everyday object categories: bottle, bowl, camera, can, laptop, and mug [2412.11420][2508.14358][2402.15726]. Because it provides category-level pose, translation, and size annotations in a canonical space while also exposing real RGB-D sensing and challenging scene composition, REAL275 has become a central benchmark not only for single-view category-level pose estimation, but also for depth-only estimation, RGB-only estimation, tracking, open-vocabulary relative pose, model-free novel-object pose, and zero-shot generalization protocols [2104.03437][2312.00690][2501.02831].

## 1. NOCS provenance and dataset composition

REAL275 is consistently situated within the NOCS framework. Several papers describe it as the real-world counterpart of the NOCS benchmark or as the official real test split, with category-level annotations for 6D pose and object size in Normalized Object Coordinate Space [2412.11420][2303.13479]. The benchmark covers six rigid categories—bottle, bowl, camera, can, laptop, and mug—and is designed to test generalization to unseen instances within known categories [2303.13479][2104.03437].

The dataset is commonly summarized as containing approximately 4.3K training images from 7 scenes and approximately 2.75K testing images from 6 scenes [2412.11420][2402.15726]. Other summaries describe the real split as 13 scenes and 7,000 images overall, with 2,750 images from six scenes reserved for validation or testing [2507.06662]. Multiple papers also emphasize that the test set contains three physical or novel object instances per category, making REAL275 a benchmark for category-level rather than instance-level generalization [2504.15134][2406.16384].

REAL275 is repeatedly characterized as a cluttered indoor RGB-D benchmark. It has been described as being captured with a Structure Sensor in cluttered indoor scenes, as containing real-world backgrounds and clutter, and as exhibiting viewpoint variation, occlusion, and significant intra-class variation, particularly for cameras and mugs [2507.06662][2207.08082][2412.11420]. This combination of real sensor data and category-level annotation is what allows the benchmark to support both canonical NOCS evaluations and a wide range of later derived protocols.

## 2. Task settings built on REAL275

The original use of REAL275 is category-level 6D or 9DoF object pose and size estimation from RGB-D observations. In this setting, methods estimate rotation $R \in SO(3)$, translation $t \in \mathbb{R}^3$, and either isotropic or anisotropic size $s$ for previously unseen instances from the six NOCS categories [2303.13479][2603.27533]. Many works build object point clouds by back-projecting masked depth using camera intrinsics, then sample either 1,024 or 1,028 points per instance for downstream processing [2402.15726][2603.27533].

REAL275 has also become a benchmark for depth-only pipelines. CLIPose uses depth-only input at inference while building point clouds from REAL275 RGB-D using camera intrinsics and instance segmentation [2402.15726]. HRC-Pose likewise uses the depth stream, with instance masks obtained from an RGB-based detector and segmented depth back-projected to point clouds uniformly sampled to $N_p = 1024$ points [2508.14358].

A separate line of work uses REAL275 for RGB-only category-level pose estimation. The diffusion-based method in "Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion" eliminates both CAD models and metric depth, using only a single RGB image together with relative depth and surface normals predicted from RGB [2412.11420]. "Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes" treats REAL275 as an RGB-only benchmark with known camera intrinsics and emphasizes scale-agnostic metrics to address monocular scale ambiguity [2508.02157].

The benchmark has also been repurposed for temporal and relational tasks. CAPTRA evaluates category-level online pose tracking on NOCS-REAL275 from point cloud sequences [2104.03437]. Oryon and Horyon construct cross-scene relative-pose benchmarks from 2,000 REAL275 image pairs, where the same physical object appears in different scenes and must be localized from a textual prompt before registration [2312.00690][2406.16384]. Any6D evaluates model-free pose estimation on 2,000 anchor–query RGB-D pairs from REAL275 using only a single RGB-D anchor image per object [2503.18673], while SingRef6D studies a stricter monocular setting with a single RGB reference and predicted depth [2509.21927]. In a different direction, the universal-features method uses REAL275 as a principal real-world benchmark for zero-shot category-level pose, with leave-one-category-out and reference-mesh protocols for unseen categories [2501.02831].

## 3. Evaluation protocols and symmetry conventions

The dominant REAL275 protocol follows NOCS. A prediction is counted as correct when it satisfies either a 3D bounding-box IoU threshold or a joint rotation–translation threshold, and AP or mAP is then computed over categories [2412.11420][2504.15134]. Commonly reported pose thresholds include $5^\circ 2$ cm, $5^\circ 5$ cm, $10^\circ 2$ cm, $10^\circ 5$ cm, and, in some papers, $10^\circ 10$ cm [2402.15726][2303.13479]. Some works additionally report rotation-only or translation-only thresholds such as $10^\circ$ and 10 cm, or 3D IoU thresholds such as 3D25, 3D50, and 3D75 [2412.11420][2303.13479].

The standard rotation and translation error definitions are explicitly written in several REAL275 papers. Rotation error is given by
$$
\theta = \arccos\left(\frac{\operatorname{Tr}(R^\top \hat{R}) - 1}{2}\right),
$$
and translation error by
$$
e_t = \lVert t - \hat{t} \rVert_2.
$$
The 3D IoU criterion is defined by the overlap between predicted and ground-truth 3D boxes, for example
$$
\operatorname{IoU}(B_{\mathrm{pred}}, B_{\mathrm{gt}})=\frac{|B_{\mathrm{pred}} \cap B_{\mathrm{gt}}|}{|B_{\mathrm{pred}} \cup B_{\mathrm{gt}}|}.
$$
These formulas appear, with minor notational variations, across NOCS-style evaluations on REAL275 [2412.11420][2504.15134][2502.01312].

Symmetry handling is a fixed part of most REAL275 evaluations. For bottle, bowl, and can, rotation around the symmetry axis is ignored; mug is evaluated symmetrically when the handle is not visible [2412.11420][2508.14358]. Some papers explicitly note this convention, while others state that they follow the standard NOCS protocol; a few summaries note that no special handling for symmetric objects is mentioned in the particular paper even though the broader benchmark convention exists [2504.15134].

Derived REAL275 protocols depart from the standard single-image NOCS setup. Oryon and Horyon use BOP-style Average Recall over VSD, MSSD, and MSPD, together with ADD(S)-0.1d, for cross-scene relative pose between two RGB-D views [2312.00690][2406.16384]. Any6D also adopts BOP AR, MSSD, MSPD, VSD, and ADD(-S) AUC for its single-anchor, model-free setting on REAL275 pairs [2503.18673]. CAPTRA, by contrast, reports tracking-oriented metrics such as $5^\circ 5$ cm accuracy, 3D mIoU, rotation error, and translation error over temporal sequences [2104.03437].

## 4. Methodological trajectories evaluated on REAL275

REAL275 has supported several distinct methodological families. Early and mid-stage category-level RGB-D work includes prior-based deformation or registration pipelines such as SPD, SGPA, DR-Pose, CATRE, and DPDN. DR-Pose explicitly separates completion-aided deformation from scaled registration, and CATRE treats refinement as iterative alignment between a partial point cloud and an abstract shape prior [2309.01925][2207.08082]. DPDN formulates Sim2Real adaptation on REAL275 with a Deep Prior Deformation Network and self-supervised inter- and intra-consistency terms [2207.05444].

A large set of prior-free or weak-prior RGB-D approaches instead emphasizes direct correspondence learning, implicit canonical mapping, or keypoint learning. IST-Net uses implicit space transformation to move from camera-space features to world-space counterparts without 3D priors [2303.13479]. INKL-Pose predicts 96 instance-adaptive keypoints and refines them with local and global geometric aggregation, including bidirectional Mamba and Feature Sequence Flipping [2504.15134]. MK-Pose combines RGB, point cloud geometry, and category-level textual descriptions in a multimodal keypoint-learning framework with graph-based relational modeling [2507.06662]. CleanPose adds a causal front-door adjustment module and residual knowledge distillation from ULIP-2, while MemPose introduces an external category-specific geometric memory buffer that stores and updates structural representations from previously observed instances [2502.01312][2607.04930].

Representation-learning and modality-transfer approaches are also prominent on REAL275. CLIPose aligns point cloud, image, and text features by multi-modal contrastive learning and prompt tuning, while HRC-Pose learns rotation-aware and translation-aware point-cloud embeddings whose distances track pose continuity [2402.15726][2508.14358]. DeMo-Pose fuses monocular semantic features with depth-based graph features and introduces a Mesh-Point Loss for RGB-D category-level 9-DoF estimation [2603.27533].

REAL275 has additionally become a testbed for RGB-only and open-vocabulary methods. The diffusion-based RGB-only method uses a conditional score-based diffusion model to generate pose hypotheses from a single RGB image, then aggregates them with Mean Shift rather than an additional energy network [2412.11420]. The unified RGB-only prototype method integrates detection and pose estimation in a single framework by leveraging neural mesh models, dense 2D–3D correspondences, and multi-model RANSAC-PnP [2508.02157]. In open-vocabulary settings, Oryon and Horyon use text-conditioned localization plus RGB-D registration across paired scenes [2312.00690][2406.16384]. Any6D and SingRef6D extend REAL275 to model-free or single-reference novel-object pose, using respectively a single RGB-D anchor or a single RGB reference with predicted depth [2503.18673][2509.21927].

This methodological range suggests that REAL275 is not merely a fixed benchmark for one algorithmic template. It functions as a common substrate on which canonical-space regression, deformation, keypoint discovery, diffusion hypothesis generation, contrastive representation learning, memory augmentation, open-vocabulary prompting, and zero-shot reference-based alignment can all be compared under real-scene clutter and category-level generalization.

## 5. Quantitative landmarks on the benchmark

Because REAL275 is used under several incompatible protocols, its headline numbers are best read within each task family rather than across all papers at once.

| Setting | Representative REAL275 result | Paper |
|---|---|---|
| RGB-only single-image category-level pose | IoU50 = 45.2; IoU75 = 7.2; 10°/10 cm = 36.6 | [2412.11420] |
| Depth-only category-level pose | IoU50 = 83.4; IoU75 = 77.8; 10°5cm = 85.4 | [2508.14358] |
| Depth-only vision–language pose | 5°2cm = 48.7%; 10°10cm = 86.2%; 40.0 FPS | [2402.15726] |
| RGB-D keypoint-based pose | IoU75 = 80.6; 5°2 cm = 63.2; 10°5 cm = 88.0 | [2504.15134] |
| Open-vocabulary relative pose | AR = 57.9; ADD(S)-0.1d = 51.6; mIoU = 81.3 | [2406.16384] |
| Model-free single-anchor relative pose | ADD(-S) AUC = 53.5; AR = 51.0 | [2503.18673] |

Within RGB-only single-image category-level pose, the diffusion method reports that its REAL275 configuration with Mean Shift and $K=50$ hypotheses reaches IoU50 = 45.2, IoU75 = 7.2, $10^\circ$ = 67.5, 10 cm = 56.6, and $10^\circ/10$ cm = 36.6, improving over DMSR’s 23.6 at $10^\circ/10$ cm and 28.3 at IoU50 [2412.11420]. The same paper states a +55% relative improvement over DMSR on the strict $10^\circ/10$ cm criterion and a +60% relative improvement on IoU50 [2412.11420]. In a different RGB-only formulation, the unified prototype method reports 75.2 on NIoU25, 53.7 on NIoU50, 19.2 on NIoU75, and a 22.9% relative average improvement over LaPose across eleven scale-agnostic metrics [2508.02157].

Among depth-only or depth-driven category-level methods, HRC-Pose reports IoU50 = 83.4, IoU75 = 77.8, $5^\circ 2$ cm = 49.8, $5^\circ 5$ cm = 58.6, $10^\circ 2$ cm = 72.5, and $10^\circ 5$ cm = 85.4, surpassing HS-Pose across all listed REAL275 metrics while running at 122.6 FPS [2508.14358]. CLIPose reports 48.7% at $5^\circ 2$ cm, 58.3% at $5^\circ 5$ cm, 70.4% at $10^\circ 2$ cm, 85.2% at $10^\circ 5$ cm, and 86.2% at $10^\circ 10$ cm, with 40.0 FPS inference [2402.15726].

Within RGB-D category-level pose, INKL-Pose reports IoU50 = 84.0, IoU75 = 80.6, $5^\circ 2$ cm = 63.2, $5^\circ 5$ cm = 68.3, $10^\circ 2$ cm = 80.9, and $10^\circ 5$ cm = 88.0 [2504.15134]. MK-Pose reports IoU50 = 84.0%, IoU75 = 80.3%, $5^\circ/2$ cm AP = 60.8%, $10^\circ/2$ cm AP = 78.0%, and $10^\circ/5$ cm AP = 84.6% [2507.06662]. MemPose reports IoU75 = 81.0, $5^\circ 2$ cm = 59.9, $5^\circ 5$ cm = 67.7, and $10^\circ 2$ cm = 79.0 [2607.04930]. CleanPose, under CATRE-style IoU75*, reports IoU75* = 62.6, $5^\circ 2$ cm = 61.5, $5^\circ 5$ cm = 67.4, $10^\circ 2$ cm = 78.3, and $10^\circ 5$ cm = 86.2, improving over AG-Pose by +4.5 points at $5^\circ 2$ cm [2502.01312].

REAL275 has also been central in relative-pose and novel-object settings. Horyon reports AR = 57.9 and ADD(S)-0.1d = 51.6 on 2,000 REAL275 cross-scene pairs, exceeding Oryon by +25.5 AR and +27.3 ADD in that open-vocabulary RGB-D setup [2406.16384]. Any6D reports ADD(-S) AUC = 53.5, AR = 51.0, MSSD = 56.5, MSPD = 65.3, and VSD = 31.1, outperforming Oryon on most metrics except VSD [2503.18673]. SingRef6D, using a single RGB reference and predicted depth, reports AR = 28.7 on REAL275 and a +14.41 percentage-point improvement in $\delta_{1.05}$ over Depth-Anything v2 for depth prediction on REAL275 [2509.21927].

## 6. Recurrent difficulties, ambiguities, and benchmark significance

Several failure modes recur across REAL275 studies. Scale ambiguity remains a persistent issue whenever methods avoid metric depth or instance CAD models. The diffusion-based RGB-only paper states that scale ambiguity persists in challenging cases and that translation mAP is sensitive to context and global features [2412.11420]. The unified RGB-only prototype method evaluates both scale-agnostic and scale-aware metrics precisely because single-view RGB introduces a fundamental ambiguity between object distance and metric scale [2508.02157]. MSL-RAPTOR, which uses only monocular RGB, identifies depth along the optical axis as the main source of translation error on REAL275 [2012.09264].

Symmetry is another structural difficulty. Rotation around symmetry axes is underdetermined for bottles, bowls, and cans, and mug evaluation changes when the handle is not visible [2412.11420][2508.14358]. Some methods explicitly model this during training, such as MK-Pose’s symmetry-aware pose-size loss [2507.06662], while open-vocabulary and BOP-style protocols absorb it into symmetry-aware metrics such as MSSD, MSPD, and ADD-S [2312.00690][2406.16384]. A plausible implication is that REAL275 measures not only raw rotation recovery but also the ability to represent or tolerate pose equivalence classes induced by object geometry.

Intra-class variation and sensor quality also matter strongly. The diffusion paper remarks that camera and mug categories show lower rotation mAP because different shapes, lenses, and handle visibility lead to distribution spread and estimation uncertainty [2412.11420]. CAPTRA reports that the camera category is especially difficult because severe real depth noise can break depth-only segmentation [2104.03437]. DR-Pose notes that mug handles are often occluded or invisible in REAL275, and that completion can mis-hallucinate them [2309.01925].

Derived REAL275 protocols reveal additional sensitivities. In open-vocabulary relative pose, Oryon shows that segmentation quality, camera distance between views, and prompt descriptiveness materially affect AR, and that generic or misleading prompts can sharply reduce performance [2312.00690]. SingRef6D notes failure cases in extremely dark scenes where RGB lacks information, while also showing that better monocular depth substantially improves downstream registration on REAL275 [2509.21927].

Taken together, these observations suggest that REAL275 remains influential because it concentrates several hard factors in one real benchmark: cluttered indoor scenes, occlusion, real sensor artifacts, novel-instance generalization, symmetry, and scale ambiguity. Its continued reuse across RGB-D, depth-only, RGB-only, open-vocabulary, tracking, single-anchor, and zero-shot formulations indicates that it functions as both a benchmark dataset and a benchmark design pattern for studying how category-level geometric reasoning transfers from controlled canonical spaces to real-world visual scenes [2412.11420][2508.14358][2406.16384].

Source: https://www.emergentmind.com/topics/real275