---
title: DIOR-IOD Benchmark for Incremental Remote Sensing Detection
url: https://www.emergentmind.com/topics/dior-iod
type: topic
---

# DIOR-IOD Benchmark for Incremental Remote Sensing Detection

DIOR-IOD is a remote sensing incremental object detection benchmark introduced in “STAR-IOD: Scale-decoupled Topology Alignment with Pseudo-label Refinement for Remote Sensing Incremental Object Detection” [2605.20738]. Constructed from the existing DIOR dataset, it reorganizes remote sensing object detection into a sequential class-incremental regime in which classes are introduced stage by stage and, at each incremental stage, only the currently introduced classes are annotated. Its purpose is to standardize evaluation for Remote Sensing Incremental Object Detection (RS-IOD) under conditions that are characteristic of overhead imagery, notably severe intra-class scale variation, complex backgrounds, dense layouts, occlusions, and old/new class co-occurrence.

## 1. Definition and provenance

DIOR-IOD was introduced because, according to its authors, no standardized RS-IOD benchmark existed, previous work lacked unified dataset splits and evaluation protocols, and direct transfer of natural-image incremental detection methods was suboptimal for remote sensing scenes. The benchmark is explicitly designed to reflect a rehearsal-free setting in which data arrive in stages, old data are unavailable during later training, and current-stage images may contain unlabeled instances of previously learned categories. In that sense, DIOR-IOD is not merely “DIOR with a different split”; it is a benchmark tailored to the operational assumptions of class-incremental remote sensing detection [2605.20738].

The benchmark is one of two datasets released in the same work, the other being DOTA-IOD. Within that paper, DIOR-IOD functions both as a benchmark contribution and as the principal empirical substrate for evaluating STAR-IOD, a Grounding DINO-based continual detector equipped with Subspace-decoupled Topology Distillation and a Clustering-driven Pseudo-label Generator. The code and dataset are released through the STAR-IOD project repository.

## 2. Dataset composition and incremental protocols

DIOR-IOD contains 20 classes and supports two standard protocols: a two-step setting with 10 base classes followed by 10 incremental classes, and a four-step setting with 5 classes introduced at each stage. The two-step protocol is the canonical setting; the four-step protocol is explicitly described as more challenging.

| Protocol | Task structure | Classes |
|---|---|---|
| `10 + 10` | Task 1 / Task 2 | Task 1: airplane, airport, bridge, service-area, toll-station, harbor, overpass, ship, trainstation, vehicle; Task 2: baseballfield, basketballcourt, chimney, dam, golffield, groundtrackfield, stadium, storagetank, tenniscourt, windmill |
| `5 + 5 + 5 + 5` | Task 1 / Task 2 / Task 3 / Task 4 | Task 1: airplane, airport, bridge, service-area, toll-station; Task 2: baseball field, basketball court, golf field, chimney, dam; Task 3: ground track field, stadium, storage tank, tennis court, windmill; Task 4: harbor, overpass, ship, train station, vehicle |

For the `10 + 10` protocol, the paper reports detailed per-class train and test instance counts. In Task 1, counts range from 501/509 for Trainstation to 27,351/35,186 for Ship. In Task 2, they range from 511/575 for Golffield to 4,898/7,343 for Tenniscourt. Summing the reported class counts gives approximately 69,073 training annotations and 124,445 test annotations. The paper does not report the total number of images for DIOR-IOD, does not specify a validation split, and does not provide a full image-level train/val/test partition [2605.20738].

This organization has methodological significance. The benchmark preserves the class imbalance and multi-scale structure of the source remote sensing corpus while imposing an incremental annotation protocol, thereby combining ordinary detection difficulty with continual-learning difficulty.

## 3. Formal task definition and annotation regime

The RS-IOD setting on DIOR-IOD is formulated as sequential learning over disjoint class sets,
\[
\mathcal{C} = \{\mathcal{C}_1, \mathcal{C}_2, \ldots, \mathcal{C}_n\},
\]
with
\[
C_i \cap C_j = \emptyset,\ \forall i \neq j.
\]
At stage \(t\), training uses only the current dataset
\[
\mathcal{D}_t = \{X_t, Y_t\},
\]
where \(Y_t\) contains annotations only for the current class set \(C_t\), even if the images contain objects from earlier stages. The learner must adapt \(\mathcal{M}_{t-1}\) to \(\mathcal{M}_t\) without revisiting previous task datasets and while preserving old-class performance [2605.20738].

The paper decomposes current-stage images into three categories: **Only Old**, **Only New**, and **Co-occurrence**. Only images in **Only New** and **Co-occurrence** are available during incremental training, and in **Co-occurrence** images the old-class objects are present but unlabeled. This is a central source of forgetting, because the detector can receive background supervision on true old-class instances. On DIOR-IOD, old/new co-occurrence reaches 23.5% among the images available during incremental training, which makes missing annotations a substantive rather than incidental phenomenon.

The authors emphasize that this setting is especially difficult in remote sensing because the same category may appear at markedly different scales and because scenes often contain dense object arrangements and frequent category co-occurrence. A plausible implication is that DIOR-IOD stresses both representation stability and label-noise robustness more strongly than many natural-image class-incremental detection settings.

## 4. Evaluation protocol and baseline ecosystem

DIOR-IOD is evaluated with standard COCO-style metrics: \(\mathit{mAP}\), \(\mathit{mAP}_{50}\), \(\mathit{mAP}_{75}\), \(\mathit{mAP}_{s}\), \(\mathit{mAP}_{m}\), and \(\mathit{mAP}_{l}\). For incremental analysis, the paper additionally reports \(\mathit{mAP}^{P}\) for previously learned classes, \(\mathit{mAP}^{C}\) for current-task classes, and \(\mathit{mAP}^{A}\) for all classes seen so far. Forgetting is examined by comparing classwise performance before and after the incremental stage rather than through a separate closed-form forgetting metric [2605.20738].

All compared methods are trained under a common setup: NVIDIA L20 GPU, AdamW optimizer, learning rate \(1 \times 10^{-4}\), weight decay \(1 \times 10^{-4}\), 25 epochs per task, and batch size 4. The compared methods include Fine-tuning, MD-DETR, CL-DETR, ERD, and GCD. In the authors’ implementation, STAR-IOD is architecturally grounded in Grounding DINO, and some baselines are likewise adapted to that detector family.

The benchmark is therefore not only a dataset definition but also an evaluation protocol with fixed metrics, fixed incremental schedules, and a common training recipe. That protocol is necessary because RS-IOD performance is sensitive to both catastrophic forgetting and new-class plasticity, and DIOR-IOD explicitly requires reporting both.

## 5. Empirical behavior on DIOR-IOD

In the two-step `10 + 10` setting, the base-stage performance for Grounding DINO-based methods is reported as \(\mathit{mAP}^{C} = 45.6\) and \(\mathit{mAP}^{C}_{50} = 72.7\). After the incremental stage, STAR-IOD achieves the best reported result on DIOR-IOD with \(\mathit{mAP}^{A} = 48.6\), \(\mathit{mAP}^{A}_{50} = 72.7\), \(\mathit{mAP}^{A}_{75} = 53.3\), and \(\mathit{mAP}^{P} = 40.7\). Against the strongest listed baseline, GCD, the gains are \(+1.7\) on \(\mathit{mAP}^{A}\), \(+1.5\) on \(\mathit{mAP}^{A}_{50}\), \(+1.9\) on \(\mathit{mAP}^{A}_{75}\), and \(+1.3\) on \(\mathit{mAP}^{P}\) [2605.20738].

| Setting | Method | Key result |
|---|---|---|
| Two-step `10 + 10` | STAR-IOD | \(\mathit{mAP}^{A}=48.6\), \(\mathit{mAP}^{P}=40.7\) |
| Two-step `10 + 10` | GCD | \(\mathit{mAP}^{A}=46.9\), \(\mathit{mAP}^{P}=39.4\) |
| Four-step `5 + 5 + 5 + 5` final stage | STAR-IOD | \(\mathit{mAP}^{A}=36.9\), \(\mathit{mAP}^{P}=37.7\) |
| Four-step `5 + 5 + 5 + 5` final stage | GCD | \(\mathit{mAP}^{A}=34.5\), \(\mathit{mAP}^{P}=33.6\) |

In the four-step `5 + 5 + 5 + 5` setting, the advantage grows at the final stage: STAR-IOD reports \(\mathit{mAP}^{A} = 36.9\), \(\mathit{mAP}^{A}_{50} = 55.8\), and \(\mathit{mAP}^{P} = 37.7\), compared with 34.5, 52.7, and 33.6 for GCD. The larger margin in the longer sequence suggests that DIOR-IOD becomes more discriminative as continual depth increases.

The ablations clarify what DIOR-IOD rewards. The Clustering-driven Pseudo-label Generator yields the largest old-class improvement, consistent with the importance of missing annotations. Scale partitioning through Scale-adaptive Instance Partitioning improves \(\mathit{mAP}^{A}\) from 37.3 to 39.4 and yields gains of \(+0.7\), \(+0.8\), and \(+3.2\) on small, medium, and large objects, respectively. This supports the paper’s claim that intra-class scale variation is central on DIOR-IOD.

The forgetting analysis is likewise revealing. On the original Task 1 classes, Harbor drops in \(AP_{50}\) from 57.1 to 38.0 and Bridge from 54.5 to 43.0, whereas Toll-station remains at 82.5. The paper interprets this as evidence that initially weaker or less discriminative classes are harder to preserve than rigid, structurally distinctive ones.

## 6. Limitations, interpretation, and term ambiguity

The paper identifies DIOR-IOD as a benchmark for standardizing RS-IOD, but it also leaves several construction details under-specified. It does not fully document the number of images, image-level splits, any validation split, or an exact preprocessing and annotation-conversion pipeline. The benchmark is evaluated in a rehearsal-free setting only, so the comparative behavior of replay-based methods under equivalent constraints remains open. The scale thresholds used in STAR-IOD, \((1024, 9216)\), are heuristic, and semantically similar classes remain difficult to separate [2605.20738].

These limitations are important for interpretation. DIOR-IOD is best understood as a benchmark that foregrounds two remote-sensing-specific continual-learning pathologies: severe scale variation and unlabeled old-class instances in current-stage images. Its primary scientific value lies less in exhaustive dataset documentation than in making those pathologies measurable under fixed incremental protocols.

The term “DIOR-IOD” is also ambiguous across arXiv. In computer vision, “DIOR” can refer to a training-free conditional image embedding framework based on large vision-language models, but that paper explicitly “does not use the exact term ‘DIOR-IOD’” [2512.21860]. In person re-identification, “DIOR” denotes “Dataset for Indoor-Outdoor Reidentification,” where “IOD” is an indoor-outdoor condition rather than a remote sensing incremental detection benchmark [2309.12429]. In astrodynamics, the relevant acronym is “D-IOD,” meaning “Direct Initial Orbit Determination,” not DIOR-IOD [2308.14298]. In medical imaging informatics, IODeep has been described as conceptually close to a “DIOR-IOD-like” DICOM AI-model object, but it is a research prototype rather than a formal DICOM standard [2311.16163]. Within the literature surveyed here, the exact term **DIOR-IOD** refers specifically to the remote sensing incremental object detection benchmark introduced alongside STAR-IOD.

Source: https://www.emergentmind.com/topics/dior-iod