---
title: 'iNaturalist-2021: Species Benchmark Dataset'
url: https://www.emergentmind.com/topics/inaturalist-2021-dataset
type: topic
---

# iNaturalist-2021: Species Benchmark Dataset

The iNaturalist-2021 (iNat2021) dataset is a large-scale, fine-grained, image-based classification collection curated to benchmark species recognition tasks in computer vision and machine learning. Derived from the citizen science iNaturalist platform, iNat2021 comprises approximately 2.7 million images encompassing 10,000 species-level classes, with a focus on macro-organisms spanning Animalia, Plantae, Fungi, and other major taxonomic kingdoms. Its primary role is as a benchmark for transfer learning—including supervised, self-supervised, and vision–language approaches—in the context of ecologically and agriculturally relevant species detection [2302.10281, 2103.16483].

## 1. Dataset Scope, Composition, and Structure

iNat2021 constitutes the largest fine-grained species dataset to date, offering the following key attributes:

- **Scale**: ~2,700,000 images, 10,000 classes (species-level granularity).
- **Taxonomic hierarchy**: Each class represents a unique species, with accompanying metadata capturing scientific (binomial) names, common names, and higher-level taxonomy (order, family, genus).
- **Kingdoms covered**: Animalia, Plantae, Fungi, and other macro-organisms.
- **Data splits**: The dataset adheres to a time-based split protocol, allocating images to training, validation, and test sets by observation date:
  - Training: 2,686,843 images
  - Validation: 100,000 images
  - Test: 500,000 images
- **Per-class annotation statistics**: The full split maintains a minimum of 152 and a maximum of 300 training images per class (average ≈267), mitigating the extreme long-tail bias in the broader iNaturalist archive [2103.16483]. A “mini” variant samples 50 images per class.

| Property               | Value                     |
|------------------------|--------------------------|
| Total images           | ~2,700,000               |
| Number of species      | 10,000                   |
| Average images/class   | ~270 (min 152, max 300)  |
| Taxonomic scope        | Animalia, Fungi, Plantae |
| Metadata per class     | Common/scientific name, higher taxonomy |

*Table: iNaturalist-2021 summary [2302.10281, 2103.16483]*

All images derive from the iNaturalist platform's "research-grade" observations, having reached community consensus on species identification [2103.16483]. Metadata fields for each image include geolocation (latitude, longitude), timestamp, observer identifier, and standardized taxonomic paths [2103.16483].

## 2. Annotation Quality and Metadata

Annotation in iNat2021 leverages the intrinsic curation processes of the iNaturalist platform:

- **Labeling process**: Species assignments are crowd-sourced and undergo peer review, with "research-grade" denoting consensus accuracy. Observations flagged as uncertain or ambiguous are either removed or explicitly marked.
- **Quality control**: No additional human verification is performed for iNat2021. Pilot studies estimate the accuracy of "research-grade" assignments at ~85–95%, with some residual label noise remaining [2103.16483].
- **Metadata**: Rich per-image information supports auxiliary research, including geospatial modeling, temporal patterns, observer biases, and federated learning paradigms [2103.16483].
- **Taxonomic treatment**: Subspecies and varieties are merged to the species level to maximize inter-class discriminability and consistency [2103.16483].

A plausible implication is that label noise and systematic imperfections in citizen science observations introduce real-world complexity valuable for training robust models.

## 3. Data Distribution and Challenges

The iNat2021 dataset reflects the fractious, long-tailed structure of natural world observations:

- **Class imbalance**: While the main split limits extremes (min 152, max 300 images/class), prior versions display a heavy long-tail (many classes <100 images, few >10,000) [2103.16483, 2302.10281].
- **Sampling**: No explicit rebalancing is performed in the distributed dataset; models must account for class frequency disparities natively.
- **Variability**: The dataset represents a spectrum of image qualities—from high-resolution DSLR captures to low-resolution smartphone outputs. Environmental conditions, occlusions, and intra/interclass visual similarity pose substantial classification and generalization challenges.
- **Fine-grainedness**: Many species are visually differentiated by subtle morphological cues (color patterns, shapes, structures), increasing the difficulty for representation learning and standard softmax classification [2302.10281].

This long-tailed, fine-grained regime motivates research emphasizing transfer learning, robust contrastive methods, label smoothing, cost-sensitive losses, and advanced data augmentation.

## 4. Dataset Adaptations and Vision–Language Integration

Unlike many image collections, iNat2021 lacks native per-image natural language captions. To exploit contrastive vision–language models, deterministic synthetic captions are generated automatically using class-level metadata:

- **Caption generation protocol** [2302.10281]:
  1. Aggregate species metadata (common/scientific name, taxonomic ranks).
  2. Select the subset of fields maximizing class discriminability.
  3. For each image of class $c$, emit a template caption: “A photo of a ⟨CONCAT_METADATA(c)⟩.”
- **Examples**: “A photo of the Buff-tailed Coronet Birds Boissonneaua flavescens”; “A photo of the Common Blue Crab Animalia Callinectes sapidus.”
- **Vision–language packaging**: Image-caption pairs are stored in WebDataset format, with captions tokenized using a CLIP-style encoder. The resulting representations are order-invariant and optimized for discriminative learning [2302.10281].
- **Modeling implications**: The LiT (“Locked-image Text” tuning) methodology freezes the pretrained vision encoder while learning text alignment, reducing over-fitting and computational cost on long-tailed data.

This pipeline makes iNat2021 well-suited for benchmarking zero-shot classification, vision–language transfer, and domain-adapted representation learning [2302.10281].

## 5. Evaluation Protocols and Baseline Metrics

Species classification performance on iNat2021 is evaluated with canonical metrics:

- **Top-K accuracy**: For a held-out set of $N$ images with ground-truth labels $y_i$, and top-$k$ predicted classes $\mathrm{Top}_k(x_i)$, metrics are:
  - Top-1: $A_1 = \frac{1}{N}\sum_i \mathbb{1}[y_i \in \mathrm{Top}_1(x_i)]$
  - Top-5: $A_5 = \frac{1}{N}\sum_i \mathbb{1}[y_i \in \mathrm{Top}_5(x_i)]$
- **Per-group mean accuracy**: Accuracy computed across “iconic groups” (e.g., Insects, Fungi, Plants).

Baselines reported on iNat2021 [2103.16483] (ResNet-50, ImageNet-pretrained):

| Split           | Top-1 Accuracy | Top-5 Accuracy |
|-----------------|---------------|---------------|
| Full iNat2021   | 0.760         | 0.914         |
| Mini (50/class) | 0.654         | 0.851         |

Self-supervised and transfer learning results indicate standard supervised features currently outperform recent self-supervised approaches such as SimCLR, although continuous improvement from new methods is anticipated [2103.16483].

## 6. Related Datasets and Position Within the iNaturalist Suite

iNat2021 builds upon and far exceeds earlier iNaturalist releases in both scale and representational depth:

- **iNat2017**: 859,000 images, 5,089 species; displays extreme long-tail and lower overall image quality [1707.06642].
- **iNat2021 vs. iNat2017**: iNat2021 is ≈5–6× larger, defines splits based on observation dates, offers improved geographic and taxonomic coverage, and more balanced per-class sample regimes [2103.16483].
- **Semi-iNat 2021**: A derived dataset for semi-supervised learning at scale—810 labeled species (L_in), 1,629 “out-of-class” unlabeled species (U_out), totaling ≈330,000 images; incorporates domain shifts and coarse taxonomic supervision to model open-set and semi-supervised regimes [2106.01364].
- **NeWT suite**: Designed for downstream transfer learning tasks (behavior, health, context) using iNat2021 pretraining [2103.16483].

The dataset continues to expand, with iNaturalist platform growth allowing annual refreshes by extending the date threshold of splits; a plausible implication is continued utility for future benchmarking as open-world recognition challenges evolve [2103.16483, 2302.10281].

## 7. Applications and Limitations

iNat2021 supports a range of research and applied domains:

- **Benchmarking**: Provides a challenging testbed for large-scale, fine-grained classification, transfer and representation learning, including self-supervised, supervised, and vision–language models.
- **Ecological and agricultural research**: Enables robust assessment of automated species detection methods in real-world, long-tailed application settings [2302.10281].
- **Geo-contextual and federated modeling**: Rich metadata encourages geospatial experiments and analysis using federated multi-user scenarios [2103.16483].
- **Caveats**: Label noise (80–95% accuracy in “research-grade”), exclusion of per-image natural language, absence of multi-label for co-occuring species, and natural label distribution variability must be considered when designing learning protocols [2103.16483].

The dataset is publicly accessible for academic research, subject to contributor-specified Creative Commons licensing via the iNaturalist platform [2103.16483].

Source: https://www.emergentmind.com/topics/inaturalist-2021-dataset