Open Zero-Shot Learning (OZSL)
- Open Zero-Shot Learning (OZSL) is a paradigm that extends traditional zero-shot learning into an open-world setting using three disjoint class sets: seen, unseen, and unknown.
- It leverages joint semantic transfer, calibration, and decision-making, integrating generative and adversarial techniques to synthesize unknown features and proxy embeddings.
- Evaluation in OZSL uses tailored metrics (e.g., F1 scores and AUROC) to measure the balance between class recognition and unknown rejection, highlighting open-world calibration challenges.
Open Zero-Shot Learning (OZSL) extends generalized zero-shot learning into an open-world regime in which a model must recognize seen classes, recognize semantically described unseen classes, and reject instances from unknown categories for which neither visual data nor class embeddings are available during training (Marmoreo et al., 2021). A closely related body of work studies open-world zero-shot recognition through enlarged candidate label spaces, especially in compositional settings where prediction must range over the full product space of primitives and many candidates are infeasible rather than merely unseen (Mancini et al., 2021). In both senses, OZSL departs from the closed-label assumption of standard ZSL and GZSL, and the central problem becomes joint semantic transfer, calibration, and open-world decision-making rather than unseen-class recognition alone (Li et al., 2023).
1. Formal task definition
The canonical OZSL formulation introduces three disjoint class sets: seen classes, unseen classes, and unknown classes. In the notation of ZS-OSR, these are
with
For seen classes, training provides image samples, class labels, and semantic embeddings; for unseen classes, training provides no image samples but semantic embeddings are available; for unknown classes, training provides no image samples and no semantic embeddings (Li et al., 2023).
A standard formalization writes the seen training set as
and the unseen semantic inventory as
At test time, data come from both unseen and unknown classes,
and the target is an open predictor
This is the standard unseen-versus-unknown version of OZSL; generalized versions additionally include seen classes at inference (Li et al., 2023).
The formulation introduced specifically under the name OZSL uses the class subsets
for seen, unseen, and unknown classes, respectively. The defining distinction is that seen classes have visual data and class embeddings, unseen classes have class embeddings but no visual data, and unknown classes have neither visual data nor class embeddings (Marmoreo et al., 2021). This is the sense in which the problem is “learning without seeing nor knowing”: the unknown branch requires rejection of classes the system has neither seen visually nor known semantically.
2. Relation to adjacent paradigms
OZSL is best understood relative to several neighboring formulations. Standard ZSL assumes test samples belong only to semantically specified unseen classes. GZSL allows test samples from seen and unseen classes but still assumes a closed candidate universe over those classes. Open-set recognition handles rejection of unknown classes, but does not provide zero-shot transfer to semantically specified unseen classes. OW-CZSL enlarges the candidate space to the full combinatorial product of primitives, so openness appears as semantic search over many implausible compositions rather than as a pure reject problem (Marmoreo et al., 2021).
| Setting | Training assumptions | Test-time behavior |
|---|---|---|
| Standard ZSL | seen images; unseen semantics known | predict only unseen classes |
| GZSL | seen images; seen and unseen semantics known | predict over seen unseen |
| OZSL / ZS-OSR | seen images; unseen semantics known; unknowns have no samples and no semantics | classify unseen and reject unknowns; generalized variants also include seen |
| OW-CZSL | known primitives; seen compositions only | predict over full |
| Vocabulary-informed open set | labeled source classes plus a large unlabeled semantic vocabulary | rank over a large candidate vocabulary |
Several influential ZSL methods are explicitly not OZSL in the strict sense. OntoZSL is a standard ZSL/GZSL framework with richer ontology-based semantics but no modeling of unknown/open classes beyond a predefined unseen label set (Geng et al., 2021). ZeroMamba targets conventional ZSL and GZSL with no explicit unknown rejection (Hou et al., 2024). “Zero-Shot Learning posed as a Missing Data Problem” is a closed-set transductive unseen-only method that forces every test sample into one of the predefined unseen Gaussian components (Zhao et al., 2016). “Classifier and Exemplar Synthesis for Zero-Shot Learning” synthesizes classifiers or exemplars for a predefined unseen set and addresses seen-vs-unseen bias in GZSL, not unknown-class rejection (Changpinyo et al., 2018).
3. Evaluation protocols and metrics
A central contribution of the OZSL literature is that GZSL metrics are insufficient once unknown classes are admitted. In GZSL, the standard summary is the harmonic mean of seen and unseen recalls,
0
but this ignores false positives from unknown samples. OZSL therefore introduces
1
with
2
and
3
The motivation is explicit: unknown classes lack semantic identities, so rejection must be reflected indirectly through the false positives they induce on seen and unseen labels (Marmoreo et al., 2021).
The benchmark protocol of the original OZSL paper adapts the Proposed Splits of Xian et al. and creates unknown classes by sampling 50% of the original unseen classes and relabeling them as unknown; the remaining 50% stay unseen. Additional split variants include “20-80”, “unseen”, and “80-20” (Marmoreo et al., 2021). The same paper also reports rejection-oriented diagnostics by collapsing all unknown classes into a macro unknown bin and measuring 4, 5, and 6.
ZS-OSR work emphasizes a complementary metric suite: classification accuracy on unseen classes, 7, and 8 for unknown-vs-unseen discrimination. It also evaluates generalized ZS-OSR, ZS-OOD, and varying openness, where openness is defined as
9
Higher openness means relatively more unknown classes (Li et al., 2023).
Compositional open-world evaluation uses another family of metrics. For OW-CZSL, the literature reports state accuracy, object accuracy, best seen accuracy, best unseen accuracy, best harmonic mean, and 0 under varying bias factors favoring unseen compositions (Mancini et al., 2021). Later OW-CZSL work preserves the seen/unseen harmonic mean and 1 emphasis, but applies them over the full compositional search space rather than a curated set of feasible labels (Kim et al., 16 May 2025).
4. Unknown-aware generative and adversarial methods
The first OZSL-specific methodological proposal is unknown feature generation. Direct Unknown Generation (DUG) synthesizes unknown visual features by MixUp-style interpolation: 2 where 3 is sampled from a 4 distribution. The resulting mixed feature is assigned the unknown label. Semantic Based Unknown Generation (SBUG) is more ambitious: it learns a transformed semantic space with a variationally conditioned Wasserstein GAN, samples semantic vectors
5
and optimizes
6
with
7
plus the gradient penalty
8
and the classification loss
9
Unknown semantic embeddings are then synthesized by interpolation in complementary regions of semantic space,
0
and used to generate unknown visual features (Marmoreo et al., 2021).
This line of work established two empirical points. First, simply combining a strong GZSL generator with OpenMax does not solve OZSL. Second, unknown generation is beneficial: DUG improved 1 across CLSWGAN, tf-VAEGAN, and CEZSL, and SBUG often improved over the base VAcWGAN setup (Marmoreo et al., 2021).
ASE (“Adversarial Semantic Embeddings”) reframes the same core problem as ZS-OSR and argues that naïvely chaining a generative ZSL model with an OSR detector fails because synthesized unseen features are generated without any awareness of unknown classes (Li et al., 2023). ASE therefore learns proxy semantic embeddings for unknown classes. Its objective is
2
with semantic-space proximity
3
and feature-space adversarial loss
4
The learned unknown semantic embeddings are passed through a pretrained generative ZSL model to synthesize unknown features, which are then pooled into a single reject label and used to train a 5-class unknowns-informed classifier (Li et al., 2023).
ASE provides the strongest direct OZSL evidence in the surveyed material. Reported AUROC values are 80.20 on CUB, 81.99 on AWA2, 72.78 on FLO, and 72.69 on SUN, and the paper states a 12.42% reduction in FPR95 on AWA2 relative to the best baseline. It also extends to generalized ZS-OSR and ZS-OOD, where unknown classes come from different datasets (Li et al., 2023).
5. Open-world label spaces, compositionality, and feasibility modeling
A major branch of OZSL-related research studies openness as expansion of the candidate label space rather than only as explicit unknown rejection. In OW-CZSL, the label set is the full Cartesian product
6
and open world is defined by
7
CompCos scores images against compositions by cosine similarity,
8
and supplements this with feasibility scores
9
combined as
0
The paper reports that the average mixing function works best, and uses feasibility both for hard masking,
1
and for feasibility-aware training (Mancini et al., 2021).
The empirical conclusion of OW-CZSL is severe: all methods deteriorate sharply when moving from closed-world to open-world evaluation. On MIT States, LE+ unseen accuracy drops from 2 to 3, SymNet drops from 4 to 5, and TMN drops from 6 to 7. CompCos recovers part of this loss, improving over SymNet by 8 unseen accuracy and doubling 9 from 0 to 1 on MIT States (Mancini et al., 2021).
Feasibility with LLM (FLM) replaces static feasibility priors with LLM-based semantic judgments. For a state-object pair 2, the feasibility score is
3
or, with in-context guidance,
4
where
5
Thresholding then produces the candidate set
6
This feasibility filter consistently improves CLIP, CoOp, and CSP across MIT-States, UT-Zappos, and C-GQA, and the paper reports especially strong gains on UT-Zappos (Kim et al., 16 May 2025).
The 2024 unified OW-CZSL framework pushes this line further with stronger multimodal interaction. It concatenates image patch embeddings and text embeddings as transformer input, introduces a TopK Embedding Selection Module to retain image-relevant textual candidates, and uses a Sparse Linear Compositor to produce attribute, object, and final composition predictions. It also introduces a hybrid procedure that combines joint composition learning with independent primitive learning, and the abstract reports state-of-the-art performance in OW-CZSL on three datasets while surpassing Large Vision LLMs in two datasets (Jayasekara et al., 2024).
A broader, non-compositional precursor is vocabulary-informed learning, which trains a single semantic-prototype model using both labeled source classes and a much larger unlabeled semantic vocabulary. It defines inference over supervised, zero-shot, generalized zero-shot, and open-set regimes by changing only the candidate label set,
7
with open set given by
8
Its weighted maximum-margin objective incorporates constraints against both seen and unsupervised vocabulary atoms, and the experiments scale to an open vocabulary of about 310K words/phrases (Fu et al., 2023). The method is highly relevant to open-vocabulary OZSL, but it has no explicit unknown rejection rule and always assigns the nearest prototype.
6. Semantic backbones, empirical trends, and limitations
A recurring theme in OZSL is that open-world handling is only as good as the semantic backbone it rests on. OntoZSL replaces limited priors such as plain attributes or word embeddings with ontology-based semantics represented as a multi-relational RDF graph
9
and learns text-aware ontology embeddings with translational scores such as
0
These embeddings are then fed into a conditional GAN,
1
to synthesize unseen features (Geng et al., 2021). OntoZSL is not an open-set or open-world method in the strict sense, but it is directly relevant as a richer semantic backbone. The paper states that ontology-based class semantics outperform previous priors such as word embeddings by an average of 12.4 accuracy points in standard ZSL across two example datasets.
On the visual side, ZeroMamba shows that stronger visual-semantic transfer can materially improve conventional ZSL and GZSL even without solving true OZSL. Its core components are Semantic-aware Local Projection,
2
Global Representation Learning,
3
and Semantic Fusion,
4
trained with
5
Its generalized prediction rule includes an unseen-class calibration term,
6
which is OZSL-relevant because seen-class bias is a prerequisite problem for any open-world extension (Hou et al., 2024).
Older ZSL formulations remain methodologically important. The “missing data problem” view models each unseen class as a Gaussian in feature space,
7
initialized from semantically transferred virtual signatures and refined by EM (Zhao et al., 2016). SynC and EXEM synthesize unseen classifiers
8
or predicted exemplars
9
for predefined unseen classes (Changpinyo et al., 2018). These methods are foundational because OZSL still needs strong candidate unseen-class models, but they remain closed-world.
Taken together, the literature indicates several stable conclusions. Closed-world assumptions can dramatically overestimate performance: open-world compositional evaluation causes severe degradation (Mancini et al., 2021). Naïve combinations of ZSL and OSR perform badly in distinguishing unseen-class and unknown-class samples (Li et al., 2023). Semantic quality is a dominant variable: ontology-grounded semantics, exemplar prediction, and vocabulary-informed margins all improve transfer to predefined unseen classes (Geng et al., 2021, Changpinyo et al., 2018, Fu et al., 2023). Feasibility modeling helps when the open label space is large and noisy, whether through primitive similarities, LLM priors, or multimodal TopK filtering (Mancini et al., 2021, Kim et al., 16 May 2025, Jayasekara et al., 2024). At the same time, many ostensibly related methods stop short of OZSL because they retain a closed candidate unseen set, provide no reject option, or collapse all novelty into nearest-prototype assignment (Geng et al., 2021, Hou et al., 2024, Fu et al., 2023).
The main unresolved issue is therefore not merely zero-shot transfer, but open-world calibration under incomplete semantic support. The surveyed works suggest several non-exclusive routes: synthesize proxy unknowns, model feasibility before visual ranking, improve semantic structure with ontologies or large vocabularies, and strengthen visual-semantic alignment so that rejection scores are less confounded by poor transfer. This suggests that OZSL is not a single method family but a junction of ZSL, OSR, open-vocabulary recognition, and structured semantic reasoning (Marmoreo et al., 2021).