Papers
Topics
Authors
Recent
Search
2000 character limit reached

Open-set Cross Modal Generalization

Updated 3 July 2026
  • OSCMG is a paradigm in multimodal learning that transfers competencies to unseen modalities, addressing gaps due to incomplete training data.
  • It leverages techniques such as domain generalization, discrete index-level alignment, and self-supervised pretext tasks to improve classification, retrieval, and grounding.
  • Challenges include overfitting, feature misalignment, and limited zero-shot extension, highlighting the need for flexible adaptation and robust benchmarking.

11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11^ 11 11zero-data 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11bridge 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11bridge 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11^ 11^ 11^ 11^ 11 11 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11 11 11 11^( 11 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11 11 11^ 11^ 11^ 11^ 11 11 11 11 11^ 11^ 11^ 11^ 11^ 11 11zero-data 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11 11 11 11 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11 11^ 11^ 11^ 11^ 11^ 11 11 11 11 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11zero-data 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11 11^ 11 11 11 11 11^ 11^ 11^ 11^ 11^ 11 11bridge 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11^ 11 11 11 11^ 11^ 11^ 11 11 11 11 11^ 11^ 11^ 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11^ 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11bridge 11 11^ 11 11 11 11 11 11 11 11bridge 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11^ 11 11 11 11 11 11zero-data 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11^ 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11^ 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11^ 11 11 11 11 11 11 11^( 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Open-set Cross Modal Generalization (OSCMG).