Intelligent Known and Novel Aircraft Recognition -- A Shift from Classification to Similarity Learning for Combat Identification (2402.16486v1)
Abstract: Precise aircraft recognition in low-resolution remote sensing imagery is a challenging yet crucial task in aviation, especially combat identification. This research addresses this problem with a novel, scalable, and AI-driven solution. The primary hurdle in combat identification in remote sensing imagery is the accurate recognition of Novel/Unknown types of aircraft in addition to Known types. Traditional methods, human expert-driven combat identification and image classification, fall short in identifying Novel classes. Our methodology employs similarity learning to discern features of a broad spectrum of military and civilian aircraft. It discerns both Known and Novel aircraft types, leveraging metric learning for the identification and supervised few-shot learning for aircraft type classification. To counter the challenge of limited low-resolution remote sensing data, we propose an end-to-end framework that adapts to the diverse and versatile process of military aircraft recognition by training a generalized embedder in fully supervised manner. Comparative analysis with earlier aircraft image classification methods shows that our approach is effective for aircraft image classification (F1-score Aircraft Type of 0.861) and pioneering for quantifying the identification of Novel types (F1-score Bipartitioning of 0.936). The proposed methodology effectively addresses inherent challenges in remote sensing data, thereby setting new standards in dataset quality. The research opens new avenues for domain experts and demonstrates unique capabilities in distinguishing various aircraft types, contributing to a more robust, domain-adapted potential for real-time aircraft recognition.
- Prnet: Progressive resolution based network for radiograph based disease classification. In 2021 Ethics and Explainability for Responsible Data Science (EE-RDS), pages 1–5. IEEE, 2021.
- Human Factors Issues in Combat Identification. Human Factors in Defence. Ashgate Publishing Limited, 2012.
- Aircraft classification based on pca and feature fusion techniques in convolutional neural network. IEEE Access, 9:161683–161694, 2021.
- An aggregation of aggregation methods in computational pathology. Medical Image Analysis, page 102885, 2023.
- Role of ai and digital pathology for colorectal immuno-oncology. British Journal of Cancer, 128(1):3–11, 2023.
- Development and validation of artificial intelligence-based prescreening of large-bowel biopsies taken in the uk and portugal: a retrospective cohort study. The Lancet Digital Health, 5(11):e786–e797, 2023.
- Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 105(10):1865–1883, 2017.
- Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009.
- Object detection in aerial images: A large-scale benchmark and challenges. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(11):7778–7796, 2022.
- An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
- Multicam: Multiple class activation mapping for aircraft recognition in remote sensing images. Remote sensing, 11(5):544, 2019.
- Optimizing and evaluating swin transformer for aircraft classification: Analysis and generalizability of the mtarsi dataset. IEEE Access, 10:134427–134439, 2022.
- Zhang. J. Gu. Y., Zhang. Y. Integration of spatial–spectral information for resolution enhancement in hyperspectral images. IEEE Trans. Geosci. Remote Sensing, 2008.
- Research on mimo-isar high resolution imaging technology. In 2021 IEEE 4th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), volume 4, pages 169–174. IEEE, 2021.
- Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
- G. Krizhevsky, A.; Hinton. Learning multiple layers of features from tiny images. University of Toronto: Toronto, ON, Canada, 2009.
- Domain adaptive few-shot learning for isar aircraft recognition with transferred attention and weighting importance. Electronics, 12(13):2909, 2023.
- Aircraft recognition in high-resolution satellite images using coarse-to-fine shape prior. IEEE Geoscience and Remote Sensing Letters, 10(3):573–577, 2012.
- Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10012–10022, 2021.
- Fine-grained visual classification of aircraft. arXiv preprint arXiv:1306.5151, 2013.
- RÂ Rudd-Orthner and LÂ Mihaylova. Multi-type aircraft of remote sensing images: Mtarsi 2. Zenodo, 2021.
- Remote sensing aircraft classification harnessing deep learning advancements. In 2023 18th International Conference on Emerging Technologies (ICET), pages 50–55, 2023.
- Mtarsi-innar. Zenodo.org, January 2024.
- Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 815–823, 2015.
- Tao.Lei Song.F, Peng.Z. Raih-det: An end-to-end rotated aircraft and aircraft head detector based on convnext and cyclical focal loss in optical remote sensing images. IEEE Trans. Geosci. Remote Sensing, 2023.
- Fair1m: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 184:116–130, 2022.
- The research of air combat intention identification method based on bilstm+ attention. Electronics, 12(12):2633, 2023.
- Srarnet: A unified framework for joint superresolution and aircraft recognition. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14:327–336, 2020.
- Aircraft detection system based on regions with convolutional neural networks. International Journal of Intelligent Systems and Applications in Engineering, 8(3):147–153, 2020.
- Transeffidet: aircraft detection and classification in aerial images based on efficientdet and transformer. Computational Intelligence and Neuroscience, 2022, 2022.
- Aircraft recognition in high-resolution optical satellite remote sensing images. IEEE Geoscience and Remote Sensing Letters, 12(1):112–116, 2014.
- ZÂ Wu. Multi-type aircraft of remote sensing images: Mtarsi. Zenodo. org, 10, 2019.
- A benchmark data set for aircraft type recognition from remote sensing images. Applied Soft Computing, 89:106132, 2020.
- Aid: A benchmark data set for performance evaluation of aerial scene classification. IEEE Transactions on Geoscience and Remote Sensing, 55(7):3965–3981, 2017.
- Yi Yang and Shawn Newsam. Bag-of-visual-words and spatial extensions for land-use classification. In Proceedings of the 18th SIGSPATIAL international conference on advances in geographic information systems, pages 270–279, 2010.
- Aircraft type recognition in remote sensing images based on feature learning with conditional generative adversarial networks. Remote Sensing, 10(7):1123, 2018.
- Aircraft type recognition in remote sensing images: Bilinear discriminative extreme learning machine framework. Electronics, 10(17):2046, 2021.
- Mgml: Multigranularity multilevel feature ensemble network for remote sensing scene classification. IEEE Transactions on Neural Networks and Learning Systems, 2021.
- Patternnet: A benchmark dataset for performance evaluation of remote sensing image retrieval. ISPRS journal of photogrammetry and remote sensing, 145:197–209, 2018.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.