2000 character limit reached
Dataset Factory: A Toolchain For Generative Computer Vision Datasets (2309.11608v1)
Published 20 Sep 2023 in cs.AI
Abstract: Generative AI workflows heavily rely on data-centric tasks - such as filtering samples by annotation fields, vector distances, or scores produced by custom classifiers. At the same time, computer vision datasets are quickly approaching petabyte volumes, rendering data wrangling difficult. In addition, the iterative nature of data preparation necessitates robust dataset sharing and versioning mechanisms, both of which are hard to implement ad-hoc. To solve these challenges, we propose a "dataset factory" approach that separates the storage and processing of samples from metadata and enables data-centric operations at scale for machine learning teams and individual researchers.
- Contrastive language and vision learning of general fashion concepts. Scientific Reports, 12(1):18958, Nov 2022. ISSN 2045-2322. doi: 10.1038/s41598-022-23052-9. URL https://doi.org/10.1038/s41598-022-23052-9.
- DataComp. Datacomp leaderboard, 2023. URL https://www.datacomp.ai/leaderboard.html.
- DataComp: In search of the next generation of multimodal datasets. arXiv preprint arXiv:2304.14108, 2023.
- Microsoft COCO: Common objects in context. CoRR, abs/1405.0312, 2014. URL http://arxiv.org/abs/1405.0312.
- Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 10012–10022, October 2021.
- Wes McKinney. Apache Arrow and the “10 things I hate about pandas”, 2017. URL https://wesmckinney.com/blog/apache-arrow-pandas-internals/.
- What can data-centric AI learn from data and ML engineering? arXiv preprint arXiv:2112.06439, 2021.
- Tracking dubious data: Protecting scientific workflows from invalidated experiments. In 2022 IEEE 18th International Conference on e-Science (e-Science), pages 456–461, 2022. doi: 10.1109/eScience55777.2022.00082.
- High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022.
- LAION-5B: An open large-scale dataset for training next generation image-text models, 2022.
- A survey of data provenance techniques. Technical Report IUB-CS-TR618, Computer Science Department, Indiana University, Bloomington, IN, 2005.
- Florence: A new foundation model for computer vision. arXiv preprint arXiv:2111.11432, 2021.
- Scaling vision transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 12104–12113, June 2022.