2000 character limit reached
cVIL: Class-Centric Visual Interactive Labeling (2405.08150v1)
Published 13 May 2024 in cs.HC
Abstract: We present cVIL, a class-centric approach to visual interactive labeling, which facilitates human annotation of large and complex image data sets. cVIL uses different property measures to support instance labeling for labeling difficult instances and batch labeling to quickly label easy instances. Simulated experiments reveal that cVIL with batch labeling can outperform traditional labeling approaches based on active learning. In a user study, cVIL led to better accuracy and higher user preference compared to a traditional instance-based visual interactive labeling approach based on 2D scatterplots.
- Power to the people: The role of humans in interactive machine learning. Ai Magazine 35, 4 (2014), 105–120.
- Semi-automatic data annotation guided by feature space projection. Pattern Recognition 109 (2021), 107612.
- A taxonomy of property measures to unify active learning and human-centered approaches to data labeling. ACM Trans. Interact. Intell. Syst. 11 (2021), 20:1–20:42.
- Comparing visual-interactive labeling with active learning: An experimental study. IEEE Transactions on Visualization and Computer Graphics 24 (2018), 298–308.
- Beil D., Theissler A.: Cluster-clean-label: an interactive machine learning approach for labeling high-dimensional data. Proceedings of the 13th International Symposium on Visual Information Communication and Interaction (2020).
- Vial: a unified process for visual interactive labeling. The Visual Computer 34 (2018), 1189–1207.
- Interactive labelling of a multivariate dataset for supervised machine learning using linked visualisations, clustering, and active learning. Vis. Informatics 3 (2019), 9–17.
- An analysis of single-layer networks in unsupervised feature learning. In Proceedings of the fourteenth international conference on artificial intelligence and statistics (2011), JMLR Workshop and Conference Proceedings, pp. 215–223.
- From data analysis and visualization to causality discovery. Computer 44 (2011), 84–87.
- Emerging properties in self-supervised vision transformers. 2021 IEEE/CVF International Conference on Computer Vision (ICCV) (2021), 9630–9640.
- Imagenet: A large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition (2009), 248–255.
- A survey on instance selection for active learning. Knowledge and Information Systems 35 (2012), 249–283.
- Visgil: machine learning-based visual guidance for interactive labeling. The Visual Computer 39 (2022), 5097 – 5119.
- MNIST handwritten digit database. ATT Labs [Online]. Available: http://yann.lecun.com/exdb/mnist 2 (2010).
- Deep learning face attributes in the wild. In ICCV (2015), IEEE Computer Society, pp. 3730–3738.
- Nonato L. G., Aupetit M.: Multidimensional projection for visual analytics: Linking techniques with distortions, tasks, and layout enrichment. IEEE Transactions on Visualization and Computer Graphics 25, 8 (2018), 2650–2673.
- Evaluation of subjective mental workload: A comparison of swat, nasa-tlx, and workload profile methods. Applied Psychology 53 (2004), 61–86.
- Settles B.: Active learning literature survey. Tech. rep., University of Wisconsin-Madison Department of Computer Sciences, 2009.
- Seifert C., Granitzer M.: User-based active learning. 2010 IEEE International Conference on Data Mining Workshops (2010), 418–425.
- Morphocluster: Efficient annotation of plankton images by clustering. Sensors 20, 11 (2020), 3060.
- van der Maaten L., Hinton G. E.: Visualizing data using t-sne. Journal of Machine Learning Research 9 (2008), 2579–2605.
- Simulation-based optimization of user interfaces for quality-assuring machine learning model predictions. ACM Transactions on Interactive Intelligent Systems (2021).