Adaptive Betweenness Clustering for Semi-Supervised Domain Adaptation (2401.11448v1)
Abstract: Compared to unsupervised domain adaptation, semi-supervised domain adaptation (SSDA) aims to significantly improve the classification performance and generalization capability of the model by leveraging the presence of a small amount of labeled data from the target domain. Several SSDA approaches have been developed to enable semantic-aligned feature confusion between labeled (or pseudo labeled) samples across domains; nevertheless, owing to the scarcity of semantic label information of the target domain, they were arduous to fully realize their potential. In this study, we propose a novel SSDA approach named Graph-based Adaptive Betweenness Clustering (G-ABC) for achieving categorical domain alignment, which enables cross-domain semantic alignment by mandating semantic transfer from labeled data of both the source and target domains to unlabeled target samples. In particular, a heterogeneous graph is initially constructed to reflect the pairwise relationships between labeled samples from both domains and unlabeled ones of the target domain. Then, to degrade the noisy connectivity in the graph, connectivity refinement is conducted by introducing two strategies, namely Confidence Uncertainty based Node Removal and Prediction Dissimilarity based Edge Pruning. Once the graph has been refined, Adaptive Betweenness Clustering is introduced to facilitate semantic transfer by using across-domain betweenness clustering and within-domain betweenness clustering, thereby propagating semantic label information from labeled samples across domains to unlabeled target data. Extensive experiments on three standard benchmark datasets, namely DomainNet, Office-Home, and Office-31, indicated that our method outperforms previous state-of-the-art SSDA approaches, demonstrating the superiority of the proposed G-ABC algorithm.
- A. Mikołajczyk and M. Grochowski, “Data augmentation for improving deep learning in image classification problem,” in 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE, 2018, pp. 117–122.
- W. Boulila, M. Sellami, M. Driss, M. Al-Sarem, M. Safaei, and F. A. Ghaleb, “Rs-dcnn: A novel distributed convolutional-neural-networks based-approach for big remote-sensing image classification,” Computers and Electronics in Agriculture, vol. 182, p. 106014, 2021.
- L. Li, J. Wang, J. Li, Q. Ma, and J. Wei, “Relation classification via keyword-attentive sentence mechanism and synthetic stimulation loss,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 27, no. 9, pp. 1392–1404, 2019.
- S. Wu, G. Deng, J. Li, R. Li, Z. Yu, and H.-S. Wong, “Enhancing triplegan for semi-supervised conditional instance synthesis and classification,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 10 091–10 100.
- J. Li, G. Li, F. Liu, and Y. Yu, “Neighborhood collective estimation for noisy label identification and correction,” in European Conference on Computer Vision. Springer, 2022, pp. 128–145.
- B. Liu, J. Jiao, and Q. Ye, “Harmonic feature activation for few-shot semantic segmentation,” IEEE Transactions on Image Processing, vol. 30, pp. 3142–3153, 2021.
- A. Garcia-Garcia, S. Orts-Escolano, S. Oprea, V. Villena-Martinez, P. Martinez-Gonzalez, and J. Garcia-Rodriguez, “A survey on deep learning techniques for image and video semantic segmentation,” Applied Soft Computing, vol. 70, pp. 41–65, 2018.
- J. Yang, R. Xu, R. Li, X. Qi, X. Shen, G. Li, and L. Lin, “An adversarial perturbation oriented domain adaptation approach for semantic segmentation,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 07, 2020, pp. 12 613–12 620.
- X. Xiong, S. Li, and G. Li, “Unpaired image-to-image translation based domain adaptation for polyp segmentation,” in 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI). IEEE, 2023, pp. 1–5.
- Z.-Q. Zhao, P. Zheng, S.-t. Xu, and X. Wu, “Object detection with deep learning: A review,” IEEE transactions on neural networks and learning systems, vol. 30, no. 11, pp. 3212–3232, 2019.
- N. Inoue, R. Furuta, T. Yamasaki, and K. Aizawa, “Cross-domain weakly-supervised object detection through progressive domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 5001–5009.
- G. Zhao, G. Li, R. Xu, and L. Lin, “Collaborative training between region proposal localization and classification for domain adaptive object detection,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII 16. Springer, 2020, pp. 86–102.
- P. Yan, Z. Wu, M. Liu, K. Zeng, L. Lin, and G. Li, “Unsupervised domain adaptive salient object detection through uncertainty-aware pseudo-label learning,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 3, 2022, pp. 3000–3008.
- H.-Y. Zhou, X. Chen, Y. Zhang, R. Luo, L. Wang, and Y. Yu, “Generalized radiograph representation learning via cross-supervision between images and free-text radiology reports,” Nature Machine Intelligence, vol. 4, no. 1, pp. 32–40, 2022.
- H.-Y. Zhou, Y. Yu, C. Wang, S. Zhang, Y. Gao, J. Pan, J. Shao, G. Lu, K. Zhang, and W. Li, “A transformer-based representation-learning model with unified processing of multimodal input for clinical diagnostics,” Nature Biomedical Engineering, pp. 1–13, 2023.
- S. Bickel, M. Brückner, and T. Scheffer, “Discriminative learning for differing training and test distributions,” in Proceedings of the 24th international conference on Machine learning, 2007, pp. 81–88.
- J. Ni, Q. Qiu, and R. Chellappa, “Subspace interpolation via dictionary learning for unsupervised domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2013, pp. 692–699.
- B. Gong, Y. Shi, F. Sha, and K. Grauman, “Geodesic flow kernel for unsupervised domain adaptation,” in 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2012, pp. 2066–2073.
- S. Herath, M. Harandi, and F. Porikli, “Learning an invariant hilbert space for domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 3845–3854.
- Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky, “Domain-adversarial training of neural networks,” The journal of machine learning research, vol. 17, no. 1, pp. 2096–2030, 2016.
- A. Kumagai and T. Iwata, “Unsupervised domain adaptation by matching distributions based on the maximum mean discrepancy via unilateral transformations,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, 2019, pp. 4106–4113.
- G. Wilson and D. J. Cook, “A survey of unsupervised deep domain adaptation,” ACM Transactions on Intelligent Systems and Technology (TIST), vol. 11, no. 5, pp. 1–46, 2020.
- K. Saito, D. Kim, S. Sclaroff, T. Darrell, and K. Saenko, “Semi-supervised domain adaptation via minimax entropy,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 8050–8058.
- T. Kim and C. Kim, “Attract, perturb, and explore: Learning a feature alignment network for semi-supervised domain adaptation,” in European Conference on Computer Vision. Springer, 2020, pp. 591–607.
- J. Li, G. Li, Y. Shi, and Y. Yu, “Cross-domain adaptive clustering for semi-supervised domain adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021, pp. 2505–2514.
- C. Qin, L. Wang, Q. Ma, Y. Yin, H. Wang, and Y. Fu, “Contradictory structure learning for semi-supervised domain adaptation,” in Proceedings of the 2021 SIAM International Conference on Data Mining (SDM). SIAM, 2021, pp. 576–584.
- S. J. Pan, I. W. Tsang, J. T. Kwok, and Q. Yang, “Domain adaptation via transfer component analysis,” IEEE Transactions on Neural Networks, vol. 22, no. 2, pp. 199–210, 2010.
- H. Yan, Y. Ding, P. Li, Q. Wang, Y. Xu, and W. Zuo, “Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 2272–2281.
- E. Tzeng, J. Hoffman, K. Saenko, and T. Darrell, “Adversarial discriminative domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 7167–7176.
- K. Li, C. Liu, H. Zhao, Y. Zhang, and Y. Fu, “Ecacl: A holistic framework for semi-supervised domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 8578–8587.
- Q. Luo, Z. Liu, L. Hong, C. Li, K. Yang, L. Wang, F. Zhou, G. Li, Z. Li, and J. Zhu, “Relaxed conditional image transfer for semi-supervised domain adaptation,” arXiv preprint arXiv:2101.01400, 2021.
- X. Peng, Q. Bai, X. Xia, Z. Huang, K. Saenko, and B. Wang, “Moment matching for multi-source domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 1406–1415.
- H. Venkateswara, J. Eusebio, S. Chakraborty, and S. Panchanathan, “Deep hashing network for unsupervised domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 5018–5027.
- K. Saenko, B. Kulis, M. Fritz, and T. Darrell, “Adapting visual category models to new domains,” in European conference on computer vision. Springer, 2010, pp. 213–226.
- D. Huang, J. Li, W. Chen, J. Huang, Z. Chai, and G. Li, “Divide and adapt: Active domain adaptation via customized learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 7651–7660.
- R. Xu, G. Li, J. Yang, and L. Lin, “Larger norm more transferable: An adaptive feature norm approach for unsupervised domain adaptation,” in Proceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 1426–1435.
- J. Zhuang, Z. Chen, P. Wei, G. Li, and L. Lin, “Discovering implicit classes achieves open set domain adaptation,” in 2022 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2022, pp. 01–06.
- Z. Zhang, W. Chen, H. Cheng, Z. Li, S. Li, L. Lin, and G. Li, “Divide and contrast: Source-free domain adaptation via adaptive contrastive learning,” Advances in Neural Information Processing Systems, vol. 35, pp. 5137–5149, 2022.
- B. Sun and K. Saenko, “Deep coral: Correlation alignment for deep domain adaptation,” in European conference on computer vision. Springer, 2016, pp. 443–450.
- E. Tzeng, J. Hoffman, N. Zhang, K. Saenko, and T. Darrell, “Deep domain confusion: Maximizing for domain invariance,” arXiv preprint arXiv:1412.3474, 2014.
- M. Long, Y. Cao, J. Wang, and M. Jordan, “Learning transferable features with deep adaptation networks,” in International conference on machine learning. PMLR, 2015, pp. 97–105.
- J.-C. Su, Y.-H. Tsai, K. Sohn, B. Liu, S. Maji, and M. Chandraker, “Active adversarial domain adaptation,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2020, pp. 739–748.
- M. Chen, S. Zhao, H. Liu, and D. Cai, “Adversarial-learned loss for domain adaptation,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, 2020, pp. 3521–3528.
- Z. Cao, L. Ma, M. Long, and J. Wang, “Partial adversarial domain adaptation,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 135–150.
- M. Awais, F. Zhou, H. Xu, L. Hong, P. Luo, S.-H. Bae, and Z. Li, “Adversarial robustness for unsupervised domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 8568–8577.
- J. Yang, C. Li, W. An, H. Ma, Y. Guo, Y. Rong, P. Zhao, and J. Huang, “Exploring robustness of unsupervised domain adaptation in semantic segmentation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 9194–9203.
- C. Chen, W. Xie, W. Huang, Y. Rong, X. Ding, Y. Huang, T. Xu, and J. Huang, “Progressive feature alignment for unsupervised domain adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 627–636.
- Y. Pan, T. Yao, Y. Li, Y. Wang, C.-W. Ngo, and T. Mei, “Transferrable prototypical networks for unsupervised domain adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 2239–2247.
- L. Zhong, Z. Fang, F. Liu, J. Lu, B. Yuan, and G. Zhang, “How does the combined risk affect the performance of unsupervised domain adaptation approaches?” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 12, 2021, pp. 11 079–11 087.
- S. Motiian, Q. Jones, S. M. Iranmanesh, and G. Doretto, “Few-shot adversarial domain adaptation,” in Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, pp. 6673–6683.
- S. Li, M. Xie, F. Lv, C. H. Liu, J. Liang, C. Qin, and W. Li, “Semantic concentration for domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 9102–9111.
- W. Xiao, Z. Ding, and H. Liu, “Implicit semantic response alignment for partial domain adaptation,” Advances in Neural Information Processing Systems, vol. 34, 2021.
- Y. Zhang, G. Song, L. Du, S. Yang, and Y. Jin, “Dane: Domain adaptive network embedding,” arXiv preprint arXiv:1906.00684, 2019.
- M. Wu, S. Pan, C. Zhou, X. Chang, and X. Zhu, “Unsupervised domain adaptive graph convolutional networks,” in Proceedings of The Web Conference 2020, 2020, pp. 1457–1467.
- S. Yang, G. Song, Y. Jin, and L. Du, “Domain adaptive classification on heterogeneous information networks,” in Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, 2021, pp. 1410–1416.
- M. Pilancı and E. Vural, “Domain adaptation on graphs via frequency analysis,” in 2019 27th Signal Processing and Communications Applications Conference (SIU). IEEE, 2019, pp. 1–4.
- M. Pilanci and E. Vural, “Domain adaptation on graphs by learning aligned graph bases,” IEEE Transactions on Knowledge and Data Engineering, 2020.
- Z. Ding, S. Li, M. Shao, and Y. Fu, “Graph adaptive knowledge transfer for unsupervised domain adaptation,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 37–52.
- D. Zhou, O. Bousquet, T. Lal, J. Weston, and B. Schölkopf, “Learning with local and global consistency,” Advances in neural information processing systems, vol. 16, 2003.
- C. H. Nguyen and H. Mamitsuka, “Discriminative graph embedding for label propagation,” IEEE transactions on neural networks, vol. 22, no. 9, pp. 1395–1405, 2011.
- L. Wang, Z. Ding, and Y. Fu, “Adaptive graph guided embedding for multi-label annotation,” in IJCAI, 2018.
- D. Li and T. Hospedales, “Online meta-learning for multi-source and semi-supervised domain adaptation,” in European Conference on Computer Vision. Springer, 2020, pp. 382–403.
- S. Chen, M. Harandi, X. Jin, and X. Yang, “Semi-supervised domain adaptation via asymmetric joint distribution matching,” IEEE Transactions on Neural Networks and Learning Systems, 2020.
- L. Yang, Y. Wang, M. Gao, A. Shrivastava, K. Q. Weinberger, W.-L. Chao, and S.-N. Lim, “Deep co-training with task decomposition for semi-supervised domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 8906–8916.
- Z. Fang, J. Lu, F. Liu, and G. Zhang, “Semi-supervised heterogeneous domain adaptation: Theory and algorithms,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 1, pp. 1087–1105, 2023.
- P. Jiang, A. Wu, Y. Han, Y. Shao, and B. Li, “Bidirectional adversarial training for semi-supervised domain adaptation,” in Twenty-Ninth International Joint Conference on Artificial Intelligence and Seventeenth Pacific Rim International Conference on Artificial Intelligence IJCAI-PRICAI-20, 2020.
- B. Li, Y. Wang, S. Zhang, D. Li, T. Darrell, K. Keutzer, and H. Zhao, “Learning invariant representations and risks for semi-supervised domain adaptation,” arXiv preprint arXiv:2010.04647, 2020.
- S. Mishra, K. Saenko, and V. Saligrama, “Surprisingly simple semi-supervised domain adaptation with pretraining and consistency,” arXiv preprint arXiv:2101.12727, 2021.
- S. Yang, Y. Wang, J. van de Weijer, L. Herranz, and S. Jui, “Generalized source-free domain adaptation,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 8958–8967.
- K. Saito, D. Kim, S. Sclaroff, and K. Saenko, “Universal domain adaptation through self supervision,” arXiv preprint arXiv:2002.07953, 2020.
- E. Arazo, D. Ortego, P. Albert, N. E. O’Connor, and K. McGuinness, “Pseudo-labeling and confirmation bias in deep semi-supervised learning,” in 2020 International Joint Conference on Neural Networks (IJCNN). IEEE, 2020, pp. 1–8.
- A. Kurakin, C.-L. Li, C. Raffel, D. Berthelot, E. D. Cubuk, H. Zhang, K. Sohn, N. Carlini, and Z. Zhang, “Fixmatch: Simplifying semi-supervised learning with consistency and confidence,” in Advances in Neural Information Processing Systems, 2020.
- Q. Xie, Z. Dai, E. Hovy, M.-T. Luong, and Q. V. Le, “Unsupervised data augmentation for consistency training,” arXiv preprint arXiv:1904.12848, 2019.
- J. Li, S. Wu, C. Liu, Z. Yu, and H.-S. Wong, “Semi-supervised deep coupled ensemble learning with classification landmark exploration,” IEEE Transactions on Image Processing, vol. 29, pp. 538–550, 2019.
- S. Wu, J. Li, C. Liu, Z. Yu, and H.-S. Wong, “Mutual learning of complementary networks via residual correction for improving semi-supervised classification,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 6500–6509.
- J. Li, K. Lu, Z. Huang, L. Zhu, and H. T. Shen, “Heterogeneous domain adaptation through progressive alignment,” IEEE transactions on neural networks and learning systems, vol. 30, no. 5, pp. 1381–1391, 2018.
- Y. Bai, C. Wang, Y. Lou, J. Liu, and L.-Y. Duan, “Hierarchical connectivity-centered clustering for unsupervised domain adaptation on person re-identification,” IEEE Transactions on Image Processing, vol. 30, pp. 6715–6729, 2021.
- F. Wang and C. Zhang, “Label propagation through linear neighborhoods,” IEEE Transactions on Knowledge and Data Engineering, vol. 20, no. 1, pp. 55–67, 2007.
- C. Gong, D. Tao, W. Liu, L. Liu, and J. Yang, “Label propagation via teaching-to-learn and learning-to-teach,” IEEE transactions on neural networks and learning systems, vol. 28, no. 6, pp. 1452–1465, 2016.
- Y. Liu, J. Lee, M. Park, S. Kim, and Y. Yang, “Transductive propagation network for few-shot learning,” CoRR, vol. abs/1805.10002, 2018. [Online]. Available: http://arxiv.org/abs/1805.10002
- S.-A. Rebuffi, S. Ehrhardt, K. Han, A. Vedaldi, and A. Zisserman, “Lsd-c: Linearly separable deep clusters,” arXiv preprint arXiv:2006.10039, 2020.
- J. Li, R. Socher, and S. C. Hoi, “Dividemix: Learning with noisy labels as semi-supervised learning,” arXiv preprint arXiv:2002.07394, 2020.
- D. Berthelot, N. Carlini, I. Goodfellow, N. Papernot, A. Oliver, and C. A. Raffel, “Mixmatch: A holistic approach to semi-supervised learning,” in Advances in Neural Information Processing Systems, 2019, pp. 5049–5059.
- J. Yoon, D. Kang, and M. Cho, “Semi-supervised domain adaptation via sample-to-sample self-distillation,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2022, pp. 1978–1987.
- A. Singh, “Clda: Contrastive learning for semi-supervised domain adaptation,” Advances in Neural Information Processing Systems, vol. 34, 2021.
- Z. Huang, K. Sheng, W. Dong, X. Mei, C. Ma, F. Huang, D. Zhou, and C. Xu, “Effective label propagation for discriminative semi-supervised domain adaptation,” CoRR, vol. abs/2012.02621, 2020.
- C. Qin, L. Wang, Q. Ma, Y. Yin, H. Wang, and Y. Fu, “Semi-supervised domain adaptive structure learning,” IEEE Transactions on Image Processing, vol. 31, pp. 7179–7190, 2022.
- Z. Yan, Y. Wu, G. Li, Y. Qin, X. Han, and S. Cui, “Multi-level consistency learning for semi-supervised domain adaptation,” in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, L. D. Raedt, Ed. International Joint Conferences on Artificial Intelligence Organization, 7 2022, pp. 1530–1536, main Track.
- A. Krizhevsky, I. Sutskever, and G. Hinton, “Imagenet classification with deep convolutional neural networks,” in NIPS, 2012.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- E. D. Cubuk, B. Zoph, J. Shlens, and Q. V. Le, “Randaugment: Practical automated data augmentation with a reduced search space,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2020.
- T. DeVries and G. W. Taylor, “Improved regularization of convolutional neural networks with cutout,” 2017.
- Y. Ganin and V. Lempitsky, “Unsupervised domain adaptation by backpropagation,” JMLR.org, 2014.
- L. v. d. Maaten and G. Hinton, “Visualizing data using t-sne,” Journal of machine learning research, vol. 9, no. Nov, pp. 2579–2605, 2008.
- Jichang Li (9 papers)
- Guanbin Li (177 papers)
- Yizhou Yu (148 papers)