Manifold-based Incomplete Multi-view Clustering via Bi-Consistency Guidance (2405.10987v1)
Abstract: Incomplete multi-view clustering primarily focuses on dividing unlabeled data into corresponding categories with missing instances, and has received intensive attention due to its superiority in real applications. Considering the influence of incomplete data, the existing methods mostly attempt to recover data by adding extra terms. However, for the unsupervised methods, a simple recovery strategy will cause errors and outlying value accumulations, which will affect the performance of the methods. Broadly, the previous methods have not taken the effectiveness of recovered instances into consideration, or cannot flexibly balance the discrepancies between recovered data and original data. To address these problems, we propose a novel method termed Manifold-based Incomplete Multi-view clustering via Bi-consistency guidance (MIMB), which flexibly recovers incomplete data among various views, and attempts to achieve biconsistency guidance via reverse regularization. In particular, MIMB adds reconstruction terms to representation learning by recovering missing instances, which dynamically examines the latent consensus representation. Moreover, to preserve the consistency information among multiple views, MIMB implements a biconsistency guidance strategy with reverse regularization of the consensus representation and proposes a manifold embedding measure for exploring the hidden structure of the recovered data. Notably, MIMB aims to balance the importance of different views, and introduces an adaptive weight term for each view. Finally, an optimization algorithm with an alternating iteration optimization strategy is designed for final clustering. Extensive experimental results on 6 benchmark datasets are provided to confirm that MIMB can significantly obtain superior results as compared with several state-of-the-art baselines.
- X. Peng, Z. Huang, J. Lv, H. Zhu, and J. T. Zhou, “Comic: Multi-view clustering without parameter selection,” in International conference on machine learning. PMLR, 2019, pp. 5092–5101.
- Z. Wang, F. Nie, L. Tian, R. Wang, and X. Li, “Discriminative feature selection via a structured sparse subspace learning module.” in IJCAI, 2020, pp. 3009–3015.
- C. Liu, Z. Wu, J. Wen, Y. Xu, and C. Huang, “Localized sparse incomplete multi-view clustering,” IEEE Transactions on Multimedia, pp. 1–13, 2022.
- Y. Wang, J. Peng, H. Wang, and M. Wang, “Progressive learning with multi-scale attention network for cross-domain vehicle re-identification,” Science China Information Sciences, vol. 65, no. 6, p. 160103, 2022.
- H. Wang, Y. Wang, Z. Zhang, X. Fu, L. Zhuo, M. Xu, and M. Wang, “Kernelized multiview subspace analysis by self-weighted learning,” IEEE Transactions on Multimedia, vol. 23, pp. 3828–3840, 2020.
- H. Liu, Y. Wang, B. Qian, M. Wang, and Y. Rui, “Structure matters: Tackling the semantic discrepancy in diffusion models for image inpainting,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
- S. Xiao, S. Du, Z. Chen, Y. Zhang, and S. Wang, “Dual fusion-propagation graph neural network for multi-view clustering,” IEEE Transactions on Multimedia, pp. 1–13, 2023.
- W. Hao, S. Pang, B. Yang, and J. Xue, “Tensor-based multi-view clustering with consistency exploration and diversity regularization,” Knowledge-Based Systems, vol. 252, p. 109342, 2022.
- Y. Yang, F. Shen, Z. Huang, H. T. Shen, and X. Li, “Discrete nonnegative spectral clustering,” IEEE Transactions on Knowledge and Data Engineering, vol. 29, no. 9, pp. 1834–1845, 2017.
- G. Jiang, J. Peng, H. Wang, Z. Mi, and X. Fu, “Tensorial multi-view clustering via low-rank constrained high-order graph learning,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 8, pp. 5307–5318, 2022.
- B. Qian, Y. Wang, H. Yin, R. Hong, and M. Wang, “Switchable online knowledge distillation,” in Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XI. Springer, 2022, pp. 449–466.
- J. Peng, G. Jiang, and H. Wang, “Adaptive memorization with group labels for unsupervised person re-identification,” IEEE Transactions on Circuits and Systems for Video Technology, 2023.
- Y. Wang, B. Qian, H. Liu, Y. Rui, and M. Wang, “Unpacking the gap box against data-free knowledge distillation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024.
- Y. Wang, “Survey on deep multi-modal data analytics: Collaboration, rivalry, and fusion,” ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 17, no. 1s, pp. 1–25, 2021.
- H. Wang, G. Jiang, J. Peng, R. Deng, and X. Fu, “Towards adaptive consensus graph: Multi-view clustering via graph collaboration,” IEEE Transactions on Multimedia, 2022.
- Y. Wang, W. Zhang, L. Wu, X. Lin, M. Fang, and S. Pan, “Iterative views agreement: An iterative low-rank based structured optimization method to multi-view spectral clustering,” in International Joint Conference on Artificial Intelligence (IJCAI), 2016, pp. 2153–2159.
- Y. Chen, S. Wang, C. Peng, Z. Hua, and Y. Zhou, “Generalized nonconvex low-rank tensor approximation for multi-view subspace clustering,” IEEE Transactions on Image Processing, vol. 30, pp. 4022–4035, 2021.
- J. Wu, Z. Lin, and H. Zha, “Essential tensor learning for multi-view spectral clustering,” IEEE Transactions on Image Processing, vol. 28, no. 12, pp. 5910–5922, 2019.
- X. Cai, F. Nie, and H. Huang, “Multi-view k-means clustering on big data,” in Twenty-Third International Joint conference on artificial intelligence, 2013.
- H. Wang, M. Yao, G. Jiang, Z. Mi, and X. Fu, “Graph-collaborated auto-encoder hashing for multi-view binary clustering,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
- Y. Chen, X. Xiao, and Y. Zhou, “Jointly learning kernel representation tensor and affinity matrix for multi-view clustering,” IEEE Transactions on Multimedia, vol. 22, no. 8, pp. 1985–1997, 2019.
- A. Kumar, P. Rai, and H. Daume, “Co-regularized multi-view spectral clustering,” Advances in neural information processing systems, vol. 24, 2011.
- Z. Li, C. Tang, X. Liu, X. Zheng, W. Zhang, and E. Zhu, “Consensus graph learning for multi-view clustering,” IEEE Transactions on Multimedia, vol. 24, pp. 2461–2472, 2021.
- Q. Yin, S. Wu, and L. Wang, “Incomplete multi-view clustering via subspace learning,” in Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, 2015, pp. 383–392.
- J. Wen, Z. Zhang, L. Fei, B. Zhang, Y. Xu, Z. Zhang, and J. Li, “A survey on incomplete multiview clustering,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2022.
- A. Trivedi, P. Rai, H. Daumé III, and S. L. DuVall, “Multiview clustering with incomplete views,” in NIPS workshop, vol. 224. Citeseer, 2010, pp. 1–8.
- X. Liu, X. Zhu, M. Li, L. Wang, E. Zhu, T. Liu, M. Kloft, D. Shen, J. Yin, and W. Gao, “Multiple kernel k𝑘kitalic_k k-means with incomplete kernels,” IEEE transactions on pattern analysis and machine intelligence, vol. 42, no. 5, pp. 1191–1204, 2019.
- S.-Y. Li, Y. Jiang, and Z.-H. Zhou, “Partial multi-view clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 28, no. 1, 2014.
- N. Xu, Y. Guo, X. Zheng, Q. Wang, and X. Luo, “Partial multi-view subspace clustering,” in Proceedings of the 26th ACM International conference on multimedia, 2018, pp. 1794–1801.
- M. Hu and S. Chen, “Doubly aligned incomplete multi-view clustering,” in Proceedings of the 27th International Joint Conference on Artificial Intelligence, 2018, pp. 2262–2268.
- W. Zhou, H. Wang, and Y. Yang, “Consensus graph learning for incomplete multi-view clustering,” in Advances in Knowledge Discovery and Data Mining: 23rd Pacific-Asia Conference, PAKDD 2019, Macau, China, April 14-17, 2019, Proceedings, Part I 23. Springer, 2019, pp. 529–540.
- H. Wang, L. Zong, B. Liu, Y. Yang, and W. Zhou, “Spectral perturbation meets incomplete multi-view data,” arXiv preprint arXiv:1906.00098, 2019.
- H. Zhao, H. Liu, and Y. Fu, “Incomplete multi-modal visual data grouping.” in IJCAI, 2016, pp. 2392–2398.
- B. Qian, Y. Wang, R. Hong, and M. Wang, “Rethinking data-free quantization as a zero-sum game,” in AAAI Conference on Artificial Intelligence (AAAI), 2023.
- W. Shao, L. He, C.-t. Lu, and S. Y. Philip, “Online multi-view clustering with incomplete views,” in 2016 IEEE International conference on big data (Big Data). IEEE, 2016, pp. 1012–1017.
- J. Wen, Z. Zhang, Y. Xu, B. Zhang, L. Fei, and H. Liu, “Unified embedding alignment with missing views inferring for incomplete multi-view clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 33, no. 01, 2019, pp. 5393–5400.
- J. Yin and S. Sun, “Incomplete multi-view clustering with reconstructed views,” IEEE Transactions on Knowledge and Data Engineering, 2021.
- J. Xu, C. Li, L. Peng, Y. Ren, X. Shi, H. T. Shen, and X. Zhu, “Adaptive feature projection with distribution alignment for deep incomplete multi-view clustering,” IEEE Transactions on Image Processing, vol. 32, pp. 1354–1366, 2023.
- C. Shang, A. Palmer, J. Sun, K.-S. Chen, J. Lu, and J. Bi, “Vigan: Missing view imputation with generative adversarial networks,” in 2017 IEEE International Conference on Big Data (Big Data). IEEE, 2017, pp. 766–775.
- Q. Wang, Z. Ding, Z. Tao, Q. Gao, and Y. Fu, “Partial multi-view clustering via consistent gan,” in 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 2018, pp. 1290–1295.
- M. Yang, Y. Li, P. Hu, J. Bai, J. Lv, and X. Peng, “Robust multi-view clustering with incomplete information,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 1, pp. 1055–1069, 2022.
- B. Qian, Y. Wang, R. Hong, and M. Wang, “Adaptive data-free quantization,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
- J. Liu, X. Liu, Y. Zhang, P. Zhang, W. Tu, S. Wang, S. Zhou, W. Liang, S. Wang, and Y. Yang, “Self-representation subspace clustering for incomplete multi-view data,” in Proceedings of the 29th ACM International Conference on Multimedia, 2021, pp. 2726–2734.
- J. Wen, Z. Zhang, Z. Zhang, L. Zhu, L. Fei, B. Zhang, and Y. Xu, “Unified tensor framework for incomplete multi-view clustering and missing-view inferring,” in Proceedings of the AAAI conference on artificial intelligence, vol. 35, no. 11, 2021, pp. 10 273–10 281.
- S. Deng, J. Wen, C. Liu, K. Yan, G. Xu, and Y. Xu, “Projective incomplete multi-view clustering,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
- A. Ng, M. Jordan, and Y. Weiss, “On spectral clustering: Analysis and an algorithm,” Advances in neural information processing systems, vol. 14, 2001.
- F. Nie, X. Wang, M. Jordan, and H. Huang, “The constrained laplacian rank algorithm for graph-based clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 30, no. 1, 2016.
- L. Fei-Fei, R. Fergus, and P. Perona, “Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories,” in 2004 conference on computer vision and pattern recognition workshop. IEEE, 2004, pp. 178–178.
- S. Wang, X. Liu, L. Liu, W. Tu, X. Zhu, J. Liu, S. Zhou, and E. Zhu, “Highly-efficient incomplete large-scale multi-view clustering with consensus bipartite graph,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 9776–9785.
- J. Wen, Y. Xu, and H. Liu, “Incomplete multiview spectral clustering with adaptive graph learning,” IEEE transactions on cybernetics, vol. 50, no. 4, pp. 1418–1429, 2018.
- M. Hu and S. Chen, “One-pass incomplete multi-view clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 33, no. 01, 2019, pp. 3838–3845.
- N. Rai, S. Negi, S. Chaudhury, and O. Deshmukh, “Partial multi-view clustering using graph regularized nmf,” in 2016 23rd International Conference on Pattern Recognition (ICPR). IEEE, 2016, pp. 2192–2197.
- Huibing Wang (33 papers)
- Mingze Yao (3 papers)
- Yawei Chen (2 papers)
- Yunqiu Xu (9 papers)
- Haipeng Liu (13 papers)
- Wei Jia (52 papers)
- Xianping Fu (25 papers)
- Yang Wang (672 papers)