Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Information Recovery-Driven Deep Incomplete Multiview Clustering Network (2304.00429v5)

Published 2 Apr 2023 in cs.CV

Abstract: Incomplete multi-view clustering is a hot and emerging topic. It is well known that unavoidable data incompleteness greatly weakens the effective information of multi-view data. To date, existing incomplete multi-view clustering methods usually bypass unavailable views according to prior missing information, which is considered as a second-best scheme based on evasion. Other methods that attempt to recover missing information are mostly applicable to specific two-view datasets. To handle these problems, in this paper, we propose an information recovery-driven deep incomplete multi-view clustering network, termed as RecFormer. Concretely, a two-stage autoencoder network with the self-attention structure is built to synchronously extract high-level semantic representations of multiple views and recover the missing data. Besides, we develop a recurrent graph reconstruction mechanism that cleverly leverages the restored views to promote the representation learning and the further data reconstruction. Visualization of recovery results are given and sufficient experimental results confirm that our RecFormer has obvious advantages over other top methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. Z. Tao, H. Liu, S. Li, Z. Ding, and Y. Fu, “Marginalized multiview ensemble clustering,” IEEE transactions on neural networks and learning systems, vol. 31, no. 2, pp. 600–611, 2019.
  2. J. Wen, C. Liu, S. Deng, Y. Liu, L. Fei, K. Yan, and Y. Xu, “Deep double incomplete multi-view multi-label learning with incomplete labels and missing views,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
  3. C. Liu, J. Wen, X. Luo, C. Huang, Z. Wu, and Y. Xu, “Dicnet: Deep instance-level contrastive network for double incomplete multi-view multi-label classification,” arXiv preprint arXiv:2303.08358, 2023.
  4. Z. Li, C. Tang, X. Liu, X. Zheng, W. Zhang, and E. Zhu, “Consensus graph learning for multi-view clustering,” IEEE Transactions on Multimedia, vol. 24, pp. 2461–2472, 2021.
  5. J. Wen, Z. Zhang, L. Fei, B. Zhang, Y. Xu, Z. Zhang, and J. Li, “A survey on incomplete multiview clustering,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2022.
  6. X. Luo, Z. Pu, Y. Xu, W. K. Wong, J. Su, X. Dou, B. Ye, J. Hu, and L. Mou, “Mvdrnet: Multi-view diabetic retinopathy detection by combining dcnns and attention mechanisms,” Pattern Recognition, vol. 120, p. 108104, 2021.
  7. S. Wang, X. Liu, X. Zhu, P. Zhang, Y. Zhang, F. Gao, and E. Zhu, “Fast parameter-free multi-view subspace clustering with consensus anchor guidance,” IEEE Transactions on Image Processing, vol. 31, pp. 556–568, 2021.
  8. X. Liang, Y. Qian, Q. Guo, H. Cheng, and J. Liang, “Af: An association-based fusion method for multi-modal classification,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 12, pp. 9236–9254, 2021.
  9. S. Hu, Z. Shi, and Y. Ye, “Dmib: Dual-correlated multivariate information bottleneck for multiview clustering,” IEEE Transactions on Cybernetics, vol. 52, no. 6, pp. 4260–4274, 2020.
  10. C. Liu, Z. Wu, J. Wen, Y. Xu, and C. Huang, “Localized sparse incomplete multi-view clustering,” IEEE Transactions on Multimedia, 2022.
  11. L. Li, Z. Wan, and H. He, “Incomplete multi-view clustering with joint partition and graph learning,” IEEE Transactions on Knowledge and Data Engineering, 2021.
  12. Y. Zhu, J. Ma, C. Yuan, and X. Zhu, “Interpretable learning based dynamic graph convolutional networks for alzheimer’s disease analysis,” Information Fusion, vol. 77, pp. 53–61, 2022.
  13. X.-L. Li, M.-S. Chen, C.-D. Wang, and J.-H. Lai, “Refining graph structure for incomplete multi-view clustering,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
  14. M. Li, S. Wang, X. Liu, and S. Liu, “Parameter-free and scalable incomplete multiview clustering with prototype graph,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
  15. J. Chen, S. Yang, X. Peng, D. Peng, and Z. Wang, “Augmented sparse representation for incomplete multiview clustering,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
  16. S.-Y. Li, Y. Jiang, and Z.-H. Zhou, “Partial multi-view clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 28, no. 1, 2014.
  17. H. Zhao, H. Liu, and Y. Fu, “Incomplete multi-modal visual data grouping,” in IJCAI, 2016, pp. 2392–2398.
  18. W. Shao, L. He, C.-t. Lu, and S. Y. Philip, “Online multi-view clustering with incomplete views,” in 2016 IEEE International conference on big data (Big Data).   IEEE, 2016, pp. 1012–1017.
  19. M. Hu and S. Chen, “One-pass incomplete multi-view clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 33, no. 01, 2019, pp. 3838–3845.
  20. J. Liu, X. Liu, Y. Zhang, P. Zhang, W. Tu, S. Wang, S. Zhou, W. Liang, S. Wang, and Y. Yang, “Self-representation subspace clustering for incomplete multi-view data,” in Proceedings of the 29th ACM International Conference on Multimedia, 2021, pp. 2726–2734.
  21. C. Liu, R. Li, S. Wu, H. Che, D. Jiang, Z. Yu, and H.-S. Wong, “Self-guided partial graph propagation for incomplete multiview clustering,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
  22. P. Rai, A. Trivedi, H. Daumé III, and S. L. DuVall, “Multiview clustering with incomplete views,” in Proceedings of the NIPS Workshop on Machine Learning for Social Computing.   Citeseer, 2010.
  23. X. Liu, X. Zhu, M. Li, L. Wang, E. Zhu, T. Liu, M. Kloft, D. Shen, J. Yin, and W. Gao, “Multiple kernel k𝑘kitalic_k k-means with incomplete kernels,” IEEE transactions on pattern analysis and machine intelligence, vol. 42, no. 5, pp. 1191–1204, 2019.
  24. J. Wen, Z. Zhang, Y. Xu, B. Zhang, L. Fei, and H. Liu, “Unified embedding alignment with missing views inferring for incomplete multi-view clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 33, no. 01, 2019, pp. 5393–5400.
  25. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
  26. X. Zang and B. Tang, “Self-supervised dynamic graph embedding with evolutionary neighborhood and community,” Expert Systems with Applications, vol. 228, p. 120409, 2023.
  27. J. Wen, K. Yan, Z. Zhang, Y. Xu, J. Wang, L. Fei, and B. Zhang, “Adaptive graph completion based incomplete multi-view clustering,” IEEE Transactions on Multimedia, vol. 23, pp. 2493–2504, 2020.
  28. J. MacQueen, “Classification and analysis of multivariate observations,” in 5th Berkeley Symp. Math. Statist. Probability, 1967, pp. 281–297.
  29. A. Asuncion and D. Newman, “Uci machine learning repository,” 2007.
  30. X. Cai, F. Nie, and H. Huang, “Multi-view k-means clustering on big data,” in International Joint conference on artificial intelligence.   Citeseer, 2013.
  31. L. Fei-Fei, R. Fergus, and P. Perona, “Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories,” in IEEE Conference on Computer Vision and Pattern Recognition workshop.   IEEE, 2004, pp. 178–178.
  32. X. Cao, C. Zhang, C. Zhou, H. Fu, and H. Foroosh, “Constrained multi-view video face clustering,” IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 4381–4393, 2015.
  33. B. Wu, Y. Zhang, B.-G. Hu, and Q. Ji, “Constrained clustering and its application to face clustering in videos,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2013, pp. 3507–3514.
  34. C. Zhang, Z. Han, H. Fu, J. T. Zhou, Q. Hu et al., “Cpm-nets: Cross partial multi-view networks,” Neural Information Processing Systems, vol. 32, 2019.
  35. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Communications of the ACM, vol. 60, no. 6, pp. 84–90, 2017.
  36. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
  37. J.-M. Geusebroek, G. J. Burghouts, and A. W. Smeulders, “The amsterdam library of object images,” International Journal of Computer Vision, vol. 61, no. 1, pp. 103–112, 2005.
  38. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770–778.
  39. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2818–2826.
  40. W. Shao, L. He, and P. S. Yu, “Multiple incomplete views clustering via weighted nonnegative matrix factorization with l 2, 1 regularization,” in Proceedings of the 2015th European Conference on Machine Learning and Knowledge Discovery in Databases-Volume Part I, 2015, pp. 318–334.
  41. M. Hu and S. Chen, “Doubly aligned incomplete multi-view clustering,” arXiv preprint arXiv:1903.02785, 2019.
  42. Y. Zhang, X. Liu, S. Wang, J. Liu, S. Dai, and E. Zhu, “One-stage incomplete multi-view clustering via late fusion,” in Proceedings of the 29th ACM International Conference on Multimedia, 2021, pp. 2717–2725.
  43. Z. Li, C. Tang, X. Zheng, X. Liu, W. Zhang, and E. Zhu, “High-order correlation preserved incomplete multi-view subspace clustering,” IEEE Transactions on Image Processing, vol. 31, pp. 2067–2080, 2022.
  44. C. Yuan, Z. Zhong, C. Lei, X. Zhu, and R. Hu, “Adaptive reverse graph learning for robust subspace learning,” Information Processing & Management, vol. 58, no. 6, p. 102733, 2021.
  45. X. Liu, M. Li, C. Tang, J. Xia, J. Xiong, L. Liu, M. Kloft, and E. Zhu, “Efficient and effective regularized incomplete multi-view clustering,” IEEE transactions on pattern analysis and machine intelligence, vol. 43, no. 8, pp. 2634–2646, 2020.
  46. L. Van der Maaten and G. Hinton, “Visualizing data using t-sne.” Journal of machine learning research, vol. 9, no. 11, 2008.
Citations (24)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now