Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Joint Projection Learning and Tensor Decomposition Based Incomplete Multi-view Clustering (2310.04038v1)

Published 6 Oct 2023 in cs.LG

Abstract: Incomplete multi-view clustering (IMVC) has received increasing attention since it is often that some views of samples are incomplete in reality. Most existing methods learn similarity subgraphs from original incomplete multi-view data and seek complete graphs by exploring the incomplete subgraphs of each view for spectral clustering. However, the graphs constructed on the original high-dimensional data may be suboptimal due to feature redundancy and noise. Besides, previous methods generally ignored the graph noise caused by the inter-class and intra-class structure variation during the transformation of incomplete graphs and complete graphs. To address these problems, we propose a novel Joint Projection Learning and Tensor Decomposition Based method (JPLTD) for IMVC. Specifically, to alleviate the influence of redundant features and noise in high-dimensional data, JPLTD introduces an orthogonal projection matrix to project the high-dimensional features into a lower-dimensional space for compact feature learning.Meanwhile, based on the lower-dimensional space, the similarity graphs corresponding to instances of different views are learned, and JPLTD stacks these graphs into a third-order low-rank tensor to explore the high-order correlations across different views. We further consider the graph noise of projected data caused by missing samples and use a tensor-decomposition based graph filter for robust clustering.JPLTD decomposes the original tensor into an intrinsic tensor and a sparse tensor. The intrinsic tensor models the true data similarities. An effective optimization algorithm is adopted to solve the JPLTD model. Comprehensive experiments on several benchmark datasets demonstrate that JPLTD outperforms the state-of-the-art methods. The code of JPLTD is available at https://github.com/weilvNJU/JPLTD.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Z. Li, C. Tang, X. Liu, X. Zheng, W. Zhang, and E. Zhu, “Consensus graph learning for multi-view clustering,” IEEE Trans. Multim., vol. 24, pp. 2461–2472, 2022.
  2. X. Liu, “Simplemkkm: Simple multiple kernel k-means,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 4, pp. 5174–5186, 2023.
  3. K. Zhan, F. Nie, J. Wang, and Y. Yang, “Multiview consensus graph clustering,” IEEE Trans. Image Process., vol. 28, no. 3, pp. 1261–1270, 2019.
  4. A. Kumar and H. D. III, “A co-training approach for multi-view spectral clustering,” in ICML, 2011, pp. 393–400.
  5. A. Kumar, P. Rai, and H. D. III, “Co-regularized multi-view spectral clustering,” in NIPS, 2011, pp. 1413–1421.
  6. M. Sun, S. Wang, P. Zhang, X. Liu, X. Guo, S. Zhou, and E. Zhu, “Projective multiple kernel subspace clustering,” IEEE Trans. Multim., vol. 24, pp. 2567–2579, 2022.
  7. X. Liu, Y. Dou, J. Yin, L. Wang, and E. Zhu, “Multiple kernel k-means clustering with matrix-induced regularization,” in AAAI, 2016, pp. 1888–1894.
  8. C. Zhang, Q. Hu, H. Fu, P. Zhu, and X. Cao, “Latent multi-view subspace clustering,” in CVPR, 2017, pp. 4333–4341.
  9. X. Cao, C. Zhang, H. Fu, S. Liu, and H. Zhang, “Diversity-induced multi-view subspace clustering,” in CVPR, 2015, pp. 586–594.
  10. S. Wang, X. Liu, L. Liu, S. Zhou, and E. Zhu, “Late fusion multiple kernel clustering with proxy graph refinement,” IEEE Trans. Neural Networks Learn. Syst., pp. 1–12, 2021, early access, doi:10.1109/TNNLS.2021.3117403.
  11. X. Li, Y. Sun, Q. Sun, and Z. Ren, “Consensus cluster center guided latent multi-kernel clustering,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 6, pp. 2864–2876, 2023.
  12. X. Liu, S. Zhou, L. Liu, C. Tang, S. Wang, J. Liu, and Y. Zhang, “Localized simple multiple kernel k-means,” in ICCV, 2021, pp. 9273–9281.
  13. J. Xu, J. Han, F. Nie, and X. Li, “Re-weighted discriminatively embedded k-means for multi-view clustering,” IEEE Trans. Image Process., vol. 26, no. 6, pp. 3016–3027, 2017.
  14. X. Liu, S. Zhou, Y. Wang, M. Li, Y. Dou, E. Zhu, and J. Yin, “Optimal neighborhood kernel clustering with multiple kernels,” in AAAI, 2017, pp. 2266–2272.
  15. F. Nie, S. Shi, J. Li, and X. Li, “Implicit weight learning for multi-view clustering,” IEEE Trans. Neural Networks Learn. Syst., pp. 1–14, 2021, early access, doi:10.1109/TNNLS.2021.3121246.
  16. S. Wang, X. Liu, X. Zhu, P. Zhang, Y. Zhang, F. Gao, and E. Zhu, “Fast parameter-free multi-view subspace clustering with consensus anchor guidance,” IEEE Trans. Image Process., vol. 31, pp. 556–568, 2022.
  17. B. Yang, X. Zhang, F. Nie, and F. Wang, “Fast multiview clustering with spectral embedding,” IEEE Trans. Image Process., vol. 31, pp. 3884–3895, 2022.
  18. J. Wu, Z. Lin, and H. Zha, “Essential tensor learning for multi-view spectral clustering,” IEEE Trans. Image Process., vol. 28, no. 12, pp. 5910–5922, 2019.
  19. H. Zhao, Z. Ding, and Y. Fu, “Multi-view clustering via deep matrix factorization,” in AAAI, 2017, pp. 2921–2927.
  20. X. Peng, H. Zhu, J. Feng, C. Shen, H. Zhang, and J. T. Zhou, “Deep clustering with sample-assignment invariance prior,” IEEE Trans. Neural Networks Learn. Syst., vol. 31, no. 11, pp. 4857–4868, 2020.
  21. D. J. Trosten, S. Løkse, R. Jenssen, and M. Kampffmeyer, “Reconsidering representation alignment for multi-view clustering,” in CVPR.   Computer Vision Foundation / IEEE, 2021, pp. 1255–1265.
  22. Q. Wang, J. Cheng, Q. Gao, G. Zhao, and L. Jiao, “Deep multi-view subspace clustering with unified and discriminative learning,” IEEE Trans. Multim., vol. 23, pp. 3483–3493, 2021.
  23. J. Wen, Z. Zhang, L. Fei, B. Zhang, Y. Xu, Z. Zhang, and J. Li, “A survey on incomplete multiview clustering,” IEEE Trans. Syst. Man Cybern. Syst., vol. 53, no. 2, pp. 1136–1149, 2023.
  24. W. Shao, X. Shi, and P. S. Yu, “Clustering on multiple incomplete datasets via collective kernel learning,” in ICDM, 2013, pp. 1181–1186.
  25. X. Liu, X. Zhu, M. Li, L. Wang, C. Tang, J. Yin, D. Shen, H. Wang, and W. Gao, “Late fusion incomplete multi-view clustering,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 41, no. 10, pp. 2410–2423, 2019.
  26. X. Liu, M. Li, C. Tang, J. Xia, J. Xiong, L. Liu, M. Kloft, and E. Zhu, “Efficient and effective regularized incomplete multi-view clustering,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 8, pp. 2634–2646, 2021.
  27. X. Liu, X. Zhu, M. Li, L. Wang, E. Zhu, T. Liu, M. Kloft, D. Shen, J. Yin, and W. Gao, “Multiple kernel k-means with incomplete kernels,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 5, pp. 1191–1204, 2020.
  28. M. Hu and S. Chen, “Doubly aligned incomplete multi-view clustering,” in IJCAI, 2018, pp. 2262–2268.
  29. J. Wen, Z. Zhang, Y. Xu, B. Zhang, L. Fei, and H. Liu, “Unified embedding alignment with missing views inferring for incomplete multi-view clustering,” in AAAI, 2019, pp. 5393–5400.
  30. J. Liu, S. Teng, L. Fei, W. Zhang, X. Fang, Z. Zhang, and N. Wu, “A novel consensus learning approach to incomplete multi-view clustering,” Pattern Recognit., vol. 115, p. 107890, 2021.
  31. Z. Li, C. Tang, X. Zheng, X. Liu, W. Zhang, and E. Zhu, “High-order correlation preserved incomplete multi-view subspace clustering,” IEEE Trans. Image Process., vol. 31, pp. 2067–2080, 2022.
  32. Q. Wang, Z. Ding, Z. Tao, Q. Gao, and Y. Fu, “Partial multi-view clustering via consistent GAN,” in ICDM, 2018, pp. 1290–1295.
  33. Y. Lin, Y. Gou, Z. Liu, B. Li, J. Lv, and X. Peng, “COMPLETER: incomplete multi-view clustering via contrastive prediction,” in CVPR, 2021, pp. 11 174–11 183.
  34. J. Xu, C. Li, Y. Ren, L. Peng, Y. Mo, X. Shi, and X. Zhu, “Deep incomplete multi-view clustering via mining cluster complementarity,” in AAAI, 2022, pp. 8761–8769.
  35. J. Wen, Y. Xu, and H. Liu, “Incomplete multiview spectral clustering with adaptive graph learning,” IEEE Trans. Cybern., vol. 50, no. 4, pp. 1418–1429, 2020.
  36. J. Wen, K. Yan, Z. Zhang, Y. Xu, J. Wang, L. Fei, and B. Zhang, “Adaptive graph completion based incomplete multi-view clustering,” IEEE Trans. Multim., vol. 23, pp. 2493–2504, 2021.
  37. S. Wang, X. Liu, L. Liu, W. Tu, X. Zhu, J. Liu, S. Zhou, and E. Zhu, “Highly-efficient incomplete large-scale multi-view clustering with consensus bipartite graph,” in CVPR, 2022, pp. 9776–9785.
  38. W. Xia, Q. Gao, Q. Wang, and X. Gao, “Tensor completion-based incomplete multiview clustering,” IEEE Trans. Cybern., vol. 52, no. 12, pp. 13 635–13 644, 2022.
  39. J. Wen, Z. Zhang, Z. Zhang, L. Zhu, L. Fei, B. Zhang, and Y. Xu, “Unified tensor framework for incomplete multi-view clustering and missing-view inferring,” in AAAI, 2021, pp. 10 273–10 281.
  40. Z. Li, C. Tang, X. Liu, X. Zheng, W. Zhang, and E. Zhu, “Tensor-based multi-view block-diagonal structure diffusion for clustering incomplete multi-view data,” in ICME, 2021, pp. 1–6.
  41. Z. Lv, Q. Gao, X. Zhang, Q. Li, and M. Yang, “View-consistency learning for incomplete multiview clustering,” IEEE Trans. Image Process., vol. 31, pp. 4790–4802, 2022.
  42. X.-L. Li, M.-S. Chen, C.-D. Wang, and J.-H. Lai, “Refining graph structure for incomplete multi-view clustering,” IEEE Trans. Neural Networks Learn. Syst., pp. 1–14, 2022, early access, doi:10.1109/TNNLS.2022.3189763.
  43. C. Zhang, H. Li, C. Chen, X. Jia, and C. Chen, “Low-rank tensor regularized views recovery for incomplete multiview clustering,” IEEE Trans. Neural Networks Learn. Syst., pp. 1–13, 2022, early access, doi:10.1109/TNNLS.2022.3232538.
  44. C. Zhang, H. Li, W. Lv, Z. Huang, Y. Gao, and C. Chen, “Enhanced tensor low-rank and sparse representation recovery for incomplete multi-view clustering,” in AAAI, 2023.
  45. X. Li, Y. Sun, Q. Sun, Z. Ren, and Y. Sun, “Cross-view graph matching guided anchor alignment for incomplete multi-view clustering,” Inf. Fusion, p. 101941, 2023, early access, doi:10.1016/j.inffus.2023.101941.
  46. M. Kilmer and C. Martin, “Factorization strategies for third-order tensors,” Linear Algebra Appl., vol. 435, no. 3, pp. 641–658, 2011.
  47. P. Zhou, C. Lu, Z. Lin, and C. Zhang, “Tensor factorization for low-rank tensor completion,” IEEE Trans. Image Process., vol. 27, no. 3, pp. 1152–1163, 2018.
  48. V. M. Patel, H. V. Nguyen, and R. Vidal, “Latent space sparse and low-rank subspace clustering,” IEEE J. Sel. Top. Signal Process., vol. 9, no. 4, pp. 691–701, 2015.
  49. C. Zhang, H. Fu, Q. Hu, X. Cao, Y. Xie, D. Tao, and D. Xu, “Generalized latent multi-view subspace clustering,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 1, pp. 86–99, 2020.
  50. Y. Xiao, J. Wei, J. Wang, Q. Ma, S. Zhe, and T. Tasdizen, “Graph constraint-based robust latent space low-rank and sparse subspace clustering,” Neural Comput. Appl., vol. 32, no. 12, pp. 8187–8204, 2020.
  51. M. Lan, M. Meng, J. Yu, and J. Wu, “Generalized multi-view collaborative subspace clustering,” IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 6, pp. 3561–3574, 2022.
  52. S. Deng, J. Wen, C. Liu, K. Yan, G. Xu, and Y. Xu, “Projective incomplete multi-view clustering,” IEEE Trans. Neural Networks Learn. Syst., pp. 1–13, 2023, early access, doi:10.1109/TNNLS.2023.3242473.
  53. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171–184, 2013.
  54. S. P. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1–122, 2011.
  55. C. Zhang, H. Li, Y. Qian, C. Chen, and X. Zhou, “Locality-constrained discriminative matrix regression for robust face identification,” IEEE Trans. Neural Networks Learn. Syst., vol. 33, no. 3, pp. 1254–1268, 2022.
  56. C. Zhang, H. Li, C. Chen, Y. Qian, and X. Zhou, “Enhanced group sparse regularized nonconvex regression for face recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 5, pp. 2438–2452, 2022.
  57. Y. Xie, D. Tao, W. Zhang, Y. Liu, L. Zhang, and Y. Qu, “On unifying multi-view self-representations for clustering by tensor multi-rank minimization,” Int. J. Comput. Vis., vol. 126, no. 11, pp. 1157–1179, 2018.
  58. M. Chen, L. Huang, C. Wang, and D. Huang, “Multi-view clustering in latent embedding space,” in AAAI, 2020, pp. 3513–3520.
  59. C. Kong, D. Lin, M. Bansal, R. Urtasun, and S. Fidler, “What are you talking about? text-to-image coreference,” in CVPR, 2014, pp. 3558–3565.
Citations (9)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now