Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Enhanced Latent Multi-view Subspace Clustering (2312.14763v2)

Published 22 Dec 2023 in cs.LG

Abstract: Latent multi-view subspace clustering has been demonstrated to have desirable clustering performance. However, the original latent representation method vertically concatenates the data matrices from multiple views into a single matrix along the direction of dimensionality to recover the latent representation matrix, which may result in an incomplete information recovery. To fully recover the latent space representation, we in this paper propose an Enhanced Latent Multi-view Subspace Clustering (ELMSC) method. The ELMSC method involves constructing an augmented data matrix that enhances the representation of multi-view data. Specifically, we stack the data matrices from various views into the block-diagonal locations of the augmented matrix to exploit the complementary information. Meanwhile, the non-block-diagonal entries are composed based on the similarity between different views to capture the consistent information. In addition, we enforce a sparse regularization for the non-diagonal blocks of the augmented self-representation matrix to avoid redundant calculations of consistency information. Finally, a novel iterative algorithm based on the framework of Alternating Direction Method of Multipliers (ADMM) is developed to solve the optimization problem for ELMSC. Extensive experiments on real-world datasets demonstrate that our proposed ELMSC is able to achieve higher clustering performance than some state-of-art multi-view clustering methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. R. Vidal, “Subspace clustering,” IEEE Signal Processing Magazine, vol. 28, no. 2, pp. 52–68, 2011.
  2. C.-G. Li, C. You, and R. Vidal, “Structured sparse subspace clustering: A joint affinity learning and subspace clustering framework,” IEEE Transactions on Image Processing, vol. 26, no. 6, pp. 2988–3001, 2017.
  3. L. Cao, L. Shi, J. Wang, Z. Yang, and B. Chen, “Robust subspace clustering by logarithmic hyperbolic cosine function,” IEEE Signal Processing Letters, 2023.
  4. E. Elhamifar and R. Vidal, “Sparse subspace clustering: Algorithm, theory, and applications,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 11, pp. 2765–2781, 2013.
  5. S. Huang, I. Tsang, Z. Xu, J. Lv, and Q.-H. Liu, “Multi-view clustering on topological manifold,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 6, 2022, pp. 6944–6951.
  6. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 171–184, 2012.
  7. C. Lu, J. Feng, Z. Lin, T. Mei, and S. Yan, “Subspace clustering by block diagonal representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 41, no. 2, pp. 487–501, 2018.
  8. F. Wu, P. Yuan, G. Shi, X. Li, W. Dong, and J. Wu, “Robust subspace clustering network with dual-domain regularization,” Pattern Recognition Letters, vol. 149, pp. 44–50, 2021.
  9. C. Xu, D. Tao, and C. Xu, “A survey on multi-view learning,” arXiv preprint arXiv:1304.5634, 2013.
  10. H. Gao, F. Nie, X. Li, and H. Huang, “Multi-view subspace clustering,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2015, pp. 4238–4246.
  11. X. Cao, C. Zhang, H. Fu, S. Liu, and H. Zhang, “Diversity-induced multi-view subspace clustering,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 586–594.
  12. Q. Qiang, B. Zhang, F. Wang, and F. Nie, “Fast multi-view discrete clustering with anchor graphs,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 11, 2021, pp. 9360–9367.
  13. A. Kumar, P. Rai, and H. Daume, “Co-regularized multi-view spectral clustering,” Advances in Neural Information Processing Systems, vol. 24, 2011.
  14. Y. Li, F. Nie, H. Huang, and J. Huang, “Large-scale multi-view spectral clustering via bipartite graph,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 29, no. 1, 2015.
  15. H. Wang, Y. Yang, and B. Liu, “Gmc: Graph-based multi-view clustering,” IEEE Transactions on Knowledge and Data Engineering, vol. 32, no. 6, pp. 1116–1129, 2019.
  16. K. Zhan, F. Nie, J. Wang, and Y. Yang, “Multiview consensus graph clustering,” IEEE Transactions on Image Processing, vol. 28, no. 3, pp. 1261–1270, 2018.
  17. X. Zhu, S. Zhang, W. He, R. Hu, C. Lei, and P. Zhu, “One-step multi-view spectral clustering,” IEEE Transactions on Knowledge and Data Engineering, vol. 31, no. 10, pp. 2022–2034, 2018.
  18. F. Nie, L. Tian, and X. Li, “Multiview clustering via adaptively weighted procrustes,” in Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2018, pp. 2022–2030.
  19. X. Liu, Y. Dou, J. Yin, L. Wang, and E. Zhu, “Multiple kernel k-means clustering with matrix-induced regularization,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30, no. 1, 2016.
  20. S. Wang, X. Liu, E. Zhu, C. Tang, J. Liu, J. Hu, J. Xia, and J. Yin, “Multi-view clustering via late fusion alignment maximization.” in International Joint Conference on Artificial Intelligence, 2019, pp. 3778–3784.
  21. S. Zhou, X. Liu, M. Li, E. Zhu, L. Liu, C. Zhang, and J. Yin, “Multiple kernel clustering with neighbor-kernel subspace segmentation,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 4, pp. 1351–1362, 2019.
  22. Z. Li, C. Tang, X. Liu, X. Zheng, W. Zhang, and E. Zhu, “Consensus graph learning for multi-view clustering,” IEEE Transactions on Multimedia, vol. 24, pp. 2461–2472, 2021.
  23. Z. Lin, Z. Kang, L. Zhang, and L. Tian, “Multi-view attributed graph clustering,” IEEE Transactions on Knowledge and Data Engineering, 2021.
  24. L. Li, S. Wang, X. Liu, E. Zhu, L. Shen, K. Li, and K. Li, “Local sample-weighted multiple kernel clustering with consensus discriminative graph,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
  25. X. Liu, “Simplemkkm: Simple multiple kernel k-means,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 4, pp. 5174–5186, 2022.
  26. J. Chen, H. Mao, D. Peng, C. Zhang, and X. Peng, “Multiview clustering by consensus spectral rotation fusion,” IEEE Transactions on Image Processing, 2023.
  27. M. Brbić and I. Kopriva, “Multi-view low-rank sparse subspace clustering,” Pattern Recognition, vol. 73, pp. 247–258, 2018.
  28. S. Luo, C. Zhang, W. Zhang, and X. Cao, “Consistent and specific multi-view subspace clustering,” in Proceedings of the AAAI conference on Artificial Intelligence, vol. 32, no. 1, 2018.
  29. C. Zhang, Q. Hu, H. Fu, P. Zhu, and X. Cao, “Latent multi-view subspace clustering,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 4279–4287.
  30. C. Zhang, H. Fu, Q. Hu, X. Cao, Y. Xie, D. Tao, and D. Xu, “Generalized latent multi-view subspace clustering,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 1, pp. 86–99, 2018.
  31. M.-S. Chen, L. Huang, C.-D. Wang, and D. Huang, “Multi-view clustering in latent embedding space,” in Proceedings of the AAAI conference on Artificial Intelligence, vol. 34, no. 04, 2020, pp. 3513–3520.
  32. S. Boyd, N. Parikh, E. Chu, B. Peleato, J. Eckstein et al., “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends® in Machine learning, vol. 3, no. 1, pp. 1–122, 2011.
  33. F. Nie, X. Wang, M. Jordan, and H. Huang, “The constrained laplacian rank algorithm for graph-based clustering,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30, no. 1, 2016.
  34. Y. Tan, Y. Liu, H. Wu, J. Lv, and S. Huang, “Metric multi-view graph clustering,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 8, 2023, pp. 9962–9970.
  35. H. Abdi and L. J. Williams, “Principal component analysis,” Wiley Interdisciplinary Reviews: Computational Statistics, vol. 2, no. 4, pp. 433–459, 2010.
  36. R. Bro and A. K. Smilde, “Principal component analysis,” Analytical methods, vol. 6, no. 9, pp. 2812–2831, 2014.
  37. Z. Lin, R. Liu, and Z. Su, “Linearized alternating direction method with adaptive penalty for low-rank representation,” Advances in Neural Information Processing Systems, vol. 24, 2011.
  38. J. Huang, F. Nie, and H. Huang, “Spectral rotation versus k-means in spectral clustering,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 27, no. 1, 2013, pp. 431–437.
  39. J.-F. Cai, E. J. Candès, and Z. Shen, “A singular value thresholding algorithm for matrix completion,” SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956–1982, 2010.
  40. Y. Tang, Y. Xie, C. Zhang, and W. Zhang, “Constrained tensor representation learning for multi-view semi-supervised subspace clustering,” IEEE Transactions on Multimedia, vol. 24, pp. 3920–3933, 2021.
  41. W. Xia, X. Zhang, Q. Gao, X. Shu, J. Han, and X. Gao, “Multiview subspace clustering by an enhanced tensor nuclear norm,” IEEE Transactions on Cybernetics, vol. 52, no. 9, pp. 8962–8975, 2021.
  42. J. Winn and N. Jojic, “Locus: Learning object classes with unsupervised segmentation,” in Tenth IEEE International Conference on Computer Vision, vol. 1, 2005, pp. 756–763.
  43. A. Asuncion and D. Newman, “Uci machine learning repository,” 2007.
  44. C. Apté, F. Damerau, and S. M. Weiss, “Automated learning of decision rules for text categorization,” ACM Transactions on Information Systems, vol. 12, no. 3, pp. 233–251, 1994.
  45. H. Wang, G. Han, B. Zhang, G. Tao, and H. Cai, “Multi-view learning a decomposable affinity matrix via tensor self-representation on grassmann manifold,” IEEE Transactions on Image Processing, vol. 30, pp. 8396–8409, 2021.
  46. Y. Chen, X. Xiao, C. Peng, G. Lu, and Y. Zhou, “Low-rank tensor graph learning for multi-view subspace clustering,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 1, pp. 92–104, 2021.
  47. M.-S. Chen, C.-D. Wang, and J.-H. Lai, “Low-rank tensor based proximity learning for multi-view clustering,” IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 5, pp. 5076–5090, 2022.
  48. W. Xia, Q. Gao, Q. Wang, X. Gao, C. Ding, and D. Tao, “Tensorized bipartite graph learning for multi-view clustering,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 4, pp. 5187–5202, 2022.
  49. P. Zhou and L. Du, “Learnable graph filter for multi-view clustering,” in Proceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 3089–3098.
  50. L. Van der Maaten and G. Hinton, “Visualizing data using t-sne.” Journal of Machine Learning Research, vol. 9, no. 11, 2008.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now