S^2MVTC: a Simple yet Efficient Scalable Multi-View Tensor Clustering (2403.09107v2)
Abstract: Anchor-based large-scale multi-view clustering has attracted considerable attention for its effectiveness in handling massive datasets. However, current methods mainly seek the consensus embedding feature for clustering by exploring global correlations between anchor graphs or projection matrices.In this paper, we propose a simple yet efficient scalable multi-view tensor clustering (S2MVTC) approach, where our focus is on learning correlations of embedding features within and across views. Specifically, we first construct the embedding feature tensor by stacking the embedding features of different views into a tensor and rotating it. Additionally, we build a novel tensor low-frequency approximation (TLFA) operator, which incorporates graph similarity into embedding feature learning, efficiently achieving smooth representation of embedding features within different views. Furthermore, consensus constraints are applied to embedding features to ensure inter-view semantic consistency. Experimental results on six large-scale multi-view datasets demonstrate that S2MVTC significantly outperforms state-of-the-art algorithms in terms of clustering performance and CPU execution time, especially when handling massive data. The code of S2MVTC is publicly available at https://github.com/longzhen520/S2MVTC.
- Multimodal machine learning: A survey and taxonomy. TPAMI, 41(2):423–443, 2018.
- Karen Braman. Third-order tensors as linear operators on a space of matrices. Linear Algebra and its Applications, 433(7):1241–1253, 2010.
- Multi-view manifold learning of human brain-state trajectories. Nature Computational Science, 3(3):240–253, 2023.
- Low-rank tensor based proximity learning for multi-view clustering. TKDE, 2022.
- Fast self-guided multi-view subspace clustering. TIP, pages 1–1, 2023a.
- Fast self-guided multi-view subspace clustering. TIP, 2023b.
- Nus-wide: A real-world web image database from national university of singapore. In Proc. of ACM Conf. on Image and Video Retrieval (CIVR’09), Santorini, Greece., July 8-10, 2009.
- Han Hu et al. Smooth representation clustering. In CVPR, pages 3834–3841, 2014.
- Fast multi-view clustering via ensembles: Towards scalability, superiority, and simplicity. TKDE, 35(11):11388–11402, 2023a.
- Fast multi-view clustering via ensembles: Towards scalability, superiority, and simplicity. TKDE, 2023b.
- Methods for simultaneous eeg-fmri: an introductory review. Journal of Neuroscience, 32(18):6053–6060, 2012.
- Anchor structure regularization induced multi-view subspace clustering via enhanced tensor rank minimization. In ICCV, pages 19343–19352, 2023.
- Consumer video understanding: A benchmark database and an evaluation of human and machine performance. In ICMR, 2011.
- Large-scale multi-view subspace clustering in linear time. In AAAI, pages 4412–4419, 2020.
- Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J. Matrix Anal. Appl., 34(1):148–172, 2013.
- Factorization strategies for third-order tensors. Linear Algebra and its Applications, 435(3):641–658, 2011.
- Alex Krizhevsky. Learning multiple layers of features from tiny images. 2012.
- Attribute-based classification for zero-shot visual object categorization. TPAMI, 36(3):453–465, 2014.
- Caltech 101, 2022a.
- Multiview clustering: A scalable and parameter-free bipartite graph fusion method. TPAMI, 44(1):330–344, 2020.
- Multiview clustering: A scalable and parameter-free bipartite graph fusion method. TPAMI, 44(1):330–344, 2022b.
- Auto-weighted tensor schatten p-norm for robust multi-view graph clustering. PR, 134:109083, 2023.
- One-pass multi-view clustering for large-scale data. In ICCV, pages 12344–12353, 2021.
- Multi-view mera subspace clustering. TMM, pages 1–11, 2023.
- Tensor robust principal component analysis with a new tensor nuclear norm. TPAMI, 42(4):925–938, 2020.
- EEG-fMRI: physiological basis, technique, and applications. Springer Nature, 2023.
- Benjamin Recht. A simpler approach to matrix completion. JMLR, 12(12), 2011.
- Walter Rudin et al. Principles of mathematical analysis. McGraw-hill New York, 1976.
- Multiview learning in biomedical applications. In Artificial intelligence in the age of neural networks and brain computing, pages 307–324. Elsevier, 2024.
- Self-weighted anchor graph learning for multi-view clustering. TMM, 2022.
- Consistent and diverse multi-view subspace clustering with structure constraint. PR, 121:108196, 2022.
- Shiliang Sun. A survey of multi-view machine learning. Neural computing and applications, 23:2031–2038, 2013.
- Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. JMLR, 9(11), 2008.
- U. Von Luxburg. A tutorial on spectral clustering. Statistics and computing, 17(4):395–416, 2007.
- Graph-collaborated auto-encoder hashing for multiview binary clustering. TNNLS, pages 1–13, 2023.
- Multi-site clustering and nested feature extraction for identifying autism spectrum disorder with resting-state fmri. Medical image analysis, 75:102279, 2022a.
- Fast parameter-free multi-view subspace clustering with consensus anchor guidance. TKDE, 31:556–568, 2021.
- Align then fusion: Generalized large-scale multi-view clustering with anchor matching correspondences. NeurIPS, 35:5882–5895, 2022b.
- Fast parameter-free multi-view subspace clustering with consensus anchor guidance. TIP, 31:556–568, 2022c.
- Unified tensor framework for incomplete multi-view clustering and missing-view inferring. In Proc. AAAI Conf. Artif. Intell., pages 10273–10281, 2021.
- Face recognition in unconstrained videos with matched background similarity. In CVPR, 2011.
- Tensorized bipartite graph learning for multi-view clustering. TPAMI, 2022.
- Robust multi-view clustering with incomplete information. TPAMI, 45(1):1055–1069, 2022.
- Learning all-in collaborative multiview binary representation for clustering. TNNLS, pages 1–14, 2022.
- Binary multi-view clustering. TPAMI, 41(7):1774–1782, 2018.