Deep Double Self-Expressive Subspace Clustering (2306.11592v1)
Abstract: Deep subspace clustering based on auto-encoder has received wide attention. However, most subspace clustering based on auto-encoder does not utilize the structural information in the self-expressive coefficient matrix, which limits the clustering performance. In this paper, we propose a double self-expressive subspace clustering algorithm. The key idea of our solution is to view the self-expressive coefficient as a feature representation of the example to get another coefficient matrix. Then, we use the two coefficient matrices to construct the affinity matrix for spectral clustering. We find that it can reduce the subspace-preserving representation error and improve connectivity. To further enhance the clustering performance, we proposed a self-supervised module based on contrastive learning, which can further improve the performance of the trained network. Experiments on several benchmark datasets demonstrate that the proposed algorithm can achieve better clustering than state-of-the-art methods.
- René Vidal, “Subspace clustering,” IEEE Signal Processing Magazine, vol. 28, no. 2, pp. 52–68, 2011.
- “Sparse subspace clustering: Algorithm, theory, and applications,” IEEE transactions on pattern analysis and machine intelligence, vol. 35, no. 11, pp. 2765–2781, 2013.
- “Robust and efficient subspace segmentation via least squares regression,” in European conference on computer vision. Springer, 2012, pp. 347–360.
- “Low rank subspace clustering (lrsc),” Pattern Recognition Letters, vol. 43, pp. 47–61, 2014.
- “Oracle based active set algorithm for scalable elastic net subspace clustering,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 3928–3937.
- “Kernel sparse subspace clustering,” in 2014 ieee international conference on image processing (icip). IEEE, 2014, pp. 2849–2853.
- “Deep subspace clustering networks,” Advances in neural information processing systems, vol. 30, 2017.
- “Deep adversarial subspace clustering,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 1596–1604.
- “Self-supervised convolutional subspace clustering network,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 5473–5482.
- “Multi-scale fusion subspace clustering using similarity constraint,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 6658–6667.
- “Multi-level representation learning for deep subspace clustering,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2020, pp. 2039–2048.
- “Pseudo-supervised deep subspace clustering,” IEEE Transactions on Image Processing, vol. 30, pp. 5252–5263, 2021.
- “Adaptive attribute and structure subspace clustering network,” IEEE Transactions on Image Processing, vol. 31, pp. 3430–3439, 2022.
- “Lrsc: learning representations for subspace clustering,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2021, vol. 35, pp. 8340–8348.
- “Linearity-aware subspace clustering,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2022, vol. 36, pp. 8770–8778.
- “Momentum contrast for unsupervised visual representation learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 9729–9738.
- “A simple framework for contrastive learning of visual representations,” in International conference on machine learning. PMLR, 2020, pp. 1597–1607.
- “Stochastic sparse subspace clustering,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 4155–4164.
- “Scalable sparse subspace clustering by orthogonal matching pursuit,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 3918–3927.
- “Pytorch: An imperative style, high-performance deep learning library,” Advances in neural information processing systems, vol. 32, 2019.
- “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.