Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Adaptive Fuzzy C-Means with Graph Embedding (2405.13427v1)

Published 22 May 2024 in cs.LG

Abstract: Fuzzy clustering algorithms can be roughly categorized into two main groups: Fuzzy C-Means (FCM) based methods and mixture model based methods. However, for almost all existing FCM based methods, how to automatically selecting proper membership degree hyper-parameter values remains a challenging and unsolved problem. Mixture model based methods, while circumventing the difficulty of manually adjusting membership degree hyper-parameters inherent in FCM based methods, often have a preference for specific distributions, such as the Gaussian distribution. In this paper, we propose a novel FCM based clustering model that is capable of automatically learning an appropriate membership degree hyper-parameter value and handling data with non-Gaussian clusters. Moreover, by removing the graph embedding regularization, the proposed FCM model can degenerate into the simplified generalized Gaussian mixture model. Therefore, the proposed FCM model can be also seen as the generalized Gaussian mixture model with graph embedding. Extensive experiments are conducted on both synthetic and real-world datasets to demonstrate the effectiveness of the proposed model.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. J. Xue, F. Nie, R. Wang, and X. Li, “Iteratively reweighted algorithm for fuzzy c𝑐citalic_c-means,” IEEE Transactions on Fuzzy Systems, vol. 30, no. 10, pp. 4310–4321, 2022.
  2. R.-P. Li and M. Mukaidono, “A maximum-entropy approach to fuzzy clustering,” in Proceedings of 1995 IEEE International Conference on Fuzzy Systems., vol. 4.   IEEE, 1995, pp. 2227–2232.
  3. S. Miyamoto and K. Umayahara, “Fuzzy clustering by quadratic regularization,” in Proceedings of 1998 IEEE International Conference on Fuzzy Systems Proceedings., vol. 2.   IEEE, 1998, pp. 1394–1399.
  4. J. Xu, J. Han, K. Xiong, and F. Nie, “Robust and sparse fuzzy k-means clustering,” in Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16, 2016, pp. 2224–2230.
  5. E. H. Ruspini, J. C. Bezdek, and J. M. Keller, “Fuzzy clustering: A historical perspective,” IEEE Computational Intelligence Magazine, vol. 14, no. 1, pp. 45–55, 2019.
  6. X. Zhao, Y. Li, and Q. Zhao, “Mahalanobis distance based on fuzzy clustering algorithm for image segmentation,” Digital Signal Processing, vol. 43, pp. 8–16, 2015.
  7. Q. Chen, W. Yu, X. Zhao, F. Nie, and X. Li, “Rooted mahalanobis distance based gustafson-kessel fuzzy c-means,” Information Sciences, vol. 644, p. 118878, 2023.
  8. L. Chen, C. P. Chen, and M. Lu, “A multiple-kernel fuzzy c-means algorithm for image segmentation,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 41, no. 5, pp. 1263–1274, 2011.
  9. H. Lu, S. Liu, H. Wei, and J. Tu, “Multi-kernel fuzzy clustering based on auto-encoder for fmri functional network,” Expert Systems with Applications, vol. 159, p. 113513, 2020.
  10. S. Zeng, X. Wang, X. Duan, S. Zeng, Z. Xiao, and D. Feng, “Kernelized mahalanobis distance for fuzzy clustering,” IEEE Transactions on Fuzzy Systems, vol. 29, no. 10, pp. 3103–3117, 2020.
  11. W. Xia, Q. Gao, Q. Wang, X. Gao, C. Ding, and D. Tao, “Tensorized bipartite graph learning for multi-view clustering,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 4, pp. 5187–5202, 2022.
  12. W. Xia, T. Wang, Q. Gao, M. Yang, and X. Gao, “Graph embedding contrastive multi-modal representation learning for clustering,” IEEE Transactions on Image Processing, vol. 32, pp. 1170–1183, 2023.
  13. H. Yang, Q. Gao, W. Xia, M. Yang, and X. Gao, “Multiview spectral clustering with bipartite graph,” IEEE Transactions on Image Processing, vol. 31, pp. 3591–3605, 2022.
  14. H. Zhao, X. Yang, Z. Wang, E. Yang, and C. Deng, “Graph debiased contrastive learning with joint representation clustering.” in Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, 2021, pp. 3434–3440.
  15. J. MacQueen et al., “Some methods for classification and analysis of multivariate observations,” in Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, vol. 1, no. 14, 1967, pp. 281–297.
  16. A. Ng, M. Jordan, and Y. Weiss, “On spectral clustering: Analysis and an algorithm,” Advances in neural information processing systems, vol. 14, 2001.
  17. U. Von Luxburg, “A tutorial on spectral clustering,” Statistics and computing, vol. 17, pp. 395–416, 2007.
  18. F. Nie, X. Wang, and H. Huang, “Clustering and projected clustering with adaptive neighbors,” in Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 2014, pp. 977–986.
  19. J. Han, K. Xiong, and F. Nie, “Orthogonal and nonnegative graph reconstruction for large scale clustering,” in Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, 2017, pp. 1809–1815.
  20. S. Pei, F. Nie, R. Wang, and X. Li, “Efficient clustering based on a unified view of k𝑘kitalic_k-means and ratio-cut,” Advances in Neural Information Processing Systems, vol. 33, pp. 14 855–14 866, 2020.
  21. F. Nie, J. Xue, W. Yu, and X. Li, “Fast clustering with anchor guidance,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
  22. X. He and P. Niyogi, “Locality preserving projections,” Advances in neural information processing systems, vol. 16, 2003.
  23. J. Zhou, W. Pedrycz, X. Yue, C. Gao, Z. Lai, and J. Wan, “Projected fuzzy c-means clustering with locality preservation,” Pattern Recognition, vol. 113, p. 107748, 2021.
  24. J. Wang, S. Guo, F. Nie, and X. Li, “Local-global fuzzy clustering with anchor graph,” IEEE Transactions on Fuzzy Systems, vol. 32, no. 1, pp. 188–202, 2024.
  25. F. Nie, C. Liu, R. Wang, Z. Wang, and X. Li, “Fast fuzzy clustering based on anchor graph,” IEEE Transactions on Fuzzy Systems, vol. 30, no. 7, pp. 2375–2387, 2022.
  26. J. Wang, Z. Yang, X. Liu, B. Li, J. Yi, and F. Nie, “Projected fuzzy c-means with probabilistic neighbors,” Information Sciences, vol. 607, pp. 553–571, 2022.
  27. X. Zhao, F. Nie, R. Wang, and X. Li, “Robust fuzzy k-means clustering with shrunk patterns learning,” IEEE Transactions on Knowledge and Data Engineering, 2021.
  28. G. J. McLachlan, S. X. Lee, and S. I. Rathnayake, “Finite mixture models,” Annual review of statistics and its application, vol. 6, pp. 355–378, 2019.
  29. D. A. Reynolds et al., “Gaussian mixture models.” Encyclopedia of biometrics, vol. 741, no. 659-663, 2009.
  30. J. Liu, D. Cai, and X. He, “Gaussian mixture model with local consistency,” in Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence AAAI-10, 2010.
  31. X. He, D. Cai, Y. Shao, H. Bao, and J. Han, “Laplacian regularized gaussian mixture model for data clustering,” IEEE Transactions on Knowledge and Data Engineering, vol. 23, no. 9, pp. 1406–1418, 2011.
  32. F. Pascal, L. Bombrun, J.-Y. Tourneret, and Y. Berthoumieu, “Parameter estimation for multivariate generalized gaussian distributions,” IEEE Transactions on Signal Processing, vol. 61, no. 23, pp. 5960–5971, 2013.
  33. J. Zhang and F. Liang, “Robust clustering using exponential power mixtures,” Biometrics, vol. 66, no. 4, pp. 1078–1086, 2010.
  34. U. J. Dang, R. P. Browne, and P. D. McNicholas, “Mixtures of multivariate power exponential distributions,” Biometrics, vol. 71, no. 4, pp. 1081–1089, 2015.
  35. S. Kotz, “Multivariate distributions at a cross road,” in A Modern Course on Statistical Distributions in Scientific Work.   Springer, 1975, pp. 247–270.
  36. S. Nadarajah, “The kotz-type distribution with applications,” Statistics: A Journal of Theoretical and Applied Statistics, vol. 37, no. 4, pp. 341–358, 2003.
  37. J. A. Bilmes et al., “A gentle tutorial of the em algorithm and its application to parameter estimation for gaussian mixture and hidden markov models,” International computer science institute, vol. 4, no. 510, p. 126, 1998.
  38. W. Liu, J. He, and S.-F. Chang, “Large graph construction for scalable semi-supervised learning,” in Proceedings of the 27th international conference on machine learning (ICML-10), 2010, pp. 679–686.
  39. F. Nie, J. Xue, D. Wu, R. Wang, H. Li, and X. Li, “Coordinate descent method for k𝑘kitalic_k-means,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 5, pp. 2371–2385, 2022.
  40. A. Fahad, N. Alshatri, Z. Tari, A. Alamri, I. Khalil, A. Y. Zomaya, S. Foufou, and A. Bouras, “A survey of clustering algorithms for big data: Taxonomy and empirical analysis,” IEEE Transactions on Emerging Topics in Computing, vol. 2, no. 3, pp. 267–279, 2014.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets