Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

GBSVM: Granular-ball Support Vector Machine (2210.03120v2)

Published 6 Oct 2022 in cs.LG and cs.AI

Abstract: GBSVM (Granular-ball Support Vector Machine) is a significant attempt to construct a classifier using the coarse-to-fine granularity of a granular-ball as input, rather than a single data point. It is the first classifier whose input contains no points. However, the existing model has some errors, and its dual model has not been derived. As a result, the current algorithm cannot be implemented or applied. To address these problems, this paper has fixed the errors of the original model of the existing GBSVM, and derived its dual model. Furthermore, a particle swarm optimization algorithm is designed to solve the dual model. The sequential minimal optimization algorithm is also carefully designed to solve the dual model. The solution is faster and more stable than the particle swarm optimization based version. The experimental results on the UCI benchmark datasets demonstrate that GBSVM has good robustness and efficiency. All codes have been released in the open source library at http://www.cquptshuyinxia.com/GBSVM.html or https://github.com/syxiaa/GBSVM.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. L. Chen. Topological structure in visual perception. Science, 218(4573), 1982.
  2. Multi-granularity stock prediction with sequential three-way decisions. Information Sciences, 621:524–544, 2023.
  3. Double-quantitative distance measurement and classification learning based on the tri-level granular structure of neighborhood system. Knowledge-Based Systems, 217(1–4):106799, 2021.
  4. W. Pedrycz. Allocation of information granularity in optimization and decision-making models: Towards building the foundations of granular computing. European Journal of Operational Research, 232(1):137–145, 2014.
  5. A trilevel analysis of uncertainty measuresin partition-based granular computing. Artificial Intelligence Review, 56(1):533–575, 2023.
  6. Multi granularity based label propagation with active learning for semi-supervised classification. Expert Systems with Applications, 192:116276, 2022.
  7. Methods and practices of three-way decisions for complex problem solving. In Rough Sets and Knowledge Technology: 10th International Conference, RSKT 2015, Held as Part of the International Joint Conference on Rough Sets, IJCRS 2015, Tianjin, China, November 20-23, 2015, Proceedings 10, pages 255–265. Springer, 2015.
  8. Granular ball computing classifiers for efficient, scalable and robust learning. Information Sciences, 483:136–152, 2019.
  9. Integrating variable reduction strategy with evolutionary algorithms for solving nonlinear equations systems. IEEE/CAA Journal of Automatica Sinica, 9(1):75–89, 2022.
  10. Trend-based granular representation of time series and its application in clustering. IEEE Transactions on Cybernetics, 52(9):9101–9110, 2021.
  11. A multi-granularity cognitive computing model bidirectionally driven by knowledge and data. Journal of Northwest University(Natural Science Edition), 2018.
  12. Granular ball computing: an efficient, robust, and interpretable adaptive multi-granularity representation and computation method. arXiv preprint arXiv:2304.11171, 2023.
  13. Weight-and-universum-based semi-supervised multi-view learning machine. Soft Computing, 24(14):10657–10679, 2020.
  14. Ball k-means: Fast adaptive clustering with no bounds. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(1):87–99, 2022.
  15. An efficient ls-svm-based method for fuzzy system construction. IEEE Transactions on Fuzzy Systems, 23(3):627–643, 2014.
  16. R. Khemchandani and S. Chandra. Twin support vector machines for pattern classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(5):905–910, 2007.
  17. Twin support vector machine: theory, algorithm and applications. Neural Computing and Applications, 28:3119–3130, 2017.
  18. G. Fung and O. L. Mangasarian. Proximal support vector machine classifiers. In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, pages 77–86, 2001.
  19. Generalized elastic net lp-norm nonparallel support vector machine. Engineering Applications of Artificial Intelligence, 88:103397, 2020.
  20. A novel projection twin support vector machine for binary classification. Soft Computing, 23:655–668, 2019.
  21. ν𝜈\nuitalic_ν-projection twin support vector machine for pattern classification. Neurocomputing, 376:10–24, 2020.
  22. Intuitionistic fuzzy weighted least squares twin svms. IEEE Transactions on Cybernetics, pages 1–10, 2022.
  23. Multiview learning with robust double-sided twin svm. IEEE Transactions on Cybernetics, 52(12):12745–12758, 2021.
  24. A transfer-based additive ls-svm classifier for handling missing data. IEEE Transactions on Cybernetics, 50(2):739–752, 2018.
  25. Semisupervised learning via axiomatic fuzzy set theory and svm. IEEE Transactions on Cybernetics, 52(6):4661–4674, 2020.
  26. Q. Ren and L. Yang. A robust projection twin support vector machine with a generalized correntropy-based loss. Applied Intelligence, 52(2):2154–2170, 2022.
  27. Twin-parametric margin support vector machine with truncated pinball loss. Neural Computing and Applications, 33:3781–3798, 2021.
  28. The dual model of support vector machine based on granular ball computing. pages 43–47, 2021.
  29. Parameters selection and application of support vector machines based on particle swarm optimization algorithm. Kongzhi Lilun yu Yingyong/ Control Theory & Applications, 23(5):740–743, 2006.
  30. John C Platt. Sequential minimal optimization: A fast algorithm for training support vector machines. Microsoft Research, 1998.
  31. An efficient and adaptive granular-ball generation method in classification problem. IEEE Transactions on Neural Networks and Learning Systems, 2022.
  32. Graph-based representation for image based on granular-ball. arXiv preprint arXiv:2303.02388, 2023.
  33. Granular-ball optimization algorithm. arXiv preprint arXiv:2303.12807, 2023.
  34. Gbnrs: A novel rough set algorithm for fast adaptive attribute reduction in classification. IEEE Transactions on Knowledge and Data Engineering, 34(3):1231–1242, 2020.
  35. Gbrs: A unified granular-ball learning model of pawlak rough set and neighborhood rough set. IEEE Transactions on Neural Networks and Learning Systems, pages 1–15, 2023.
  36. Granular ball sampling for noisy label classification or imbalanced classification. IEEE Transactions on Neural Networks and Learning Systems, PP(99):1–12, 2021.
  37. An efficient spectral clustering algorithm based on granular-ball. IEEE Transactions on Knowledge and Data Engineering, 2023.
  38. Complete random forest based class noise filtering learning for improving the generalizability of classifiers. IEEE Transactions on Knowledge and Data Engineering, 31(11):2063–2078, 2018.
  39. Relative density based support vector machine. Neurocomputing, 149:1424–1432, 2015.
  40. T. Liu and D. Tao. Classification with noisy labels by importance reweighting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(3):447–461, 2015.
  41. C. J. Burges. A tutorial on support vector machines for pattern recognition. Data mining and knowledge discovery, 2(2):121–167, 1998.
  42. Kernel k-means: spectral clustering and normalized cuts. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 551–556, 2004.
  43. mcrf and mrd: two classification methods based on a novel multiclass label noise filtering learning framework. IEEE Transactions on Neural Networks and Learning Systems, 33(7):2916–2930, 2021.
  44. S. Guan and B. Biswal. Spline adaptive filtering algorithm based on different iterative gradients: Performance analysis and comparison. Journal of Automation and Intelligence, 2(1):1–13, 2023.
  45. Practical bipartite consensus for multi-agent systems: A barrier function-based adaptive sliding-mode control approach. Journal of Automation and Intelligence, 2(1):14–19, 2023.
  46. Sampled-data control through model-free reinforcement learning with effective experience replay. Journal of Automation and Intelligence, 2(1):20–30, 2023.
  47. Towards cognitive navigation: A biologically inspired calibration mechanism for the head direction cell network. Journal of Automation and Intelligence, 2(1):31–41, 2023.
  48. Cost-effective distributed ftfc for uncertain nonholonomic mobile robot fleet with collision avoidance and connectivity preservation. Journal of Automation and Intelligence, 2(1):42–50, 2023.
  49. M. Guan and C. Wen. Autonomous exploration using uwb and lidar. Journal of Automation and Intelligence, 2(1):51–60, 2023.
  50. Practical prescribed-time fuzzy tracking control for uncertain nonlinear systems with time-varying actuators faults. Journal of Automation and Intelligence, 2023.
  51. Msfired-net: A lightweight and efficient convolutional neural network for flame and smoke segmentation. Journal of Automation and Intelligence, 2(3):130–138, 2023.
  52. A review on colregs-compliant navigation of autonomous surface vehicles: From traditional to learning-based approaches. Journal of Automation and Intelligence, 1(1):100003, 2022.
Citations (14)

Summary

We haven't generated a summary for this paper yet.