Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Granular-ball computing: an efficient, robust, and interpretable adaptive multi-granularity representation and computation method (2304.11171v4)

Published 21 Apr 2023 in cs.LG and cs.AI

Abstract: Human cognition operates on a "Global-first" cognitive mechanism, prioritizing information processing based on coarse-grained details. This mechanism inherently possesses an adaptive multi-granularity description capacity, resulting in computational traits such as efficiency, robustness, and interpretability. The analysis pattern reliance on the finest granularity and single-granularity makes most existing computational methods less efficient, robust, and interpretable, which is an important reason for the current lack of interpretability in neural networks. Multi-granularity granular-ball computing employs granular-balls of varying sizes to daptively represent and envelop the sample space, facilitating learning based on these granular-balls. Given that the number of coarse-grained "granular-balls" is fewer than sample points, granular-ball computing proves more efficient. Moreover, the inherent coarse-grained nature of granular-balls reduces susceptibility to fine-grained sample disturbances, enhancing robustness. The multi-granularity construct of granular-balls generates topological structures and coarse-grained descriptions, naturally augmenting interpretability. Granular-ball computing has successfully ventured into diverse AI domains, fostering the development of innovative theoretical methods, including granular-ball classifiers, clustering techniques, neural networks, rough sets, and evolutionary computing. This has notably ameliorated the efficiency, noise robustness, and interpretability of traditional methods. Overall, granular-ball computing is a rare and innovative theoretical approach in AI that can adaptively and simultaneously enhance efficiency, robustness, and interpretability. This article delves into the main application landscapes for granular-ball computing, aiming to equip future researchers with references and insights to refine and expand this promising theory.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. From data to granular data and granular classifiers, in: 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), IEEE. pp. 432–438.
  2. Svm-km: speeding svms learning with a priori cluster selection and k-means, in: Proceedings. Vol.1. Sixth Brazilian Symposium on Neural Networks, pp. 162–167. doi:10.1109/SBRN.2000.889732.
  3. A clustering performance measure based on fuzzy set decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence , 66–75.
  4. Adversarial attacks on face detectors using neural net based constrained optimization, in: 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP), IEEE. pp. 1–6.
  5. A rough-set-based incremental approach for updating approximations under dynamic maintenance environments. IEEE Transactions on Knowledge and Data Engineering 25, 274–284.
  6. Topological structure in visual perception. Science 218, 699–700.
  7. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 .
  8. Fast r-cnn, in: Proceedings of the IEEE international conference on computer vision, pp. 1440–1448.
  9. Vision gnn: An image is worth graph of nodes. arXiv preprint arXiv:2206.00272 .
  10. Neighborhood rough set based heterogeneous feature subset selection. Information Sciences 178, 3577–3594.
  11. On robust fuzzy rough set models. IEEE Transactions on Fuzzy Systems 20, 636–651.
  12. Large-scale multimodality attribute reduction with multi-kernel fuzzy rough sets. IEEE Transactions on Fuzzy Systems 26, 226–238.
  13. Counting with fuzzy sets. IEEE Transactions on Pattern Analysis and Machine Intelligence , 556–557.
  14. Shield: Defending textual neural networks against multiple black-box adversarial attacks with stochastic multi-expert patcher, in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 6661–6674.
  15. Evolving granular neural networks from fuzzy data streams. Neural Networks 38, 1–16.
  16. Uncertainty reasoning based on cloud models in controllers. Computers & Mathematics with Applications 35, 99–123.
  17. A new cognitive model: Cloud model. International Journal of Intelligent Systems 24, 357–375.
  18. A group incremental approach to feature selection applying rough set technique. IEEE Transactions on Knowledge and Data Engineering 26, 294–308.
  19. Combinatorial iterative algorithms for computing the centroid of an interval type-2 fuzzy set. IEEE Transactions on Fuzzy Systems 28, 607–617.
  20. Textual manifold-based defense against natural language adversarial examples, in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pp. 6612–6625.
  21. Granular neural networks and their development through context-based clustering and adjustable dimensionality of receptive fields. IEEE Transactions on Neural Networks 20, 1604–1616.
  22. Granular neural networks. Neurocomputing 36, 205–224.
  23. From soft sets to information systems, in: 2005 IEEE International Conference on Granular Computing, IEEE. pp. 617–621.
  24. Positive approximation: an accelerator for attribute reduction in rough set theory. Artificial Intelligence 174, 597–618.
  25. You only look once: Unified, real-time object detection, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788.
  26. A design of granular fuzzy classifier. Expert Systems with Applications 41, 6786–6795.
  27. Graph-based representation for image based on granular-ball. arXiv preprint arXiv:2303.02388 .
  28. Parallel granular neural networks for fast credit card fraud detection, in: 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE’02. Proceedings (Cat. No. 02CH37291), IEEE. pp. 572–577.
  29. Granular support vector machine with random granularity. US Patent 8,160,975.
  30. Rough reduction in algebra view and information view. International Journal of Intelligent Systems 18, 679–688.
  31. Dgcc: data-driven granular cognitive computing. Granular Computing 2, 343–355.
  32. Theory and applications of granular labelled partitions in multi-scale decision tables. Information Sciences 181, 3878–3897.
  33. An efficient and accurate rough set for feature selection, classification, and knowledge representation. IEEE Transactions on Knowledge and Data Engineering .
  34. Granular-ball optimization algorithm. arXiv preprint arXiv:2303.12807 .
  35. An efficient and adaptive granular-ball generation method in classification problem. IEEE Transactions on Neural Networks and Learning Systems .
  36. Fuzzy granular-ball computing framework and its implementation in svm. arXiv preprint arXiv:2210.11675 .
  37. Granular ball computing classifiers for efficient, scalable and robust learning. Information Sciences 483, 136–152.
  38. Ball k𝑘kitalic_k k-means: Fast adaptive clustering with no bounds. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 87–99.
  39. Gbrs: A unified granular-ball learning model of pawlak rough set and neighborhood rough set. IEEE Transactions on Neural Networks and Learning Systems .
  40. Complete random forest based class noise filtering learning for improving the generalizability of classifiers. IEEE Transactions on Knowledge and Data Engineering 31, 2063–2078.
  41. Gbsvm: Granular-ball support vector machine. IEEE Transactions on Neural Networks and Learning Systems .
  42. A coarse-to-fine adaptive acceleration framework for exact k-means. IEEE Transactions on Pattern Analysis and Machine Intelligence .
  43. Grrs: Accurate and efficient neighborhood rough set for feature selection. IEEE Transactions on Knowledge and Data Engineering .
  44. Gbc: An efficient and adaptive clustering algorithm based on granular-ball. arXiv:2205.14592.
  45. Gbnrs: A novel rough set algorithm for fast adaptive attribute reduction in classification. IEEE Transactions on Knowledge and Data Engineering 34, 1231--1242.
  46. Granular ball sampling for noisy label classification or imbalanced classification. IEEE Transactions on Neural Networks and Learning Systems .
  47. Research on efficient fuzzy clustering method based on local fuzzy granules. arXiv preprint arXiv:2303.03590 .
  48. An efficient spectral clustering algorithm based on granular-ball. IEEE Transactions on Knowledge and Data Engineering .
  49. GBMST: An Efficient Minimum Spanning Tree Clustering Based on Granular-Ball Computing. arXiv e-prints , arXiv:2303.01082doi:10.48550/arXiv.2303.01082, arXiv:2303.01082.
  50. On the properties of covering rough sets model. Journal of Henan Normal University (Natural Science) 33, 130--132.
  51. Decision-theor etic rough set models, in: Rough Sets and Knowledge Technology: Second International Conference, RSKT 2007, Toronto, Canada, May 14-16, 2007. Proceedings 2, Springer. pp. 1--12.
  52. Fuzzy sets and information granularity. Fuzzy sets, fuzzy logic, and fuzzy systems: selected papers , 433--448.
  53. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy sets and systems 90, 111--127.
  54. Theory of fuzzy quotient space (methods of fuzzy granular computing). Journal of Software 14, 770--776.
  55. The quotient space theory of problem solving. Fundamenta Informaticae 59, 287--298.
  56. Incremental learning based on granular ball rough sets for classification in dynamic mixed-type decision system. IEEE Transactions on Knowledge and Data Engineering .
  57. A multiobjective optimization of pcb prototyping assembly with ofa based on the similarity of intuitionistic fuzzy sets. IEEE Transactions on Fuzzy Systems 29, 2054--2061.
  58. Defense against synonym substitution-based adversarial attacks via dirichlet neighborhood ensemble, in: Association for Computational Linguistics (ACL).
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now