DCNFIS: Deep Convolutional Neuro-Fuzzy Inference System (2308.06378v3)
Abstract: A key challenge in eXplainable Artificial Intelligence is the well-known tradeoff between the transparency of an algorithm (i.e., how easily a human can directly understand the algorithm, as opposed to receiving a post-hoc explanation), and its accuracy. We report on the design of a new deep network that achieves improved transparency without sacrificing accuracy. We design a deep convolutional neuro-fuzzy inference system (DCNFIS) by hybridizing fuzzy logic and deep learning models and show that DCNFIS performs as accurately as existing convolutional neural networks on four well-known datasets and 3 famous architectures. Our performance comparison with available fuzzy methods show that DCNFIS is now state-of-the-art fuzzy system and outperforms other shallow and deep fuzzy methods to the best of our knowledge. At the end, we exploit the transparency of fuzzy logic by deriving explanations, in the form of saliency maps, from the fuzzy rules encoded in the network to take benefit of fuzzy logic upon regular deep learning methods. We investigate the properties of these explanations in greater depth using the Fashion-MNIST dataset.
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 1–9.
- I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,” in Advances in neural information processing systems, 2014, pp. 3104–3112.
- T. N. Sainath, B. Kingsbury, G. Saon, H. Soltau, A. rahman Mohamed, G. Dahl, and B. Ramabhadran, “Deep Convolutional Neural Networks for Large-scale Speech Tasks,” Neural Networks, vol. 64, 2015.
- A. Soleymani, A. A. S. Asl, M. Yeganejou, S. Dick, M. Tavakoli, and X. Li, “Surgical skill evaluation from robot-assisted surgery recordings,” in 2021 International Symposium on Medical Robotics (ISMR). IEEE, 2021, pp. 1–6.
- M. Yeganejou, M. Keshmiri, and S. Dick, “Accurate and explainable retinal disease recognition via DCNFIS,” in Fuzzy Information Processing: 42th Conference of the North American Fuzzy Information Processing Society, NAFIPS 2023, Cincinnati, OH, USA, Proceedings 42. Springer, 2023.
- M. T. Ribeiro, S. Singh, and C. Guestrin, “Why should i trust you?: Explaining the predictions of any classifier,” in Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, 2016, pp. 1135–1144.
- R. Caruana, Y. Lou, J. Gehrke, P. Koch, M. Sturm, and N. Elhadad, “Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission,” in 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ’15), Proceedings, 2015.
- D. Baehrens, T. Schroeter, S. Harmeling, M. Kawanabe, K. Hansen, and K.-R. MÞller, “How to explain individual classification decisions,” Machine Learning Research 11(Jun)., 2010.
- L. R. Ye and P. E. Johnson, “The impact of explanation facilities on user acceptance of expert systems advice,” Mis Quarterly, pp. 157–172, 1995.
- U. Fayyad, G. Piatetsky-Shapiro, and P. Smyth, “Knowledge Discovery and Data Mining: Towards a Unifying Framework.” Int Conf on Knowledge Discovery and Data Mining, 1996.
- S. Hajian, F. Bonchi, and C. Castillo, “Algorithmic bias: From discrimination discovery to fairness-aware data mining,” in Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016.
- B. Goodman and S. Flaxman, “European union regulations on algorithmic decision making and a ”right to explanation”,” AI Magazine, 2017.
- M. Yeganejou and S. Dick, “Explainable Artificial Intelligence and Computational Intelligence: Past and Present,” HANDBOOK ON COMPUTER LEARNING AND INTELLIGENCE: Volume 2: Deep Learning, Intelligent Control and Evolutionary Computation, pp. 3–55, 2022.
- R. Goebel, A. Chander, K. Holzinger, F. Lecue, Z. Akata, S. Stumpf, P. Kieseberg, and A. Holzinger, “Explainable AI: the new 42?” in International cross-domain conference for machine learning and knowledge extraction. Springer, 2018, pp. 295–303.
- H. Ishibuchi and Y. Nojima, “Discussions on Interpretability of Fuzzy Systems using Simple Examples.” in IFSA/EUSFLAT Conf., 2009, pp. 1649–1654.
- Z. C. Lipton, “The mythos of model interpretability,” Communications of the ACM, 2018.
- A. B. Tickle, R. Andrews, M. Golea, and J. Diederich, “The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks,” IEEE Transactions on Neural Networks, 1998.
- J. R. Zilke, E. Loza Mencía, and F. Janssen, “DeepRED – Rule Extraction from Deep Neural Networks,” Discovery Science 19th International Conference, 2016.
- M. D. Zeiler, D. Krishnan, G. W. Taylor, and R. Fergus, “Deconvolutional networks,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010.
- S. Bach, A. Binder, G. Montavon, F. Klauschen, K. R. Müller, and W. Samek, “On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation,” PLoS ONE, 2015.
- M. T. Ribeiro, S. Singh, and C. Guestrin, “Model-agnostic interpretability of machine learning,” arXiv preprint arXiv:1606.05386, 2016.
- S. K. Pal and S. Mitra, “Multilayer Perceptron, Fuzzy Sets, and Classification,” IEEE Transactions on Neural Networks, 1992.
- J. S. R. Jang, “ANFIS: Adaptive-Network-Based Fuzzy Inference System,” IEEE Transactions on Systems, Man and Cybernetics, 1993.
- M. J. Gacto, R. Alcalá, and F. Herrera, “Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures,” Information Sciences, 2011.
- H. Ishibuchi and Y. Nojima, “Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning,” International Journal of Approximate Reasoning, vol. 44, no. 1, pp. 4–31, 2007.
- M. Yeganejou, R. Kluzinski, S. Dick, and J. Miller, “An End-to-End Trainable Deep Convolutional Neuro-Fuzzy Classifier,” in 2022 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, 2022, pp. 1–7.
- M. Yeganejou, S. Dick, and J. Miller, “Interpretable Deep Convolutional Fuzzy Classifier,” IEEE Transactions on Fuzzy Systems, vol. 28, no. 7, pp. 1407–1419, 2020.
- M. Yeganejou and S. Dick, “Improved deep fuzzy clustering for accurate and interpretable classifiers,” in 2019 IEEE international conference on fuzzy systems (FUZZ-IEEE). IEEE, 2019, pp. 1–7.
- Yeganejou, Mojtaba and S. Dick, “Classification via deep fuzzy c-means clustering,” in IEEE International Conference on Fuzzy Systems, 2018.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein et al., “Imagenet large scale visual recognition challenge,” International journal of computer vision, vol. 115, pp. 211–252, 2015.
- F. Chollet, “Xception: Deep learning with depthwise separable convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 1251–1258.
- R. E. Kalman, “A new approach to linear filtering and prediction problems,” Journal of Fluids Engineering, Transactions of the ASME, 1960.
- S. Ovchinnikov, “Similarity relations, fuzzy partitions, and fuzzy orderings,” Fuzzy Sets and Systems, vol. 40, no. 1, pp. 107–126, 1991.
- L. A. Zadeh, “The concept of a linguistic variable and its application to approximate reasoning-I,” Information Sciences, 1975.
- L. Zadeh, “Fuzzy sets,” Information and Control, 1965.
- Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, 1998.
- A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in neural information processing systems, 2012, pp. 1097–1105.
- M. D. Zeiler and R. Fergus, “Visualizing and understanding convolutional networks,” in European conference on computer vision. Springer, 2014, pp. 818–833.
- I. Arel, D. C. Rose, and T. P. Karnowski, “Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier],” IEEE Computational Intelligence Magazine, 2010.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- K. He, X. Zhang, S. Ren, and J. Sun, “Identity mappings in deep residual networks,” in Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV 14. Springer, 2016, pp. 630–645.
- S. Zagoruyko and N. Komodakis, “Wide residual networks,” arXiv preprint arXiv:1605.07146, 2016.
- C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2818–2826.
- A. Sarabakha and E. Kayacan, “Online Deep Fuzzy Learning for Control of Nonlinear Systems Using Expert Knowledge,” IEEE Transactions on Fuzzy Systems, 2020.
- C. L. Chen, C. Y. Zhang, L. Chen, and M. Gan, “Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning,” IEEE Transactions on Fuzzy Systems, 2015.
- R. R. Yager, “Pythagorean membership grades in multicriteria decision making,” IEEE Transactions on Fuzzy Systems, 2014.
- Y.-J. Zheng, W.-G. Sheng, X.-M. Sun, and S.-Y. Chen, “Airline Passenger Profiling Based on Fuzzy Deep Machine Learning,” IEEE Transactions on Neural Networks and Learning Systems, 2016.
- A. Shukla, T. Seth, and P. Muhuri, “Interval type-2 fuzzy sets for enhanced learning in deep belief networks,” in IEEE International Conference on Fuzzy Systems, 2017.
- S. Feng, C. L. Philip Chen, and C. Y. Zhang, “A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification,” IEEE Transactions on Fuzzy Systems, 2020.
- Y. J. Zheng, S. Y. Chen, Y. Xue, and J. Y. Xue, “A Pythagorean-Type Fuzzy Deep Denoising Autoencoder for Industrial Accident Early Warning,” IEEE Transactions on Fuzzy Systems, 2017.
- T. Sharma, V. Singh, S. Sudhakaran, and N. K. Verma, “Fuzzy based pooling in convolutional neural network for image classification,” in 2019 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, 2019, pp. 1–6.
- D. E. Diamantis and D. K. Iakovidis, “Fuzzy pooling,” IEEE Transactions on Fuzzy Systems, vol. 29, no. 11, pp. 3481–3488, 2020.
- A. Beke and T. Kumbasar, “Interval type-2 fuzzy systems as deep neural network activation functions,” in 11th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT 2019). Atlantis Press, 2019, pp. 267–273.
- Y. Bodyanskiy and S. Kostiuk, “Deep neural network based on f-neurons and its learning,” 2022.
- T. Sharma, N. K. Verma, and S. Masood, “Mixed fuzzy pooling in convolutional neural networks for image classification,” Multimedia Tools and Applications, vol. 82, no. 6, pp. 8405–8421, 2023.
- S. Zhang, Z. Sun, M. Wang, J. Long, Y. Bai, and C. Li, “Deep Fuzzy Echo State Networks for Machinery Fault Diagnosis,” IEEE Transactions on Fuzzy Systems, 2020.
- L. X. Wang, “Fast Training Algorithms for Deep Convolutional Fuzzy Systems with Application to Stock Index Prediction,” IEEE Transactions on Fuzzy Systems, 2020.
- M. Pratama, W. Pedrycz, and G. I. Webb, “An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Nonstationary Data Streams,” IEEE Transactions on Fuzzy Systems, 2020.
- S. Liu, G. Lin, Q. L. Han, S. Wen, J. Zhang, and Y. Xiang, “DeepBalance: Deep-Learning and Fuzzy Oversampling for Vulnerability Detection,” IEEE Transactions on Fuzzy Systems, 2020.
- Q. Feng, L. Chen, C. L. Philip Chen, and L. Guo, “Deep Fuzzy Clustering-A Representation Learning Approach,” IEEE Transactions on Fuzzy Systems, 2020.
- P. Hurtik, V. Molek, and J. Hula, “Data Preprocessing Technique for Neural Networks Based on Image Represented by a Fuzzy Function,” IEEE Transactions on Fuzzy Systems, 2020.
- L. Chen, W. Su, M. Wu, W. Pedrycz, and K. Hirota, “A Fuzzy Deep Neural Network with Sparse Autoencoder for Emotional Intention Understanding in Human-Robot Interaction,” IEEE Transactions on Fuzzy Systems, 2020.
- C. Guan, S. Wang, and A. W.-C. Liew, “Lip image segmentation based on a fuzzy convolutional neural network,” IEEE Transactions on Fuzzy Systems, 2019.
- Y. Wang, Q. Hu, P. Zhu, L. Li, B. Lu, J. M. Garibaldi, and X. Li, “Deep Fuzzy Tree for Large-Scale Hierarchical Visual Classification,” IEEE Transactions on Fuzzy Systems, 2020.
- A. I. Aviles, S. M. Alsaleh, E. Montseny, P. Sobrevilla, and A. Casals, “A deep-neuro-fuzzy approach for estimating the interaction forces in robotic surgery,” in 2016 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE 2016, 2016.
- S. Rajurkar and N. K. Verma, “Developing deep fuzzy network with Takagi Sugeno fuzzy inference system,” in IEEE International Conference on Fuzzy Systems, 2017.
- T. Zhou, F. L. Chung, and S. Wang, “Deep TSK Fuzzy Classifier With Stacked Generalization and Triplely Concise Interpretability Guarantee for Large Data,” IEEE Transactions on Fuzzy Systems, 2017.
- S. Gu, F.-L. Chung, and S. Wang, “A novel deep fuzzy classifier by stacking adversarial interpretable TSK fuzzy sub-classifiers with smooth gradient information,” IEEE Transactions on Fuzzy Systems, vol. 28, no. 7, pp. 1369–1382, 2019.
- W. R. Tan, C. S. Chan, H. E. Aguirre, and K. Tanaka, “Fuzzy qualitative deep compression network,” Neurocomputing, 2017.
- R. Jafari, S. Razvarz, and A. Gegov, “Neural Network Approach to Solving Fuzzy Nonlinear Equations Using Z-Numbers,” IEEE Transactions on Fuzzy Systems, 2020.
- M. A. Islam, D. T. Anderson, A. J. Pinar, T. C. Havens, G. Scott, and J. M. Keller, “Enabling Explainable Fusion in Deep Learning with Fuzzy Integral Neural Networks,” IEEE Transactions on Fuzzy Systems, 2020.
- V. John, S. Mita, Z. Liu, and B. Qi, “Pedestrian detection in thermal images using adaptive fuzzy C-means clustering and convolutional neural networks,” in 2015 14th IAPR International Conference on Machine Vision Applications (MVA), 2015.
- Y. De la Rosa, Erick, Wen, “Data-Driven Fuzzy Modeling Using Deep Learning,” arXiv preprint arXiv:1702.07076 (2017).
- Z. Zhang, M. Huang, S. Liu, B. Xiao, and T. S. Durrani, “Fuzzy Multilayer Clustering and Fuzzy Label Regularization for Unsupervised Person Reidentification,” IEEE Transactions on Fuzzy Systems, 2020.
- S. Riaz, A. Arshad, and L. Jiao, “A semi-supervised cnn with fuzzy rough c-mean for image classification,” IEEE Access, vol. 7, pp. 49 641–49 652, 2019.
- O. Yazdanbakhsh and S. Dick, “A deep neuro-fuzzy network for image classification,” arXiv preprint arXiv:2001.01686, 2019.
- Y. Zhang, H. Ishibuchi, and S. Wang, “Deep Takagi-Sugeno-Kang Fuzzy Classifier With Shared Linguistic Fuzzy Rules,” IEEE Transactions on Fuzzy Systems, 2018.
- T. Zhou, H. Ishibuchi, and S. Wang, “Stacked-structure-based hierarchical takagi-sugeno-kang fuzzy classification through feature augmentation,” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 1, no. 6, pp. 421–436, 2017.
- X. Gu and P. P. Angelov, “Semi-supervised deep rule-based approach for image classification,” Applied Soft Computing, vol. 68, pp. 53–68, 2018.
- D. Tan, Z. Huang, X. Peng, W. Zhong, and V. Mahalec, “Deep adaptive fuzzy clustering for evolutionary unsupervised representation learning,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
- F. Guo, J. Liu, M. Li, T. Huang, Y. Zhang, D. Li, and H. Zhou, “A concise tsk fuzzy ensemble classifier integrating dropout and bagging for high-dimensional problems,” IEEE Transactions on Fuzzy Systems, vol. 30, no. 8, pp. 3176–3190, 2021.
- R. Shah, “Adaptive fuzzy network based transfer learning for image classification,” in 2020 IEEE International Students’ Conference on Electrical, Electronics and Computer Science (SCEECS). IEEE, 2020, pp. 1–4.
- E. Di Nardo and A. Ciaramella, “Advanced fuzzy relational neural network.” in WILF, 2021.
- Z. Xi and G. Panoutsos, “Interpretable machine learning: convolutional neural networks with rbf fuzzy logic classification rules,” in 2018 International conference on intelligent systems (IS). IEEE, 2018, pp. 448–454.
- R. Zhang, X. Li, H. Zhang, and F. Nie, “Deep fuzzy k-means with adaptive loss and entropy regularization,” IEEE Transactions on Fuzzy Systems, vol. 28, no. 11, pp. 2814–2824, 2019.
- K. Lazanyi, “Readiness for Artificial Intelligence,” in International Symposium on Intelligent Systems and Informatics (SISY), 2018, pp. 235–238.
- M. Ashoori and J. D. Weisz, “In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making Processes,” Tech. Rep., 2019.
- D. H. McKnight and N. L. Chervany, “What trust means in e-commerce customer relationships: An interdisciplinary conceptual typology,” International journal of electronic commerce, vol. 6, no. 2, pp. 35–59, 2001.
- P. Beatty, I. Reay, S. Dick, and J. Miller, “Consumer trust in e-commerce web sites: A meta-study,” ACM Computing Surveys, vol. 43, no. 3, pp. 14:1–14:46, 2011.
- J. B. Rotter, “A new scale for the measurement of interpersonal trust.” Journal of personality, 1967.
- T. R. Tyler, “Why People Obey the Law,” 1990.
- D. M. Rousseau, S. B. Sitkin, R. S. Burt, and C. Camerer, “Not so different after all: A cross-discipline view of trust,” Academy of management review, vol. 23, no. 3, pp. 393–404, 1998.
- R. C. Mayer, J. H. Davis, and F. D. Schoorman, “An Integrative Model Of Organizational Trust,” Academy of Management Review, vol. 20, no. 3, pp. 709–734, 1995.
- J. D. Lee and K. A. See, “Trust in Automation: Designing for Appropriate Reliance,” Human Factors: The Journal of the Human Factors and Ergonomics Society2, vol. 46, no. 1, pp. 50–80, 4.
- B. W. Israelsen and N. R. Ahmed, ““Dave…I can assure you …that it’s going to be all right …” A Definition, Case for, and Survey of Algorithmic Assurances in Human-Autonomy Trust Relationships,” pp. 1–37, 2019.
- J. Drozdal, J. Weisz, D. Wang, G. Dass, B. Yao, C. Zhao, M. Muller, L. Ju, and H. Su, “Trust in AutoML: Exploring Information Needs for Establishing Trust in Automated Machine Learning Systems,” 2020. [Online]. Available: http://arxiv.org/abs/2001.06509%0Ahttp://dx.doi.org/10.1145/3377325.3377501
- J. Overton, “Scientific Explanation and Computation.” in ExaCt, 2011, pp. 41–50.
- T. Miller, “Explanation in Artificial Intelligence: Insights from the Social Sciences,” Artificial Intelligence, vol. 267, pp. 1–38, 2019.
- D. H. McKnight, V. Choudhury, and C. Kacmar, “Developing and validating trust measures for e-commerce: An integrative typology,” Information systems research, vol. 13, no. 3, pp. 334–359, 2002.
- D. Gefen, I. Benbasat, and P. Pavlou, “A research agenda for trust in online environments,” Journal of Management Information Systems, vol. 24, no. 4, pp. 275–286, 2008.
- P. B. Lowry, A. Vance, G. Moody, B. Beckman, and A. Read, “Explaining and predicting the impact of branding alliances and web site quality on initial consumer trust of e-commerce web sites,” Journal of Management Information Systems, vol. 24, no. 4, pp. 199–224, 2008.
- R. Tomsett, D. Braines, D. Harborne, A. Preece, and S. Chakraborty, “Interpretable to whom? A role-based model for analyzing interpretable machine learning systems,” 2018.
- J. Lyons, N. Ho, J. Friedman, G. Alarcon, and S. Guznov, “Trust of Learning Systems: Considerations for Code, Algorithms, and Affordances for Learning,” in Human and Machine Learning, J. Zhou and F. Chen, Eds. Cham: Springer International Publishing AG, 2018, pp. 265–278.
- W. A. Bainbridge, J. W. Hart, E. S. Kim, and B. Scassellati, “The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents,” International Journal of Social Robotics, vol. 3, pp. 41–52, 2011.
- G. J. Nalepa, M. van Otterlo, S. Bobek, and M. Atzmueller, “From context mediation to declarative values and explainability,” in Proceedings of the IJCAI/ECAI Workshop on Explainable Artificial Intelligence (XAI 2018). IJCAI, Stockholm, 2018.
- V. Beaudouin, I. Bloch, D. Bounie, S. Clémençon, F. D’Alché-Buc, J. Eagan, W. Maxwell, P. Mozharovskyi, and J. Parekh, “Flexible and Context-Specific AI Explainability: A Multidisciplinary Approach,” SSRN Electronic Journal, 2020.
- S. R. Islam, W. Eberle, and S. K. Ghafoor, “Towards quantification of explainability in explainable artificial intelligence methods,” in The thirty-third international flairs conference, 2020.
- C.-T. Sun and J.-S. Jang, “A neuro-fuzzy classifier and its applications,” in [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems. IEEE, 1993, pp. 94–98.
- J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller, “Striving for simplicity: The all convolutional net,” arXiv preprint arXiv:1412.6806, 2014.
- V. Petsiuk, A. Das, and K. Saenko, “Rise: Randomized input sampling for explanation of black-box models,” arXiv preprint arXiv:1806.07421, 2018.
- T. Fel, L. Hervier, D. Vigouroux, A. Poche, J. Plakoo, R. Cadene, M. Chalvidal, J. Colin, T. Boissin, L. Bethune, A. Picard, C. Nicodeme, L. Gardes, G. Flandin, and T. Serre, “Xplique: A deep learning explainability toolbox,” Workshop on Explainable Artificial Intelligence for Computer Vision (CVPR), 2022.
- M. Yeganejou, “Interpretable Deep Covolutional Fuzzy Networks,” 2019. [Online]. Available: https://era.library.ualberta.ca/items/3e81868d-b0d8-4a25-a154-8d1f51ee293e
- “Dataset, MNIST.” [Online]. Available: http://yann.lecun.com/exdb/mnist/
- H. Xiao, K. Rasul, and R. Vollgraf, “Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms,” arXiv preprint arXiv:1708.07747, 2017.
- A. Krizhevsky, “Learning Multiple Layers of Features from Tiny Images,” … Science Department, University of Toronto, Tech. …, 2009.
- Jia Deng, Wei Dong, R. Socher, Li-Jia Li, Kai Li, and Li Fei-Fei, “ImageNet: A large-scale hierarchical image database,” in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009.
- G. A. Miller, “Wordnet: a lexical database for english,” Communications of the ACM, vol. 38, no. 11, pp. 39–41, 1995.
- M. Alber, S. Lapuschkin, P. Seegerer, M. Hägele, K. Schütt, G. Montavon, W. Samek, K.-R. Müller, S. Dähne, and P.-J. Kindermans, “iNNvestigate neural networks!” arXiv preprint arXiv:1808.04260, 2018.
- L. A. Hendricks, A. Rohrbach, B. Schiele, T. Darrell, and Z. Akata, “Generating visual explanations with natural language,” Applied AI Letters, vol. 2, no. 4, 2021.
- L. McInnes and J. Healy, “Umap: Uniform manifold approximation and projection for dimension reduction,” arXiv preprint arXiv:1802.03426, 2018.
- D. Gunning, E. Vorm, J. Y. Wang, and M. Turek, “DARPA ’s explainable AI ( XAI ) program: A retrospective,” Applied AI Letters, vol. 2, no. 4, 2021.
- A. B. Khalifa and H. Frigui, “Mcmi-anfis: A robust multi class multiple instance adaptive neuro-fuzzy inference system,” in 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, 2016, pp. 1991–1998.