Explainable Deep Learning Methods in Medical Image Classification: A Survey (2205.04766v3)
Abstract: The remarkable success of deep learning has prompted interest in its application to medical imaging diagnosis. Even though state-of-the-art deep learning models have achieved human-level accuracy on the classification of different types of medical data, these models are hardly adopted in clinical workflows, mainly due to their lack of interpretability. The black-box-ness of deep learning models has raised the need for devising strategies to explain the decision process of these models, leading to the creation of the topic of eXplainable Artificial Intelligence (XAI). In this context, we provide a thorough survey of XAI applied to medical imaging diagnosis, including visual, textual, example-based and concept-based explanation methods. Moreover, this work reviews the existing medical imaging datasets and the existing metrics for evaluating the quality of the explanations. In addition, we include a performance comparison among a set of report generation-based methods. Finally, the major challenges in applying XAI to medical imaging and the future research directions on the topic are also discussed.
- SLIC Superpixels Compared to State-of-the-Art Superpixel Methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 11 (2012), 2274–2282.
- Sanity Checks for Saliency Maps. Advances in Neural Information Processing Systems 31 (2018).
- Content-Based Image Retrieval in Radiology: Current Status and Future Directions. Journal of Digital Imaging 24, 2 (2011), 208–222.
- iNNvestigate Neural Networks! Journal of Machine Learning Research 20, 93 (2019), 1–8.
- Supporting Skin Lesion Diagnosis with Content-Based Image Retrieval. In Proceedings of the IEEE International Conference on Pattern Recognition (ICPR). 8053–8060.
- Towards better understanding of gradient-based attribution methods for Deep Neural Networks. In International Conference on Learning Representations (ICLR).
- The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. Medical Physics 38, 2 (2011), 915–931.
- Automatic medical image interpretation: State of the art and future directions. Pattern Recognition 114 (2021), 107856.
- On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLoS ONE 10, 7 (2015), e0130140.
- Recent Advances in Adversarial Training for Adversarial Robustness. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). 4312–4321.
- Deep Attention Model for the Hierarchical Diagnosis of Skin Lesions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 2757–2765.
- Catarina Barata and Carlos Santiago. 2021. Improving the Explainability of Skin Cancer Diagnosis Using CBIR. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI). 550–559.
- Interpretable Mammographic Image Classification using Case-Based Reasoning and Deep Learning. In Workshop on Deep Learning, Case-Based Reasoning, and AutoML: Present and Future Synergies - IJCAI.
- The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ Digital Medicine 3, 1 (2020), 118.
- Mohammad Ehtasham Billah and Farrukh Javed. 2022. Bayesian Convolutional Neural Network-based Models for Diagnosis of Blood Cancer. Applied Artificial Intelligence (2022), 1–22.
- A histopathological image dataset for grading breast invasive ductal carcinomas. Informatics in Medicine Unlocked 19 (2020), 100341.
- Language models are few-shot learners. Advances in Neural Information Processing Systems (NeurIPS) 33 (2020), 1877–1901.
- PadChest: A large chest x-ray image dataset with multi-label annotated reports. Medical Image Analysis 66 (2020), 101797.
- Explaining Bayesian Neural Networks. arXiv preprint arXiv:2108.10346 (2021).
- Deep Clustering for Unsupervised Learning of Visual Features. In Proceedings of the European Conference on Computer Vision (ECCV). 132–149.
- This Looks Like That: Deep Learning for Interpretable Image Recognition. In Proceedings of the International Conference of Neural Information Processing Systems (NIPS).
- Visual-Linguistic Causal Intervention for Radiology Report Generation. arXiv preprint arXiv:2303.09117 (2023).
- Concept Whitening for Interpretable Image Recognition. Nature Machine Intelligence 2, 12 (2020), 772–782.
- Generating Radiology Reports via Memory-driven Transformer. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 1439–1449.
- XAI-CBIR: Explainable AI System for Content based Retrieval of Video Frames from Minimally Invasive Surgery Videos. In Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI). 66–69.
- Applying Self-Supervised Learning to Medicine: Review of the State of the Art and Medical Implementations. Informatics 8, 3 (2021), 59.
- COVID-19 Image Data Collection. arXiv 2003.11597 (2020). https://github.com/ieee8023/covid-chestxray-dataset
- SkinCon: A skin disease dataset densely annotated by domain experts for fine-grained debugging and analysis. Advances in Neural Information Processing Systems 35 (2022), 18157–18167.
- A Systematic Review on Model-agnostic XAI Libraries. (2021).
- Light Field Image Dataset of Skin Lesions. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 3905–3908.
- Preparing a collection of radiology examinations for distribution and retrieval. Journal of the American Medical Informatics Association 23, 2 (2016), 304–310.
- Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypes. arXiv preprint arXiv:2111.15000 (2021).
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proceedings of the International Conference on Learning Representations (ICLR).
- Fabian Eitel and Kerstin Ritter for the Alzheimer’s Disease Neuroimaging Initiative (ADNI). 2019. Testing the Robustness of Attribution Methods for Convolutional Neural Networks in MRI-Based Alzheimer’s Disease Classification. In Interpretability of Machine Intelligence in Medical Image Computing and Multimodal Learning for Clinical Decision Support (IMIMIC). 3–11.
- Concept-based Explanation for Fine-grained Images and Its Application in Infectious Keratitis Classification. In Proceedings of the ACM International Conference on Multimedia. 700–708.
- Understanding Deep Networks via Extremal Perturbations and Smooth Masks. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). 2950–2958.
- Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. In Proceedings of the International Conference on Machine Learning (ICML). 1050–1059.
- Producing Radiologist-Quality Reports for Interpretable Deep Learning. In Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI). 1275–1279.
- Interpretation of Neural Networks is Fragile. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 3681–3688.
- Towards Automatic Concept-Based Explanations. In Advances in Neural Information Processing Systems, Vol. 32.
- Bryce Goodman and Seth Flaxman. 2017. European Union Regulations on Algorithmic Decision-Making and a “Right to Explanation”. AI Magazine 38, 3 (2017), 50–57.
- Mahesh Gour and Sweta Jain. 2022. Uncertainty-aware convolutional neural network for COVID-19 X-ray images classification. Computers in Biology and Medicine 140 (2022), 105047.
- Concept attribution: Explaining CNN decisions to physicians. Computers in Biology and Medicine 123 (2020), 103865.
- Evaluating deep neural networks trained on clinical images in dermatology with the fitzpatrick 17k dataset. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 1820–1828.
- A Review of Explainable Deep Learning Cancer Detection Models in Medical Imaging. Applied Sciences 11, 10 (2021), 4573.
- David Gunning and David Aha. 2019. DARPA’s Explainable Artificial Intelligence (XAI) Program. AI Magazine 40, 2 (2019), 44–58.
- IRTEX: Image Retrieval with Textual Explanations. In Proceedings of the IEEE International Conference on Human-Machine Systems (ICHMS). 1–4.
- Fleischner Society: Glossary of Terms for Thoracic Imaging. Radiology 246, 3 (2008), 697–722.
- Denoising Diffusion Probabilistic Models. Advances in Neural Information Processing Systems 33 (2020), 6840–6851.
- This Looks Like That… Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networks. In ICML Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI.
- A Benchmark for Interpretability Methods in Deep Neural Networks. In Advances in Neural Information Processing Systems, Vol. 32. 9737–9748.
- X-MIR: EXplainable Medical Image Retrieval. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 440–450.
- CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 590–597.
- On the Automatic Generation of Medical Imaging Reports. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL).
- MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Scientific Data 6, 1 (2019), 1–8.
- Seven-Point Checklist and Skin Lesion Classification Using Multitask Multimodal Neural Nets. IEEE Journal of Biomedical and Health Informatics 23, 2 (2019), 538–546.
- Diffusion models for medical image analysis: A comprehensive survey. arXiv preprint arXiv:2211.07804 (2022).
- Correlations between radiological classification systems and confirmed cartilage loss in severe knee osteoarthritis. The Bone & Joint Journal 102-B, 3 (2020), 301–309.
- Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In Proceedings of the International Conference on Machine Learning (ICML). 2668–2677.
- XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 15719–15728.
- Interpretation of Lesional Detection via Counterfactual Generation. In Proceedings of the IEEE International Conference on Image Processing (ICIP). 96–100.
- Learning how to explain neural networks: PatternNet and PatternAttribution. In International Conference on Learning Representations (ICML).
- Concept Bottleneck Models. In Proceedings of the International Conference on Machine Learning (ICML). 5338–5348.
- Kokhlikyanet. 2019. Pytorch Captum. [Online]. Accessed January, 21 2021. Available: https://github.com/pytorch/captum.
- ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems (NIPS) 25 (2012).
- Attribute and Simile Classifiers for Face Verification. In Proceedings of the IEEE International Conference on Computer Vision (CVPR). 365–372.
- Learning to Detect Unseen Object Classes by Between-class Attribute Transfer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 951–958.
- Explainable artificial intelligence for breast cancer: A visual case-based reasoning approach. Artificial Intelligence in Medicine 94 (2019), 42–53.
- The LRP Toolbox for Artificial Neural Networks. Journal of Machine Learning Research 17, 114 (2016), 1–5.
- Alon Lavie and Abhaya Agarwal. 2007. METEOR: An Automatic Metric for MT Evaluation with High Levels of Correlation with Human Judgments. In Proceedings of the Workshop on Statistical Machine Translation. 228–231.
- Generation of Multimodal Justification Using Visual Word Constraint Model for Explainable Computer-Aided Diagnosis. In Interpretability of Machine Intelligence in Medical Image Computing and Multimodal Learning for Clinical Decision Support. 21–29.
- A curated mammography data set for use in computer-aided detection and diagnosis research. Scientific Data 4, 1 (2017), 1–9.
- Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generation. In Proceedings of the International Conference on Neural Information Processing Systems (NIPS). 1537–1547.
- Auxiliary signal-guided knowledge encoder-decoder for medical report generation. World Wide Web 26, 1 (2023), 253–270.
- Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. 74–81.
- Tsung-Chieh Lin and Hsi-Chieh Lee. 2020. Covid-19 Chest Radiography Images Analysis Based on Integration of Image Preprocess, Guided Grad-CAM, Machine Learning and Risk Management. In Proceedings of the International Conference on Medical and Health Informatics (ICMHI). 281–288.
- Zachary C Lipton. 2017. The Doctor Just Won’t Accept That! arXiv preprint arXiv:1711.08037 (2017).
- 1399 H&E-stained sentinel lymph node sections of breast cancer patients: the CAMELYON dataset. GigaScience 7, 6 (2018).
- A Survey on Deep Learning in Medical Image Analysis. Medical Image Analysis 42 (2017), 60–88.
- Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13753–13762.
- Contrastive Attention for Automatic Chest X-ray Report Generation. In Proceedings of the Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. 269–280.
- Clinically Accurate Chest X-Ray Report Generation. In Machine Learning for Healthcare Conference. 249–269.
- Investigation of Deep-Learning-Driven Identification of Multiple Sclerosis Patients Based on Susceptibility-Weighted Images Using Relevance Analysis. Frontiers in N euroscience (2020), 1356.
- ExAID: A Multimodal Explanation Framework for Computer-Aided Diagnosis of Skin Lesions. Computer Methods and Programs in Biomedicine (2022), 106620.
- Explaining AI-based Decision Support Systems using Concept Localization Maps. In Proceedings of the International Conference on Neural Information Processing. 185–193.
- Consistent Individualized Feature Attribution for Tree Ensembles. arXiv preprint arXiv:1802.03888 (2018).
- Scott M Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Proceedings of the International Conference on Neural Information Processing Systems (NIPS). 4768–4777.
- Towards Deep Learning Models Resistant to Adversarial Attacks. In Proceedings of the International Conference on Learning Representations (ICLR).
- An Explainable Machine Learning Model for Early Detection of Parkinson’s Disease using LIME on DaTscan Imagery. Computers in Biology and Medicine 126 (2020), 104041.
- Chest Radiograph Interpretation with Deep Learning Models: Assessment with Radiologist-adjudicated Reference Standards and Population-adjusted Evaluation. Radiology 294, 2 (2020), 421–431.
- Explaining Machine Learning-Based Classifications of In-Vivo Gastral Images. In Digital Image Computing: Techniques and Applications (DICTA). 1–7.
- Improving Interpretability in Medical Imaging Diagnosis using Adversarial Training. In Medical Imaging Meets NeurIPS Workshop.
- Is it Time to Replace CNNs with Transformers for Medical Images?. In ICCV 2021: Workshop on Computer Vision for Automated Medical Diagnosis (CVAMD).
- PH 2-A dermoscopic image database for research and benchmarking. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS). 5437–5440.
- A survey on deep learning and explainability for automatic report generation from medical images. ACM Computing Surveys (CSUR) 54, 10s (2022), 1–40.
- Christoph Molnar. 2022. Interpretable Machine Learning: A Guide for Making Black Box Models Explainable. Available: https://christophm.github.io/interpretable-ml-book.
- Explaining NonLinear Classification Decisions with Deep Taylor Decomposition. Pattern Recognition 65 (2017), 211–222.
- Johanna D Moore and William R Swartout. 1988. Explanation in Expert Systems: A Survey. University of Southern California (1988).
- INbreast: Toward a Full-field Digital Mammographic Database. Academic Radiology 19, 2 (2012), 236–248.
- The Osteoarthritis Initiative. Protocol for the Cohort Study 1 (2006).
- VinDr-CXR: An Open Dataset of Chest X-rays with Radiologist’s Annotations. arXiv preprint arXiv:2012.15029 (2020).
- VinDr-SpineXR: A Deep Learning Framework for Spinal Lesions Detection and Classification from Radiographs. In Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI). 291–301.
- BLEU: a Method for Automatic Evaluation of Machine Translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL). 311–318.
- On the difficulty of training Recurrent Neural Networks. In Proceedings of the International Conference on Machine Learning (ICML). 1310–1318.
- Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 3799–3808.
- Radiology Objects in COntext (ROCO): A Multimodal Image Dataset. In Intravascular Imaging and Computer Assisted Stenting and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis. 180–189.
- RISE: Randomized Input Sampling for Explanation of Black-box Models. In British Machine Vision Conference (BMVC).
- Survey of XAI in Digital Pathology. In Artificial Intelligence and Machine Learning for Digital Pathology: State-of-the-Art and Future Challenges. 56–88.
- Narinder Singh Punn and Sonali Agarwal. 2021. Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks. Applied Intelligence 51, 5 (2021), 2689–2702.
- Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS medicine 15, 11 (2018).
- A Survey of Medical Image Analysis Using Deep Learning Approaches. In Proceedings of the IEEE International Conference on Computing Methodologies and Communication (ICCMC). 1334–1342.
- ”Why Should I Trust You?”: Explaining the Predictions of Any Classifier. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1135–1144.
- VarGrad: A Low-Variance Gradient Estimator for Variational Inference. Advances in Neural Information Processing Systems 33 (2020), 13481–13492.
- Understanding the decisions of CNNs: An in-model approach. Pattern Recognition Letters 133 (2020), 373–380.
- Stephen Robertson. 2004. Understanding Inverse Document Frequency: on Theoretical Arguments for IDF. Journal of Documentation 60 (2004), 503–520.
- A Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Context. Scientific Data 8, 1 (2021), 1–8.
- Cynthia Rudin. 2019. Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead. Nature Machine Intelligence 1, 5 (2019), 206–215.
- How Users Perceive Content-based Image Retrieval for Identifying Skin Images. In Understanding and Interpreting Machine Learning in Medical Image Computing Applications. 141–148.
- Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methods. Computers in Biology and Medicine 140 (2022), 105111.
- Evaluating the Visualization of What a Deep Neural Network Has Learned. IEEE Transactions on Neural Networks and Learning Systems 28, 11 (2016), 2660–2673.
- What is healthy? generative counterfactual diffusion for lesion localization. In Deep Generative Models: Second MICCAI Workshop, DGM4MICCAI 2022, Held in Conjunction with MICCAI 2022, Singapore, September 22, 2022, Proceedings. 34–44.
- A Framework for Learning Ante-hoc Explainable Models via Concepts. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 10286–10295.
- Using a Deep Learning Algorithm and Integrated Gradients Explanation to Assist Grading for Diabetic Retinopathy. Ophthalmology 126, 4 (2019), 552–564.
- Predicting Semantic Descriptions from Medical Images with Convolutional Neural Networks. In Proceedings of the International Conference on Information Processing in Medical Imaging (IPMI). 437–448.
- Using StyleGAN for Visual Interpretability of Deep Learning Models on Medical Images. In Medical Imaging Meets NeurIPS Workshop.
- Medical image captioning via generative pretrained transformers. Scientific Reports 13, 1 (2023), 4171.
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization. In Proceedings of the IEEE International Conference on Computer Vision (ICCV). 618–626.
- Transformers in Medical Imaging: A Survey. Medical Image Analysis (2023), 102802.
- L. S. Shapley. 2016. A Value for n-Person Games. In Contributions to the Theory of Games (AM-28), Harold William Kuhn and Albert William Tucker (Eds.). Vol. II. 307–318.
- Learning Important Features Through Propagating Activation Differences. In Proceedings of the International Conference on Machine Learning (ICML), Vol. 70. 3145–3153.
- Interpretability-guided Content-based Medical Image Retrieval. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI). 305–314.
- Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. In Workshop at International Conference on Learning Representations (ICLR).
- Explainable Deep Learning Models in Medical Image Analysis. Journal of Imaging 6, 6 (2020), 52.
- Gurmail Singh and Kin-Choong Yow. 2021a. An Interpretable Deep Learning Model For Covid-19 Detection With Chest X-ray Images. IEEE Access 9 (2021), 85198–85208.
- Gurmail Singh and Kin-Choong Yow. 2021b. These do not Look Like Those: An Interpretable Deep Learning Model for Image Recognition. IEEE Access 9 (2021), 41482–41493.
- From Chest X-Rays to Radiology Reports: A Multimodal Machine Learning Approach. In Digital Image Computing: Techniques and Applications (DICTA). 1–8.
- Explaining the Black-box Smoothly - A Counterfactual Approach. Medical Image Analysis 84 (2023), 102721.
- SmoothGrad: Removing Noise by Adding Noise. In ICML Workshop on Visualization for Deep Learning.
- Asia Pacific Tele-Ophthalmology Society. 2019. APTOS Diabetic Retinopathy Dataset. [Online]. Accessed November, 23 2021. Available: https://www.kaggle.com/c/aptos2019-blindness-detection/data.
- A Dataset for Breast Cancer Histopathological Image Classification. IEEE Transactions on Biomedical Engineering 63, 7 (2015), 1455–1462.
- Striving for Simplicity: The All Convolutional Net. arXiv preprint arXiv:1412.6806 (2014).
- Study on Medical Image Report Generation Based on Improved Encoding-Decoding Method. In Intelligent Computing Theories and Application. 686–696.
- Axiomatic Attribution for Deep Networks. In Proceedings of the International Conference on Machine Learning (ICML). 3319–3328.
- Explanation and Use of Uncertainty Obtained by Bayesian Neural Network Classifiers for Breast Histopathology Images. IEEE Transactions on Medical Imaging 41, 4 (2021), 815–825.
- Erico Tjoa and Cuntai Guan. 2020. A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI. IEEE Transactions on Neural Networks and Learning Systems 32, 11 (2020), 4793–4813.
- What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use. In Proceedings of the Machine Learning for Healthcare Conference. 359–380.
- Diagnostic Accuracy of Content Based Dermatoscopic Image Retrieval with Deep Classification Features. British Journal of Dermatology 181, 1 (2019), 155–165.
- The HAM10000 Dataset: A Large Collection of Multi-Source Dermatoscopic Images of Common Pigmented Skin Lesions. Scientific Data 5, 1 (2018), 1–9.
- Interpretable artificial intelligence framework for COVID-19 screening on chest X-rays. Experimental and Therapeutic Medicine 20, 2 (2020), 727–735.
- Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9, 11 (2008).
- Explainable Artificial Intelligence (XAI) in Deep Learning-based Medical Image Analysis. Medical Image Analysis 79 (2022), 102470.
- An Explainable Artificial Intelligence System for Small-unit Tactical Behavior. In Proceedings of the National Conference on Artificial Intelligence (AAAI). 900–907.
- Attention Is All You Need. In Advances in Neural Information Processing Systems. 5998–6008.
- CIDEr: Consensus-based Image Description Evaluation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 4566–4575.
- Cristiano Patrício (7 papers)
- João C. Neves (8 papers)
- Luís F. Teixeira (8 papers)