Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Automated Radiology Report Generation: A Review of Recent Advances (2405.10842v2)

Published 17 May 2024 in cs.CV

Abstract: Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for automatic radiology report generation (ARRG), sparking an explosion of research. This survey paper conducts a methodological review of contemporary ARRG approaches by way of (i) assessing datasets based on characteristics, such as availability, size, and adoption rate, (ii) examining deep learning training methods, such as contrastive learning and reinforcement learning, (iii) exploring state-of-the-art model architectures, including variations of CNN and transformer models, (iv) outlining techniques integrating clinical knowledge through multimodal inputs and knowledge graphs, and (v) scrutinising current model evaluation techniques, including commonly applied NLP metrics and qualitative clinical reviews. Furthermore, the quantitative results of the reviewed models are analysed, where the top performing models are examined to seek further insights. Finally, potential new directions are highlighted, with the adoption of additional datasets from other radiological modalities and improved evaluation methods predicted as important areas of future development.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (17)
  1. A. P. Brady, “Error and discrepancy in radiology: inevitable or avoidable?”, Insights into Imaging. Vol. 8, No. 1, pp. 171–182, 2017.
  2. A. Rimmer, “Radiologist shortage leaves patient care at risk, warns royal college” BMJ (Online) Vol.359, 2017.
  3. Royal College of Radiologists, “The Standards for interpretation and reporting of imaging investigations, 2nd Ed”, 2018. [Online] Available from: https://www.rcr.ac.uk/publication/standards-interpretation-and-reporting-imaging-investigations-second-edition
  4. European Society of Radiology (ESR), “Good practice for radiological reporting. Guidelines from the European Society of Radiology (ESR)”. Insights in Imaging Vol. 2, pp. 93–-96 2011.
  5. A. Fernandez-Quilez, “Deep learning in radiology: ethics of data and on the value of algorithm transparency, interpretability and explainability.” AI Ethics Vol. 3, pp.257–265, 2023.
  6. X. Ying “An Overview of Overfitting and its Solutions” J. Phys. Conf. Ser., vol. 1168, 2019.
  7. J. Lovelace and B. Mortazavi, “Learning to Generate Clinically Coherent Chest X-Ray Reports” Find. Empir. Methods Nat. Lang. Process., pp. 1235–1243, 2020.
  8. H. Qin and Y. Song, “Reinforced Cross-modal Alignment for Radiology Report Generation” Find. Assoc. Comput. Linguist., pp. 448–458, 2022.
  9. N. Kaur and A. Mittal, “CheXPrune: sparse chest X-ray report generation model using multi-attention and one-shot global pruning.” J. Ambient Intell. Human Comput. Vol. 14, pp. 7485–7497, 2023.
  10. S. Yan “Memory-aligned Knowledge Graph for Clinically Accurate Radiology Image Report Generation.” Proc. Biomed. Lang. Proc.. pp. 116–122, 2022.
  11. B. Yan, and M. Pei, “Clinical-BERT: Vision-Language Pre-training for Radiograph Diagnosis and Reports Generation.”, Proc. AAAI Conf. Artif. Intell., vol. 36, No. 3, pp. 2982-2990. 2020.
  12. N. Reimers and I. Gurevych, “Sentence-BERT: sentence embeddings using siamese BERT-networks.” In Proc. Conf. Empir. Methods Nat. Lang. Process., pp. 671–688, 2019.
  13. OpenAI, “ChatGPT”, 2022. https://chat.openai.com/chat
  14. T. Kudo and J. Richardson, “Sentencepiece: A simple and language independent subword tokenizer and detokenizer for neural text processing.” arXiv preprint, 2018.
  15. C. P. Langlotz, “RadLex: a new method for indexing online educational materials.” Radiographics Vol, 26, No. 6, pp. 1595–1597, 2006.
  16. M. Denkowski and A. Lavie, “Meteor 1.3: Automatic metric for reliable optimization and evaluation of machine translation systems” Proc. Assoc. Comput. Linguist. Stat. Mach. Translation, pp. 85–91, 2011.
  17. C. Lin, “Rouge: A package for automatic evaluation of summaries” Proc. Assoc. Comput. Linguist., pp 74–81, 2004.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Phillip Sloan (1 paper)
  2. Philip Clatworthy (4 papers)
  3. Edwin Simpson (20 papers)
  4. Majid Mirmehdi (47 papers)
Citations (7)

Summary

We haven't generated a summary for this paper yet.