Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Zero-Shot Pediatric Tuberculosis Detection in Chest X-Rays using Self-Supervised Learning (2402.14741v1)

Published 22 Feb 2024 in eess.IV and cs.CV

Abstract: Tuberculosis (TB) remains a significant global health challenge, with pediatric cases posing a major concern. The World Health Organization (WHO) advocates for chest X-rays (CXRs) for TB screening. However, visual interpretation by radiologists can be subjective, time-consuming and prone to error, especially in pediatric TB. AI-driven computer-aided detection (CAD) tools, especially those utilizing deep learning, show promise in enhancing lung disease detection. However, challenges include data scarcity and lack of generalizability. In this context, we propose a novel self-supervised paradigm leveraging Vision Transformers (ViT) for improved TB detection in CXR, enabling zero-shot pediatric TB detection. We demonstrate improvements in TB detection performance ($\sim$12.7% and $\sim$13.4% top AUC/AUPR gains in adults and children, respectively) when conducting self-supervised pre-training when compared to fully-supervised (i.e., non pre-trained) ViT models, achieving top performances of 0.959 AUC and 0.962 AUPR in adult TB detection, and 0.697 AUC and 0.607 AUPR in zero-shot pediatric TB detection. As a result, this work demonstrates that self-supervised learning on adult CXRs effectively extends to challenging downstream tasks such as pediatric TB detection, where data are scarce.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. World Health Organization, “Global Tuberculosis Report,” 2023.
  2. “Tuberculosis in Children,” Infect Dis Clin N Am, vol. 36, no. 1, pp. 49–71, Mar 2022.
  3. “Screening tests for active pulmonary tuberculosis in children,” Cochrane Database of Systematic Reviews, vol. 2021, no. 6, Jul 2021.
  4. World Health Organization, “Chest Radiography in Tuberculosis Detection: Summary of current WHO recommendations and guidance on programmatic approaches,” 2016.
  5. B. A. A. Ubaidi, “The Radiological Diagnosis of Pulmonary Tuberculosis (TB) in Primary Care,” J Fam Med Dis Prev, vol. 4, no. 1, Mar 2018.
  6. A. P. Brady, “Error and discrepancy in radiology: inevitable or avoidable?,” Insights into imaging, vol. 8, no. 1, pp. 171–182, Feb 2017.
  7. “Chest x-ray-based telemedicine platform for pediatric tb diagnosis in low resource settings: Development and validation,” JMIR Preprints, Nov 2023.
  8. “Artificial Intelligence, Radiology, and Tuberculosis: A Review,” Acad Radiol, vol. 27, no. 1, pp. 71–75, Jan 2020.
  9. “A new resource on artificial intelligence powered computer automated detection software products for tuberculosis programmes and implementers,” Tuberculosis, vol. 127, pp. 102049, Mar 2021.
  10. “Deep Learning in Radiology,” Acad Radiol, vol. 25, pp. 1472–1480, Nov 2018.
  11. “Emerging properties in self-supervised vision transformers,” in IEEE/CVF ICCV, 2021, pp. 9650–9660.
  12. “Momentum Contrast for Unsupervised Visual Representation Learning,” IEEE/CVF CVPR, 2020.
  13. “Masked Autoencoders Are Scalable Vision Learners,” IEEE/CVF CVPR, pp. 16000–16009, 2022.
  14. “A novel approach for tuberculosis screening based on deep convolutional neural networks,” in SPIE MI, 2016, vol. 9785, pp. 750–757.
  15. “Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networks,” arXiv preprint arXiv:1705.09850, May 2017.
  16. “Efficient Deep Network Architectures for Fast Chest X-Ray Tuberculosis Screening and Visualization,” Sci Rep, vol. 9, no. 1, pp. 1–9, Apr 2019.
  17. “A Lightweight, Rapid and Efficient Deep Convolutional Network for Chest X-Ray Tuberculosis Detection,” in IEEE ISBI, 2023, pp. 1–5.
  18. “CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV,” npj Digit Med, vol. 3, no. 1, pp. 1–8, Sep 2020.
  19. “TB-Net: A Tailored, Self-Attention Deep Convolutional Neural Network Design for Detection of Tuberculosis Cases From Chest X-Ray Images,” Fr Art Int, vol. 5, pp. 827299, Apr 2022.
  20. “Optimising computer aided detection to identify intra-thoracic tuberculosis on chest x-ray in South African children,” PLOS global public health, vol. 3, no. 5, pp. e0001799, May 2023.
  21. “MoCo Pretraining Improves Representation and Transferability of Chest X-ray Models,” in MIDL. PMLR, 2021, pp. 728–744.
  22. “Self-supervised deep convolutional neural network for chest x-ray classification,” IEEE Access, vol. 9, pp. 151972–151982, 2021.
  23. “Self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation,” Nat Commun, vol. 13, no. 1, pp. 1–11, Jul 2022.
  24. “Expert-level detection of pathologies from unannotated chest X-ray images via self-supervised learning,” Nat Biomed Eng, vol. 6, no. 12, pp. 1399–1406, Sep 2022.
  25. “SPCXR: Self-supervised Pretraining using Chest X-rays Towards a Domain Specific Foundation Model,” arXiv preprint arXiv: 2211.12944, 2023.
  26. “Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison,” AAAI, vol. 33, no. 01, pp. 590–597, Jul. 2019.
  27. “ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases,” in IEEE/CVF CVPR, 2017, pp. 2097–2106.
  28. “COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images,” Sci Rep, vol. 10, no. 1, pp. 1–12, Nov 2020.
  29. “COVIDx CXR-3: A Large-Scale, Open-Source Benchmark Dataset of Chest X-ray Images for Computer-Aided COVID-19 Diagnostics,” arXiv preprint arXiv:2206.03671, 2022.
  30. “Two public chest X-ray datasets for computer-aided screening of pulmonary diseases,” Quant Imaging Med Surg, vol. 4, no. 6, pp. 475, Dec 2014.
  31. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale,” CIBCB, 2020.
  32. “An Empirical Study of Training Self-Supervised Vision Transformers,” IEEE/CVF ICCV, pp. 9620–9629, Apr 2021.
  33. “Decoupled Weight Decay Regularization,” 7th International Conference on Learning Representations, ICLR 2019, Nov 2017.
  34. “Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach,” Biometrics, vol. 44, no. 3, pp. 837–845, 1988.
  35. “Fast implementation of delong’s algorithm for comparing the areas under correlated receiver operating characteristic curves,” IEEE Signal Processing Letters, vol. 21, no. 11, pp. 1389–1393, 2014.
  36. “Bootstrap confidence intervals: when, which, what? a practical guide for medical statisticians,” Statistics in Medicine, vol. 19, no. 9, pp. 1141–1164, 2000.
Citations (1)

Summary

We haven't generated a summary for this paper yet.