Zero-Shot Pediatric Tuberculosis Detection in Chest X-Rays using Self-Supervised Learning (2402.14741v1)
Abstract: Tuberculosis (TB) remains a significant global health challenge, with pediatric cases posing a major concern. The World Health Organization (WHO) advocates for chest X-rays (CXRs) for TB screening. However, visual interpretation by radiologists can be subjective, time-consuming and prone to error, especially in pediatric TB. AI-driven computer-aided detection (CAD) tools, especially those utilizing deep learning, show promise in enhancing lung disease detection. However, challenges include data scarcity and lack of generalizability. In this context, we propose a novel self-supervised paradigm leveraging Vision Transformers (ViT) for improved TB detection in CXR, enabling zero-shot pediatric TB detection. We demonstrate improvements in TB detection performance ($\sim$12.7% and $\sim$13.4% top AUC/AUPR gains in adults and children, respectively) when conducting self-supervised pre-training when compared to fully-supervised (i.e., non pre-trained) ViT models, achieving top performances of 0.959 AUC and 0.962 AUPR in adult TB detection, and 0.697 AUC and 0.607 AUPR in zero-shot pediatric TB detection. As a result, this work demonstrates that self-supervised learning on adult CXRs effectively extends to challenging downstream tasks such as pediatric TB detection, where data are scarce.
- World Health Organization, “Global Tuberculosis Report,” 2023.
- “Tuberculosis in Children,” Infect Dis Clin N Am, vol. 36, no. 1, pp. 49–71, Mar 2022.
- “Screening tests for active pulmonary tuberculosis in children,” Cochrane Database of Systematic Reviews, vol. 2021, no. 6, Jul 2021.
- World Health Organization, “Chest Radiography in Tuberculosis Detection: Summary of current WHO recommendations and guidance on programmatic approaches,” 2016.
- B. A. A. Ubaidi, “The Radiological Diagnosis of Pulmonary Tuberculosis (TB) in Primary Care,” J Fam Med Dis Prev, vol. 4, no. 1, Mar 2018.
- A. P. Brady, “Error and discrepancy in radiology: inevitable or avoidable?,” Insights into imaging, vol. 8, no. 1, pp. 171–182, Feb 2017.
- “Chest x-ray-based telemedicine platform for pediatric tb diagnosis in low resource settings: Development and validation,” JMIR Preprints, Nov 2023.
- “Artificial Intelligence, Radiology, and Tuberculosis: A Review,” Acad Radiol, vol. 27, no. 1, pp. 71–75, Jan 2020.
- “A new resource on artificial intelligence powered computer automated detection software products for tuberculosis programmes and implementers,” Tuberculosis, vol. 127, pp. 102049, Mar 2021.
- “Deep Learning in Radiology,” Acad Radiol, vol. 25, pp. 1472–1480, Nov 2018.
- “Emerging properties in self-supervised vision transformers,” in IEEE/CVF ICCV, 2021, pp. 9650–9660.
- “Momentum Contrast for Unsupervised Visual Representation Learning,” IEEE/CVF CVPR, 2020.
- “Masked Autoencoders Are Scalable Vision Learners,” IEEE/CVF CVPR, pp. 16000–16009, 2022.
- “A novel approach for tuberculosis screening based on deep convolutional neural networks,” in SPIE MI, 2016, vol. 9785, pp. 750–757.
- “Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networks,” arXiv preprint arXiv:1705.09850, May 2017.
- “Efficient Deep Network Architectures for Fast Chest X-Ray Tuberculosis Screening and Visualization,” Sci Rep, vol. 9, no. 1, pp. 1–9, Apr 2019.
- “A Lightweight, Rapid and Efficient Deep Convolutional Network for Chest X-Ray Tuberculosis Detection,” in IEEE ISBI, 2023, pp. 1–5.
- “CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV,” npj Digit Med, vol. 3, no. 1, pp. 1–8, Sep 2020.
- “TB-Net: A Tailored, Self-Attention Deep Convolutional Neural Network Design for Detection of Tuberculosis Cases From Chest X-Ray Images,” Fr Art Int, vol. 5, pp. 827299, Apr 2022.
- “Optimising computer aided detection to identify intra-thoracic tuberculosis on chest x-ray in South African children,” PLOS global public health, vol. 3, no. 5, pp. e0001799, May 2023.
- “MoCo Pretraining Improves Representation and Transferability of Chest X-ray Models,” in MIDL. PMLR, 2021, pp. 728–744.
- “Self-supervised deep convolutional neural network for chest x-ray classification,” IEEE Access, vol. 9, pp. 151972–151982, 2021.
- “Self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation,” Nat Commun, vol. 13, no. 1, pp. 1–11, Jul 2022.
- “Expert-level detection of pathologies from unannotated chest X-ray images via self-supervised learning,” Nat Biomed Eng, vol. 6, no. 12, pp. 1399–1406, Sep 2022.
- “SPCXR: Self-supervised Pretraining using Chest X-rays Towards a Domain Specific Foundation Model,” arXiv preprint arXiv: 2211.12944, 2023.
- “Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison,” AAAI, vol. 33, no. 01, pp. 590–597, Jul. 2019.
- “ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases,” in IEEE/CVF CVPR, 2017, pp. 2097–2106.
- “COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images,” Sci Rep, vol. 10, no. 1, pp. 1–12, Nov 2020.
- “COVIDx CXR-3: A Large-Scale, Open-Source Benchmark Dataset of Chest X-ray Images for Computer-Aided COVID-19 Diagnostics,” arXiv preprint arXiv:2206.03671, 2022.
- “Two public chest X-ray datasets for computer-aided screening of pulmonary diseases,” Quant Imaging Med Surg, vol. 4, no. 6, pp. 475, Dec 2014.
- “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale,” CIBCB, 2020.
- “An Empirical Study of Training Self-Supervised Vision Transformers,” IEEE/CVF ICCV, pp. 9620–9629, Apr 2021.
- “Decoupled Weight Decay Regularization,” 7th International Conference on Learning Representations, ICLR 2019, Nov 2017.
- “Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach,” Biometrics, vol. 44, no. 3, pp. 837–845, 1988.
- “Fast implementation of delong’s algorithm for comparing the areas under correlated receiver operating characteristic curves,” IEEE Signal Processing Letters, vol. 21, no. 11, pp. 1389–1393, 2014.
- “Bootstrap confidence intervals: when, which, what? a practical guide for medical statisticians,” Statistics in Medicine, vol. 19, no. 9, pp. 1141–1164, 2000.