EXACT-Net:EHR-guided lung tumor auto-segmentation for non-small cell lung cancer radiotherapy (2402.14099v2)
Abstract: Lung cancer is a devastating disease with the highest mortality rate among cancer types. Over 60% of non-small cell lung cancer (NSCLC) patients, which accounts for 87% of diagnoses, require radiation therapy. Rapid treatment initiation significantly increases the patient's survival rate and reduces the mortality rate. Accurate tumor segmentation is a critical step in the diagnosis and treatment of NSCLC. Manual segmentation is time and labor-consuming and causes delays in treatment initiation. Although many lung nodule detection methods, including deep learning-based models, have been proposed, there is still a long-standing problem of high false positives (FPs) with most of these methods. Here, we developed an electronic health record (EHR) guided lung tumor auto-segmentation called EXACT-Net (EHR-enhanced eXACtitude in Tumor segmentation), where the extracted information from EHRs using a pre-trained LLM, was used to remove the FPs and keep the TP nodules only. The auto-segmentation model was trained on NSCLC patients' computed tomography (CT), and the pre-trained LLM was used with the zero-shot learning approach. Our approach resulted in a 250% boost in successful nodule detection using the data from ten NSCLC patients treated in our institution.
- Large language models are zero-shot clinical information extractors. arXiv preprint arXiv:2205.12689, 2022.
- Recurrent residual U-Net for medical image segmentation. Journal of Medical Imaging, 6(1):14006, 2019.
- The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Medical physics, 38(2):915–931, 2011.
- Deep learning for lung Cancer detection and classification. Multimedia Tools and Applications, 79:7731–7762, 2020.
- Som Biswas. ChatGPT and the future of medical writing, 2023.
- A systematic review and meta-analysis of stereotactic body radiation therapy versus surgery for patients with non–small cell lung cancer. The Journal of Thoracic and Cardiovascular Surgery, 157(1):362–373.e8, 2019.
- The Effects of Time to Treatment Initiation for Patients With Non–small-cell Lung Cancer in the United States. Clinical lung cancer, 22(1):e84–e97, 2021.
- Procedure guideline for tumor imaging with 18F-FDG PET/CT 1.0. Journal of nuclear Medicine, 47(5):885–895, 2006.
- A bibliometric review of large language models research from 2017 to 2023. arXiv preprint arXiv:2304.02020, 2023.
- Deep convolutional neural network for segmentation of thoracic organs-at-risk using cropped 3D images. Medical Physics, 46(5):2169–2180, 2019.
- Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features. Frontiers in Computational Neuroscience, 14, 2020.
- Ross Girshick. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pages 1440–1448, 2015.
- 3D deep learning for detecting pulmonary nodules in CT scans. Journal of the American Medical Informatics Association, 25(10):1301–1310, 2018.
- Mortality due to cancer treatment delay: systematic review and meta-analysis. BMJ, 371:m4087, 2020.
- The biology and management of non-small cell lung cancer. Nature, 553(7689):446–454, 2018.
- deepPERFECT: Novel Deep Learning CT Synthesis Method for Expeditious Pancreatic Cancer Radiotherapy. Cancers, 15(11):3061, 2023a.
- DAART: a deep learning platform for deeply accelerated adaptive radiation therapy for lung cancer. Frontiers in Oncology, 13:1201679, 2023b.
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. nature.comF Isensee, PF Jaeger, SAA Kohl, J Petersen, KH Maier-HeinNature methods, 2021•nature.com.
- Lung cancer tumor region segmentation using recurrent 3d-denseunet. In Thoracic Image Analysis: Second International Workshop, TIA 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 8, 2020, Proceedings 2, pages 36–47. Springer, 2020.
- R C Kenneth. Digital image processing. Prentice Hall., 1996.
- Time to initial cancer treatment in the United States and association with survival over time: An observational study. PLOS ONE, 14(3):e0213209, 2019.
- Semi-supervised multi-task learning for lung cancer diagnosis. In 2018 40th Annual international conference of the IEEE engineering in medicine and biology society (EMBC), pages 710–713. IEEE, 2018.
- Large language models are zero-shot reasoners. Advances in neural information processing systems, 35:22199–22213, 2022.
- Lung nodules detection and segmentation using 3D mask-RCNN. arXiv preprint arXiv:1907.07676, 2019.
- RRc-UNet 3D for Lung Tumor Segmentation from CT Scans of Non-Small Cell Lung Cancer Patients. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2316–2325, 2023.
- Deep Learning Applications in Computed Tomography Images for Pulmonary Nodule Detection and Diagnosis: A Review, 2022.
- Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, pages 2980–2988, 2017.
- RadOnc-GPT: A Large Language Model for Radiation Oncology. arXiv preprint arXiv:2309.10160, 2023a.
- Deid-gpt: Zero-shot medical text de-identification by gpt-4. arXiv preprint arXiv:2303.11032, 2023b.
- Challenges in the target volume definition of lung cancer radiotherapy. Translational lung cancer research, 10(4):1983, 2021.
- V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV), pages 565–571. Ieee, 2016.
- Rapid Disease Progression With Delay in Treatment of Non–Small-Cell Lung Cancer. International Journal of Radiation Oncology*Biology*Physics, 79(2):466–472, 2011.
- Automated volumetric lung segmentation of thoracic CT images using fully convolutional neural network. In Medical Imaging 2018: Computer-Aided Diagnosis, pages 356–361. SPIE, 2018.
- Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730–27744, 2022.
- Auto Segmentation of Lung in Non-small Cell Lung Cancer Using Deep Convolution Neural Network. In Advances in Computing and Data Sciences: 4th International Conference, ICACDS 2020, Valletta, Malta, April 24–25, 2020, Revised Selected Papers 4, pages 340–351. Springer, 2020.
- LungSeg-Net: Lung field segmentation using generative adversarial network. Biomedical Signal Processing and Control, 64:102296, 2021.
- Effects of delayed surgical resection on short-term and long-term outcomes in clinical stage I non-small cell lung cancer. The Annals of thoracic surgery, 99(6):1906–1913, 2015.
- Carmel Shachar. HIPAA, privacy, and reproductive rights in a post-Roe era. JAMA, 328(5):417–418, 2022.
- Review on Lung Nodule Segmentation-Based Lung Cancer Classification Using Machine Learning Approaches BT - Artificial Intelligence on Medical Data. pages 277–286, Singapore, 2023. Springer Nature Singapore.
- S M Siad. The Promise and Perils of Google’s Bard for Scientific Research. 2023.
- Cancer statistics, 2023. CA: A Cancer Journal for Clinicians, 73(1):17–48, 2023.
- Lung CT image segmentation using deep neural networks. Procedia Computer Science, 127:109–113, 2018.
- Surgery versus stereotactic body radiation therapy for stage I non–small cell lung cancer: A comprehensive review. Cancer, 124(4):667–678, 2018.
- Automatic pulmonary lobe segmentation using deep learning. In 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pages 1225–1228. IEEE, 2019.
- Estimating the need for radiotherapy for lung cancer: an evidence-based, epidemiologic approach. International Journal of Radiation Oncology* Biology* Physics, 49(4):973–985, 2001.
- Lung tumor segmentation algorithm. Procedia computer science, 120:140–147, 2017.
- Small-cell lung cancer. The Lancet, 378(9804):1741–1755, 2011.
- Automated pulmonary nodule detection in CT images using deep convolutional neural networks. Pattern Recognition, 85:109–119, 2019.
- A deep learning approach for automatic tumor delineation in stereotactic radiotherapy for non-small cell lung cancer using diagnostic PET-CT and planning CT. Frontiers in Oncology, 13, 2023.
- Automatic segmentation of the gross target volume in non-small cell lung cancer using a modified version of ResNet. Technology in Cancer Research & Treatment, 19:1533033820947484, 2020.
- A novel multi-scale CNNs for false positive reduction in pulmonary nodule detection. Expert Systems with Applications, 207:117652, 2022.
- Lung boundary detection for chest X-ray images classification based on GLCM and probabilistic neural networks. Procedia Computer Science, 159:1439–1448, 2019.
- Hamed Hooshangnejad (3 papers)
- Xue Feng (69 papers)
- Gaofeng Huang (10 papers)
- Rui Zhang (1138 papers)
- Quan Chen (91 papers)
- Kai Ding (29 papers)
- Katelyn Kelly (1 paper)