The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT (2307.01984v1)
Abstract: This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Segmentation Challenge (KiTS21) held in conjunction with the 2021 international conference on Medical Image Computing and Computer Assisted Interventions (MICCAI). KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed, in addition to a larger dataset. A novel annotation method was used to collect three separate annotations for each region of interest, and these annotations were performed in a fully transparent setting using a web-based annotation tool. Further, the KiTS21 test set was collected from an outside institution, challenging participants to develop methods that generalize well to new populations. Nonetheless, the top-performing teams achieved a significant improvement over the state of the art set in 2019, and this performance is shown to inch ever closer to human-level performance. An in-depth meta-analysis is presented describing which methods were used and how they faired on the leaderboard, as well as the characteristics of which cases generally saw good performance, and which did not. Overall KiTS21 facilitated a significant advancement in the state of the art in kidney tumor segmentation, and provides useful insights that are applicable to the field of semantic segmentation as a whole.
- Overview of the hecktor challenge at miccai 2020: automatic head and neck tumor segmentation in pet/ct. In 3D Head and Neck Tumor Segmentation in PET/CT Challenge, pages 1–21. Springer, 2021.
- Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the brats challenge. arXiv preprint arXiv:1811.02629, 2018.
- Cultural competence and health care disparities: key perspectives and trends. Health affairs, 24(2):499–505, 2005.
- Ct-based radiomics for differentiating renal tumours: a systematic review. Abdominal Radiology, 46(5):2052–2063, 2021.
- The liver tumor segmentation benchmark (lits). Medical Image Analysis, page 102680, 2022.
- Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers—from the radiology editorial board, 2020.
- Epidemiology of renal cell carcinoma. European urology, 75(1):74–84, 2019.
- Renal cancer. The Lancet, 387(10021):894–906, 2016.
- Sources of bias in artificial intelligence that perpetuate healthcare disparities—a global review. PLOS Digital Health, 1(3):e0000022, 2022.
- Physicians and implicit bias: how doctors may unwittingly perpetuate health care disparities. Journal of general internal medicine, 28:1504–1510, 2013.
- Telemedicine and healthcare disparities: a cohort study in a large healthcare system in new york city during covid-19. Journal of the American Medical Informatics Association, 28(1):33–41, 2021.
- Exploratory and inferential analysis of benchmark experiments. 2008.
- Preoperative aspects and dimensions used for an anatomical (padua) classification of renal tumours in patients who are candidates for nephron-sparing surgery. European urology, 56(5):786–793, 2009.
- Yasmeen George. A coarse-to-fine 3d u-net network for semantic segmentation of kidney ct scans. In International Challenge on Kidney and Kidney Tumor Segmentation, pages 137–142. Springer, 2022.
- Radiomics: images are more than pictures, they are data. Radiology, 278(2):563, 2016.
- An ensemble of 3d u-net based models for segmentation of kidney and masses in ct scans. In International Challenge on Kidney and Kidney Tumor Segmentation, pages 103–115. Springer, 2022.
- Performance of ct radiomics in predicting the overall survival of patients with stage iii clear cell renal carcinoma after radical nephrectomy. La radiologia medica, 127(8):837–847, 2022.
- A brief survey on semantic segmentation with deep learning. Neurocomputing, 406:302–321, 2020.
- Segmentation of knee images: a grand challenge. In Proc. MICCAI Workshop on Medical Image Analysis for the Clinic, volume 1. Beijing, China, 2010.
- Imperfect segmentation labels: How much do they matter? In Intravascular Imaging and Computer Assisted Stenting and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, pages 112–120. Springer, 2018.
- The state of the art in kidney and kidney tumor segmentation in contrast-enhanced ct imaging: Results of the kits19 challenge. Medical image analysis, 67:101821, 2021.
- Computer-generated renal nephrometry scores yield comparable predictive results to those of human-expert scores in predicting oncologic and perioperative outcomes. The Journal of urology, 207(5):1105–1115, 2022.
- Sture Holm. A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics, pages 65–70, 1979.
- nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature methods, 18(2):203–211, 2021.
- Active surveillance of small renal masses: progression patterns of early stage kidney cancer. European urology, 60(1):39–44, 2011.
- Highly accurate protein structure prediction with alphafold. Nature, 596(7873):583–589, 2021.
- Radiogenomics of clear-cell renal cell carcinoma: associations between ct imaging features and mutations. Radiology, 270(2):464, 2014.
- Chaos challenge-combined (ct-mr) healthy abdominal organ segmentation. Medical Image Analysis, 69:101950, 2021.
- Critical assessment of methods of protein structure prediction (casp)—round xiv. Proteins: Structure, Function, and Bioinformatics, 89(12):1607–1617, 2021.
- The renal nephrometry score: a comprehensive standardized system for quantitating renal tumor size, location and depth. The Journal of urology, 182(3):844–853, 2009.
- Segthor: segmentation of thoracic organs at risk in ct images. In 2020 Tenth International Conference on Image Processing Theory, Tools and Applications (IPTA), pages 1–6. IEEE, 2020.
- Utilization of renal mass biopsy in patients with renal cell carcinoma. Urology, 83(4):774–780, 2014.
- Evaluation of prostate segmentation algorithms for mri: the promise12 challenge. Medical image analysis, 18(2):359–373, 2014.
- Stability analysis of ct radiomic features with respect to segmentation variation in oropharyngeal cancer. Clinical and translational radiation oncology, 21:11–18, 2020.
- Fast and low-gpu-memory abdomen ct organ segmentation: The flare challenge. Medical Image Analysis, 82:102616, 2022.
- Why rankings of biomedical image analysis competitions should be interpreted with care. Nature communications, 9(1):1–13, 2018.
- The effects of changes in utilization and technological advancements of cross-sectional imaging on radiologist workload. Academic radiology, 22(9):1191–1198, 2015.
- Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426, 2018.
- John Moult. A decade of casp: progress, bottlenecks and prognosis in protein structure prediction. Current opinion in structural biology, 15(3):285–289, 2005.
- Noninvasive fuhrman grading of clear cell renal cell carcinoma using computed tomography radiomic features and machine learning. La radiologia medica, 125(8):754–762, 2020.
- Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy. arXiv preprint arXiv:1809.04430, 2018.
- Benign renal neoplasms in adults: cross-sectional imaging findings. American Journal of Roentgenology, 190(1):158–164, 2008.
- Labeling instructions matter in biomedical image analysis. arXiv preprint arXiv:2207.09899, 2022.
- Common limitations of performance metrics in biomedical image analysis. 2021.
- Common pitfalls and recommendations for grand challenges in medical artificial intelligence. European Urology Focus, 7(4):710–712, 2021.
- Renal cancer: overdiagnosis and overtreatment, 2021.
- Verse: A vertebrae labelling and segmentation benchmark for multi-detector ct images. Medical image analysis, 73:102166, 2021.
- Heterogeneity and renal mass biopsy: a review of its role and reliability. Cancer biology & medicine, 11(3):162, 2014.
- Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of machine learning research, 9(11), 2008.
- Incidental renal tumours: the frequency of benign lesions and the role of preoperative core biopsy. BJU international, 97(5):946–949, 2006.
- Methods and open-source toolkit for analyzing and visualizing challenge results. arXiv preprint arXiv:1910.05121, 2019.
- A coarse-to-fine framework for the 2021 kidney and kidney tumor segmentation challenge. In International Challenge on Kidney and Kidney Tumor Segmentation, pages 53–58. Springer, 2022.