Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Liver Tumor Segmentation Benchmark (LiTS) (1901.04056v2)

Published 13 Jan 2019 in cs.CV

Abstract: In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with varied sizes and appearances with various lesion-to-background levels (hyper-/hypo-dense), created in collaboration with seven hospitals and research institutions. Seventy-five submitted liver and liver tumor segmentation algorithms were trained on a set of 131 computed tomography (CT) volumes and were tested on 70 unseen test images acquired from different patients. We found that not a single algorithm performed best for both liver and liver tumors in the three events. The best liver segmentation algorithm achieved a Dice score of 0.963, whereas, for tumor segmentation, the best algorithms achieved Dices scores of 0.674 (ISBI 2017), 0.702 (MICCAI 2017), and 0.739 (MICCAI 2018). Retrospectively, we performed additional analysis on liver tumor detection and revealed that not all top-performing segmentation algorithms worked well for tumor detection. The best liver tumor detection method achieved a lesion-wise recall of 0.458 (ISBI 2017), 0.515 (MICCAI 2017), and 0.554 (MICCAI 2018), indicating the need for further research. LiTS remains an active benchmark and resource for research, e.g., contributing the liver-related segmentation tasks in \url{http://medicaldecathlon.com/}. In addition, both data and online evaluation are accessible via \url{www.lits-challenge.com}.

User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (109)
  1. Patrick Bilic (5 papers)
  2. Patrick Christ (2 papers)
  3. Hongwei Bran Li (33 papers)
  4. Eugene Vorontsov (19 papers)
  5. Avi Ben-Cohen (12 papers)
  6. Georgios Kaissis (79 papers)
  7. Adi Szeskin (4 papers)
  8. Colin Jacobs (31 papers)
  9. Gabriel Efrain Humpire Mamani (2 papers)
  10. Gabriel Chartrand (4 papers)
  11. Fabian Lohöfer (1 paper)
  12. Julian Walter Holch (1 paper)
  13. Wieland Sommer (2 papers)
  14. Felix Hofmann (56 papers)
  15. Alexandre Hostettler (7 papers)
  16. Naama Lev-Cohain (1 paper)
  17. Michal Drozdzal (45 papers)
  18. Michal Marianne Amitai (4 papers)
  19. Refael Vivantik (1 paper)
  20. Jacob Sosna (1 paper)
Citations (866)

Summary

  • The paper demonstrates a comprehensive evaluation of deep learning approaches for automating liver and tumor segmentation in CT scans.
  • It details various U-Net architectures and hybrid models with refined loss functions, achieving high Dice scores for liver (0.93+) and tumor segmentation (above 0.70).
  • The study emphasizes 3D convolutional models, robust preprocessing, and clinical validations, advocating for improved strategies in medical image analysis.

The Liver Tumor Segmentation Benchmark (LiTS)

The Liver Tumor Segmentation Benchmark (LiTS) provides a comprehensive evaluation of state-of-the-art methods for the automated segmentation of liver and liver tumors using computed tomography (CT) imaging. The benchmark setup, results, and analysis stem from data and contributions collected through collaboration with multiple international institutions. This essay summarizes the technical and methodological insights gained from the LiTS challenge and discusses their implications for future developments in automated medical image analysis.

Introduction and Challenge Overview

The liver is a critical organ involved in various metabolic processes and cancer pathologies, including primary liver cancers and metastases. Automated segmentation of the liver and its lesions from 3D CT scans is essential for accurate diagnosis, treatment planning, and monitoring. Given the complexity and variability of liver tumor appearances, manual segmentation is time-consuming and prone to inter-operator variability.

The LiTS challenge was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) and the Medical Image Computing and Computer-Assisted Intervention (MICCAI) conferences. The challenge dataset comprises 201 CT volumes annotated manually by experienced radiologists to distinguish between healthy liver tissue and tumors.

Methodologies

The LiTS challenge attracted various automated segmentation approaches, primarily based on deep learning techniques. Most submissions used variations of U-Net architectures tailored for liver and liver tumor segmentation tasks. The methods can be grouped based on the following criteria:

  1. Network Architecture:
    • 2D and 2.5D U-Nets: Processing 2D slices or stacking slices to predict the middle slice.
    • 3D U-Nets: Leveraging full 3D volumetric information for segmentation, an approach that became prevalent in later stages, particularly in MICCAI 2018.
    • Hybrid Models: Combining 2D and 3D convolutions to balance computational load and capture volumetric features.
  2. Loss Functions:
    • Cross-entropy, Dice loss, and their weighted variants were commonly used. Some methods employed combination losses to improve segmentation boundaries and mitigate class imbalance.
  3. Data Augmentation and Preprocessing:
    • Techniques such as random flipping, rotations, scaling, and intensity normalization were widely applied to enhance generalization.
    • Preprocessing steps often included HU-value clipping and resampling to standard voxel sizes.
  4. Post-processing:
    • Methods frequently used connected component analysis, morphological operations, and conditional random fields (CRFs) to refine segmentation outputs.

Results and Analysis

Liver Segmentation:

The liver segmentation task consistently showed high performance, with Dice scores exceeding 0.930 for most methods. MICCAI 2017 submissions slightly outperformed MICCAI 2018 entries in terms of Average Symmetric Surface Distance (ASD), possibly due to specific optimization for liver CT images.

Liver Tumor Segmentation and Detection:

Tumor segmentation presented greater challenges due to the variability in tumor size, shape, and contrast with liver tissue. The best methods achieved Dice scores above 0.70, with the highest scores in MICCAI 2018 significantly improving over ISBI 2017.

Detection metrics, which included precision, recall, and F1 scores for small, medium, and large tumors, revealed that smaller lesions were particularly difficult to detect accurately. This finding emphasizes the need for improved identification and segmentation techniques for small and low-contrast tumors.

Implications and Future Directions

The LiTS challenge highlights several key points for the future development of medical image segmentation techniques:

  1. Integration of 3D Models: The shift towards 3D convolutional networks in later challenges underscores their superior capability to leverage volumetric context, critical for accurate tumor segmentation. Future developments should continue to optimize 3D models, particularly focusing on computational efficiency and memory constraints.
  2. Handling Imbalance and Variability: Improved loss functions and adaptive learning methods are necessary to address the imbalance between large normal regions and small tumor regions. Techniques to enhance boundary precision and mitigate the impact of noise and artifacts must be prioritized.
  3. Robustness and Generalization: Pre-training models using self-supervised learning on large unannotated datasets before fine-tuning on annotated data can enhance robustness and generalization to unseen cases. Cross-cohort validations and federated learning approaches should be explored to evaluate models across diverse datasets.
  4. Quantitative Assessment and Clinical Relevance: Incorporating clinically relevant metrics such as lesion-wise recall and precision, along with measures like tumor burden, provides a more comprehensive evaluation. Continuous benchmark platforms can support the iterative improvement and validation of segmentation methods.

Conclusion

The LiTS challenge has significantly contributed to advancing automated liver and liver tumor segmentation methods. By providing a standardized and diverse dataset, the benchmark has driven the development of sophisticated deep learning models that show promise for clinical application. Continued emphasis on multi-institutional collaboration, methodological innovation, and rigorous evaluation will further enhance the accuracy and reliability of medical image segmentation tools.

Youtube Logo Streamline Icon: https://streamlinehq.com