LinFlo-Net: A two-stage deep learning method to generate simulation ready meshes of the heart (2310.20065v2)
Abstract: We present a deep learning model to automatically generate computer models of the human heart from patient imaging data with an emphasis on its capability to generate thin-walled cardiac structures. Our method works by deforming a template mesh to fit the cardiac structures to the given image. Compared with prior deep learning methods that adopted this approach, our framework is designed to minimize mesh self-penetration, which typically arises when deforming surface meshes separated by small distances. We achieve this by using a two-stage diffeomorphic deformation process along with a novel loss function derived from the kinematics of motion that penalizes surface contact and interpenetration. Our model demonstrates comparable accuracy with state-of-the-art methods while additionally producing meshes free of self-intersections. The resultant meshes are readily usable in physics based simulation, minimizing the need for post-processing and cleanup.
- “Personalized virtual-heart technology for guiding the ablation of infarct-related ventricular tachycardia,” Nature biomedical engineering, 2(10), pp. 732–740.
- “The ‘digital twin’to enable the vision of precision cardiology,” European heart journal, 41(48), pp. 4556–4564.
- “Evaluation of algorithms for multi-modality whole heart segmentation: an open-access grand challenge,” Medical image analysis, 58, p. 101537.
- “Totalsegmentator: robust segmentation of 104 anatomical structures in ct images,” arXiv preprint arXiv:2208.05868.
- “A deep-learning approach for direct whole-heart mesh reconstruction,” Medical image analysis, 74, p. 102222.
- “Learning whole heart mesh generation from patient images for computational simulations,” IEEE Transactions on Medical Imaging, 42, pp. 533–545.
- “Pixel2mesh: 3d mesh model generation via image guided deformation,” IEEE transactions on pattern analysis and machine intelligence, 43(10), pp. 3600–3613.
- “Voxel2mesh: 3d mesh model generation from volumetric data,” In Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part IV 23, Springer, pp. 299–308.
- “Tetgen, a delaunay-based quality tetrahedral mesh generator,” ACM Trans. Math. Softw, 41(2), p. 11.
- “Distortion energy for deep learning-based volumetric finite element mesh generation for aortic valves,” In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part VI 24, Springer, pp. 485–494.
- Neural mesh flow: 3d manifold mesh generation via diffeomorphic flows University of California, San Diego.
- “Corticalflow: a diffeomorphic mesh transformer network for cortical surface reconstruction,” Advances in Neural Information Processing Systems, 34, pp. 29491–29505.
- “Cortexode: Learning cortical surface reconstruction by neural odes,” IEEE Transactions on Medical Imaging, 42(2), pp. 430–443.
- “Meshes meet voxels: Abdominal organ segmentation via diffeomorphic deformations,” arXiv preprint arXiv:2306.15515.
- “Accelerating 3d deep learning with pytorch3d,” arXiv:2007.08501.
- “U-net: Convolutional networks for biomedical image segmentation,” In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, Springer, pp. 234–241.
- Finite difference methods for ordinary and partial differential equations: steady-state and time-dependent problems SIAM.
- “Continuum mechanics,” Lecture Notes on The Mechanics of Elastic Solids.
- “An evaluation of automatic coronary artery calcium scoring methods with cardiac ct using the orcascore framework,” Medical physics, 43(5), pp. 2361–2373.
- “Algorithms for left atrial wall segmentation and thickness–evaluation on an open-source ct and mri image database,” Medical image analysis, 50, pp. 36–53.
- “Benchmark for algorithms segmenting the left atrium from 3d ct and mri datasets,” IEEE transactions on medical imaging, 34(7), pp. 1460–1473.
- “Automating model generation for image-based cardiac flow simulation,” Journal of Biomechanical Engineering, 142(11), p. 111011.
- “Multi-label whole heart segmentation using cnns and anatomical label configurations,” In International Workshop on Statistical Atlases and Computational Models of the Heart, Springer, pp. 190–198.
- The Visualization Toolkit (4th ed.) Kitware.
- PyMesh https://github.com/PyMesh/PyMesh.
- “Meshlab: an open-source mesh processing tool.,” In Eurographics Italian chapter conference, Vol. 2008, Salerno, Italy, pp. 129–136.