Learning Homeomorphic Image Registration via Conformal-Invariant Hyperelastic Regularisation (2303.08113v2)
Abstract: Deformable image registration is a fundamental task in medical image analysis and plays a crucial role in a wide range of clinical applications. Recently, deep learning-based approaches have been widely studied for deformable medical image registration and achieved promising results. However, existing deep learning image registration techniques do not theoretically guarantee topology-preserving transformations. This is a key property to preserve anatomical structures and achieve plausible transformations that can be used in real clinical settings. We propose a novel framework for deformable image registration. Firstly, we introduce a novel regulariser based on conformal-invariant properties in a nonlinear elasticity setting. Our regulariser enforces the deformation field to be smooth, invertible and orientation-preserving. More importantly, we strictly guarantee topology preservation yielding to a clinical meaningful registration. Secondly, we boost the performance of our regulariser through coordinate MLPs, where one can view the to-be-registered images as continuously differentiable entities. We demonstrate, through numerical and visual experiments, that our framework is able to outperform current techniques for image registration.
- The grötzsch problem in higher dimensions. Rendiconti Lincei-matematica E Applicazioni - REND LINCEI-MAT APPL 18, 163–177. doi:10.4171/RLM/488.
- Voxel-based morphometry—the methods. Neuroimage 11, 805–821.
- Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Medical image analysis 12, 26–41.
- Advanced normalization tools (ants). Insight j 2, 1–35.
- Multiresolution elastic matching. Computer vision, graphics, and image processing 46, 1–21.
- An unsupervised learning model for deformable medical image registration, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9252–9260.
- Voxelmorph: a learning framework for deformable medical image registration. IEEE Transactions on Medical Imaging 38, 1788–1800.
- Global invertibility of Sobolev functions and the interpenetration of matter. P. Roy. Soc. Edin. A 88, 315–328.
- Symmetric data attachment terms for large deformation image registration. IEEE transactions on medical imaging 26, 1179–1189.
- Computing large deformation metric mappings via geodesic flows of diffeomorphisms. International journal of computer vision 61, 139–157.
- Analyse fonctionnelle. Dunod Paris.
- Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the aapm radiation therapy committee task group no. 132. Medical physics 44, e43–e76.
- A hyperelastic regularization energy for image registration. SIAM Journal on Scientific Computing 35, B132–B148.
- Large deformation diffeomorphic metric mapping of vector fields. IEEE transactions on medical imaging 24, 1216–1230.
- A reference dataset for deformable image registration spatial accuracy evaluation using the copdgene study archive. Physics in Medicine & Biology 58, 2861.
- A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets. Physics in Medicine & Biology 54, 1849.
- Deformable templates using large deformation kinematics. IEEE Transactions on Image Processing 5, 1435–1447.
- Three-Dimensional Elasticity. Mathematical Elasticity, Elsevier Science.
- 3d u-net: learning dense volumetric segmentation from sparse annotation, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer. pp. 424–432.
- Direct Methods in the Calculus of Variations, Second Edition. Springer.
- A deep learning framework for unsupervised affine and deformable image registration. Medical image analysis 52, 128–143.
- Birnet: Brain image registration using dual-supervised fully convolutional networks. Medical image analysis 54, 193–206.
- Large deformation diffeomorphic metric curve mapping. International journal of computer vision 80, 317–336.
- Diffeomorphic image registration with neural velocity field, in: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 1869–1879.
- Closing the gap between deep and conventional image registration using probabilistic dense displacement networks, in: International Conference on Medical Image Computing and Computer-Assisted Intervention., Springer. pp. 50–58.
- CNN-based lung CT registration with multiple anatomical constraints. Medical Image Analysis 72, 102139.
- Cyclemorph: cycle consistent unsupervised deformable image registration. Medical Image Analysis 71, 102036.
- Unsupervised deformable image registration using cycle-consistent cnn, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer. pp. 166–174.
- Elastix: a toolbox for intensity-based medical image registration. IEEE transactions on medical imaging 29, 196–205.
- Predicting respiratory motion for real-time tumour tracking in radiotherapy, in: International Symposium on Computer-Based Medical Systems (CBMS), IEEE. pp. 7–12.
- Landmark- and intensity-based registration with large deformations via quasi-conformal maps. SIAM Journal on Imaging Sciences 7, 2364–2392. doi:10.1137/130943406.
- Notes de Cours de DEA. Méthodes mathématiques en ̵́élasticité.
- Rethinking medical image reconstruction via shape prior, going deeper and faster: Deep joint indirect registration and reconstruction. Medical Image Analysis 68, 101930.
- Probabilistic multilayer regularization network for unsupervised 3D brain image registration, in: International Conference on Medical Image Computing and Computer-Assisted Intervention., Springer. pp. 346–354.
- Pc-swinmorph: patch representation for unsupervised medical image registration and segmentation. arXiv preprint arXiv:2203.05684 .
- Flownet3d: Learning scene flow in 3D point clouds, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 529–537.
- Fully convolutional networks for semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440.
- ilogdemons: A demons-based registration algorithm for tracking incompressible elastic biological tissues. International Journal of Computer Vision 92, 92–111.
- Numerical methods for image registration. OUP Oxford.
- Large deformation diffeomorphic image registration with laplacian pyramid networks, in: International Conference on Medical Image Computing and Computer-Assisted Intervention., Springer. pp. 211–221.
- Medical image registration: a review. Computer methods in biomechanics and biomedical engineering 17, 73–93.
- High resolution digital image correlation using proper generalized decomposition: Pgd-dic. International Journal for Numerical Methods in Engineering 92, 531–550.
- Understanding the “demon’s algorithm”: 3d non-rigid registration by gradient descent, in: Medical Image Computing and Computer-Assisted Intervention–MICCAI’99: Second International Conference, Cambridge, UK, September 19-22, 1999. Proceedings 2, Springer. pp. 597–605.
- Strain measurement in the left ventricle during systole with deformable image registration. Medical Image Analysis 13, 354–361.
- Symmetric image registration. Medical image analysis 10, 484–493.
- U-net: Convolutional networks for biomedical image segmentation, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer. pp. 234–241.
- Nonrigid registration using free-form deformations: application to breast mr images. IEEE Transactions on Medical Imaging 18, 712–721.
- Implicit neural representations with periodic activation functions. Advances in Neural Information Processing Systems 33, 7462–7473.
- 3d convolutional neural networks image registration based on efficient supervised learning from artificial deformations. arXiv preprint arXiv:1908.10235 .
- Nonrigid image registration using multi-scale 3d convolutional neural networks, in: International conference on medical image computing and computer-assisted intervention, Springer. pp. 232–239.
- Image-guided biopsy in the era of personalized cancer care: proceedings from the society of interventional radiology research consensus panel. Journal of Vascular and Interventional Radiology: JVIR 27, 8.
- Fourier features let networks learn high frequency functions in low dimensional domains. Advances in Neural Information Processing Systems 33, 7537–7547.
- Computer aided diagnosis system for cervical lymph nodes in CT images using deep learning. Biomedical Signal Processing and Control 71, 103158.
- Diffeomorphic demons: Efficient non-parametric image registration. NeuroImage 45, S61–S72.
- Measurement of strain in the left ventricle during diastole with cine-MRI and deformable image registration. J Biomech Eng .
- Diffeomorphic 3d image registration via geodesic shooting using an efficient adjoint calculation. International Journal of Computer Vision 97, 229–241.
- Implicit neural representations for deformable image registration, in: International Conference on Medical Imaging with Deep Learning, PMLR. pp. 1349–1359.
- Deepatlas: Joint semi-supervised learning of image registration and segmentation, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer. pp. 420–429.
- Fast predictive multimodal image registration, in: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), IEEE. pp. 858–862.
- Recursive cascaded networks for unsupervised medical image registration, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10600–10610.
- Unsupervised 3d end-to-end medical image registration with volume tweening network. IEEE journal of biomedical and health informatics 24, 1394–1404.
- Swin-voxelmorph: A symmetric unsupervised learning model for deformable medical image registration using swin transformer, in: International Conference on Medical Image Computing and Computer-Assisted Intervention., Springer. pp. 78–87.
- Deformable lung CT registration by decomposing large deformation, in: Biomedical Image Registration: 10th International Workshop, WBIR 2022, Munich, Germany, July 10–12, 2022, Proceedings, Springer. pp. 185–189.