Papers
Topics
Authors
Recent
Search
2000 character limit reached

PatchMorph: A Stochastic Deep Learning Approach for Unsupervised 3D Brain Image Registration with Small Patches

Published 12 Dec 2023 in cs.CV and cs.LG | (2312.06958v1)

Abstract: We introduce "PatchMorph," an new stochastic deep learning algorithm tailored for unsupervised 3D brain image registration. Unlike other methods, our method uses compact patches of a constant small size to derive solutions that can combine global transformations with local deformations. This approach minimizes the memory footprint of the GPU during training, but also enables us to operate on numerous amounts of randomly overlapping small patches during inference to mitigate image and patch boundary problems. PatchMorph adeptly handles world coordinate transformations between two input images, accommodating variances in attributes such as spacing, array sizes, and orientations. The spatial resolution of patches transitions from coarse to fine, addressing both global and local attributes essential for aligning the images. Each patch offers a unique perspective, together converging towards a comprehensive solution. Experiments on human T1 MRI brain images and marmoset brain images from serial 2-photon tomography affirm PatchMorph's superior performance.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. B. B. Avants, N. J. Tustison, G. Song, P. A. Cook, A. Klein, and J. C. Gee, “A reproducible evaluation of ants similarity metric performance in brain image registration,” Neuroimage, vol. 54, no. 3, pp. 2033–2044, 2011.
  2. S. Klein, M. Staring, K. Murphy, M. A. Viergever, and J. P. Pluim, “Elastix: a toolbox for intensity-based medical image registration,” IEEE transactions on medical imaging, vol. 29, no. 1, pp. 196–205, 2009.
  3. G. Haskins, U. Kruger, and P. Yan, “Deep learning in medical image registration: a survey,” Machine Vision and Applications, vol. 31, pp. 1–18, 2020.
  4. A. V. Dalca, G. Balakrishnan, J. Guttag, and M. R. Sabuncu, “Unsupervised learning for fast probabilistic diffeomorphic registration,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part I, pp. 729–738, Springer, 2018.
  5. G. Balakrishnan, A. Zhao, M. R. Sabuncu, J. Guttag, and A. V. Dalca, “Voxelmorph: a learning framework for deformable medical image registration,” IEEE transactions on medical imaging, vol. 38, no. 8, pp. 1788–1800, 2019.
  6. M. Hoffmann, B. Billot, D. N. Greve, J. E. Iglesias, B. Fischl, and A. V. Dalca, “Synthmorph: learning contrast-invariant registration without acquired images,” IEEE transactions on medical imaging, vol. 41, no. 3, pp. 543–558, 2021.
  7. Y. Hu, M. Modat, E. Gibson, W. Li, N. Ghavami, E. Bonmati, G. Wang, S. Bandula, C. M. Moore, M. Emberton, et al., “Weakly-supervised convolutional neural networks for multimodal image registration,” Medical image analysis, vol. 49, pp. 1–13, 2018.
  8. K. A. Eppenhof and J. P. Pluim, “Pulmonary ct registration through supervised learning with convolutional neural networks,” IEEE transactions on medical imaging, vol. 38, no. 5, pp. 1097–1105, 2018.
  9. C. K. Guo, Multi-modal image registration with unsupervised deep learning. PhD thesis, Massachusetts Institute of Technology, 2019.
  10. T. C. Mok and A. C. Chung, “Large deformation diffeomorphic image registration with laplacian pyramid networks,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part III 23, pp. 211–221, Springer, 2020.
  11. L. Zhang, L. Zhou, R. Li, X. Wang, B. Han, and H. Liao, “Cascaded feature warping network for unsupervised medical image registration,” in 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 913–916, IEEE, 2021.
  12. J. M. Wolterink, J. C. Zwienenberg, and C. Brune, “Implicit neural representations for deformable image registration,” in International Conference on Medical Imaging with Deep Learning, pp. 1349–1359, PMLR, 2022.
  13. M. Byra, C. Poon, M. F. Rachmadi, M. Schlachter, and H. Skibbe, “Exploring the performance of implicit neural representations for brain image registration,” Scientific Reports, vol. 13, no. 1, p. 17334, 2023.
  14. M. Reisert, M. Russe, S. Elsheikh, E. Kellner, and H. Skibbe, “Deep neural patchworks: Coping with large segmentation tasks,” arXiv preprint arXiv:2206.03210, 2022.
  15. O. Cetin, Y. Shu, N. Flinner, P. Ziegler, P. Wild, and H. Koeppl, “Multi-magnification networks for deformable image registration on histopathology images,” in International Workshop on Biomedical Image Registration, pp. 124–133, Springer, 2022.
  16. S. Chatterjee, H. Bajaj, I. H. Siddiquee, N. B. Subbarayappa, S. Simon, S. B. Shashidhar, O. Speck, and A. Nürnberger, “Micdir: Multi-scale inverse-consistent deformable image registration using unetmss with self-constructing graph latent,” Computerized Medical Imaging and Graphics, vol. 108, p. 102267, 2023.
  17. Y. Hu, M. Modat, E. Gibson, N. Ghavami, E. Bonmati, C. M. Moore, M. Emberton, J. A. Noble, D. C. Barratt, and T. Vercauteren, “Label-driven weakly-supervised learning for multimodal deformable image registration,” in 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 1070–1074, IEEE, 2018.
  18. P. MONAI, “Monai: Medical open network for ai,” 2023.
  19. D. Rueckert, L. I. Sonoda, C. Hayes, D. L. Hill, M. O. Leach, and D. J. Hawkes, “Nonrigid registration using free-form deformations: application to breast mr images,” IEEE transactions on medical imaging, vol. 18, no. 8, pp. 712–721, 1999.
  20. A. Klein and J. Tourville, “101 labeled brain images and a consistent human cortical labeling protocol,” Frontiers in neuroscience, vol. 6, p. 171, 2012.
  21. H. Skibbe, M. F. Rachmadi, K. Nakae, C. E. Gutierrez, J. Hata, H. Tsukada, C. Poon, M. Schlachter, K. Doya, P. Majka, et al., “The brain/minds marmoset connectivity resource: An open-access platform for cellular-level tracing and tractography in the primate brain,” PLoS biology, vol. 21, no. 6, p. e3002158, 2023.
  22. I. Loshchilov and F. Hutter, “Decoupled weight decay regularization,” arXiv preprint arXiv:1711.05101, 2017.
  23. R. Pascanu, T. Mikolov, and Y. Bengio, “On the difficulty of training recurrent neural networks,” in International conference on machine learning, pp. 1310–1318, Pmlr, 2013.
  24. A. Bigalke, L. Hansen, T. C. Mok, and M. P. Heinrich, “Unsupervised 3d registration through optimization-guided cyclical self-training,” in International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 677–687, Springer, 2023.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free