Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
143 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Embedded Feature Similarity Optimization with Specific Parameter Initialization for 2D/3D Medical Image Registration (2305.06252v5)

Published 10 May 2023 in cs.CV and eess.IV

Abstract: We present a novel deep learning-based framework: Embedded Feature Similarity Optimization with Specific Parameter Initialization (SOPI) for 2D/3D medical image registration which is a most challenging problem due to the difficulty such as dimensional mismatch, heavy computation load and lack of golden evaluation standard. The framework we design includes a parameter specification module to efficiently choose initialization pose parameter and a fine-registration module to align images. The proposed framework takes extracting multi-scale features into consideration using a novel composite connection encoder with special training techniques. We compare the method with both learning-based methods and optimization-based methods on a in-house CT/X-ray dataset as well as simulated data to further evaluate performance. Our experiments demonstrate that the method in this paper has improved the registration performance, and thereby outperforms the existing methods in terms of accuracy and running time. We also show the potential of the proposed method as an initial pose estimator. The code is available at https://github.com/m1nhengChen/SOPI

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. “Pair-wise and group-wise deformation consistency in deep registration network,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part III 23. Springer, 2020, pp. 171–180.
  2. “Semantic hierarchy guided registration networks for intra-subject pulmonary ct image alignment,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part III 23. Springer, 2020, pp. 181–189.
  3. “Biomechanics-informed neural networks for myocardial motion tracking in mri,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part III 23. Springer, 2020, pp. 296–306.
  4. “2d/3d multimode medical image registration based on normalized cross-correlation,” Applied Sciences, vol. 12, no. 6, pp. 2828, 2022.
  5. “Robust 3d–2d image registration: application to spine interventions and vertebral labeling in the presence of anatomical deformation,” Physics in Medicine & Biology, vol. 58, no. 23, pp. 8535, 2013.
  6. “3d–2d image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch,” Physics in Medicine & Biology, vol. 61, no. 8, pp. 3009, 2016.
  7. “A comparison of similarity measures for use in 2-d-3-d medical image registration,” IEEE transactions on medical imaging, vol. 17, no. 4, pp. 586–595, 1998.
  8. “Medical image registration based on uncoupled learning and accumulative enhancement,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part IV. Springer, 2021, pp. 3–13.
  9. “End-to-end ultrasound frame to volume registration,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part IV 24. Springer, 2021, pp. 56–65.
  10. “Cross-modal attention for mri and ultrasound volume registration,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part IV 24. Springer, 2021, pp. 66–75.
  11. You Zhang, “An unsupervised 2d–3d deformable registration network (2d3d-regnet) for cone-beam ct estimation,” Physics in Medicine & Biology, vol. 66, no. 7, pp. 074001, 2021.
  12. “Deep iterative 2d/3d registration,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part IV 24. Springer, 2021, pp. 383–392.
  13. “A cnn regression approach for real-time 2d/3d registration,” IEEE transactions on medical imaging, vol. 35, no. 5, pp. 1352–1363, 2016.
  14. “Real-time 2d/3d registration via cnn regression,” in 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI). IEEE, 2016, pp. 1430–1434.
  15. “Generalizing spatial transformers to projective geometry with applications to 2d/3d registration,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part III 23. Springer, 2020, pp. 329–339.
  16. “Deep learning-based 2d/3d registration of an atlas to biplanar x-ray images,” International Journal of Computer Assisted Radiology and Surgery, vol. 17, no. 7, pp. 1333–1342, 2022.
  17. “2d/3d registration with a statistical deformation model prior using deep learning,” in 2021 IEEE EMBS international conference on biomedical and health informatics (BHI). IEEE, 2021, pp. 1–4.
  18. “The impact of machine learning on 2d/3d registration for image-guided interventions: A systematic review and perspective,” Frontiers in Robotics and AI, vol. 8, pp. 716007, 2021.
  19. “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
  20. “Learning unsupervised parameter-specific affine transformation for medical images registration,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part IV 24. Springer, 2021, pp. 24–34.
  21. “Comparison of similarity measures for rigid-body ct/dual x-ray image registrations,” Technology in cancer research & treatment, vol. 6, no. 4, pp. 337–345, 2007.
  22. “Cfnet: Cascade fusion network for dense prediction,” arXiv preprint arXiv:2302.06052, 2023.
  23. “Cbnet: A novel composite backbone network architecture for object detection,” in Proceedings of the AAAI conference on artificial intelligence, 2020, vol. 34, pp. 11653–11660.
  24. “Resnest: Split-attention networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 2736–2746.
  25. “3d pose regression using convolutional neural networks,” in Proceedings of the IEEE International Conference on Computer Vision Workshops, 2017, pp. 2174–2182.
  26. “Real-time deep registration with geodesic loss,” arXiv preprint arXiv:1803.05982, 2018.
  27. “Vertebrae localization, segmentation and identification using a graph optimization and an anatomic consistency cycle,” Computerized Medical Imaging and Graphics, p. 102235, 2023.
  28. “Geomstats: a python package for riemannian geometry in machine learning,” The Journal of Machine Learning Research, vol. 21, no. 1, pp. 9203–9211, 2020.
  29. “Surf: Speeded up robust features,” Lecture notes in computer science, vol. 3951, pp. 404–417, 2006.
  30. “Orb: An efficient alternative to sift or surf,” in 2011 International conference on computer vision. Ieee, 2011, pp. 2564–2571.
Citations (2)

Summary

We haven't generated a summary for this paper yet.