Highly efficient non-rigid registration in k-space with application to cardiac Magnetic Resonance Imaging
Abstract: In Magnetic Resonance Imaging (MRI), high temporal-resolved motion can be useful for image acquisition and reconstruction, MR-guided radiotherapy, dynamic contrast-enhancement, flow and perfusion imaging, and functional assessment of motion patterns in cardiovascular, abdominal, peristaltic, fetal, or musculoskeletal imaging. Conventionally, these motion estimates are derived through image-based registration, a particularly challenging task for complex motion patterns and high dynamic resolution. The accelerated scans in such applications result in imaging artifacts that compromise the motion estimation. In this work, we propose a novel self-supervised deep learning-based framework, dubbed the Local-All Pass Attention Network (LAPANet), for non-rigid motion estimation directly from the acquired accelerated Fourier space, i.e. k-space. The proposed approach models non-rigid motion as the cumulative sum of local translational displacements, following the Local All-Pass (LAP) registration technique. LAPANet was evaluated on cardiac motion estimation across various sampling trajectories and acceleration rates. Our results demonstrate superior accuracy compared to prior conventional and deep learning-based registration methods, accommodating as few as 2 lines/frame in a Cartesian trajectory and 3 spokes/frame in a non-Cartesian trajectory. The achieved high temporal resolution (less than 5 ms) for non-rigid motion opens new avenues for motion detection, tracking and correction in dynamic and real-time MRI applications.
- Quantifying the financial savings of motion correction in brain mri: a model-based estimate of the costs arising from patient head motion and potential savings from implementation of motion correction. Journal of Magnetic Resonance Imaging, 52(3):731–738, 2020.
- Head injury or head motion? assessment and quantification of motion artifacts in diffusion tensor imaging studies. Human brain mapping, 33(1):50–62, 2012.
- Motion artifacts in mri: A complex problem with many partial solutions. Journal of Magnetic Resonance Imaging, 42(4):887–901, 2015.
- Toward quantifying the prevalence, severity, and cost associated with patient motion during clinical mr examinations. Journal of the American College of Radiology, 12(7):689–695, 2015.
- Segmented k-space cine breath-hold cardiovascular mr imaging: Part 1. principles and technique. AJR. American journal of roentgenology, 169(2):395–400, 1997.
- Compressed sensing single–breath-hold cmr for fast quantification of lv function, volumes, and mass. JACC: Cardiovascular Imaging, 7(9):882–892, 2014.
- Spherical navigator echoes for full 3d rigid body motion measurement in mri. Magnetic resonance in medicine: an official journal of the international society for magnetic resonance in medicine, 47(1):32–41, 2002.
- Prospective motion correction in brain imaging: a review. Magnetic resonance in medicine, 69(3):621–636, 2013.
- Pilot tone navigation for respiratory and cardiac motion-resolved free-running 5d flow mri. Magnetic resonance in medicine, 87(2):718–732, 2022.
- Cardiac and respiratory mri gating using combined wavelet sub-band decomposition and adaptive filtering. Annals of biomedical engineering, 35:733–743, 2007.
- Evaluation of respiratory liver and kidney movements for mri navigator gating. Journal of Magnetic Resonance Imaging, 33(1):143–148, 2011.
- Respiratory gating in magnetic resonance imaging at 0.5 tesla. Radiology, 151(2):521–523, 1984.
- Respiratory ordered phase encoding (rope): a method for reducing respiratory motion artefacts in mr imaging. Journal of computer assisted tomography, 9(4):835–838, 1985.
- Sense: sensitivity encoding for fast mri. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 42(5):952–962, 1999.
- Sparse mri: The application of compressed sensing for rapid mr imaging. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 58(6):1182–1195, 2007.
- James G Pipe. Motion correction with propeller mri: application to head motion and free-breathing cardiac imaging. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 42(5):963–969, 1999.
- An optimal radial profile order based on the golden ratio for time-resolved mri. IEEE transactions on medical imaging, 26(1):68–76, 2006.
- Quantification of left ventricular function with magnetic resonance images acquired in real time. Journal of magnetic resonance imaging, 12(3):430–438, 2000.
- Temporally constrained reconstruction of dynamic cardiac perfusion mri. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 57(6):1027–1036, 2007.
- Real-time mri at a resolution of 20 ms. NMR in Biomedicine, 23(8):986–994, 2010.
- Sparse reconstruction techniques in magnetic resonance imaging: methods, applications, and challenges to clinical adoption. Investigative radiology, 51(6):349–364, 2016.
- Real time movie images by nmr. The British journal of radiology, 55(658):729–733, 1982.
- Real-time non-rigid 3d respiratory motion estimation for mr-guided radiotherapy using mr-motus. IEEE Transactions on Medical Imaging, 41(2):332–346, 2021.
- Correcting magnetic resonance-space data for in-plane motion using an optical position tracking system. Medical physics, 36(12):5580–5585, 2009.
- Prospective motion correction with continuous gradient updates in diffusion weighted imaging. Magnetic resonance in medicine, 67(2):326–338, 2012.
- Three-dimensional motion corrected sensitivity encoding reconstruction for multi-shot multi-slice mri: application to neonatal brain imaging. Magnetic resonance in medicine, 79(3):1365–1376, 2018.
- Retrospective correction of motion-affected mr images using deep learning frameworks. Magnetic resonance in medicine, 82(4):1527–1540, 2019.
- Highly efficient nonrigid motion-corrected 3d whole-heart coronary vessel wall imaging. Magnetic resonance in medicine, 77(5):1894–1908, 2017.
- 3d whole-heart isotropic sub-millimeter resolution coronary magnetic resonance angiography with non-rigid motion-compensated prost. Journal of Cardiovascular Magnetic Resonance, 22(1):1–16, 2020.
- Real-time mri motion estimation through an unsupervised k-space-driven deformable registration network (ks-regnet). Physics in Medicine & Biology, 67(13):135012, 2022.
- Motion compensated generalized reconstruction for free-breathing dynamic contrast-enhanced mri. Magnetic resonance in medicine, 65(3):812–822, 2011.
- Robust non-rigid motion compensation of free-breathing myocardial perfusion mri data. IEEE transactions on medical imaging, 38(8):1812–1820, 2019.
- The use of deformable image registration to integrate diagnostic mri into the radiotherapy planning pathway for head and neck cancer. Radiotherapy and Oncology, 122(2):229–235, 2017.
- Multimodal image registration for preoperative planning and image-guided neurosurgical procedures. Neurosurgery Clinics, 22(2):197–206, 2011.
- Extreme mri: Large-scale volumetric dynamic imaging from continuous non-gated acquisitions. Magnetic resonance in medicine, 84(4):1763–1780, 2020.
- Cardiovascular magnetic resonance artefacts. Journal of Cardiovascular Magnetic Resonance, 15(1):41, 2013.
- Deep predictive motion tracking in magnetic resonance imaging: application to fetal imaging. IEEE transactions on medical imaging, 39(11):3523–3534, 2020.
- Advanced flow mri: emerging techniques and applications. Clinical radiology, 71(8):779–795, 2016.
- Automated detection of regional wall motion abnormalities based on a statistical model applied to multislice short-axis cardiac mr images. IEEE Transactions on Medical Imaging, 28(4):595–607, 2009.
- Strain measurement in the left ventricle during systole with deformable image registration. Medical image analysis, 13(2):354–361, 2009.
- Magnetic resonance imaging for the assessment of gastrointestinal function. Scandinavian journal of gastroenterology, 41(11):1245–1260, 2006.
- Evaluation of bowel peristalsis by dynamic cine mri: detection of relevant functional disturbances—initial experience. Journal of Magnetic Resonance Imaging, 35(4):859–867, 2012.
- Intermittently tagged real-time mri reveals internal tongue motion during speech production. Magnetic resonance in medicine, 82(2):600–613, 2019.
- Dynamic mri to quantify musculoskeletal motion: A systematic review of concurrent validity and reliability, and perspectives for evaluation of musculoskeletal disorders. PLoS One, 12(12):e0189587, 2017.
- Voxelmorph: a learning framework for deformable medical image registration. IEEE transactions on medical imaging, 38(8):1788–1800, 2019.
- Retrospective motion correction in multishot mri using generative adversarial network. Scientific Reports, 10(1):4786, 2020.
- Non-rigid respiratory motion estimation of whole-heart coronary mr images using unsupervised deep learning. IEEE Transactions on Medical Imaging, 40(1):444–454, 2020.
- Attention-aware non-rigid image registration for accelerated mr imaging. IEEE transactions on medical imaging, 26(1):68–76, 2024.
- Retrospective reconstruction of high temporal resolution cine images from real-time mri using iterative motion correction. Magnetic Resonance in Medicine, 68(3):741–750, 2012.
- Deep learning-based image reconstruction and motion estimation from undersampled radial k-space for real-time mri-guided radiotherapy. Physics in Medicine & Biology, 65(15):155015, 2020.
- Time-resolved cardiac imaging and motion analysis using a multi-scale dynamics decomposition. In Proc. International Society for Magnetic Resonance in Medicine (ISMRM), 2023.
- Deep learning-based motion quantification from k-space for fast model-based magnetic resonance imaging motion correction. Medical physics, 50(4):2148–2161, 2023.
- Lapnet: non-rigid registration derived in k-space for magnetic resonance imaging. IEEE transactions on medical imaging, 40(12):3686–3697, 2021.
- 3d motion flow estimation using local all-pass filters. In 2016 IEEE 13th international symposium on biomedical imaging (ISBI), pages 282–285, 2016.
- Operational introduction to fast fourier transform. In Fourier Optics and Computational Imaging, pages 51–57. Springer, 2023.
- Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural networks, 107:3–11, 2018.
- Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7132–7141, 2018.
- A database and evaluation methodology for optical flow. International journal of computer vision, 92:1–31, 2011.
- Design and validation of segment-freely available software for cardiovascular image analysis. BMC medical imaging, 10:1–13, 2010.
- Espirit—an eigenvalue approach to autocalibrating parallel mri: where sense meets grappa. Magnetic resonance in medicine, 71(3):990–1001, 2014.
- Variable density incoherent spatiotemporal acquisition (vista) for highly accelerated cardiac mri. Magnetic resonance in medicine, 74(5):1266–1278, 2015.
- Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017.
- Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983, 2016.
- Elastix: a toolbox for intensity-based medical image registration. IEEE transactions on medical imaging, 29(1):196–205, 2009.
- Nonrigid multimodality image registration. In Medical imaging 2001: image processing, volume 4322, pages 1609–1620, 2001.
- Axiomatic attribution for deep networks. In International conference on machine learning, pages 3319–3328, 2017.
- Reconstruction-driven motion estimation for motion-compensated mr cine imaging. arXiv preprint arXiv:2302.02504, 2023.
- End-to-end deep learning of non-rigid groupwise registration and reconstruction of dynamic mri. Frontiers in cardiovascular medicine, 9:880186, 2022.
- Videoflow: Exploiting temporal cues for multi-frame optical flow estimation. arXiv preprint arXiv:2303.08340, 2023.
- Motion-adaptive spatio-temporal regularization for accelerated dynamic mri. Magnetic Resonance in Medicine, 70(3):800–812, 2013.
- Real-time magnetic resonance imaging of cardiac function and flow—recent progress. Quantitative imaging in medicine and surgery, 4(5):313, 2014.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.