Scalable Non-Cartesian Magnetic Resonance Imaging with R2D2 (2403.17905v3)
Abstract: We propose a new approach for non-Cartesian magnetic resonance image reconstruction. While unrolled architectures provide robustness via data-consistency layers, embedding measurement operators in Deep Neural Network (DNN) can become impractical at large scale. Alternative Plug-and-Play (PnP) approaches, where the denoising DNNs are blind to the measurement setting, are not affected by this limitation and have also proven effective, but their highly iterative nature also affects scalability. To address this scalability challenge, we leverage the "Residual-to-Residual DNN series for high-Dynamic range imaging (R2D2)" approach recently introduced in astronomical imaging. R2D2's reconstruction is formed as a series of residual images, iteratively estimated as outputs of DNNs taking the previous iteration's image estimate and associated data residual as inputs. The method can be interpreted as a learned version of the Matching Pursuit algorithm. We demonstrate R2D2 in simulation, considering radial k-space sampling acquisition sequences. Our preliminary results suggest that R2D2 achieves: (i) suboptimal performance compared to its unrolled incarnation R2D2-Net, which is however non-scalable due to the necessary embedding of NUFFT-based data-consistency layers; (ii) superior reconstruction quality to a scalable version of R2D2-Net embedding an FFT-based approximation for data consistency; (iii) superior reconstruction quality to PnP, while only requiring few iterations.
- “Deep learning for undersampled mri reconstruction,” Physics in Medicine & Biology, vol. 63, no. 13, pp. 135007, 2018.
- “Non-cartesian parallel imaging reconstruction,” Journal of Magnetic Resonance Imaging, vol. 40, no. 5, pp. 1022–1040, 2014.
- “Plug-and-play methods for integrating physical and learned models in computational imaging: Theory, algorithms, and applications,” IEEE Signal Processing Magazine, vol. 40, no. 1, pp. 85–97, 2023.
- “Nc-pdnet: A density-compensated unrolled network for 2d and 3d non-cartesian mri reconstruction,” IEEE Transactions on Medical Imaging, vol. 41, no. 7, pp. 1625–1638, 2022.
- “4d flow imaging with mri,” Cardiovascular Diagnosis and Therapy, vol. 4, no. 2, pp. 173, 2014.
- “Matching pursuits with time-frequency dictionaries,” IEEE Transactions on Signal Processing, vol. 41, no. 12, pp. 3397–3415, 1993.
- “Deep network series for large-scale high-dynamic range imaging,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Ultra-fast high-dynamic range imaging of cygnus a with the r2d2 deep neural network series,” arXiv preprint arXiv:2309.03291, 2023.
- “The r2d2 deep neural network series paradigm for fast precision imaging in radio astronomy,” arXiv preprint arXiv:2403.05452, 2024.
- “Image reconstruction algorithms in radio interferometry: From handcrafted to learned regularization denoisers,” Monthly Notices of the Royal Astronomical Society, vol. 518, no. 1, pp. 604–622, 09 2022.
- “End-to-end variational networks for accelerated mri reconstruction,” in International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI). Springer, 2020, pp. Part II 23, 64–73.
- “U-net: Convolutional networks for biomedical image segmentation,” in International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI). Springer, 2015, pp. Part III 18, 234–241.
- “fastmri: An open dataset and benchmarks for accelerated mri,” arXiv preprint arXiv:1811.08839, 2018.
- “Practical blind image denoising via swin-conv-unet and data synthesis,” Machine Intelligence Research, vol. 20, no. 6, pp. 822–836, 2023.
- “Sampling density compensation in mri: rationale and an iterative numerical solution,” Magnetic Resonance in Medicine, vol. 41, no. 1, pp. 179–186, 1999.
- “Scalable precision wide-field imaging in radio interferometry: I. usara validated on askap data,” Monthly Notices of the Royal Astronomical Society, vol. 522, no. 4, pp. 5558–5575, 2023.
- “Learning maximally monotone operators for image recovery,” SIAM Journal on Imaging Sciences, vol. 14, no. 3, pp. 1206–1237, 2021.
- “Plug-and-play imaging with model uncertainty quantification in radio astronomy,” arXiv preprint arXiv:2312.07137, 2023.
- “Pytorch: An imperative style, high-performance deep learning library,” Advances in neural information processing systems (NIPS), pp. 8024–8035, 2019.
- “Torchkbnufft: A high-level, hardware-agnostic non-uniform fast fourier transform,” in ISMRM Workshop on Data Sampling & Image Reconstruction, 2020.
- “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.