MA-RECON: Mask-aware deep-neural-network for robust fast MRI k-space interpolation (2209.00462v2)
Abstract: High-quality reconstruction of MRI images from under-sampled k-space' data, which is in the Fourier domain, is crucial for shortening MRI acquisition times and ensuring superior temporal resolution. Over recent years, a wealth of deep neural network (DNN) methods have emerged, aiming to tackle the complex, ill-posed inverse problem linked to this process. However, their instability against variations in the acquisition process and anatomical distribution exposes a deficiency in the generalization of relevant physical models within these DNN architectures. The goal of our work is to enhance the generalization capabilities of DNN methods for k-space interpolation by introducing
MA-RECON', an innovative mask-aware DNN architecture and associated training method. Unlike preceding approaches, our `MA-RECON' architecture encodes not only the observed data but also the under-sampling mask within the model structure. It implements a tailored training approach that leverages data generated with a variety of under-sampling masks to stimulate the model's generalization of the under-sampled MRI reconstruction problem. Therefore, effectively represents the associated inverse problem, akin to the classical compressed sensing approach. The benefits of our MA-RECON approach were affirmed through rigorous testing with the widely accessible fastMRI dataset. Compared to standard DNN methods and DNNs trained with under-sampling mask augmentation, our approach demonstrated superior generalization capabilities. This resulted in a considerable improvement in robustness against variations in both the acquisition process and anatomical distribution, especially in regions with pathology. In conclusion, our mask-aware strategy holds promise for enhancing the generalization capacity and robustness of DNN-based methodologies for MRI reconstruction from undersampled k-space data.
- Plug-and-play methods for magnetic resonance imaging: Using denoisers for image recovery. IEEE signal processing magazine 37, 105–116.
- Statistical analysis of noise in mri. Switzerland: Springer International Publishing .
- Scan-specific robust artificial-neural-networks for k-space interpolation (raki) reconstruction: Database-free deep learning for fast imaging. Magnetic resonance in medicine 81, 439–453.
- On instabilities of deep learning in image reconstruction and the potential costs of ai. Proceedings of the National Academy of Sciences 117, 30088–30095.
- Ai-based reconstruction for fast mri—a systematic review and meta-analysis. Proceedings of the IEEE 110, 224–245.
- Deepspirit: generalized parallel imaging using deep convolutional neural networks, in: Annual Meeting of the International Society of Magnetic Resonance in Medicine.
- K-unn: k-space interpolation with untrained neural network. URL: https://arxiv.org/abs/2208.05827, doi:10.48550/ARXIV.2208.05827.
- Kiki-net: cross-domain convolutional neural networks for reconstructing undersampled magnetic resonance images. Magnetic resonance in medicine 80, 2188–2201.
- Halving mr imaging time by conjugation: demonstration at 3.5 kg. Radiology 161, 527–531.
- Hfist-net: High-throughput fast iterative shrinkage thresholding network for accelerating mr image reconstruction. Computer Methods and Programs in Biomedicine 232, 107440.
- Generalized autocalibrating partially parallel acquisitions (grappa). Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 47, 1202–1210.
- Physics-driven deep learning for computational magnetic resonance imaging. arXiv preprint arXiv:2203.12215 .
- Dual-domain accelerated mri reconstruction using transformers with learning-based undersampling. Computerized Medical Imaging and Graphics 106, 102206.
- Deep learning for undersampled mri reconstruction. Physics in Medicine & Biology 63, 135007.
- Robust compressed sensing mri with deep generative priors. Advances in Neural Information Processing Systems 34, 14938–14954.
- Deep mri reconstruction: unrolled optimization algorithms meet neural networks. arXiv preprint arXiv:1907.11711 .
- Principles of magnetic resonance imaging. SPIE Optical Engineering Press Bellingham.
- Santis: sampling-augmented neural network with incoherent structure for mr image reconstruction. Magnetic resonance in medicine 82, 1890–1904.
- Sparse mri: The application of compressed sensing for rapid mr imaging. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 58, 1182–1195.
- Spirit: iterative self-consistent parallel imaging reconstruction from arbitrary k-space. Magnetic resonance in medicine 64, 457–471.
- Transfer learning enhanced generative adversarial networks for multi-channel mri reconstruction. Computers in Biology and Medicine 134, 104504.
- Domain knowledge augmentation of parallel mr image reconstruction using deep learning. Computerized Medical Imaging and Graphics 92, 101968.
- Sense: sensitivity encoding for fast mri. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 42, 952–962.
- Compressed sensing mri reconstruction using a generative adversarial network with a cyclic loss. IEEE transactions on medical imaging 37, 1488–1497.
- U-net: Convolutional networks for biomedical image segmentation, in: International Conference on Medical image computing and computer-assisted intervention, Springer. pp. 234–241.
- Subsampled brain mri reconstruction by generative adversarial neural networks. Medical Image Analysis 65, 101747.
- End-to-end variational networks for accelerated mri reconstruction, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer. pp. 64–73.
- Mhan: Multi-stage hybrid attention network for mri reconstruction and super-resolution. Computers in Biology and Medicine , 107181.
- Deep learning based mri reconstruction with transformer. Computer Methods and Programs in Biomedicine 233, 107452.
- Dagan: deep de-aliasing generative adversarial networks for fast compressed sensing mri reconstruction. IEEE transactions on medical imaging 37, 1310–1321.
- Deep plug-and-play prior for parallel mri reconstruction, in: 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), IEEE. pp. 3952–3958.
- Compressed sensing mri: a review from signal processing perspective. BMC Biomedical Engineering 1, 1–17.
- Stable deep mri reconstruction using generative priors. URL: https://arxiv.org/abs/2210.13834, doi:10.48550/ARXIV.2210.13834.
- fastmri: An open dataset and benchmarks for accelerated mri. arXiv preprint arXiv:1811.08839 .
- A dual-task dual-domain model for blind mri reconstruction. Computerized Medical Imaging and Graphics 89, 101862.
- fastmri+: Clinical pathology annotations for knee and brain fully sampled multi-coil mri data. arXiv preprint arXiv:2109.03812 .
- Swingan: A dual-domain swin transformer-based generative adversarial network for mri reconstruction. Computers in Biology and Medicine 153, 106513.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.