Realistic Restorer: artifact-free flow restorer(AF2R) for MRI motion artifact removal (2306.10689v1)
Abstract: Motion artifact is a major challenge in magnetic resonance imaging (MRI) that severely degrades image quality, reduces examination efficiency, and makes accurate diagnosis difficult. However, previous methods often relied on implicit models for artifact correction, resulting in biases in modeling the artifact formation mechanism and characterizing the relationship between artifact information and anatomical details. These limitations have hindered the ability to obtain high-quality MR images. In this work, we incorporate the artifact generation mechanism to reestablish the relationship between artifacts and anatomical content in the image domain, highlighting the superiority of explicit models over implicit models in medical problems. Based on this, we propose a novel end-to-end image domain model called AF2R, which addresses this problem using conditional normalization flow. Specifically, we first design a feature encoder to extract anatomical features from images with motion artifacts. Then, through a series of reversible transformations using the feature-to-image flow module, we progressively obtain MR images unaffected by motion artifacts. Experimental results on simulated and real datasets demonstrate that our method achieves better performance in both quantitative and qualitative results, preserving better anatomical details.
- Reducing clinical mri motion degradation using a prescan patient information pamphlet. American Journal of Roentgenology, 200(3):630–634, 2013.
- Unsupervised medical image translation using cycle-medgan. In 2019 27th European Signal Processing Conference (EUSIPCO), pages 1–5. IEEE, 2019.
- Medgan: Medical image translation using gans. Computerized medical imaging and graphics, 79:101684, 2020.
- Respiratory ordered phase encoding (ROPE): a method for reducing respiratory motion artefacts in mr imaging. Journal of computer assisted tomography, 9(4):835–838, 1985.
- Seeing what a gan cannot generate. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4502–4511, 2019.
- Detection and elimination of motion artifacts by regeneration of k-space. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 47(4):677–686, 2002.
- Joseph W Carlson. An algorithm for nmr imaging reconstruction based on multiple rf receiver coils. Journal of Magnetic Resonance (1969), 74(2):376–380, 1987.
- Free-breathing contrast-enhanced multiphase mri of the liver using a combination of compressed sensing, parallel imaging, and golden-angle radial sampling. Investigative radiology, 48(1), 2013.
- Abdominal mr imaging in children: motion compensation, sequence optimization, and protocol organization. Radiographics, 33(3):703–719, 2013.
- Beautyglow: On-demand makeup transfer framework with reversible generative network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10042–10050, 2019.
- Conditional normalizing flows for low-dose computed tomography image reconstruction. In ICML Workshop on Invertible Neural Networks, Normalizing Flows, and Explicit Likelihood Models, 2020.
- Nice: Non-linear independent components estimation. In International Conference on Learning Representations, 2015.
- Density estimation using real NVP. In International Conference on Learning Representations, 2017.
- Retrospective motion artifact correction of structural mri images using deep learning improves the quality of cortical surface reconstructions. NeuroImage, 230:117756, 2021.
- Magnetic resonance imaging with respiratory gating: techniques and advantages. American journal of Roentgenology, 143(6):1175–1182, 1984.
- Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
- Justin P Haldar. Low-rank modeling of local k𝑘kitalic_k-space neighborhoods (loraks) for constrained mri. IEEE transactions on medical imaging, 33(3):668–681, 2013.
- P-loraks: low-rank modeling of local k-space neighborhoods with parallel imaging data. Magnetic resonance in medicine, 75(4):1499–1514, 2016.
- Network accelerated motion estimation and reduction (namer): convolutional neural network guided retrospective motion correction using a separable motion model. Magnetic resonance in medicine, 82(4):1452–1461, 2019.
- Targeted motion estimation and reduction (tamer): data consistency based motion mitigation for mri using a reduced model joint optimization. IEEE transactions on medical imaging, 37(5):1253–1265, 2018.
- Motion artifact correction in mri using generalized projections. IEEE transactions on medical imaging, 10(1):40–46, 1991.
- Flow++: Improving flow-based generative models with variational dequantization and architecture design. In International Conference on Machine Learning, pages 2722–2730. PMLR, 2019.
- Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning, pages 448–456. PMLR, 2015.
- Sum-of-squares polynomial flow. In International Conference on Machine Learning, pages 3009–3018. PMLR, 2019.
- Mri artifact correction using sparse+ low-rank decomposition of annihilating filter-based hankel matrix. Magnetic resonance in medicine, 78(1):327–340, 2017.
- Loraks makes better sense: phase-constrained partial fourier sense reconstruction without phase calibration. Magnetic resonance in medicine, 77(3):1021–1035, 2017.
- Glow: Generative flow with invertible 1x1 convolutions. Advances in neural information processing systems, 31, 2018.
- Parallel magnetic resonance imaging. Physics in Medicine & Biology, 52(7):R15, 2007.
- Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4681–4690, 2017.
- Acceleration of mr parameter mapping using annihilating filter-based low rank hankel matrix (aloha). Magnetic resonance in medicine, 76(6):1848–1864, 2016.
- Mc2-net: motion correction network for multi-contrast brain mri. Magnetic Resonance in Medicine, 86(2):1077–1092, 2021.
- Hierarchical conditional flow: A unified framework for image super-resolution and image rescaling. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4076–4085, 2021.
- Adn: artifact disentanglement network for unsupervised metal artifact reduction. IEEE Transactions on Medical Imaging, 39(3):634–643, 2019.
- Motion artifacts reduction in brain mri by means of a deep residual network with densely connected multi-resolution blocks (drn-dcmb). Magnetic resonance imaging, 71:69–79, 2020.
- Blind retrospective motion correction of mr images. Magnetic resonance in medicine, 70(6):1608–1618, 2013.
- Srflow: Learning the super-resolution space with normalizing flow. In European conference on computer vision, pages 715–732. Springer, 2020.
- Sparse mri: The application of compressed sensing for rapid mr imaging. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 58(6):1182–1195, 2007.
- Compressed sensing mri. IEEE signal processing magazine, 25(2):72–82, 2008.
- Macow: Masked convolutional generative flow. Advances in Neural Information Processing Systems, 32, 2019.
- Peter Mansfield. Multi-planar image formation using nmr spin echoes. Journal of Physics C: Solid State Physics, 10(3):L55, 1977.
- Image metric-based correction (autocorrection) of motion effects: analysis of image metrics. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine, 11(2):174–181, 2000.
- Survae flows: Surjections to bridge the gap between vaes and flows. Advances in Neural Information Processing Systems, 33:12685–12696, 2020.
- Unpaired mr motion artifact deep learning using outlier-rejecting bootstrap aggregation. IEEE Transactions on Medical Imaging, 40(11):3125–3139, 2021.
- Masked autoregressive flow for density estimation. Advances in neural information processing systems, 30, 2017.
- Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
- Motion correction in mri using deep convolutional neural network. In Proceedings of the ISMRM Scientific Meeting & Exhibition, Paris, volume 1174, 2018.
- James G Pipe. Motion correction with propeller mri: application to head motion and free-breathing cardiac imaging. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 42(5):963–969, 1999.
- Scout accelerated motion estimation and reduction (samer). Magnetic Resonance in Medicine, 87(1):163–178, 2022.
- Waveglow: A flow-based generative network for speech synthesis. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 3617–3621. IEEE, 2019.
- Prospective head-movement correction for high-resolution mri using an in-bore optical tracking system. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 62(4):924–934, 2009.
- Variational inference with normalizing flows. In International conference on machine learning, pages 1530–1538. PMLR, 2015.
- Weight normalization: A simple reparameterization to accelerate training of deep neural networks. Advances in neural information processing systems, 29, 2016.
- Robust non-rigid motion compensation of free-breathing myocardial perfusion mri data. IEEE transactions on medical imaging, 38(8):1812–1820, 2019.
- A k-space model of movement artefacts: application to segmentation augmentation and artefact removal. IEEE transactions on medical imaging, 39(9):2881–2892, 2020.
- 3d cine displacement-encoded mri of pulsatile brain motion. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 61(1):153–162, 2009.
- Motion robust magnetic resonance imaging via efficient fourier aggregation. Medical Image Analysis, 83:102638, 2023.
- Artifacts in body mr imaging: their appearance and how to eliminate them. European radiology, 17(5):1242–1255, 2007.
- Motion artifact reduction using a convolutional neural network for dynamic contrast enhanced mr imaging of the liver. Magnetic resonance in medical sciences, 19(1):64, 2020.
- Prospective motion correction of 3d echo-planar imaging data for functional mri using optical tracking. Neuroimage, 113:1–12, 2015.
- Uncertainty-guided progressive gans for medical image translation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 614–624. Springer, 2021.
- Andre Van Der Kouwe and Jalal B Andre. Motion Correction in MR: Correction of Position, Motion, and Dynamic Field Changes. Elsevier, 2022.
- Navigated abdominal t1-w mri permits free-breathing image acquisition with less motion artifact. Pediatric radiology, 40(3):340–344, 2010.
- Echo planar time-resolved imaging (epti). Magnetic resonance in medicine, 81(6):3599–3615, 2019.
- Esrgan: Enhanced super-resolution generative adversarial networks. In Proceedings of the European conference on computer vision (ECCV) workshops, pages 0–0, 2018.
- Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004.
- Spherical navigator echoes for full 3d rigid body motion measurement in mri. Magnetic resonance in medicine: an official journal of the international society for magnetic resonance in medicine, 47(1):32–41, 2002.
- Promo: real-time prospective motion correction in mri using image-based tracking. Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine, 63(1):91–105, 2010.
- Mr image artifacts from periodic motion. Medical physics, 12(2):143–151, 1985.
- Motion artifacts in mri: A complex problem with many partial solutions. Journal of Magnetic Resonance Imaging, 42(4):887–901, 2015.
- Multi-scale network with the deeper and wider residual block for mri motion artifact correction. In 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), volume 2, pages 405–410. IEEE, 2019.
- A flexible deartifacting module for compressed sensing mri. IEEE Journal of Selected Topics in Signal Processing, 16(4):725–736, 2022.
- Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision, pages 2223–2232, 2017.