Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Adaptive Local Neighborhood-based Neural Networks for MR Image Reconstruction from Undersampled Data (2206.00775v2)

Published 1 Jun 2022 in eess.IV and cs.LG

Abstract: Recent medical image reconstruction techniques focus on generating high-quality medical images suitable for clinical use at the lowest possible cost and with the fewest possible adverse effects on patients. Recent works have shown significant promise for reconstructing MR images from sparsely sampled k-space data using deep learning. In this work, we propose a technique that rapidly estimates deep neural networks directly at reconstruction time by fitting them on small adaptively estimated neighborhoods of a training set. In brief, our algorithm alternates between searching for neighbors in a data set that are similar to the test reconstruction, and training a local network on these neighbors followed by updating the test reconstruction. Because our reconstruction model is learned on a dataset that is in some sense similar to the image being reconstructed rather than being fit on a large, diverse training set, it is more adaptive to new scans. It can also handle changes in training sets and flexible scan settings, while being relatively fast. Our approach, dubbed LONDN-MRI, was validated on multiple data sets using deep unrolled reconstruction networks. Reconstructions were performed at four fold and eight fold undersampling of k-space with 1D variable-density random phase-encode undersampling masks. Our results demonstrate that our proposed locally-trained method produces higher-quality reconstructions compared to models trained globally on larger datasets as well as other scan-adaptive methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. “Statistical image reconstruction for polyenergetic X-ray computed tomography,” IEEE Transactions on Medical Imaging, vol. 21, no. 2, pp. 89–99, 2002.
  2. J. A. Fessler, “Model-Based Image Reconstruction for MRI,” IEEE Signal Processing Magazine, vol. 27, no. 4, pp. 81–89, 2010.
  3. D.L. Donoho, “Compressed sensing,” IEEE Transactions on Information Theory, vol. 52, no. 4, pp. 1289–1306, 2006.
  4. “Low-complexity image denoising based on statistical modeling of wavelet coefficients,” IEEE Signal Processing Letters, vol. 6, no. 12, pp. 300–303, 1999.
  5. “An efficient algorithm for compressed MR imaging using total variation and wavelets,” in 2008 IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1–8.
  6. S. Ravishankar and Y. Bresler, “MR image reconstruction from highly undersampled k-space data by dictionary learning,” IEEE Transactions on Medical Imaging, vol. 30, no. 5, pp. 1028–1041, 2011.
  7. S. G. Lingala and M. Jacob, “Blind compressive sensing dynamic MRI,” IEEE Transactions on Medical Imaging, vol. 32, no. 6, pp. 1132–1145, 2013.
  8. “Efficient sum of sparse outer products dictionary learning (SOUP-DIL),” CoRR, vol. abs/1511.06333, 2015.
  9. “Low-dose x-ray ct reconstruction via dictionary learning,” IEEE Transactions on Medical Imaging, vol. 31, no. 9, pp. 1682–1697, 2012.
  10. “Unified Supervised-Unsupervised (SUPER) Learning for X-Ray CT Image Reconstruction,” IEEE Transactions on Medical Imaging, vol. 40, no. 11, pp. 2986–3001, 2021.
  11. S. Ravishankar and Y. Bresler, “Learning sparsifying transforms,” IEEE Transactions on Signal Processing, vol. 61, no. 5, pp. 1072–1086, 2012.
  12. “Image reconstruction: From sparsity to data-adaptive methods and machine learning,” Proceedings of the IEEE, vol. 108, no. 1, pp. 86–109, 2020.
  13. “Transform learning for magnetic resonance image reconstruction: From model-based learning to building neural networks,” IEEE Signal Processing Magazine, vol. 37, no. 1, pp. 41–53, 2020.
  14. “Bilevel learning of l1 regularizrs with closed-form gradients (blorc),” in ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022, pp. 1491–1495.
  15. “U-net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, 2015, pp. 234–241.
  16. “Deep convolutional neural network for inverse problems in imaging,” IEEE Trans. Im. Proc., vol. 26, no. 9, pp. 4509–22, Sept. 2017.
  17. “Task Transformer Network for Joint MRI Reconstruction and Super-Resolution,” in International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2021.
  18. “Wasserstein gans for mr imaging: From paired to unpaired training,” IEEE Transactions on Medical Imaging, vol. 40, no. 1, pp. 105–115, Jan 2021.
  19. “A Transfer-Learning Approach for Accelerated MRI using Deep Neural Networks,” arXiv preprint arXiv:1710.02615, 2017.
  20. “MoDL: model-based deep learning architecture for inverse problems,” IEEE Trans. Med. Imaging, vol. 38, no. 2, pp. 394–405, 2019.
  21. “Cascaded dilated dense network with two-step data consistency for MRI reconstruction,” in NeurIPS, 2019.
  22. “A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction,” IEEE Transactions on Medical Imaging, vol. 37, no. 2, pp. 491–503, 2018.
  23. “Deep ADMM-Net for compressive sensing MRI,” in Advances in Neural Information Processing Systems, 2016, pp. 10–18.
  24. “Learning a variational network for reconstruction of accelerated MRI data,” Magnetic resonance in medicine, vol. 79, no. 6, pp. 3055–3071, 2018.
  25. “The Little Engine That Could: Regularization by Denoising (RED),” SIAM Journal on Imaging Sciences, vol. 10, no. 4, pp. 1804–1844, 2017.
  26. “Plug-and-play unplugged: optimization-free reconstruction using consensus equilibrium,” SIAM J. Imaging Sci., vol. 11, no. 3, pp. 2001–20, Jan. 2018.
  27. J. Zhang and B. Ghanem, “ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing,” arXiv preprint arXiv:1706.07929, 2018.
  28. “On instabilities of deep learning in image reconstruction and the potential costs of ai,” Proceedings of the National Academy of Sciences, vol. 117, no. 48, pp. 30088–30095, May 2020.
  29. “Ocmr (v1.0)–open-access multi-coil k-space dataset for cardiovascular magnetic resonance imaging,” arXiv preprint arXiv:2008.03410, 2020.
  30. J. Zbontar et al, “fastMRI: An Open Dataset and Benchmarks for Accelerated MRI,” 2019, arXiv preprint arXiv:1811.08839.
  31. “Deep image prior,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 9446–9454.
  32. M. Z. Darestani and R. Heckel, “Accelerated MRI with un-trained neural networks,” arXiv preprint arXiv:2007.02471, 2021.
  33. “Scan-specific robust artificial-neural-networks for k-space interpolation (raki) reconstruction: Database-free deep learning for fast imaging,” Magnetic resonance in medicine, vol. 81, no. 2, pp. 439–453, 2019.
  34. “Parallel mr imaging,” Journal of magnetic resonance imaging, vol. 36, no. 1, pp. 55–72, 2012.
  35. “LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Space,” arXiv preprint arXiv:1904.09390, 2019.
  36. “Self-supervised learning of physics-guided reconstruction neural networks without fully sampled reference data,” Magnetic Resonance in Medicine, vol. 84, no. 6, pp. 3172–3191, 2020.
  37. “Combining supervised and semi-blind dictionary (Super-BReD) learning for MRI reconstruction,” in Proc. Intl. Soc. Mag. Res. Med., 2020, p. 3456.
  38. “Sparse MRI: The application of compressed sensing for rapid MR imaging,” Mag. Res. Med., vol. 58, no. 6, pp. 1182–95, Dec. 2007.
  39. C. Crockett and J. A. Fessler, “Bilevel methods for image reconstruction,” arXiv preprint arXiv:2109.09610, 2021.
  40. F. Knoll et al, “fastMRI: A Publicly Available Raw k-Space and DICOM Dataset of Knee Images for Accelerated MR Image Reconstruction Using Machine Learning,” Radiology: Artificial Intelligence, vol. 2, no. 1, pp. e190007, 2020.
  41. J.Y. Cheng, “Stanford 2D FSE,” June 2019.
  42. M. Uecker, “mrirecon/bart: version 0.4.03,” Apr. 2018.
  43. “Deep iterative down-up cnn for image denoising,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019, pp. 2095–2103.
  44. “Blind Primed Supervised (BLIPS) Learning for MR Image Reconstruction,” IEEE Transactions on Medical Imaging, vol. 40, no. 11, pp. 3113–3124, 2021.
  45. “Robust autocalibrated loraks for epi ghost correction,” IEEE International Symposium on Biomedical Imaging, vol. 36, no. 1, pp. 663–666, 2018.
  46. “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process., vol. 13, no. 4, pp. 600–612, 2004.
  47. M. Kaya and H. Ş. bilge, “Deep metric learning: A survey,” Symmetry, vol. 11, no. 9, 2019.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com