Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction (1712.01751v3)

Published 5 Dec 2017 in cs.CV

Abstract: Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning community over the last decades. The key ingredient to the problem is how to exploit the temporal correlation of the MR sequence to resolve the aliasing artefact. Traditionally, such observation led to a formulation of a non-convex optimisation problem, which were solved using iterative algorithms. Recently, however, deep learning based-approaches have gained significant popularity due to its ability to solve general inversion problems. In this work, we propose a unique, novel convolutional recurrent neural network (CRNN) architecture which reconstructs high quality cardiac MR images from highly undersampled k-space data by jointly exploiting the dependencies of the temporal sequences as well as the iterative nature of the traditional optimisation algorithms. In particular, the proposed architecture embeds the structure of the traditional iterative algorithms, efficiently modelling the recurrence of the iterative reconstruction stages by using recurrent hidden connections over such iterations. In addition, spatiotemporal dependencies are simultaneously learnt by exploiting bidirectional recurrent hidden connections across time sequences. The proposed algorithm is able to learn both the temporal dependency and the iterative reconstruction process effectively with only a very small number of parameters, while outperforming current MR reconstruction methods in terms of computational complexity, reconstruction accuracy and speed.

User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Chen Qin (52 papers)
  2. Jo Schlemper (27 papers)
  3. Jose Caballero (16 papers)
  4. Anthony Price (5 papers)
  5. Joseph V. Hajnal (33 papers)
  6. Daniel Rueckert (335 papers)
Citations (473)

Summary

Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction

The paper presents an innovative approach to solving the ill-posed inverse problem of dynamic magnetic resonance imaging (MRI) reconstruction from undersampled data, a challenge that has garnered significant attention due to its potential to accelerate data acquisition in clinical settings. The researchers propose a unique Convolutional Recurrent Neural Network (CRNN) architecture designed to effectively leverage temporal correlations in MR sequences alongside the iterative nature of traditional optimization algorithms, thus enabling the reconstruction of high-quality cardiac MR images.

Methodological Framework

The proposed CRNN architecture is inspired by conventional optimization strategies, specifically variable splitting and alternate minimization techniques commonly employed in Compressed Sensing (CS) approaches. In the context of MRI, undersampling in the frequency domain (k-space) leads to significant aliasing artifacts when reconstructing images. The CRNN addresses this by learning a recurrent representation that models both temporal sequence dependencies and iterative refinement during reconstruction.

The architecture comprises two primary components:

  1. Bidirectional Convolutional Recurrent Neural Network (BCRNN-t-i) Units: These model spatio-temporal dependencies across time frames, capturing the dynamic nature of the data.
  2. Convolutional Recurrent Neural Network (CRNN-i) Units: These units focus on propagating feature representations across the iterations of reconstruction, enhancing the contextual support for each optimization stage.

By integrating these components, the CRNN-MRI network encodes both iteration and temporal recurrence, offering a robust mapping that balances fidelity and feature regularization implicitly learned through training data.

Numerical Results and Claims

The experimental evaluations conducted with cardiac cine MRI data highlight several key findings:

  • The CRNN approach consistently outperforms existing CS-based methods such as k-t FOCUSS and k-t SLR in terms of PSNR, SSIM, and HFEN, indicating superior quality in both structural preservation and fine detail resolution.
  • Compared to similarly structured 3D CNN networks, both parameter-shared and non-shared versions, the CRNN shows significant improvements in reconstruction accuracy, despite having a smaller parameter set, demonstrating its efficient use of recurrent connections.
  • The proposed architecture achieved a considerable reduction in computational time, attributing to the efficient propagation across iterations and time sequences.

Implications and Future Directions

The implications of this research are multifold:

  • Practical Impact: The CRNN framework’s ability to enhance image quality from highly undersampled data could translate into significant reductions in MRI scan times, benefiting both patients and healthcare systems by alleviating motion artifacts and operational costs.
  • Theoretical Advancement: By modeling iterative and temporal dependencies, this work contributes to the broader understanding and application of deep learning architectures in dynamic imaging contexts, paving the way for further development in other imaging modalities and inverse problems.

Future research directions may include exploring more advanced recurrent unit designs like LSTM or GRU to potentially enhance memory retention of dynamic patterns in the data. Additionally, integrating multi-coil data and investigating motion correction mechanisms could further improve the model's applicability in various clinical scenarios.

This work represents a meaningful advancement in MRI reconstruction methodologies and sets a foundation for subsequent explorations in the use of convolutional recurrent neural networks for complex dynamic imaging tasks.