PIFON-EPT: MR-Based Electrical Property Tomography Using Physics-Informed Fourier Networks (2302.11883v4)
Abstract: We propose Physics-Informed Fourier Networks for Electrical Properties (EP) Tomography (PIFON-EPT), a novel deep learning-based method for EP reconstruction using noisy and/or incomplete magnetic resonance (MR) measurements. Our approach leverages the Helmholtz equation to constrain two networks, responsible for the denoising and completion of the transmit fields, and the estimation of the object's EP, respectively. We embed a random Fourier features mapping into our networks to enable efficient learning of high-frequency details encoded in the transmit fields. We demonstrated the efficacy of PIFON-EPT through several simulated experiments at 3 and 7 tesla (T) MR imaging, and showed that our method can reconstruct physically consistent EP and transmit fields. Specifically, when only $20\%$ of the noisy measured fields were used as inputs, PIFON-EPT reconstructed the EP of a phantom with $\leq 5\%$ error, and denoised and completed the measurements with $\leq 1\%$ error. Additionally, we adapted PIFON-EPT to solve the generalized Helmholtz equation that accounts for gradients of EP between inhomogeneities. This yielded improved results at interfaces between different materials without explicit knowledge of boundary conditions. PIFON-EPT is the first method that can simultaneously reconstruct EP and transmit fields from incomplete noisy MR measurements, providing new opportunities for EPT research.
- C. M. Collins and Z. Wang, “Calculation of radiofrequency electromagnetic fields and their effects in mri of human subjects,” Magnetic resonance in medicine, vol. 65, no. 5, pp. 1470–1482, 2011.
- J. Hand, “Modelling the interaction of electromagnetic fields (10 mhz–10 ghz) with the human body: methods and applications,” Physics in Medicine & Biology, vol. 53, no. 16, p. R243, 2008.
- D. Holder, “Detection of cerebral ischaemia in the anaesthetised rat by impedance measurement with scalp electrodes: implications for non-invasive imaging of stroke by electrical impedance tomography,” Clinical Physics and Physiological Measurement, vol. 13, no. 1, p. 63, 1992.
- M. A. Fallert et al., “Myocardial electrical impedance mapping of ischemic sheep hearts and healing aneurysms.” Circulation, vol. 87, no. 1, pp. 199–207, 1993.
- K. K. Tha et al., “Noninvasive evaluation of electrical conductivity of the normal brain and brain tumors,” in Proc. Int. Soc. Magn. Reson. Med, vol. 22, 2014, p. 1885.
- K. K. Tha et al., “Noninvasive electrical conductivity measurement by mri: a test of its validity and the electrical conductivity characteristics of glioma,” European radiology, vol. 28, no. 1, pp. 348–355, 2018.
- E. Balidemaj et al., “Feasibility of electric property tomography of pelvic tumors at 3t,” Magnetic resonance in medicine, vol. 73, no. 4, pp. 1505–1513, 2015.
- J. Shin et al., “Initial study on in vivo conductivity mapping of breast cancer using mri,” Journal of Magnetic Resonance Imaging, vol. 42, no. 2, pp. 371–378, 2015.
- C. Rossmann and D. Haemmerich, “Review of temperature dependence of thermal properties, dielectric properties, and perfusion of biological tissues at hyperthermic and ablation temperatures,” Critical Reviews™ in Biomedical Engineering, vol. 42, no. 6, 2014.
- E. Balidemaj et al., “Hyperthermia treatment planning for cervical cancer patients based on electrical conductivity tissue properties acquired in vivo with ept at 3 t mri,” International Journal of Hyperthermia, vol. 32, no. 5, pp. 558–568, 2016.
- M. M. de Oliveira, P. Wen, and T. Ahfock, “Bio-heat transfer model of electroconvulsive therapy: Effect of biological properties on induced temperature variation,” in 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 2016, pp. 3997–4000.
- E. Haacke et al., “Extraction of conductivity and permittivity using magnetic resonance imaging,” Physics in Medicine & Biology, vol. 36, no. 6, p. 723, 1991.
- H. Wen, “Noninvasive quantitative mapping of conductivity and dielectric distributions using rf wave propagation effects in high-field mri,” in Medical Imaging 2003: Physics of Medical Imaging, vol. 5030. SPIE, 2003, pp. 471–477.
- U. Katscher et al., “Determination of electric conductivity and local sar via b1 mapping,” IEEE transactions on medical imaging, vol. 28, no. 9, pp. 1365–1374, 2009.
- T. Voigt, U. Katscher, and O. Doessel, “Quantitative conductivity and permittivity imaging of the human brain using electric properties tomography,” Magnetic Resonance in Medicine, vol. 66, no. 2, pp. 456–466, 2011.
- F. S. Hafalir et al., “Convection-reaction equation based magnetic resonance electrical properties tomography (cr-mrept),” IEEE transactions on medical imaging, vol. 33, no. 3, pp. 777–793, 2014.
- X. Zhang, S. Zhu, and B. He, “Imaging electric properties of biological tissues by rf field mapping in mri,” IEEE transactions on medical imaging, vol. 29, no. 2, pp. 474–481, 2010.
- D. K. Sodickson et al., “Local maxwell tomography using transmit-receive coil arrays for contact-free mapping of tissue electrical properties and determination of absolute rf phase,” in Proceedings of the 20th Annual Meeting of ISMRM. ISMRM Concord California, USA, 2012, p. 388.
- J. E. Serrallés et al., “Noninvasive estimation of electrical properties from magnetic resonance measurements via global maxwell tomography and match regularization,” IEEE Transactions on Biomedical Engineering, vol. 67, no. 1, pp. 3–15, 2019.
- R. L. Leijsen et al., “3-d contrast source inversion-electrical properties tomography,” IEEE transactions on medical imaging, vol. 37, no. 9, pp. 2080–2089, 2018.
- J. Liu et al., “Gradient-based electrical properties tomography (g ept): A robust method for mapping electrical properties of biological tissues in vivo using magnetic resonance imaging,” Magnetic resonance in medicine, vol. 74, no. 3, pp. 634–646, 2015.
- N. Gurler and Y. Z. Ider, “Gradient-based electrical conductivity imaging using mr phase,” Magnetic resonance in medicine, vol. 77, no. 1, pp. 137–150, 2017.
- S. Mandija et al., “Error analysis of helmholtz-based mr-electrical properties tomography,” Magnetic resonance in medicine, vol. 80, no. 1, pp. 90–100, 2018.
- I. I. Giannakopoulos et al., “Global Maxwell Tomography using an 8-channel radiofrequency coil: simulation results for a tissue-mimicking phantom at 7T,” in 2019 IEEE International Symposium on Antennas and Propagation and USNC-URSI Radio Science Meeting. IEEE, 2019, pp. 823–824.
- I. I. Giannakopoulos et al., “Magnetic-resonance-based electrical property mapping using Global Maxwell Tomography with an 8-channel head coil at 7 Tesla: a simulation study,” IEEE Transactions on Biomedical Engineering, vol. 68, no. 1, pp. 236–246, 2020.
- S. Mandija et al., “Opening a new window on mr-based electrical properties tomography with deep learning,” Scientific reports, vol. 9, no. 1, pp. 1–9, 2019.
- N. Hampe et al., “Investigating the challenges and generalizability of deep learning brain conductivity mapping,” Physics in Medicine & Biology, vol. 65, no. 13, p. 135001, 2020.
- S. Gavazzi et al., “Deep learning-based reconstruction of in vivo pelvis conductivity with a 3d patch-based convolutional neural network trained on simulated mr data,” Magnetic resonance in medicine, vol. 84, no. 5, pp. 2772–2787, 2020.
- I. Giannakopoulos et al., “On the usage of deep neural networks as a tensor-to-tensor translation between mr measurements and electrical properties,” Proc. ISMRM, 2020.
- R. Leijsen et al., “Combining deep learning and 3d contrast source inversion in mr-based electrical properties tomography,” NMR in Biomedicine, vol. 35, no. 4, p. e4211, 2022.
- A. J. G. Inda et al., “Physics-coupled neural network magnetic resonance electrical property tomography (mrept) for conductivity reconstruction,” IEEE Transactions on Image Processing, 2022.
- A. J. G. Inda et al., “Physics informed neural networks (pinn) for low snr magnetic resonance electrical properties tomography (mrept),” Diagnostics, vol. 12, no. 11, p. 2627, 2022.
- A. G. Baydin et al., “Automatic differentiation in machine learning: a survey,” Journal of Marchine Learning Research, vol. 18, pp. 1–43, 2018.
- X. Yu et al., “MR-Based Electrical Property Reconstruction Using Physics-Informed Neural Networks,” arXiv preprint arXiv:2210.12584, 2022.
- M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational physics, vol. 378, pp. 686–707, 2019.
- G. E. Karniadakis et al., “Physics-informed machine learning,” Nature Reviews Physics, vol. 3, no. 6, pp. 422–440, 2021.
- S. Qi et al., “Two-dimensional electromagnetic solver based on deep learning technique,” IEEE Journal on Multiscale and Multiphysics Computational Techniques, vol. 5, pp. 83–88, 2020.
- S. Qi and C. D. Sarris, “Electromagnetic-thermal analysis with fdtd and physics-informed neural networks,” IEEE Journal on Multiscale and Multiphysics Computational Techniques, vol. 8, pp. 49–59, 2023.
- M. Tancik et al., “Fourier features let networks learn high frequency functions in low dimensional domains,” Advances in Neural Information Processing Systems, vol. 33, pp. 7537–7547, 2020.
- A. Arduino, “Eptlib: An open-source extensible collection of electric properties tomography techniques,” Applied Sciences, vol. 11, no. 7, p. 3237, 2021.
- A. Savitzky and M. J. Golay, “Smoothing and differentiation of data by simplified least squares procedures.” Analytical chemistry, vol. 36, no. 8, pp. 1627–1639, 1964.
- C. E. Hayes et al., “An efficient, highly homogeneous radiofrequency coil for whole-body nmr imaging at 1.5 t,” Journal of Magnetic Resonance (1969), vol. 63, no. 3, pp. 622–628, 1985.
- C. Li, W. Yu, and S. Y. Huang, “An mr-based viscosity-type regularization method for electrical property tomography,” Tomography, vol. 3, no. 1, pp. 50–59, 2017.
- Z. Wang et al., “Contrastive learning with consistent representations,” arXiv preprint arXiv:2302.01541, 2023.
- Z. Chen, Q. Li, and Z. Zhang, “Towards robust neural networks via close-loop control,” arXiv preprint arXiv:2102.01862, 2021.
- S. Ruder, “An overview of gradient descent optimization algorithms,” arXiv preprint arXiv:1609.04747, 2016.
- Y. Yang et al., “Vflh: A following-the-leader-history based algorithm for adaptive online convex optimization with stochastic constraints,” Available at SSRN 4040704, 2022.
- Y. Yang, A. Koppel, and Z. Zhang, “A gradient-based approach for online robust deep neural network training with noisy labels,” arXiv preprint arXiv:2306.05046, 2023.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- S. Wang, X. Yu, and P. Perdikaris, “When and why pinns fail to train: A neural tangent kernel perspective,” Journal of Computational Physics, vol. 449, p. 110768, 2022.
- S. Wang, Y. Teng, and P. Perdikaris, “Understanding and mitigating gradient flow pathologies in physics-informed neural networks,” SIAM Journal on Scientific Computing, vol. 43, no. 5, pp. A3055–A3081, 2021.
- D. K. Sodickson et al., “Generalized local Maxwell tomography for mapping of electrical property gradients and tensors,” in Proceedings of the 21st Annual Meeting of ISMRM. ISMRM, 2013, p. 4175.
- I. I. Giannakopoulos, M. S. Litsarev, and A. G. Polimeridis, “Memory footprint reduction for the FFT-based volume integral equation method via tensor decompositions,” IEEE Transactions on Antennas and Propagation, vol. 67, no. 12, pp. 7476–7486, 2019.
- I. I. Giannakopoulos et al., “A tensor train compression scheme for remote volume-surface integral equation interactions,” in 2021 International Applied Computational Electromagnetics Society Symposium (ACES). IEEE, 2021, pp. 1–4.
- I. I. Giannakopoulos et al., “A hybrid volume-surface integral equation method for rapid electromagnetic simulations in mri,” IEEE Transactions on Biomedical Engineering, 2022.
- I. P. Georgakis et al., “A fast volume integral equation solver with linear basis functions for the accurate computation of EM fields in MRI,” IEEE Transactions on Antennas and Propagation, vol. 69, no. 7, pp. 4020–4032, 2020.
- W. J. Wiscombe, “Improved Mie scattering algorithms,” Applied optics, vol. 19, no. 9, pp. 1505–1509, 1980.
- I. P. Georgakis et al., “Novel Numerical Basis Sets for Electromagnetic Field Expansion in Arbitrary Inhomogeneous Objects,” IEEE Transactions on Antennas and Propagation, vol. 70, no. 9, pp. 8227–8241, 2022.
- B. Ronen et al., “The convergence rate of neural networks for learned functions of different frequencies,” Advances in Neural Information Processing Systems, vol. 32, 2019.
- Y. Cao et al., “Towards understanding the spectral bias of deep learning,” arXiv preprint arXiv:1912.01198, 2019.
- N. Rahaman et al., “On the spectral bias of neural networks,” in International Conference on Machine Learning. PMLR, 2019, pp. 5301–5310.
- S. Wang, H. Wang, and P. Perdikaris, “On the eigenvector bias of fourier feature networks: From regression to solving multi-scale pdes with physics-informed neural networks,” Computer Methods in Applied Mechanics and Engineering, vol. 384, p. 113938, 2021.
- A. Novikov et al., “Tensorizing neural networks,” Advances in neural information processing systems, vol. 28, 2015.
- Z. Liu, X. Yu, and Z. Zhang, “TT-PINN: A tensor-compressed neural PDE solver for edge computing,” arXiv preprint arXiv:2207.01751, 2022.
Collections
Sign up for free to add this paper to one or more collections.