Gradient Descent Provably Solves Nonlinear Tomographic Reconstruction (2310.03956v1)
Abstract: In computed tomography (CT), the forward model consists of a linear Radon transform followed by an exponential nonlinearity based on the attenuation of light according to the Beer-Lambert Law. Conventional reconstruction often involves inverting this nonlinearity as a preprocessing step and then solving a convex inverse problem. However, this nonlinear measurement preprocessing required to use the Radon transform is poorly conditioned in the vicinity of high-density materials, such as metal. This preprocessing makes CT reconstruction methods numerically sensitive and susceptible to artifacts near high-density regions. In this paper, we study a technique where the signal is directly reconstructed from raw measurements through the nonlinear forward model. Though this optimization is nonconvex, we show that gradient descent provably converges to the global optimum at a geometric rate, perfectly reconstructing the underlying signal with a near minimal number of random measurements. We also prove similar results in the under-determined setting where the number of measurements is significantly smaller than the dimension of the signal. This is achieved by enforcing prior structural information about the signal through constraints on the optimization variables. We illustrate the benefits of direct nonlinear CT reconstruction with cone-beam CT experiments on synthetic and real 3D volumes. We show that this approach reduces metal artifacts compared to a commercial reconstruction of a human skull with metal dental crowns.
- A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM journal on imaging sciences, 2(1):183–202, 2009.
- R. N. Bracewell. Numerical Transforms. Science, 248(4956):697–704, May 1990. doi: 10.1126/science.248.4956.697.
- Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 52(2):489–509, 2006. doi: 10.1109/TIT.2005.862083.
- Phase retrieval via wirtinger flow: Theory and algorithms. IEEE Transactions on Information Theory, 61(4):1985–2007, 2015.
- Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage. IEEE Transactions on image processing, 7(3):319–335, 1998.
- FDA Clears First Major Imaging Device Advancement for Computed Tomography in Nearly a Decade, 2021. URL https://www.fda.gov/news-events/press-announcements/fda-clears-first-major-imaging-device-advancement-computed-tomography-nearly-decade.
- Computed Tomography (CT), 2023. URL https://www.fda.gov/radiation-emitting-products/medical-x-ray-imaging/computed-tomography-ct.
- A Mathematical Introduction to Compressive Sensing. Birkhauser, 2013.
- Comparison between pre-log and post-log statistical models in ultra-low-dose ct reconstruction. IEEE transactions on medical imaging, 36(3):707–720, 2016.
- Principles of computerized tomographic imaging. SIAM, 2001.
- The landscape of empirical risk for nonconvex losses. The Annals of Statistics, 46(6A):2747–2774, 2018.
- Frank Natterer. The Mathematics of Computerized Tomography. Society for Industrial and Applied Mathematics, 2001.
- Fast and reliable parameter estimation from nonlinear observations. SIAM Journal on Optimization, 27(4):2276–2300, 2017a. doi: 10.1137/17M1113874. URL https://doi.org/10.1137/17M1113874.
- Fast and reliable parameter estimation from nonlinear observations. SIAM Journal on Optimization, 27(4):2276–2300, 2017b.
- Sharp time–data tradeoffs for linear inverse problems. IEEE Transactions on Information Theory, 64(6):4129–4158, 2017.
- Isometric sketching of any set via the Restricted Isometry Property. Information and Inference: A Journal of the IMA, 7(4):707–726, 03 2018. ISSN 2049-8764. doi: 10.1093/imaiai/iax019. URL https://doi.org/10.1093/imaiai/iax019.
- Johann Radon. Uber die bestimmung von funktionen durch ihre integralwerte langs gewissez mannigfaltigheiten, ber. Verh. Sachs. Akad. Wiss. Leipzig, Math Phys Klass, 69, 1917.
- Neat: Neural adaptive tomography. ACM Trans. Graph., 41(4), jul 2022. ISSN 0730-0301. doi: 10.1145/3528223.3530121. URL https://doi.org/10.1145/3528223.3530121.
- Plenoxels: Radiance fields without neural networks. In CVPR, 2022.
- The fourier reconstruction of a head section. IEEE Transactions on nuclear science, 21(3):21–43, 1974.
- Photon counting computed tomography: concept and initial results. Medical physics, 32(2):427–436, 2005.
- Mahdi Soltanolkotabi. Learning relus via gradient descent. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, pp. 2004?2014, Red Hook, NY, USA, 2017. Curran Associates Inc. ISBN 9781510860964.
- Mahdi Soltanolkotabi. Structured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization. IEEE Transactions on Information Theory, 65(4):2374–2400, 2019a. doi: 10.1109/TIT.2019.2891653.
- Mahdi Soltanolkotabi. Structured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization. IEEE Transactions on Information Theory, 65(4):2374–2400, 2019b.
- A review of deep learning ct reconstruction: concepts, limitations, and promise in clinical practice. Current Radiology Reports, 10(9):101–115, 2022.
- Roman Vershynin. High-dimensional probability: An introduction with applications in data science, volume 47. Cambridge university press, 2018.
- Martin J Wainwright. High-dimensional statistics: A non-asymptotic viewpoint, volume 48. Cambridge university press, 2019.