Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Regularization with optimal space-time priors (2405.06337v1)

Published 10 May 2024 in math.NA and cs.NA

Abstract: We propose a variational regularization approach based on cylindrical shearlets to deal with dynamic imaging problems, with dynamic tomography as guiding example. The idea is that the mismatch term essentially integrates a sequence of separable, static problems, while the regularization term sees the non-stationary target as a spatio-temporal object. We motivate this approach by showing that cylindrical shearlets provide optimally sparse approximations for the class of cartoon-like videos, i.e., a class of functions useful to model spatio-temporal image sequences and videos, which we introduce extending the classic notion of cartoon-like images. To formulate our regularization model, we define cylindrical shearlet smoothness spaces, which is pivotal to obtain suitable embeddings in functional spaces. To complete our analysis, we prove that the proposed regularization strategy is well-defined, the solution of the minimisation problem exists and is unique (for $ p > 1$). Furthermore, we provide convergence rates (in terms of the symmetric Bregman distance) under deterministic and random noise conditions, and within the context of statistical inverse learning. We numerically validate our theoretical results using both simulated and measured dynamic tomography data, showing that our approach leads to a practical and robust reconstruction strategy.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (105)
  1. Joint reconstruction and low-rank decomposition for dynamic inverse problems. Inverse Problems and Imaging, 16(3):483–523, 2022.
  2. Optimal rates for regularization of statistical inverse learning problems. Foundations of Computational Mathematics, 18(4):971–1013, 2018.
  3. Inverse problems with inexact forward operator: iterative regularization and application in dynamic imaging. Inverse Problems, 36(12):124001, 2020.
  4. Variable metric inexact line-search-based methods for nonsmooth optimization. SIAM journal on optimization, 26(2):891–921, 2016.
  5. Frame decomposition of decomposition spaces. Journal of Fourier Analysis and Applications, 13(1):39–70, 2007.
  6. Dynamic image reconstruction with motion priors in application to 3D magnetic particle imaging. arXiv preprint arXiv:2306.11625, 2023.
  7. A nonsmooth regularization approach based on shearlets for Poisson noise removal in ROI tomography. Appl. Math. Comput., 318:131 – 152, 2018.
  8. Convex regularization in statistical inverse learning problems. Inverse Problems and Imaging, 17(6):1193–1225, 2023.
  9. Efficient representation of spatio-temporal data using cylindrical shearlets. Journal of Computational and Applied Mathematics, 429:115206, 2023.
  10. Sparse dynamic tomography: a shearlet-based approach for iodine perfusion in plant stems. Inverse Problems, 36(9):094002, 2020.
  11. randDynTomo, 2023. Accessed 21.11.2023.
  12. Shearlet-based regularization in statistical inverse learning with an application to X-ray tomography. Inverse Problems, 38(5):054001, 2022.
  13. A variational reconstruction method for undersampled dynamic x-ray tomography based on physical motion models. Inverse Problems, 33(12):124008, 2017.
  14. Large noise in variational regularization. Transactions of Mathematics and its Applications, 2(1):tny002, 2018.
  15. Convergence rates of convex variational regularization. Inverse problems, 20(5):1411, 2004.
  16. Error estimation for Bregman iterations and inverse scale space methods in image restoration. Computing, 81:109–135, 2007.
  17. Curvelets and reconstruction of images from noisy Radon data. In Proc. SPIE 4119, Wavelet applications in signal and image processing VIII, volume 4119, pages 108–118, 2000.
  18. The reconstruction formula for Banach frames and duality. Journal of Approximation Theory, 163(5):640–651, 2011.
  19. Frames for Banach spaces. Contemporary Mathematics, 247:149–182, 1999.
  20. Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage. IEEE Transactions on Image Processing, 7(3):319–335, 1998.
  21. A new variational model for joint image reconstruction and motion estimation in spatiotemporal imaging. SIAM Journal on Imaging Sciences, 12(4):1686–1719, 2019.
  22. Efficient registration of nonrigid 3-d bodies. IEEE transactions on image processing, 21(1):262–272, 2011.
  23. A limited-angle CT reconstruction method based on anisotropic TV minimization. Phys. Med. Biol., 58:2119–41, 2013.
  24. Radon transform inversion using the shearlet representation. Appl. Comput. Harmon. A., 29(2):232 – 250, 2010.
  25. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Communication on Pure and Applied Mathematics, 57:1413–1457, 2004.
  26. Compensation of some time dependent deformations in tomography. IEEE transactions on medical imaging, 26(2):261–269, 2007.
  27. Ronald A DeVore. Nonlinear approximation. Acta numerica, 7:51–150, 1998.
  28. David Leigh Donoho. Sparse components of images and optimal atomic decompositions. Constructive Approximation, 17(3):353–382, 2001.
  29. 3d_cylind_shear – 3d Cylindrical Shearlet transform for Matlab, 2023. Accessed 21.11.2023.
  30. Optimally sparse representations of cartoon-like cylindrical data. The Journal of Geometric Analysis, 31(9):8926–8946, 2021.
  31. Regularization of inverse problems, volume 375. Springer Science & Business Media, 1996.
  32. Dynamic and clinical PET data reconstruction: A nonparametric Bayesian approach. In 2013 IEEE International Conference on Image Processing, pages 345–349. IEEE, 2013.
  33. Hans G. Feichtinger. Banach spaces of distributions defined by decomposition methods, II. Mathematische Nachrichten, 132(1):207–237, 1987.
  34. Banach spaces of distributions defined by decomposition methods, I. Mathematische Nachrichten, 123(1):97–120, 1985.
  35. J. Frikel. Sparse regularization in limited angle tomography. Applied and Computational Harmonic Analysis, 34(1):117–141, January 2013.
  36. Robust principal component analysis-based four-dimensional computed tomography. Physics in Medicine & Biology, 56(11):3181, 2011.
  37. Robust and stable region-of-interest tomographic reconstruction using a robust width prior. Inverse Problems and Imaging, 14(2):291–316, 2020.
  38. A complementary ℓ1superscriptℓ1\ell^{1}roman_ℓ start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT-TV reconstruction algorithm for limited data CT. arXiv preprint arXiv:2304.11599, 2023.
  39. Markus Grasmair. Linear convergence rates for Tikhonov regularization with positively homogeneous functionals. Inverse Problems, 27(075014), 2011.
  40. Sparse regularization with ℓqsuperscriptℓ𝑞\ell^{q}roman_ℓ start_POSTSUPERSCRIPT italic_q end_POSTSUPERSCRIPT penalty term. Inverse Problems, 24(5):055020, 2008.
  41. Necessary and sufficient conditions for linear convergence of ℓ1superscriptℓ1\ell^{1}roman_ℓ start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT-regularization. Communications on Pure and Applied Mathematics, 64(2):161–182, 2011.
  42. Tomographic reconstruction of dynamic cardiac image sequences. IEEE transactions on image processing, 16(4):932–942, 2007.
  43. K. Guo and D. Labate. Optimal recovery of 3D X-ray tomographic data via shearlet decomposition. Adv. Comput. Math., 39(2):227–255, 2013.
  44. Optimally sparse 3D approximations using shearlet representations. Electronic Research Announcements, 17:125, 2010.
  45. Optimally Sparse Representations of 3D Data with C2superscript𝐶2C^{2}italic_C start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT Surface Singularities Using Parseval Frames of Shearlets. SIAM Journal on Mathematical Analysis, 44(2):851–886, 2012.
  46. Bernadette N. Hahn. Motion estimation and compensation strategies in dynamic computerized tomography. Sensing and Imaging, 18:1–20, 2017.
  47. Undersampled dynamic X-ray tomography with dimension reduction Kalman filter. IEEE Transactions on Computational Imaging, 5(3):492–501, 2019.
  48. Markus Haltmeier. Stable signal reconstruction via ℓ1superscriptℓ1\ell^{1}roman_ℓ start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT-minimization in redundant, non-tight frames. IEEE transactions on signal processing, 61(2):420–426, 2012.
  49. Sparse Tomography. SIAM J. Sci. Comput., 35(3):B644–B665, 2013.
  50. A review on fast tomographic imaging techniques and their potential application in industrial process control. Sensors, 22(6):2309, 2022.
  51. Image reconstruction in dynamic inverse problems with temporal models. Handbook of Mathematical Models and Algorithms in Computer Vision and Imaging: Mathematical Imaging and Vision, pages 1–31, 2021.
  52. Tommi Heikkilä. STEMPO–dynamic X-ray tomography phantom. arXiv preprint arXiv:2209.12471, 2022.
  53. Tommi Heikkilä. STEMPO - dynamic X-ray tomography phantom, 2023. v1.2.0 [data set].
  54. Optimal convergence rates for sparsity promoting wavelet-regularization in Besov spaces. Inverse Problems, 35(6):065005, 2019.
  55. Motion-compensated iterative cone-beam CT image reconstruction with adapted blobs as basis functions. Physics in Medicine & Biology, 53(23):6777, 2008.
  56. GPU-based iterative cone-beam CT reconstruction using tight frame regularization. Phys. Med. Biol., 56:3787–807, 2011.
  57. How little data is enough? Phase-diagram analysis of sparsity-regularized X-ray computed tomography. Phil. Trans. R. Soc. A, 373:20140387, 2015.
  58. Single-shot tomography of discrete dynamic objects. arXiv preprint arXiv:2311.05269, 2023.
  59. Analysis of regularized inversion of data corrupted by white Gaussian noise. Inverse problems, 30(4):045009, 2014.
  60. Wavelet methods for a weighted sparsity penalty for region of interest tomography. Inverse Probl., 31(2):025001, 2015.
  61. Shearlets: multiscale analysis for multivariate data. Birkhauser, Applied and Numerical Harmonic Analysis, 2012.
  62. Shearlet smoothness spaces. Journal of Fourier Analysis and Applications, 19(3):577–611, 2013.
  63. Spatiotemporal Besov Priors for Bayesian Inverse Problems. arXiv preprint arXiv:2306.16378, 2023.
  64. Rethinking medical image reconstruction via shape prior, going deeper and faster: Deep joint indirect registration and reconstruction. Medical Image Analysis, 68:101930, 2021.
  65. Adaptive-weighted total variation minimization for sparse data toward low-dose X-ray computed tomography image reconstruction. Phys. Med. Biol., 57:7923–56, 2012.
  66. Dirk A. Lorenz. Convergence rates and source conditions for Tikhonov regularization with sparsity constraints. Journal of Inverse and Ill-posed Problems, 16, 2008.
  67. Tomographic inversion using ℓ1superscriptℓ1\ell^{1}roman_ℓ start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT-norm regularization of wavelet coefficients. Geophys. J. Int., 170(1):359–370, 2007.
  68. Tomographic motion detection and correction directly in sinogram space. Physics in Medicine & Biology, 47(8):1267, 2002.
  69. On learned operator correction in inverse problems. SIAM Journal on Imaging Sciences, 14(1):92–127, 2021.
  70. Peyman Milanfar. A model of the effect of image motion in the Radon transform domain. IEEE Transactions on Image processing, 8(9):1276–1281, 1999.
  71. Maximal spaces for approximation rates in ℓ1subscriptℓ1\ell_{1}roman_ℓ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT-regularization. Numerische Mathematik, 149(2):341–374, 2021.
  72. Wavelet Toolbox. Release 2022a, original release in 1997. MathWorks inc.
  73. The impact of temporal inaccuracies on 4DCT image quality. Medical physics, 34(5):1615–1622, 2007.
  74. Improving dynamic tomography, through maximum a posteriori estimation. In Developments in X-Ray Tomography IX, volume 9212, pages 270–278. SPIE, 2014.
  75. Mathematical methods in image reconstruction. SIAM, 2001.
  76. Dynamic multi-source X-ray tomography using a spacetime level set method. Journal of Computational Physics, 291:218–237, 2015.
  77. Bayesian multiresolution method for local tomography in dental X-ray imaging. Phys. Med. Biol., 52:6663–6678, 2007.
  78. A new view into prokaryotic cell biology from electron cryotomography. Nature Reviews Microbiology, 14(4):205–220, 2016.
  79. Low-rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of background and dynamic components. Magnetic resonance in medicine, 73(3):1125–1136, 2015.
  80. Core Imaging Library-Part II: multichannel reconstruction for dynamic and spectral tomography. Philosophical Transactions of the Royal Society A, 379(2204):20200193, 2021.
  81. A computational framework for edge-preserving regularization in dynamic inverse problems. Electronic Transactions on Numerical Analysis, 58:486–516, 2023.
  82. Controlled wavelet domain sparsity for x-ray tomography. Measurement Science and Technology, 29(1):014002, 2017.
  83. Wavelet-based reconstruction for limited-angle X-ray tomography. IEEE transactions on medical imaging, 25(2):210–217, 2006.
  84. Limited-data x-ray CT for underwater pipeline inspection. Inverse Probl., 34(3):034002, 2018.
  85. Predictive respiratory gating: a new method to reduce motion artifacts on CT scans. Radiology, 190(3):847–852, 1994.
  86. Four dimensional material movies: High speed phase-contrast tomography by backprojection along dynamically curved paths. Scientific reports, 7(1):6487, 2017.
  87. Sparse-view x-ray CT reconstruction via total generalized variation regularization. Phys. Med. Biol., 59:2997–3017, 2014.
  88. Efficient algorithms for the regularization of dynamic inverse problems: II. Applications. Inverse Problems, 18(3):659, 2002.
  89. Dynamic Cell Imaging in PET With Optimal Transport Regularization. IEEE Transactions on Medical Imaging, 39(5):1626–1635, 2020.
  90. Dynamic inverse problems: modelling – regularization – numerics. Inverse Problems, 34(040301):1–4, 2018.
  91. Regularization methods in Banach spaces, volume 10. Walter de Gruyter, 2012.
  92. Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT. J. X-Ray Sci. Technol., 14:119–139, 2006.
  93. E. Y. Sidky and X. Pan. Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization. Phys. Med. Biol., 53:4777–807, 2008.
  94. Support vector machines. Springer Science & Business Media, 2008.
  95. Tensor-based dictionary learning for dynamic tomographic reconstruction. Physics in Medicine & Biology, 60(7):2803, 2015.
  96. Low-dose CT reconstruction via edge-preserving total variation regularization. Phys. Med. Biol., 56:5949–67, 2011.
  97. Fast and flexible X-ray tomography using the ASTRA toolbox. Optics express, 24(22):25129–25147, 2016.
  98. The ASTRA toolbox: A platform for advanced algorithm development in electron tomography. Ultramicroscopy, 157:35–47, 2015.
  99. Combined motion estimation and reconstruction in tomography. In Computer Vision–ECCV 2012. Workshops and Demonstrations: Florence, Italy, October 7-13, 2012, Proceedings, Part I 12, pages 12–21. Springer, 2012.
  100. Iterative CT reconstruction using shearlet-based regularization. IEEE Transactions on Nuclear Science, 60(5):3305–3317, 2013.
  101. Roman Vershynin. High-dimensional probability: An introduction with applications in data science, volume 47. Cambridge university press, 2018.
  102. In vivo time-resolved microtomography reveals the mechanics of the blowfly flight motor. PLoS biology, 12(3):e1001823, 2014.
  103. Fast spatiotemporal image reconstruction based on low-rank matrix estimation for dynamic photoacoustic computed tomography. Journal of biomedical optics, 19(5):056007–056007, 2014.
  104. Optimal convergence rates for Tikhonov regularization in Besov spaces. SIAM Journal on Numerical Analysis, 58(1):21–47, 2020.
  105. Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces. Journal of Mathematical Analysis and Applications, 157(1):189–210, 1991.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com