Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
143 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Samplet basis pursuit: Multiresolution scattered data approximation with sparsity constraints (2306.10180v4)

Published 16 Jun 2023 in stat.ML, cs.LG, cs.NA, and math.NA

Abstract: We consider scattered data approximation in samplet coordinates with $\ell_1$-regularization. The application of an $\ell_1$-regularization term enforces sparsity of the coefficients with respect to the samplet basis. Samplets are wavelet-type signed measures, which are tailored to scattered data. Therefore, samplets enable the use of well-established multiresolution techniques on general scattered data sets. They provide similar properties as wavelets in terms of localization, multiresolution analysis, and data compression. By using the Riesz isometry, we embed samplets into reproducing kernel Hilbert spaces and discuss the properties of the resulting functions. We argue that the class of signals that are sparse with respect to the embedded samplet basis is considerably larger than the class of signals that are sparse with respect to the basis of kernel translates. Vice versa, every signal that is a linear combination of only a few kernel translates is sparse in samplet coordinates. We propose the rapid solution of the problem under consideration by combining soft-shrinkage with the semi-smooth Newton method. Leveraging on the sparse representation of kernel matrices in samplet coordinates, this approach converges faster than the fast iterative shrinkage thresholding algorithm and is feasible for large-scale data. Numerical benchmarks are presented and demonstrate the superiority of the multiresolution approach over the single-scale approach. As large-scale applications, the surface reconstruction from scattered data and the reconstruction of scattered temperature data using a dictionary of multiple kernels are considered.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. A. Beck and M. Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci., 2(1):183–202, 2009.
  2. On convergence rates for the iteratively regularized gauss-newton method. IMA J. Numer. Anal., 17(3):421–436, 1997.
  3. Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn., 3(1):1–122, 2010.
  4. Stable signal recovery from incomplete and inaccurate measurements. Comm. Pure Appl. Math., 59(8):1207–1223, 2006.
  5. Curvelets: A surprisingly effective nonadaptive representation for objects with edges. In A. Cohen, C. Rabut, and L. Schumaker, editors, Curves and Surface Fitting: Saint-Malo 1999, page 105–120, Nashville, 2000. Vanderbilt University Press.
  6. Reconstruction and representation of 3D objects with radial basis functions. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, SIGGRAPH ’01, pages 67–76, New York, 2001. Association for Computing Machinery.
  7. S. Chen and D.L. Donoho. Basis pursuit. In Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers, volume 1, pages 41–44, Pacific Grove, CA, USA, 1994. IEEE.
  8. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput., 20(1):33–61, 1998.
  9. Smoothing methods and semismooth methods for nondifferentiable operator equations. SIAM J. Numer. Anal., 38(4):1200–1216, 2000.
  10. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Comm. Pure Appl. Math., 57:1413–1457, 2004.
  11. M.N. Do and M. Vetterli. The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans. Image Proc., 14:2091–2106, 2005.
  12. D.L. Donoho. Compressed sensing. IEEE Trans. Inf. Theory, 52(4):1289–1306, 2006.
  13. G.E. Fasshauer. Meshfree approximation methods with MATLAB. World Scientific, River Edge, 2007.
  14. S. Foucart and H. Rauhut. A Mathematical Introduction to Compressive Sensing. Applied and Numerical Harmonic Analysis. Birkhäuser, New York, 2013.
  15. R. Griesse and D.A. Lorenz. A semismooth Newton method for Tikhonov functionals with sparsity constraints. Inverse Problems, 24(3):035007, 2008.
  16. Kernel basis pursuit. In J. Gama, R. Camacho, P. B. Brazdil, A. M. Jorge, and L. Torgo, editors, Machine Learning: ECML 2005, pages 146–157, Berlin, Heidelberg, 2005. Springer.
  17. K. Guo and D. Labate. Optimally sparse multidimensional representation using shearlets. SIAM J. Math. Anal., 39(1):298–318, 2007.
  18. Wavelet Galerkin BEM on unstructured meshes. Comput. Vis. Sci., 8(3–4):189–199, 2005.
  19. H. Harbrecht and M. Multerer. Samplets: Construction and scattered data compression. J. Comput. Phys., 471:111616, 2022.
  20. Multiresolution kernel matrix algebra. arXiv-Preprint, arXiv:2211.11681, 2022.
  21. The era5 global reanalysis. Q. J. R. Meteorol., 146(730):1999–2049, 2020.
  22. The primal-dual active set strategy as a semismooth Newton method. SIAM J. Optim., 13:865–888, 2003.
  23. An Introduction to Statistical Learning. Springer Texts in Statistics. Springer, New York, 2013.
  24. H. König. Eigenvalue distribution of compact operators, volume 16 of Operator Theory: Advances and Applications. Birkhäuser, Basel, 1986.
  25. D.A. Lorenz. Convergence rates and source conditions for tikhonov regularization with sparsity constraints. J. Inverse Ill-Posed Probl., 16(5):463–478, 2008.
  26. Singularity detection and processing with wavelets. IEEE Trans. Inf. Theory, 38(2):617–643, 1992.
  27. S.G. Mallat and Z. Zhang. Matching pursuits with time-frequency dictionaries. IEEE Trans. Sign. Proc., 41(12):3397–3415, 1993.
  28. R. Ramlau and G. Teschke. A Tikhonov-based projection iteration for nonlinear ill-posed problems with sparsity constraints. Numer. Math., 104(2):177–203, 2006.
  29. A.H. Robinson. A new map projection: Its development and characteristics. International yearbook of cartography, 14(1974):145–155, 1974.
  30. P. J. Schmid. Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech., 656:5–28, 2010.
  31. T. Tao and E.J. Candès. Near-optimal signal recovery from random projections: universal encoding strategies? IEEE Trans. Inf. Theory, 52(12):5406–5425, 2006.
  32. J. Tausch and J. White. Multiscale bases for the sparse representation of boundary integral operators on complex geometry. SIAM J. Sci. Comput., 24(5):1610–1629, 2003.
  33. J.A. Tropp. Greed is good: algorithmic results for sparse approximation. IEEE Trans. Inf. Theory, 50(10):2231–2242, 2004.
  34. H. Wendland. Scattered Data Approximation. Cambridge University Press, Cambridge, 2004.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com