Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

New Convergence Analysis of GMRES with Weighted Norms, Preconditioning and Deflation, Leading to a New Deflation Space (2312.13625v2)

Published 21 Dec 2023 in math.NA and cs.NA

Abstract: New convergence bounds are presented for weighted, preconditioned, and deflated GMRES for the solution of large, sparse, non-Hermitian linear systems. These bounds are given for the case when the Hermitian part of the coefficient matrix is positive definite, the preconditioner is Hermitian positive definite, and the weight is equal to the preconditioner. The new bounds are a novel contribution in and of themselves. In addition, they are sufficiently explicit to indicate how to choose the preconditioner and the deflation space to accelerate the convergence. One such choice of deflating space is presented, and numerical experiments illustrate the effectiveness of such space.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. A shift-splitting preconditioner for non-Hermitian positive definite matrices. J. Comput. Math., 24:539–552, 2006.
  2. M. Benzi. Preconditioning techniques for large linear systems: A survey. J. Comp. Phys., 182:418–477, 2002.
  3. GMRES on (nearly) singular systems. SIAM J. Matrix Anal. Appl., 18:37–51, 1997.
  4. A deflation technique for linear systems of equations. SIAM J. Sci. Comput., 19:1245–1260, 1998.
  5. Preserving symmetry in preconditioned Krylov subspace methods. SIAM J. Sci. Comput., 20:568–581, 1999.
  6. A. Chapman and Y. Saad. Deflated and augmented Krylov subspace techniques. Numer. Linear Algebra Appl., 4:43–66, 1997.
  7. P. Concus and G. H. Golub. A generalized conjugate gradient method for nonsymmetric systems of linear equations. In R. Glowinski and J.-L. Lions, editors, Computing methods in applied sciences and engineering (Second Internat. Sympos., Versailles, 1975), Part 1, volume 134 of Lecture Notes in Econom. and Math. Systems, pages 56–65. Springer, Berlin, 1976.
  8. Weighted inner products for GMRES and GMRES-DR. SIAM J. Sci. Comput., 39:S610–S632, 2017.
  9. Y. A. Erlangga and R. Nabben. Deflation and balancing preconditioners for Krylov subspace methods applied to nonsymmetric matrices. SIAM J. Matrix Anal. Appl., 30:684–699, 2008.
  10. A. Essai. Weighted FOM and GMRES for solving nonsymmetric linear systems. Numer. Algorithms, 18:277–292, 1998.
  11. Projections, deflation, and multigrid for nonsymmetric matrices. SIAM J. Matrix Anal. Appl., 41:83–105, 2020.
  12. A framework for deflated and augmented Krylov subspace methods. SIAM J. Matrix Anal. Appl., 34:495–518, 2013.
  13. On non-Hermitian positive (semi)definite linear algebraic systems arising from dissipative Hamiltonian DAEs. SIAM J. Sci. Computing, 44:A2871–A2894, 2022.
  14. S. Güttel and J. Pestana. Some observations on weighted GMRES. Numer. Algorithms, 67:733–752, 2014.
  15. K. Hayami and M. Sugihara. A geometric view of Krylov subspace methods on singular systems. Numer. Linear Algebra Appl., 18:449–469, 2011.
  16. F. Hecht. New development in FreeFem++. J. Numer. Math., 20(3-4):251–265, 2012.
  17. Matrix Analysis. Cambridge University Press, Cambridge, 1985.
  18. Y. Saad. Iterative methods for sparse linear systems. Philadelphia, PA: SIAM Society for Industrial and Applied Mathematics, 2nd ed. edition, 2003.
  19. Y. Saad and M. H. Schultz. GMRES: A generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Stat. Comput., 7:856–869, 1986.
  20. V. Simoncini and D. B. Szyld. Recent computational developments in Krylov subspace methods for linear systems. Numer. Linear Algebra Appl., 14:1–59, 2007.
  21. N. Spillane. Robust domain decomposition methods for symmetric positive definite problems. PhD thesis, UPMC, 2014.
  22. N. Spillane. Hermitian preconditioning for a class of non-Hermitian linear systems, 2023. Available at the arXiv:2304.03546, and also at https://hal.science/hal-04028590. To appear in SIAM J. Sci. Stat. Comput.
  23. A robust two-level domain decomposition preconditioner for systems of PDEs. C. R. Math. Acad. Sci. Paris, 349(23-24):1255–1259, 2011.
  24. Abstract robust coarse spaces for systems of PDEs via generalized eigenproblems in the overlaps. Numer. Math., 126(4):741–770, 2014.
  25. G. Starke. Field-of-values analysis of preconditioned iterative methods for nonsymmetric elliptic problems. Numer. Math., 78:103–117, 1997.
  26. Variational analysis of some conjugate gradient methods. East-West J. Numer. Math., 1:51–74, 1993.
  27. Comparison of two-level preconditioners derived from deflation, domain decomposition and multigrid methods. J. Sci. Comput., 39:340–370, 2009.
  28. O. Widlund. A Lanczos method for a class of nonsymmetric systems of linear equations. SIAM J. Numer. Anal., 15:801–812, 1978.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now