Arrowhead-Matrix Method Overview
- Arrowhead-Matrix Method is defined by matrices with off-diagonal entries confined to one row and column, enabling structure exploitation analogous to a star graph.
- It leverages explicit sparse decompositions, such as factor-width-2 certificates and shift-and-invert eigensolvers, to achieve O(n) computations for determinants, inverses, and eigenvalue problems.
- Its applications span numerical linear algebra, high-performance computing, matrix completion, and theoretical analyses, offering practical insights for efficient sparse approximations and distributed solvers.
Searching arXiv for recent and foundational papers on arrowhead matrices and related methods. “Arrowhead-Matrix Method” denotes a family of structure-exploiting techniques built around matrices whose off-diagonal entries are confined to one distinguished row and column, or around closely related generalizations such as diagonal-plus-rank-one and block-tridiagonal-arrowhead forms. In the positive-semidefinite setting, the method can mean an explicit rank-one sparse decomposition on principal submatrices; in numerical linear algebra, it can mean shift-and-invert eigensolvers, determinant and inverse formulas, sparse approximation from matrix-vector products, or distributed Schur-complement decompositions that preserve arrowhead structure. A particularly explicit formulation appears for positive semidefinite arrowhead matrices in “The Factor Width Rank of a Matrix,” where every such matrix has factor width at most $2$ and satisfies for all (Johnston et al., 2024).
1. Definition and structural setting
An arrowhead matrix is one satisfying
Equivalently, all off-diagonal entries are confined to the first row and first column. In block form,
where , , and 0 is diagonal. For positive semidefinite arrowhead matrices, 1, 2, and the Schur-complement inequality imposes the relation
3
when all 4 (Johnston et al., 2024).
This zero pattern is naturally identified with a star graph. That viewpoint is important because several results in the literature interpret arrowhead matrices as sparse objects whose nonzeros are concentrated on edgewise 5 principal blocks involving a hub index. A broader but closely related setting includes matrices of the form
6
over 7, diagonal-plus-rank-one matrices
8
and block-tridiagonal-arrowhead matrices used in selected inversion and interior-point methods (Stor et al., 2022).
The term is also used for generalizations in which a small dense head is combined with a narrow band. In “Arrow Matrix Decomposition,” a matrix has arrow-width 9 if all nonzeros are confined to the first $2$0 rows, the first $2$1 columns, and a diagonal band of width $2$2; ordinary arrowhead matrices are the special case $2$3 (Gianinazzi et al., 2024).
2. Positive-semidefinite decomposition and factor-width rank
For $2$4, factor width at most $2$5 means that
$2$6
for vectors $2$7, each having at most $2$8 nonzero entries. Equivalently, $2$9 can be written as a sum of positive semidefinite matrices each supported on a single 0 principal submatrix. The factor-width-1 rank is
2
One always has
3
For arrowhead matrices, Theorem 4.4 gives a complete characterization: if 4 is arrowhead, then 5 has factor width at most 6, and
7
The proof first removes zero diagonal entries, since for 8 any vanishing diagonal entry forces the corresponding row and column to be zero. It then uses the determinant identity
9
so that 0 is either 1 or 2 depending on whether the scalar residual at 3 is positive or zero (Johnston et al., 2024).
The constructive decomposition defines, for each 4, a vector 5 supported only on coordinates 6 and 7, with
8
Then
9
and
0
The final correction is rank one if nonzero, so the number of terms is exactly 1 or 2, matching the ordinary rank. This gives a direct factor-width-3 certificate, an explicit minimal sparse rank-one decomposition, and immediate computation of 4 from 5 (Johnston et al., 2024).
This behavior is exceptional. For arbitrary positive semidefinite matrices, factor-width rank can be much larger than ordinary rank; for example,
6
and for dense factor-width-7 matrices with no zero entries and 8,
9
Arrowhead matrices are therefore a favorable class in which factor width 0 does not cause combinatorial blowup in sparse rank-one decomposition (Johnston et al., 2024).
3. Numerical linear algebra: eigensolvers, determinants, and inverses
In numerical linear algebra, the Arrowhead-Matrix Method is closely associated with high-accuracy eigensolvers for real symmetric arrowhead matrices
1
and with structurally related diagonal-plus-rank-one matrices. The eigenvalues are zeros of the secular function
2
and the corresponding eigenvectors are
3
The shift-and-invert algorithm computes each eigenvalue separately by shifting at the nearest pole 4, forming 5, and recovering
6
where 7 is an extremal eigenvalue of 8. Higher precision may be needed only for one scalar entry 9 of 0, which is the numerically delicate quantity in the inverse representation (Stor et al., 2013).
This numerical philosophy extends to diagonal-plus-rank-one matrices
1
After shifting to the nearest pole and inverting, the inverse of the shifted matrix becomes a permuted arrowhead matrix,
2
so the desired eigenpair can be computed by the same arrowhead secular-equation machinery. The resulting algorithm computes each eigenvalue and all components of the corresponding eigenvector with high relative accuracy in 3 work per eigenpair and extends naturally to the Hermitian case (Stor et al., 2014).
A separate structured calculus gives unified 4 formulas for matvecs, determinants, and inverses of arrowhead and diagonal-plus-rank-one matrices over 5, 6, and 7. For
8
if all shaft entries 9, then
0
and
1
with
2
All formulas require 3 arithmetic operations and remain valid in the quaternionic setting provided multiplication order is preserved (Stor et al., 2022).
The same structured viewpoint also underlies a polynomial root-finding method for real polynomials with real distinct roots. By Fiedler’s theorem, such a polynomial can be realized as the characteristic polynomial of a real symmetric arrowhead matrix
4
with
5
The roots are then computed as eigenvalues of 6 by a modified arrowhead eigensolver in 7 total work, with double the working precision required only in the non-iterative construction phase and occasionally for one scalar in a shifted inverse (Stor et al., 2015).
4. Sparse approximation and communication-efficient multiplication
For implicit matrices accessible only through matrix-vector products, the arrowhead pattern appears as a distinguished sparse target family. The sparse approximation problem is to recover or approximate
8
for a prescribed sparsity mask 9, using right and left matvec queries with 0 and 1. The best approximation supported on 2 is characterized by
3
The complexity is governed by the degeneracy 4, defined as the smallest 5 such that iteratively deleting all rows and columns with at most 6 ones empties 7. The main result gives a polynomial-time algorithm using
8
non-adaptive matvec queries and a matching lower bound 9 (Musco et al., 10 Jun 2026).
For the standard 00 arrowhead mask,
01
one has
02
Hence exact recovery of an arrowhead-supported matrix needs only
03
matvecs, while near-optimal approximation needs
04
queries. This sharply improves generic bounds based on maximum row sparsity, total sparsity, or conflict-graph coloring, all of which are larger for the arrowhead pattern (Musco et al., 10 Jun 2026).
A different large-scale meaning of the method appears in sparse matrix–dense matrix multiplication. There, a sparse matrix is decomposed as
05
where each 06 has arrow-width at most 07. Multiplication becomes
08
When the decomposition is 09-compacting and 10 with 11, one iteration of distributed sparse matrix–dense matrix multiplication has communication cost
12
improving bandwidth by a factor 13 over fully replicated 1.5D methods under the stated assumptions (Gianinazzi et al., 2024).
5. Large-scale structured solvers and high-performance computing
In direct sparse factorizations, arrowhead structure is exploited by sTiles, a tiled Cholesky framework for symmetric positive definite sparse matrices whose nonzeros lie primarily in the last block row, the last block column, and along the block diagonal. The method combines heuristic reorderings, symbolic factorization, and a left-looking tiled Cholesky using POTRF, TRSM, SYRK, and GEMM kernels. The left-looking formulation enables tree reductions for update accumulations and is specifically motivated by the thin task graph of arrowhead matrices, where parallelism is limited by the structure. The framework reported speedups of up to 14, 15, 16, and 17 compared to CHOLMOD, SymPACK, MUMPS, and PARDISO, respectively, and a 18 speedup over a 32-core AMD EPYC CPU on an NVIDIA A100 GPU (Fattah et al., 5 Jan 2025).
For block-tridiagonal arrowhead matrices, selected inversion is developed in Serinv. A block-tridiagonal arrowhead matrix consists of a block-tridiagonal core plus an arrow tip block 19 and rectangular couplings 20, 21. The selected inversion computes only the inverse blocks on the original sparsity pattern: 22 After block Cholesky factorization 23, the backward recurrences are specialized to the arrowhead couplings; for example,
24
and
25
The distributed algorithm uses a partition-plus-reduced-system strategy; its sequential complexity is 26, the reduced system has 27 main blocks, and the library reports 28 strong-scaling efficiency, 29 weak-scaling efficiency, and up to two orders of magnitude speedup over PARDISO and MUMPS on 16 GPUs (Maillou et al., 21 Mar 2025).
A related but optimization-centered HPC use appears in PIPS-IPM++. For doubly-bordered block-diagonal linear programs, the interior-point Newton system can be written as
30
with Schur complement
31
The new contribution is a hierarchical Schur complement decomposition that exploits local border constraints, recursively partitions the inner systems, and isolates a dense layer associated with global links. This enables distributed solution of very large LPs, including instances with more than 32 nonzeros in the constraint matrix (Kempke et al., 2024). A complementary distributed presolve framework for arrowhead linear programs keeps the same block-arrowhead organization, classifies reductions as local or global, and preserves the structure required by the Schur-complement interior-point solve; on the reported benchmark set it outperformed PaPILO by a factor of 33 and Gurobi’s presolve by a factor of 34 in shifted geometric mean runtime on a single machine, and by a factor of 35 against Gurobi in a distributed environment (Kempke et al., 3 Mar 2026).
6. Broader theoretical extensions and domain-specific uses
Beyond decomposition and HPC, arrowhead structure supports exact analysis in several specialized settings. In random-matrix physics, the disordered single-excitation Tavis–Cummings Hamiltonian becomes an 36 arrowhead matrix with diagonal disorder and uniform cavity coupling. Its eigenvalues satisfy the secular equation
37
with interlacing
38
and eigenvectors
39
This exact arrowhead solution yields asymptotically exact formulas for polaritons, dark states, multifractal participation ratios, and cavity-protected transport (Dubail et al., 2021).
In model reduction, arrowhead realizations provide direct access to the sign parameters governing exactness of the balanced truncation error bound. For an arrowhead realization
40
the sign parameters satisfy, up to permutation,
41
If all signs in the truncated block are identical, then the balanced truncation and singular perturbation approximation error bounds are attained with equality: 42 Thus the arrowhead structure converts an abstract balanced-canonical invariant into an explicit entrywise sign test (Reiter et al., 2020).
In matrix completion, a width-one arrowhead specification pattern supports new sufficient conditions for set-completely positive completion. The main theorem concerns partial matrices
43
and shows that under boundedness, extreme-point, and linear consistency conditions, every such partial matrix in
44
is completable to
45
The method derives completion from exactness of a sparse conic relaxation rather than from graph-theoretic completion theory alone (Gabl, 17 Sep 2025).
A different algebraic use appears in exact rank-one matrix completion via sum-of-squares relaxations. There the coefficient matrix 46 in the objective is chosen to be arrowhead,
47
so that the associated Gram matrix has rank 48. The one-dimensional nullspace then isolates the true monomial vector and yields exact completion, including cases where connectivity is hidden in linear combinations of constraints (Azuma et al., 2023).
Finally, arrowhead matrices also admit geometric analysis through numerical range. For
49
the Gau–Wu number can be computed for broad classes by rotating so that the real part becomes diagonal and the imaginary part remains Hermitian arrowhead. If
50
for all 51 with 52, then 53 equals the sum of multiplicities of the largest and smallest eigenvalues of
54
The same structural machinery yields a characterization of dichotomous arrowhead matrices and a criterion for their unitary irreducibility (Camenga et al., 2021).
The cumulative picture is that arrowhead structure is valuable precisely because it collapses dense global behavior into a small border, a rank-one perturbation, or a star-graph interaction. This suggests a unifying interpretation: whenever the nonzero pattern can be localized to one hub row and column, or to a small arrowhead generalization, exact formulas, sparse decompositions, or recursive eliminations often become available in closed form or with sharply reduced complexity.