--- title: Tensor Train Variety Overview url: https://www.emergentmind.com/topics/tensor-train-variety type: topic --- # Tensor Train Variety Overview A tensor train variety is a projective algebraic variety parametrizing all tensors admitting a fixed TT-rank structure: a decomposition into contracted core tensors along a chain, with rank constraints encoded via matrix unfoldings. Originating as the geometric underpinning of the TT-format for high-dimensional tensor analysis and quantum many-body applications (matrix product states), the TT-variety gives a precise description not only of the manifold of TT-decomposable tensors but also of the singularities, tangent cones, ideal generators, and dimension. Fundamental algebraic-geometric and geometric-invariant-theory techniques yield both structure theorems and algorithms for energy minimization, completion, and feasibility within this variety [2512.06939][2402.12182][2306.13360][1701.08437][2101.03148][2309.15170][2110.15479]. ## 1. Algebraic-Geometric Definition and Characterization Given mode sizes $k_1,\dots,k_d$ and a TT-rank vector $\mathbf{r} = (r_1,\dots,r_{d-1})$, a tensor $T \in \mathbb{C}^{k_1 \times \cdots \times k_d}$ admits a TT-decomposition via core tensors $G^{(1)},\dots,G^{(d)}$, where $$ G^{(1)} \in \mathbb{C}^{k_1 \times r_1}, \;\; G^{(2)} \in \mathbb{C}^{r_1 \times k_2 \times r_2}, \ldots, G^{(d)} \in \mathbb{C}^{r_{d-1} \times k_d}. $$ The contraction yields $T$ by summing over the internal "bond" indices. The TT-variety $V$ is the Zariski closure of the image of the rational map $$ (G^{(1)},\dots,G^{(d)}) \mapsto T, $$ yielding $V = V_{(k_1,\ldots,k_d), (r_1,\ldots,r_{d-1})} \subset \mathbb{P}(\mathbb{C}^{k_1} \otimes \cdots \otimes \mathbb{C}^{k_d})$ [2512.06939]. Equivalently, $T \in V$ iff all matricizations $T^{(i)} \in \mathbb{C}^{(k_1 \cdots k_i) \times (k_{i+1} \cdots k_d)}$ satisfy $\operatorname{rank}(T^{(i)}) \leq r_i$ for $i=1,\ldots,d-1$. Set-theoretically, $V$ is defined by vanishing of all $(r_i+1) \times (r_i+1)$ minors of $T^{(i)}$. Conjecturally, these minors generate the full ideal and form a Gröbner basis for an appropriate order (Conjecture 2.9 in [2512.06939]). For special cases (binary tensors, Segre), reduced Gröbner bases are established. ## 2. Dimension Theory and Stratification The dimension of the TT-variety is furnished by parameter counting in the cores, subtracting gauge freedoms: $$ \dim V = \sum_{i=1}^{d} r_{i-1} k_i r_i - \sum_{i=1}^{d-1} r_i^2 $$ with $r_0 = r_d = 1$ [2101.03148][2402.12182]. This coincides with the general upper bound for tensor network varieties (path graphs), proven to be sharp in the supercritical regime, where $r_{i-1} r_i \leq k_i$ for all $i$ [2101.03148]. The TT-variety admits a stratification: the smooth stratum with fixed TT-rank is a manifold of this dimension, while the full variety is the Zariski closure over lower ranks, with singularities manifesting when multiple ranks drop simultaneously [2402.12182]. ## 3. Segre Product Cases and Birational Parametrization For uniform bond dimensions $r_i = 1$, the TT-variety reduces to the Segre embedding $\mathbb{P}^{k_1-1} \times \cdots \times \mathbb{P}^{k_d-1} \to \mathbb{P}^{k_1 \cdots k_d - 1}$ [2512.06939][2110.15479]. More generally, if nontrivial ranks are "separated blocks" (no two adjacent $r_i > 1$), and certain saturation bounds hold, Segre-type factorization arises (Theorem 2.7 in [2512.06939]). On the dense open locus where each unfolding $T^{(i)}$ has maximal rank $r_i$, the TT-variety is birational to a product of Grassmannians, via recursive skeleton decompositions (Theorem 3.3 in [2512.06939]): $$ \prod_{i=1}^{d-1} \mathrm{Gr}(r_i, r_{i-1} k_i) \times \mathbb{C}^{r_{d-1} \times k_d} \dashrightarrow V. $$ This birationality also underpins dimension counts and establishes irreducibility. ## 4. Tangent Cones, Singular Locus, and Rank Estimation At boundary points (where some TT-ranks are strictly less than their upper limits), the tangent cone of $V$ admits an explicit block-TT parametrization [2306.13360][2402.12182][2309.15170]: - The tangent space to the fixed-rank manifold corresponds to variations within current ranks ("top-left block"). - Additional blocks describe normal directions that enable rank increase, key to rank-adaptive optimization. Approximate projection algorithms onto the tangent cone, satisfying rigorous angle conditions, facilitate gradient-based methods on $V$, with improved constants compared to earlier variants [2306.13360]. Rank-adaptive solvers exploit this structure to increase or decrease TT-rank efficiently during tensor completion and approximation problems, guided by singular-value gaps in the block unfoldings of the gradient [2309.15170]. TT-rounding is proven to act as an $\omega$-approximate projection (Theorem 4.2 in [2402.12182]), crucial for stability in adaptive algorithms. ## 5. Feasibility of TT-Singular Tuples and Quantum Marginal Connection The TT-format gives rise to the tensor feasibility problem (TFP): determining which sets of singular-value tuples are admissible for a TT decomposition [1701.08437]. This problem is equivalent to the quantum marginal problem (QMP), where the spectra of reduced density matrices for pure states in multipartite quantum systems are prescribed. Feasibility of TT-singular values is characterized via polyhedral cones specified by Horn-type inequalities, trace constraints, and an intertwining with Knutson–Tao honeycomb objects. Linear programming algorithms and hive-based heuristics are available for feasibility testing and explicit core construction [1701.08437]. ## 6. Orthogonal Tensor Trains: Algebraic Structure and Comparison A subclass, orthogonal tensor train varieties, arise by restricting core tensors to orthogonally decomposable forms [2110.15479]. The length-2 orthogonal TT variety is cut out by mode-pair symmetry, two families of quadratic contraction symmetry equations, and a single global degree-$n$ determinantal constraint. For $n=2$, these equations form a prime ideal, matching the predicted variety dimension. Contrasted with general TT-varieties (whose defining relations can be highly nontrivial and include higher-degree determinantal constraints across unfoldings), the orthogonal case admits more tractable, compact algebraic descriptions. ## 7. Applications and Numerical Algebraic Geometry TT-varieties underpin state-of-the-art high-dimensional numerical methods, including: - Energy minimization through Rayleigh quotient optimization over TT-varieties, with all critical points enumerated by Rayleigh–Ritz degree using homotopy continuation [2512.06939]. - Benchmarking against Alternating Linear Scheme and Density Matrix Renormalization Group protocols for quantum chemistry computations [2512.06939]. - Rank-adaptive tensor completion and approximation, leveraging stratification, tangent cone parametrization, and rank estimation to avoid overfitting and ensure computational efficiency [2402.12182][2309.15170][2306.13360]. Ongoing work explores explicit degree formulas, Gröbner basis generation, and further geometric criteria for singular locus and variety stratification. --- **Table: Core Structural Properties of TT-Varieties** | Property | TT-Variety | Segre Product Special Case | |---------------------------------|------------------------------------------------------------------|---------------------------------------------| | Defining equations | $(r_i+1)\times(r_i+1)$ minors of each unfolding | Simple monomial equations | | Dimension (generic) | $\sum_{i=1}^d r_{i-1}k_i r_i - \sum_{i=1}^{d-1} r_i^2$ | $\sum_{i=1}^d k_i - d$ | | Birational parametrization | Product of Grassmannians $\prod \mathrm{Gr}(r_i, r_{i-1}k_i)$ | Identity map on product of projective spaces| | Singular locus | Drop in rank in any flattening | Absent if $r_i=1$ | Further technical details, including explicit algorithmic pseudocode, advanced horn inequalities, and quantum marginal reductions, can be found in [2512.06939], [2101.03148], [1701.08437], [2402.12182], and [2309.15170]. Source: https://www.emergentmind.com/topics/tensor-train-variety