Papers
Topics
Authors
Recent
Search
2000 character limit reached

Fanions: Flagged Schur & Matrix Updates

Updated 17 December 2025
  • Fanions are a dual-use concept: in algebraic combinatorics they denote flagged Schur functions, and in optimization they refer to matrix update methods using Ky Fan norms.
  • In combinatorics, flagged Schur functions are defined through tableau constraints and are enumerated by parabolic Catalan numbers, linking them to Demazure characters and convex polytopes.
  • In optimization, Fanion algorithms interpolate between low-rank and full-rank updates, providing robust performance improvements in tasks such as LLM training and linear regression.

Fanions are a concept appearing in several specialized mathematical contexts. In algebraic combinatorics, "fanion" denotes flagged Schur functions, which provide a refined class of symmetric polynomials with explicit combinatorial and representation-theoretic significance. In modern optimization for large-scale learning, "Fanions" refer to a parameterized family of matrix update algorithms that interpolate between low-rank and full-rank steps using Ky Fan norms and their convex combinations. Both usages are rooted in deep mathematical structures and have concrete theoretical and algorithmic impact.

1. Flagged Schur Functions: Definition and Tableau Structure

Let n1n\ge1 be an integer and let λ=(λ1λ2λn0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0) be a partition with at most nn parts. For such λ\lambda, a "flag" is an nn-tuple φ=(φ1,,φn)\varphi=(\varphi_1,\dots,\varphi_n) satisfying 1φ1φnn1\le\varphi_1\le \dots \le\varphi_n\le n. The set Tλ\mathcal T_\lambda comprises semistandard Young tableaux of shape λ\lambda with entries in [n][n]—weakly increasing across rows, strictly increasing down columns.

For TTλT\in\mathcal T_\lambda, let Θ(T)=(θ1,,θn)\Theta(T)=(\theta_1,\dots,\theta_n) with θi\theta_i the multiplicity of entry ii in TT, so xΘ(T)=x1θ1xnθnx^{\Theta(T)} = x_1^{\theta_1}\cdots x_n^{\theta_n}. The flagged Schur function indexed by (λ,φ)(\lambda,\varphi) is

sλ(φ;x)=TSλ(φ)xΘ(T),Sλ(φ)={TTλ:Ti,jφi},s_\lambda(\varphi;x) = \sum_{T \in \mathcal S_\lambda(\varphi)} x^{\Theta(T)},\quad \mathcal S_\lambda(\varphi)=\{T\in\mathcal T_\lambda : T_{i,j}\le\varphi_i\},

that is, the sum over TT such that every entry in row ii lies in [i,φi][i,\varphi_i] (Proctor et al., 2016). The tableau constraint enables highly structured combinatorics, with applications to Demazure characters and polynomial representations.

2. Enumeration and Parabolic Catalan Numbers

Enumeration of flagged Schur functions is governed by parabolic Catalan numbers. For R{1,,n1}R\subseteq\{1,\dots,n-1\}, define R={q1<<qr}R=\{q_1<\dots<q_r\}, with q0=0q_0=0, qr+1=nq_{r+1}=n. An RR-permutation is a permutation πSn\pi\in S_n increasing on each block ("carrel") (qh1,qh](q_{h-1},q_h]. Such a permutation is RR–312–avoiding if it contains no pattern of the type πa>πb<πc\pi_a>\pi_b<\pi_c with aqh<bqh+1<cna\le q_h< b\le q_{h+1}<c\le n and πa>πc\pi_a>\pi_c.

The parabolic RR–Catalan number

CnR={πSnR:π is R–312–avoiding}C_n^R = |\{\pi\in S_n^R: \pi \text{ is } R\text{–312–avoiding}\}|

counts not only RR–312–avoiding RR–permutations, but also enumerates: the set of distinct flagged Schur functions sλ(φ;x)s_\lambda(\varphi;x) with RR as the shape's set of non-maximal column lengths, gapless RR–tuples, RR–floor and RR–ceiling flags, RR–rightmost clump–deleting chains, and combinatorial keys (Proctor et al., 2016).

3. Convexity of Demazure Sets and Coincidences

For πSnR\pi\in S_n^R, the Demazure character (key polynomial) is defined as

dλ(π;x)=TDλ(π)xΘ(T),d_\lambda(\pi;x)=\sum_{T\in\mathcal D_\lambda(\pi)} x^{\Theta(T)},

where Dλ(π)\mathcal D_\lambda(\pi) is the set of π\pi–Demazure tableaux. These sets in Zλ\mathbb Z^{|\lambda|} are convex polytopes (principal ideals [Yλ(π)][Y_\lambda(\pi)]) if and only if π\pi is RR–312–avoiding. The scanning-tableau method realizes Dλ(π)={SYλ(π)}\mathcal D_\lambda(\pi) = \{S\le Y_\lambda(\pi)\} (Proctor et al., 2016).

Flagged Schur functions and Demazure characters coincide precisely when their indexing sets correspond under canonical maps. Specifically, sλ(φ;x)=dλ(π;x)s_\lambda(\varphi;x)=d_\lambda(\pi;x) if and only if π\pi is RR–312–avoiding and the indexing flags correspond via established bijections. This coincidence is unique at the level of tableau sets.

4. Fanions in Matrix Optimization: Ky Fan Norms and Dual Norms

In first-order matrix optimization, as encountered in LLM training, "Fanions" denote a family of update methods parameterized by the Ky Fan kk-norm and its dual. For WRm×nW\in \mathbb R^{m\times n} with singular values σ10\sigma_1\ge \cdots\ge 0, the Ky Fan kk-norm is

W(k)=i=1kσi(W)\|W\|_{(k)} = \sum_{i=1}^k \sigma_i(W)

with dual

X(k)=max{X2,1kX}=max{σ1(X),1ki=1rσi(X)},r=min{m,n}\|X\|_{(k)}^\dagger = \max\{\|X\|_2,\, \tfrac{1}{k}\|X\|_*\} = \max\{\sigma_1(X),\, \tfrac{1}{k}\sum_{i=1}^r \sigma_i(X)\},\quad r=\min\{m,n\}

(Kravatskiy et al., 10 Dec 2025). Fanion-kk updates operate by taking the rank-kk projector onto the top singular directions of the gradient.

Convex combinations with the Frobenius norm (F-Fanions) or \ell_\infty norm (S-Fanions) yield flexible update rules:

  • F-Fanions mix the Ky Fan projector with normalized gradient;
  • S-Fanions mix with a scaled elementwise sign. Notable extremes are F-Muon (k=rk=r) and F-Neon (k=1k=1), with Fanion-rr coinciding with the Muon update.

5. Muon-like Update Rules and LMO Implementation

Fanion updates are implemented within the Linear Minimization Oracle (LMO) framework. For a matrix WW and gradient GG, each update is

D=argminD:D1G,D,WWγDD = \arg\min_{D:\,\|D\|\le1} \langle G, D \rangle, \qquad W \leftarrow W - \gamma D

where \|\cdot\| is the dual norm described above. When specializing to the Fanion family:

  • Fanion-kk: D=i=1kuiviD = \sum_{i=1}^k u_iv_i^\top (top-kk singular directions)
  • F-Muon: D=α(i=1ruivi)+(1α)G/GFD = \alpha (\sum_{i=1}^r u_iv_i^\top) + (1-\alpha) G/\|G\|_F
  • S-Muon: D=α(i=1ruivi)+(1α)ηsign(G)D = \alpha (\sum_{i=1}^r u_iv_i^\top) + (1-\alpha)\eta\,\mathrm{sign}(G)

Computational bottleneck is in computing the top-kk SVD, for which thick-restart Lanczos (TRLan) is efficient, with memory O(mnd)O(mnd) and flops O(mn2+n2d+nd2)O(mn^2 + n^2d + nd^2) when mnm\ge n (Kravatskiy et al., 10 Dec 2025).

6. Theoretical Guarantees and Empirical Results

Standard convergence results for LMO-based algorithms extend to Fanions and their variants. For LL–smooth objective FF,

$\min_{0\le t<T}\mathbb E[\|\nabla F(W^t)\|_F^2] \le O\left(\frac{F(W^0) - F_\inf}{\gamma T}\right)$

with γ=O(1/Lρ)\gamma=O(1/L\rho) if the dual ball is contained in a Frobenius ball of radius ρ\rho, requiring T=O(1/ϵ4)T=O(1/\epsilon^4) iterations to reach ϵ\epsilon–stationarity.

In convex settings with linear regression F(W)=12AWBF2F(W)=\frac{1}{2}\|AW-B\|_F^2, one obtains linear convergence for all Fanion variants, with per-iteration scaling O(κ2log(1/ϵ))O(\kappa^2\log(1/\epsilon)) in the condition number κ\kappa.

Empirical findings demonstrate:\newline — F-Muon outperforms vanilla Muon (by 14%) on linear least squares;\newline — On CIFAR-10, NanoGPT, and GPT-2 Medium, F-Muon and S-Muon match or slightly outperform Muon;\newline — S-Muon and F-Muon remain robust across learning rates and problem settings, attesting to the flexibility provided by norm combinations (Kravatskiy et al., 10 Dec 2025).

Table: Fanion Algorithm Family

Name Update Constraint Interpolates with
Fanion-kk Ky Fan kk-norm dual Neon (k=1k=1)
F-Muon Ky Fan rr + Frobenius NSGD (Frobenius)
S-Muon Ky Fan rr + \ell_\infty SignSGD

This explicit generalization unifies previous Muon, Neon, Dion, and normalized gradient methods under a shared structure (Kravatskiy et al., 10 Dec 2025).

7. Relationships, Practical Implications, and Future Directions

Fanions, in both tableau-combinatorial and matrix-optimization domains, possess deep structural connections. In optimization, the flexibility of choosing the norm constraint enables interpolation between low-rank, full-rank, and sign-based updates. Low-rank Fanion-kk variants provide fine-grained rank adaptivity, revealing failure modes of under-parameterized updates, such as Neon with k=1k=1, versus robust performance at higher kk.

Fanion methods support fast, scalable implementations and can be further enhanced with error feedback, adaptive steps, and layerwise dropout. The structural understanding of dual balls for composite norms underpins future algorithmic research, especially in large-scale, nonconvex deep learning regimes.

In algebraic combinatorics, flagged Schur functions enumerate and classify objects indexed by parabolic Catalan numbers, key tableaux, and Demazure characters, providing refined symmetry and convex-geometric insights for tableaux and their applications in representation theory (Proctor et al., 2016).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Fanions.