Fanions: Flagged Schur & Matrix Updates
- Fanions are a dual-use concept: in algebraic combinatorics they denote flagged Schur functions, and in optimization they refer to matrix update methods using Ky Fan norms.
- In combinatorics, flagged Schur functions are defined through tableau constraints and are enumerated by parabolic Catalan numbers, linking them to Demazure characters and convex polytopes.
- In optimization, Fanion algorithms interpolate between low-rank and full-rank updates, providing robust performance improvements in tasks such as LLM training and linear regression.
Fanions are a concept appearing in several specialized mathematical contexts. In algebraic combinatorics, "fanion" denotes flagged Schur functions, which provide a refined class of symmetric polynomials with explicit combinatorial and representation-theoretic significance. In modern optimization for large-scale learning, "Fanions" refer to a parameterized family of matrix update algorithms that interpolate between low-rank and full-rank steps using Ky Fan norms and their convex combinations. Both usages are rooted in deep mathematical structures and have concrete theoretical and algorithmic impact.
1. Flagged Schur Functions: Definition and Tableau Structure
Let be an integer and let be a partition with at most parts. For such , a "flag" is an -tuple satisfying . The set comprises semistandard Young tableaux of shape with entries in —weakly increasing across rows, strictly increasing down columns.
For , let with the multiplicity of entry in , so . The flagged Schur function indexed by is
that is, the sum over such that every entry in row lies in (Proctor et al., 2016). The tableau constraint enables highly structured combinatorics, with applications to Demazure characters and polynomial representations.
2. Enumeration and Parabolic Catalan Numbers
Enumeration of flagged Schur functions is governed by parabolic Catalan numbers. For , define , with , . An -permutation is a permutation increasing on each block ("carrel") . Such a permutation is –312–avoiding if it contains no pattern of the type with and .
The parabolic –Catalan number
counts not only –312–avoiding –permutations, but also enumerates: the set of distinct flagged Schur functions with as the shape's set of non-maximal column lengths, gapless –tuples, –floor and –ceiling flags, –rightmost clump–deleting chains, and combinatorial keys (Proctor et al., 2016).
3. Convexity of Demazure Sets and Coincidences
For , the Demazure character (key polynomial) is defined as
where is the set of –Demazure tableaux. These sets in are convex polytopes (principal ideals ) if and only if is –312–avoiding. The scanning-tableau method realizes (Proctor et al., 2016).
Flagged Schur functions and Demazure characters coincide precisely when their indexing sets correspond under canonical maps. Specifically, if and only if is –312–avoiding and the indexing flags correspond via established bijections. This coincidence is unique at the level of tableau sets.
4. Fanions in Matrix Optimization: Ky Fan Norms and Dual Norms
In first-order matrix optimization, as encountered in LLM training, "Fanions" denote a family of update methods parameterized by the Ky Fan -norm and its dual. For with singular values , the Ky Fan -norm is
with dual
(Kravatskiy et al., 10 Dec 2025). Fanion- updates operate by taking the rank- projector onto the top singular directions of the gradient.
Convex combinations with the Frobenius norm (F-Fanions) or norm (S-Fanions) yield flexible update rules:
- F-Fanions mix the Ky Fan projector with normalized gradient;
- S-Fanions mix with a scaled elementwise sign. Notable extremes are F-Muon () and F-Neon (), with Fanion- coinciding with the Muon update.
5. Muon-like Update Rules and LMO Implementation
Fanion updates are implemented within the Linear Minimization Oracle (LMO) framework. For a matrix and gradient , each update is
where is the dual norm described above. When specializing to the Fanion family:
- Fanion-: (top- singular directions)
- F-Muon:
- S-Muon:
Computational bottleneck is in computing the top- SVD, for which thick-restart Lanczos (TRLan) is efficient, with memory and flops when (Kravatskiy et al., 10 Dec 2025).
6. Theoretical Guarantees and Empirical Results
Standard convergence results for LMO-based algorithms extend to Fanions and their variants. For –smooth objective ,
$\min_{0\le t<T}\mathbb E[\|\nabla F(W^t)\|_F^2] \le O\left(\frac{F(W^0) - F_\inf}{\gamma T}\right)$
with if the dual ball is contained in a Frobenius ball of radius , requiring iterations to reach –stationarity.
In convex settings with linear regression , one obtains linear convergence for all Fanion variants, with per-iteration scaling in the condition number .
Empirical findings demonstrate:\newline — F-Muon outperforms vanilla Muon (by 14%) on linear least squares;\newline — On CIFAR-10, NanoGPT, and GPT-2 Medium, F-Muon and S-Muon match or slightly outperform Muon;\newline — S-Muon and F-Muon remain robust across learning rates and problem settings, attesting to the flexibility provided by norm combinations (Kravatskiy et al., 10 Dec 2025).
Table: Fanion Algorithm Family
| Name | Update Constraint | Interpolates with |
|---|---|---|
| Fanion- | Ky Fan -norm dual | Neon () |
| F-Muon | Ky Fan + Frobenius | NSGD (Frobenius) |
| S-Muon | Ky Fan + | SignSGD |
This explicit generalization unifies previous Muon, Neon, Dion, and normalized gradient methods under a shared structure (Kravatskiy et al., 10 Dec 2025).
7. Relationships, Practical Implications, and Future Directions
Fanions, in both tableau-combinatorial and matrix-optimization domains, possess deep structural connections. In optimization, the flexibility of choosing the norm constraint enables interpolation between low-rank, full-rank, and sign-based updates. Low-rank Fanion- variants provide fine-grained rank adaptivity, revealing failure modes of under-parameterized updates, such as Neon with , versus robust performance at higher .
Fanion methods support fast, scalable implementations and can be further enhanced with error feedback, adaptive steps, and layerwise dropout. The structural understanding of dual balls for composite norms underpins future algorithmic research, especially in large-scale, nonconvex deep learning regimes.
In algebraic combinatorics, flagged Schur functions enumerate and classify objects indexed by parabolic Catalan numbers, key tableaux, and Demazure characters, providing refined symmetry and convex-geometric insights for tableaux and their applications in representation theory (Proctor et al., 2016).