Papers
Topics
Authors
Recent
Search
2000 character limit reached

Fanions: Flagged Schur & Matrix Updates

Updated 17 December 2025
  • Fanions are a dual-use concept: in algebraic combinatorics they denote flagged Schur functions, and in optimization they refer to matrix update methods using Ky Fan norms.
  • In combinatorics, flagged Schur functions are defined through tableau constraints and are enumerated by parabolic Catalan numbers, linking them to Demazure characters and convex polytopes.
  • In optimization, Fanion algorithms interpolate between low-rank and full-rank updates, providing robust performance improvements in tasks such as LLM training and linear regression.

Fanions are a concept appearing in several specialized mathematical contexts. In algebraic combinatorics, "fanion" denotes flagged Schur functions, which provide a refined class of symmetric polynomials with explicit combinatorial and representation-theoretic significance. In modern optimization for large-scale learning, "Fanions" refer to a parameterized family of matrix update algorithms that interpolate between low-rank and full-rank steps using Ky Fan norms and their convex combinations. Both usages are rooted in deep mathematical structures and have concrete theoretical and algorithmic impact.

1. Flagged Schur Functions: Definition and Tableau Structure

Let n≥1n\ge1 be an integer and let λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0) be a partition with at most nn parts. For such λ\lambda, a "flag" is an nn-tuple φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n) satisfying 1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n. The set Tλ\mathcal T_\lambda comprises semistandard Young tableaux of shape λ\lambda with entries in [n][n]—weakly increasing across rows, strictly increasing down columns.

For λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)0, let λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)1 with λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)2 the multiplicity of entry λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)3 in λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)4, so λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)5. The flagged Schur function indexed by λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)6 is

λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)7

that is, the sum over λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)8 such that every entry in row λ=(λ1≥λ2≥⋯≥λn≥0)\lambda=(\lambda_1\ge\lambda_2\ge\dots\ge\lambda_n\ge0)9 lies in nn0 (Proctor et al., 2016). The tableau constraint enables highly structured combinatorics, with applications to Demazure characters and polynomial representations.

2. Enumeration and Parabolic Catalan Numbers

Enumeration of flagged Schur functions is governed by parabolic Catalan numbers. For nn1, define nn2, with nn3, nn4. An nn5-permutation is a permutation nn6 increasing on each block ("carrel") nn7. Such a permutation is nn8–312–avoiding if it contains no pattern of the type nn9 with λ\lambda0 and λ\lambda1.

The parabolic λ\lambda2–Catalan number

λ\lambda3

counts not only λ\lambda4–312–avoiding λ\lambda5–permutations, but also enumerates: the set of distinct flagged Schur functions λ\lambda6 with λ\lambda7 as the shape's set of non-maximal column lengths, gapless λ\lambda8–tuples, λ\lambda9–floor and nn0–ceiling flags, nn1–rightmost clump–deleting chains, and combinatorial keys (Proctor et al., 2016).

3. Convexity of Demazure Sets and Coincidences

For nn2, the Demazure character (key polynomial) is defined as

nn3

where nn4 is the set of nn5–Demazure tableaux. These sets in nn6 are convex polytopes (principal ideals nn7) if and only if nn8 is nn9–312–avoiding. The scanning-tableau method realizes φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)0 (Proctor et al., 2016).

Flagged Schur functions and Demazure characters coincide precisely when their indexing sets correspond under canonical maps. Specifically, φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)1 if and only if φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)2 is φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)3–312–avoiding and the indexing flags correspond via established bijections. This coincidence is unique at the level of tableau sets.

4. Fanions in Matrix Optimization: Ky Fan Norms and Dual Norms

In first-order matrix optimization, as encountered in LLM training, "Fanions" denote a family of update methods parameterized by the Ky Fan φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)4-norm and its dual. For φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)5 with singular values φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)6, the Ky Fan φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)7-norm is

φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)8

with dual

φ=(φ1,…,φn)\varphi=(\varphi_1,\dots,\varphi_n)9

(Kravatskiy et al., 10 Dec 2025). Fanion-1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n0 updates operate by taking the rank-1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n1 projector onto the top singular directions of the gradient.

Convex combinations with the Frobenius norm (F-Fanions) or 1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n2 norm (S-Fanions) yield flexible update rules:

  • F-Fanions mix the Ky Fan projector with normalized gradient;
  • S-Fanions mix with a scaled elementwise sign. Notable extremes are F-Muon (1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n3) and F-Neon (1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n4), with Fanion-1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n5 coinciding with the Muon update.

5. Muon-like Update Rules and LMO Implementation

Fanion updates are implemented within the Linear Minimization Oracle (LMO) framework. For a matrix 1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n6 and gradient 1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n7, each update is

1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n8

where 1≤φ1≤⋯≤φn≤n1\le\varphi_1\le \dots \le\varphi_n\le n9 is the dual norm described above. When specializing to the Fanion family:

  • Fanion-Tλ\mathcal T_\lambda0: Tλ\mathcal T_\lambda1 (top-Tλ\mathcal T_\lambda2 singular directions)
  • F-Muon: Tλ\mathcal T_\lambda3
  • S-Muon: Tλ\mathcal T_\lambda4

Computational bottleneck is in computing the top-Tλ\mathcal T_\lambda5 SVD, for which thick-restart Lanczos (TRLan) is efficient, with memory Tλ\mathcal T_\lambda6 and flops Tλ\mathcal T_\lambda7 when Tλ\mathcal T_\lambda8 (Kravatskiy et al., 10 Dec 2025).

6. Theoretical Guarantees and Empirical Results

Standard convergence results for LMO-based algorithms extend to Fanions and their variants. For Tλ\mathcal T_\lambda9–smooth objective λ\lambda0,

λ\lambda1

with λ\lambda2 if the dual ball is contained in a Frobenius ball of radius λ\lambda3, requiring λ\lambda4 iterations to reach λ\lambda5–stationarity.

In convex settings with linear regression λ\lambda6, one obtains linear convergence for all Fanion variants, with per-iteration scaling λ\lambda7 in the condition number λ\lambda8.

Empirical findings demonstrate:\newline — F-Muon outperforms vanilla Muon (by 14%) on linear least squares;\newline — On CIFAR-10, NanoGPT, and GPT-2 Medium, F-Muon and S-Muon match or slightly outperform Muon;\newline — S-Muon and F-Muon remain robust across learning rates and problem settings, attesting to the flexibility provided by norm combinations (Kravatskiy et al., 10 Dec 2025).

Table: Fanion Algorithm Family

Name Update Constraint Interpolates with
Fanion-λ\lambda9 Ky Fan [n][n]0-norm dual Neon ([n][n]1)
F-Muon Ky Fan [n][n]2 + Frobenius NSGD (Frobenius)
S-Muon Ky Fan [n][n]3 + [n][n]4 SignSGD

This explicit generalization unifies previous Muon, Neon, Dion, and normalized gradient methods under a shared structure (Kravatskiy et al., 10 Dec 2025).

7. Relationships, Practical Implications, and Future Directions

Fanions, in both tableau-combinatorial and matrix-optimization domains, possess deep structural connections. In optimization, the flexibility of choosing the norm constraint enables interpolation between low-rank, full-rank, and sign-based updates. Low-rank Fanion-[n][n]5 variants provide fine-grained rank adaptivity, revealing failure modes of under-parameterized updates, such as Neon with [n][n]6, versus robust performance at higher [n][n]7.

Fanion methods support fast, scalable implementations and can be further enhanced with error feedback, adaptive steps, and layerwise dropout. The structural understanding of dual balls for composite norms underpins future algorithmic research, especially in large-scale, nonconvex deep learning regimes.

In algebraic combinatorics, flagged Schur functions enumerate and classify objects indexed by parabolic Catalan numbers, key tableaux, and Demazure characters, providing refined symmetry and convex-geometric insights for tableaux and their applications in representation theory (Proctor et al., 2016).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Fanions.