---
title: Whittaker Annihilator in Representation Theory
url: https://www.emergentmind.com/topics/whittaker-annihilator
type: topic
---

# Whittaker Annihilator in Representation Theory

Searching arXiv for recent and foundational papers on Whittaker annihilator and related notions.
The **Whittaker annihilator** is a representation-theoretic invariant attached to a character of a Lie subalgebra or ideal, used to control the structure of Whittaker-type modules. In the most direct sense developed by Cheng, Gao, Liu, Zhao, and Zhao, it is the subalgebra
$$
\mathfrak g^\phi=\{\,x\in\mathfrak g\mid \phi([x,p])=0,\ \forall p\in\mathfrak p\,\}
$$
associated with a Lie algebra $\mathfrak g$, a nonperfect ideal $\mathfrak p\triangleleft\mathfrak g$, and a character $\phi:\mathfrak p\to\mathbb C$; in that setting it determines the irreducibility and maximal submodules of universal quasi-Whittaker modules [2508.05917]. In related literatures, the same term-family appears in the forms of **annihilator ideals** and **Whittaker annihilator varieties**, which encode analogous information for simple Whittaker modules, degenerate Whittaker functionals, parabolically induced representations, and generalized Whittaker states [2108.07532, 1106.0454, 2011.02270, 1203.1427].

## 1. Definition in the quasi-Whittaker setting

Let $\mathfrak g$ be a complex Lie algebra, not necessarily semisimple, and let $\mathfrak p\triangleleft\mathfrak g$ be a nonperfect ideal, so $[\mathfrak p,\mathfrak p]\neq\mathfrak p$. Fix a Lie-algebra homomorphism
$$
\phi:\mathfrak p\to\mathbb C,\qquad \phi([x,y])=0\ \text{for all }x,y\in\mathfrak p.
$$
Writing $w_{(\phi)}$ for a formal generator with
$$
p\cdot w_{(\phi)}=\phi(p)\,w_{(\phi)},\qquad p\in\mathfrak p,
$$
the induced universal quasi-Whittaker module is
$$
W(\phi)=\operatorname{Ind}_{\mathfrak p\to\mathfrak g}\mathbb C\cdot w_{(\phi)}
      =U(\mathfrak g)\otimes_{U(\mathfrak p)}\mathbb C\cdot w_{(\phi)}.
$$
By construction, $W(\phi)$ is generated by the quasi-Whittaker cyclic vector $w_{(\phi)}$ [2508.05917].

The Whittaker annihilator of $\phi$ is then defined by
$$
\mathfrak g^\phi=\{\,x\in\mathfrak g\mid \phi([x,p])=0,\ \forall p\in\mathfrak p\,\}\subseteq\mathfrak g.
$$
A basic lemma states that $\mathfrak g^\phi$ is a subalgebra of $\mathfrak g$ containing $\mathfrak p$. The proof uses linearity and the Jacobi identity for closure under brackets, together with $\phi([\mathfrak p,\mathfrak p])=0$ to obtain $\mathfrak p\subseteq\mathfrak g^\phi$ [2508.05917].

This definition is adapted to an ordered basis of $\mathfrak g$ compatible with the chain
$$
\mathfrak p\subseteq \mathfrak g^\phi\subseteq\mathfrak g,
$$
for example
$$
\mathfrak g=\operatorname{Span}\{x_i\mid i\in I\}\oplus \operatorname{Span}\{y_j\mid j\in J\}\oplus \operatorname{Span}\{p_k\mid k\in K\},
$$
with $\{p_k\}$ a basis of $\mathfrak p$ and $\{y_j\}\cup\{p_k\}$ a basis of $\mathfrak g^\phi$. By the Poincaré–Birkhoff–Witt theorem, $U(\mathfrak g)$ is free as a right module over $U(\mathfrak g^\phi)$ with basis $x^\alpha$, and over $U(\mathfrak p)$ with basis $x^\alpha y^\beta$ [2508.05917].

## 2. $\phi$-invariants and the irreducibility criterion

For any $\mathfrak g$-module $V$, the $\phi$-invariants are
$$
V_\phi=\{\,v\in V\mid p\cdot v=\phi(p)v,\ \forall p\in\mathfrak p\,\}.
$$
These form a $\mathfrak g^\phi$-stable subspace. In the universal module $W(\phi)$, Cheng–Gao–Liu–Zhao–Zhao prove that
$$
W(\phi)_\phi=\mathbb C[y_j\mid j\in J]\cdot w_{(\phi)}.
$$
Thus the quasi-Whittaker vectors of type $\phi$ are exactly those obtained by applying the polynomial algebra in the $y_j$ to the cyclic vector [2508.05917].

The central structural theorem is the irreducibility criterion
$$
W(\phi)\ \text{is irreducible}\quad\Longleftrightarrow\quad \mathfrak g^\phi=\mathfrak p.
$$
If $\mathfrak g^\phi\neq\mathfrak p$, then the complement represented by the $y_j$ is nonzero, and each $y_j\cdot w_{(\phi)}$ spans a proper submodule. Conversely, if $\mathfrak g^\phi=\mathfrak p$, then
$$
W(\phi)_\phi=\mathbb C\cdot w_{(\phi)},
$$
so the space of quasi-Whittaker vectors is one-dimensional. A minimal-degree argument shows that any nonzero submodule contains a nonzero $\phi$-invariant, hence contains $w_{(\phi)}$, and therefore equals $W(\phi)$ [2508.05917].

This criterion identifies the Whittaker annihilator as the precise obstruction to simplicity. In that sense, $\mathfrak g^\phi$ is not merely an auxiliary stabilizer: it is the invariant governing whether the universal induced object already yields a simple quasi-Whittaker module.

## 3. Reducible cases and explicit classifications

When $\mathfrak g^\phi$ properly contains $\mathfrak p$ but with minimal possible codimension,
$$
\dim(\mathfrak g^\phi/\mathfrak p)=1,
$$
one may choose $y\in\mathfrak g^\phi$ such that
$$
\mathfrak g^\phi=\mathbb C\cdot y\oplus\mathfrak p.
$$
In this case all maximal submodules of $W(\phi)$ are
$$
J_\xi=U(\mathfrak g)\cdot (y-\xi)w_{(\phi)},\qquad \xi\in\mathbb C,
$$
and the corresponding simple quotients are
$$
W(\phi)/J_\xi\simeq V(\phi_\xi),
$$
where $\phi_\xi$ is the unique extension of $\phi$ to $\mathfrak g^\phi$ satisfying $\phi_\xi(y)=\xi$ [2508.05917].

The paper applies this framework to several classes of Lie algebras. For conformal Galilei and Schrödinger algebras, with $\mathfrak g=\mathfrak{sl}_2\ltimes p$ and $p$ irreducible, one has
$$
\dim(\mathfrak g^\phi/\mathfrak p)\le 1
$$
for any nonzero $\phi$. Hence every irreducible quasi-Whittaker module is either $W(\phi)$, when $\mathfrak g^\phi=\mathfrak p$, or one of the quotients $V(\phi_\xi)$ when $\dim(\mathfrak g^\phi/\mathfrak p)=1$ [2508.05917].

For Heisenberg–Virasoro-type algebras, the determination of $\mathfrak g^\phi$ reduces to linear conditions of the form $\phi([x,p])=0$, as formulated in Corollary 3.6 and Theorem 4.5–4.7 of the paper. For smooth $W_n^+$-modules of height $2$, one sets
$$
\mathfrak a=W_n^+{}_{\ge 0},\qquad \mathfrak p=W_n^+{}_{\ge 1},
$$
and chooses $\phi$ to vanish on $W_n^+{}_{\ge 2}$ but to be nonzero on each monomial $t_i^2\partial_i$. The interaction matrix $A_\phi$ in Corollary 3.6 then has full rank $n^2$, forcing $\mathfrak g^\phi=\mathfrak p$. It follows that $W(\phi)$ is irreducible as an $\mathfrak a$-module of height $2$, and by extension one obtains a family of irreducible smooth $W_n^+$-modules of height $2$ [2508.05917].

## 4. Relation to classical Whittaker theory and annihilator ideals

In Kostant’s classical theory for a semisimple Lie algebra with triangular decomposition
$$
\mathfrak g=\mathfrak n_-\oplus\mathfrak h\oplus\mathfrak n_+,
$$
one takes $\mathfrak p=\mathfrak n_+$ and $\phi:\mathfrak n_+\to\mathbb C$ to be a nondegenerate character. Then
$$
\mathfrak g^\phi=\{\,x\in\mathfrak g\mid \phi([x,\mathfrak n_+])=0\,\}=\mathfrak n_+,
$$
so the universal Whittaker module is always irreducible. The quasi-Whittaker construction replaces $\mathfrak n_+$ by an arbitrary nonperfect ideal $\mathfrak p\triangleleft\mathfrak g$ and shows that the invariant controlling simplicity is precisely $\mathfrak g^\phi$ [2508.05917].

A distinct but closely related notion is the **annihilator ideal** of a Whittaker module. For quasireductive Lie superalgebras $\mathfrak g=\mathfrak g_0\oplus\mathfrak g_1$, Chih-Whi Chen studies the Whittaker category $\tilde{\mathcal N}$ of finitely generated modules that are locally finite over both $\mathfrak n^+$ and $Z(\mathfrak g_0)$. In that setting, for a type I quasireductive Lie superalgebra, a non-singular $\psi$, and every integral, $W_0$-anti-dominant $\lambda$, one has
$$
\operatorname{Ann}_U(L(\lambda,\psi))=\operatorname{Ann}_U(L(\lambda)).
$$
Concretely,
$$
\operatorname{Ann}_U(L(\lambda,\psi))
=
U\cdot\ker\chi_\lambda+\sum_{x\in\mathfrak n^+}U(x-\psi(x))
=
I(\lambda),
$$
so the annihilator of the simple Whittaker module coincides with the primitive ideal coming from category $\mathcal O$ [2108.07532].

| Term | Setting | Role |
|---|---|---|
| $\mathfrak g^\phi$ | quasi-Whittaker modules | subalgebra controlling simplicity |
| $\operatorname{Ann}_U(M)$ | Whittaker modules and supermodules | two-sided ideal annihilating a module |
| $\operatorname{WAn}(\pi)$ | induced representations | geometric Whittaker support closure |

This comparison isolates a terminological distinction. In the quasi-Whittaker theory, the Whittaker annihilator is a subalgebra inside $\mathfrak g$; in the superalgebra and primitive-ideal literature, the annihilator is a two-sided ideal in $U(\mathfrak g)$.

## 5. Geometric forms: associated varieties and Whittaker supports

For irreducible unitary representations of $GL(n,\mathbb R)$, Gourevitch and Sahi formulate an annihilator–Whittaker correspondence in terms of the annihilator ideal and its associated variety. If
$$
\operatorname{AV}(\pi)=\overline{O_\alpha},
$$
where $\alpha\vdash n$ is the partition attached to the nilpotent orbit $O_\alpha$, then
$$
Wh_\alpha^{\mathrm{K\!fin}}(\pi)\neq 0,
$$
and if
$$
Wh_b^{\mathrm{cont}}(\pi)\neq 0
$$
for some composition $b\vdash n$, then
$$
O_b\subset\overline{O_\alpha}.
$$
Thus $\alpha$ is the largest partition for which Whittaker functionals survive. Here the annihilator controls the existence of degenerate Whittaker functionals through the geometry of nilpotent orbits rather than through a subalgebra such as $\mathfrak g^\phi$ [1106.0454].

For $G=GL(n,\mathbb C)$ with a two-block Levi subgroup $L=GL(n_1)\times GL(n_2)$ and a parabolic $P=LN$, Zhang studies the **Whittaker annihilator variety** of a parabolically induced representation
$$
\pi=\operatorname{Ind}_P^G(\sigma).
$$
If $\mathcal O(\sigma)=\mathcal O_{\alpha,\beta}$, then
$$
\operatorname{WAn}(\pi)=G\cdot(\mathcal O_{\alpha,\beta}+\mathfrak n)
=
\bigcup_{\gamma\vdash n\,:\,c_{\alpha,\beta}^\gamma>0}\overline{\mathcal O_\gamma}.
$$
Equivalently,
$$
\mathcal O_\gamma\subset G\cdot(\mathcal O_{\alpha,\beta}+\mathfrak n)
\quad\Longleftrightarrow\quad
c_{\alpha,\beta}^\gamma\neq 0,
$$
where $c_{\alpha,\beta}^\gamma$ is the Littlewood–Richardson coefficient. The locally closed subvarieties
$$
P_{\alpha,\beta}^\gamma=\{\,x\in\mathcal O_\gamma\cap\mathfrak p\mid p_\mathfrak l(x)\in\mathcal O_{\alpha,\beta}\,\}
$$
have exactly $c_{\alpha,\beta}^\gamma$ irreducible components, all of the same dimension
$$
\dim P_{\alpha,\beta}^\gamma
=
\langle\rho,\alpha+\beta-\gamma\rangle
=
\tfrac12\bigl(\|\gamma^t\|^2-\|\alpha^t\|^2-\|\beta^t\|^2\bigr).
$$
In this setting, “Whittaker annihilator” refers to a geometric invariant situated inside the associated variety formalism [2011.02270].

## 6. Generalized annihilators in conformal and gauge-theoretic settings

In the theory of irregular conformal blocks and instanton counting, the annihilator viewpoint appears in the defining ideals of generalized Whittaker states. For pure $SU(2)$ gauge theory, the Virasoro Gaiotto state $|G_0\rangle$ satisfies
$$
L_1|G_0\rangle=\Lambda^2|G_0\rangle,\qquad L_2|G_0\rangle=0,\qquad L_{n\ge 3}|G_0\rangle=0,
$$
so the annihilator ideal is generated by
$$
L_n\ (n\ge 3),\qquad L_2,\qquad (L_1-\Lambda^2).
$$
For pure $SU(3)$, the $W_3$-Whittaker state is characterized by
$$
L_1|G_0\rangle=0,\quad L_2|G_0\rangle=0,\quad L_{n\ge 3}|G_0\rangle=0,
$$
together with
$$
W_1|G_0\rangle=w|G_0\rangle,\qquad W_{n\ge 2}|G_0\rangle=0.
$$
In each case the conditions uniquely determine the state in the Verma module, up to normalization, and its norm reproduces the corresponding Nekrasov instanton partition function [1203.1427].

The generalized case arises when additional matter or surface operators force zero-modes into the defining relations. For $SU(3)$ with $N_f=2$ fundamentals, one has
$$
L_{n\ge 3}|G_2\rangle=0,\qquad W_{n\ge 4}|G_2\rangle=0,
$$
together with
$$
L_1|G_2\rangle=\lambda_1|G_2\rangle,\qquad
L_2|G_2\rangle=\lambda_2|G_2\rangle,
$$
$$
(W_1-w_0L_0)|G_2\rangle=\omega_1|G_2\rangle,\qquad
W_2|G_2\rangle=\omega_2|G_2\rangle,\qquad
W_3|G_2\rangle=\omega_3|G_2\rangle.
$$
For $SU(2)$ with a full surface operator, the affine $\widehat{\mathfrak{sl}}(2)$ generalized Whittaker vector satisfies
$$
J^+_{n>0}|G_{1,m}\rangle
=
J^0_{n>1}|G_{1,m}\rangle
=
J^-_{n>1}|G_{1,m}\rangle
=0,
$$
and
$$
(J^+_0+\sqrt x\,J^0_0)|G_{1,m}\rangle
=
\frac{\sqrt x}{2\epsilon_1}(1+2m)|G_{1,m}\rangle,
$$
$$
J^-_1|G_{1,m}\rangle=\frac{\sqrt x}{\epsilon_1}|G_{1,m}\rangle,\qquad
J^0_1|G_{1,m}\rangle=\epsilon_1\sqrt x\,|G_{1,m}\rangle.
$$
The occurrence of $L_0$ or $J^0_0$ shows that the defining annihilator is no longer a strict character of a purely nilpotent positive subalgebra. The paper therefore describes these objects as generalized Whittaker states and explicitly relates them to the classical Lie-theoretic annihilator generated by $\{X-\chi(X)\}_{X\in\mathfrak n_+}$ [1203.1427].

Across these settings, the recurring theme is that a Whittaker-type object is determined by linear conditions of the form “generator minus prescribed scalar or mode” acting on a cyclic vector. What changes from one theory to another is the ambient algebraic structure—Lie algebra, Lie superalgebra, enveloping algebra, associated variety, or chiral algebra—and with it the precise meaning of “annihilator.”

Source: https://www.emergentmind.com/topics/whittaker-annihilator