---
title: Generalized Whittaker Models in Modern Representation Theory
url: https://www.emergentmind.com/topics/generalized-whittaker-models
type: topic
---

# Generalized Whittaker Models in Modern Representation Theory

Generalized Whittaker models are orbit-theoretic extensions of the classical Whittaker model from generic representations to broader classes of representations of reductive groups, as well as to several geometric, categorical, and infinite-dimensional settings. In the local representation theory of reductive groups, the classical Whittaker model corresponds to the principal nilpotent orbit, while generalized and degenerate models are attached to arbitrary nilpotent orbits or to more flexible Whittaker pairs \((S,\varphi)\) [1808.00890]. In the global setting they appear as Fourier coefficients of automorphic forms attached to nilpotent data; in geometric representation theory they become Whittaker categories; and in integrable-systems and conformal-field-theoretic contexts they reappear as parabolic Whittaker functions or generalized Whittaker states [1811.02468].

## 1. Orbit-theoretic definition and local construction

A standard local framework begins with a reductive group \(G\) over a local field of characteristic \(0\), its Lie algebra \(\mathfrak g\), and a Whittaker pair \((S,\varphi)\), where \(S\in\mathfrak g\) is rational semisimple and \(\varphi\in\mathfrak g^*\) satisfies
\[
\operatorname{ad}^*(S)(\varphi)=-2\varphi.
\]
From this data one defines
\[
\mathfrak u=\mathfrak g_{\ge 1}^S,
\qquad
\omega_\varphi(X,Y)=\varphi([X,Y]),
\]
lets \(\mathfrak n\) be the radical of \(\omega_\varphi\) on \(\mathfrak u\), and sets \(U=\exp(\mathfrak u)\), \(N=\exp(\mathfrak n)\), \(N'=\exp(\mathfrak n\cap\ker\varphi)\) [1502.06483][1808.00890]. If \(1\) is not an eigenvalue of \(\operatorname{ad}(S)\), then \(\varphi\) defines a character \(\chi_\varphi\) of \(U\) and the degenerate Whittaker model is
\[
\mathcal W_{S,\varphi}:=\operatorname{ind}_U^G(\chi_\varphi).
\]
If \(1\) is an eigenvalue, then \(U/N'\) is a Heisenberg group, and one instead induces the corresponding oscillator representation:
\[
\mathcal W_{S,\varphi}:=\operatorname{ind}_U^G(\omega_\varphi)
\]
[1502.06483].

A generalized Whittaker model is obtained when \(S\) is chosen as a neutral element for \(\varphi\), equivalently from an \(\mathfrak{sl}_2\)-triple associated to the nilpotent orbit of \(\varphi\). The resulting model \(\mathcal W_\varphi\) depends only on the coadjoint orbit \(\mathcal O=G\cdot\varphi\), so it is also written \(\mathcal W_\mathcal O\) [1502.06483][1808.00890]. For a smooth representation \(\pi\), one considers either
\[
\mathcal W_{\mathcal O}(\pi)=\operatorname{Hom}_G(\mathcal W_{\mathcal O},\pi^*)
\]
or the quotient formulation
\[
\pi_{\mathcal O}:=(W_{\mathcal O}\otimes \pi)_G,
\]
depending on the context [1502.06483][1808.00890].

This construction clarifies a common point of confusion: generalized Whittaker models are not restricted to generic representations. Precisely because only generic representations admit classical Whittaker models, generalized and degenerate models were introduced to attach orbit-dependent Whittaker data to arbitrary representations [1808.00890]. The maximal nilpotent orbits for which the corresponding quotient is nonzero form the Whittaker support
\[
WS(\pi):=\max(WO(\pi)),
\]
where \(WO(\pi)\) is the set of orbits \(\mathcal O\) with \(\pi_\mathcal O\neq 0\) [1808.00890].

## 2. Comparison theorems, wave-front sets, and derivatives

A central structural result is that generalized Whittaker models dominate degenerate ones. For a Whittaker pair \((S,\varphi)\), there is a \(G\)-equivariant epimorphism
\[
\mathcal W_\varphi \twoheadrightarrow \mathcal W_{S,\varphi},
\]
and more generally there are comparison maps to certain degenerate models attached to larger compatible orbits [1502.06483]. In the survey formulation, if \((S,\varphi)\) is a Whittaker pair and \(v\) lies in the \(G_S\)-orbit closure of \(\varphi\), then there is a natural surjection
\[
W_v \twoheadrightarrow W_{S,\varphi},
\]
with corresponding nonvanishing implications for representation-theoretic quotients [1808.00890].

These comparison results connect generalized Whittaker models to singular support invariants. For non-Archimedean fields, the maximal nilpotent orbits in the Whittaker support coincide with the wave-front set:
\[
WF(\pi)=WS(\pi),
\qquad
c_\mathcal O(\pi)=\dim \pi_\mathcal O
\]
for \(\mathcal O\in WF(\pi)\) [1808.00890]. For \(\mathrm{GL}_n(F)\), Gomez–Gourevitch–Sahi sharpen this to a full orbit-closure criterion:
\[
\mathcal W_{\mathcal O}(T)\neq 0
\quad\Longleftrightarrow\quad
\mathcal O\subset \operatorname{WF}(T),
\]
not merely for maximal orbits [1502.06483]. They also express generalized Whittaker models for \(\mathrm{GL}_n\) as iterated Bernstein–Zelevinsky-type derivatives:
\[
\mathcal W_{\mathcal O_\lambda}(T)
\cong
\Bigl(\mathcal E^{\lambda_k}\bigl(\cdots \mathcal E^{\lambda_1}(T)\cdots\bigr)\Bigr)^*
\]
for the partition \(\lambda\) corresponding to \(\mathcal O_\lambda\) [1502.06483].

The orbit picture also imposes restrictions on which nilpotent orbits can occur. The strongest general statement in the survey is that every orbit in \(WS(\pi)\) is quasi-admissible, and in the \(p\)-adic setting there are strong relations between Whittaker support, distinguishedness, and cuspidality or temperedness [1808.00890]. This places generalized Whittaker models alongside wave-front sets, annihilator varieties, and associated cycles as nilpotent invariants of representations rather than as isolated functional constructions.

## 3. Jacquet modules, asymptotics, and \(L^2\)-criteria

For reductive groups over non-Archimedean local fields, generalized Whittaker functions can be studied through constant terms and Jacquet modules. Let \(G\) be the \(F\)-points of a connected reductive group, \(P_0=M_0U_0\) a minimal parabolic, and \(\psi:U_0\to\mathbf C^\times\) a non-degenerate character. The space
\[
W(G,\psi)=\{W:G\to \mathbf C \text{ smooth} \mid W(ug)=\psi(u)W(g)\}
\]
admits a constant term map
\[
D_P:W(G,\psi)\to W(M,\psi_M)
\]
for any standard parabolic \(P=MU\supseteq P_0\), and Delorme’s construction descends to normalized Jacquet modules [2009.01624]. A key theorem identifies the descended map with the dual of the inverse Bushnell–Henniart isomorphism on compactly supported Whittaker spaces, so \(D_P\) is surjective. The same paper proves that Lapid–Mao’s germ map equals this Jacquet-module map and is therefore injective [2009.01624].

This comparison yields asymptotic expansions controlled by Jacquet-module exponents. For an admissible \(G\)-submodule \(\pi\subset W(G,\psi)\) and \(W\in\pi\), the expansion of \(W(t)\) on cones in \(A_0\) is indexed by parabolics \(P=MU\) and by the character set \(E(A_M,J_P(\pi))\), with terms lying in generalized eigenspaces \(F(A_0)_{(\chi)}\) [2009.01624]. The same paper gives an integral \(\ell\)-adic version: if \(\pi\) is an integral finite-length submodule with integral Jacquet modules, then the expansion can be chosen with integral \(f_i\) and integral \(\phi_i\) [2009.01624].

For the specific families
\[
G_n\in\{GL(n,F),\,GSO(2n-1,F),\,GSp(2n,F),\,GSO(2(n-1),F)\},
\]
a more explicit asymptotic theory is available. Using mirabolic subgroups or their analogues and derivative functors, Matringe proves an asymptotic expansion of Whittaker functions along the maximal torus \(A_n=Z_1\cdots Z_n\), in terms of a minimal set of characters \(\chi_{i,k}\) arising from derivatives \(\pi^{(n-k)}\) [1004.1315]. The same derivative exponents determine square-integrability: for a generic representation with unitary central character, the following are equivalent:
1. all Whittaker functions are in \(L^2(Z_nN_n\backslash G_n)\),
2. all exponents of the derivatives are positive,
3. \(\pi\) is square-integrable, hence a generic discrete series representation [1004.1315].

These results prove, for those four families, the Lapid–Mao conjectural picture that generic representations occurring in \(L^2(Z_nN_n\backslash G_n)\) are precisely the generic discrete series [1004.1315]. A plausible implication is that generalized Whittaker asymptotics are most effective when organized through derivative or Jacquet-module data rather than by direct analysis on the ambient group.

## 4. Global Fourier coefficients, theta lifting, and relative duality

In the global theory, generalized Whittaker models appear as Fourier coefficients of automorphic forms. For a number field \(K\), adeles \(\mathbb A\), and a Whittaker pair \((S,\varphi)\) defined over \(K\), the relevant coefficient is
\[
F_{S,\varphi}(f)=\int_{N(K)\backslash N(\mathbb A)} f(n)\,\chi_\varphi(n)^{-1}\,dn,
\]
where \(N=\exp(\mathfrak n)\) is constructed from \((S,\varphi)\) exactly as in the local theory [1808.00890]. The global comparison theorems show that \(F_{S,\varphi}\) and the coefficient attached directly to \(\varphi\) are connected by sequences of integral transforms, and that maximal Fourier coefficients govern the others [1808.00890][1502.06483].

Local theta correspondence transports generalized Whittaker models along nilpotent-orbit correspondences. For a reductive dual pair \((G,\tilde G)\), moment maps on \(\operatorname{Hom}(V,\tilde V)\) define a lift \(\mathcal O\mapsto \Theta(\mathcal O)\) of nilpotent orbits. If \(\pi\) is a smooth irreducible representation of \(G\) and \(\Theta(\pi)\) its full theta lift, then under the standing moment-map hypothesis there is a canonical identification
\[
\mathrm{Wh}_{\mathcal O}\bigl(\Theta(\pi)\bigr)\cong \mathrm{Wh}_{\Theta(\mathcal O)}(\pi^\vee)
\]
as modules over the relevant stabilizer group [1302.3744]. In the stable range with \(G\) the smaller member, every nilpotent orbit of \(\mathfrak g\) lies in the image of the moment map, so the theorem applies to all such orbits [1302.3744].

This local mechanism underlies more elaborate global results. For the generalized metaplectic theta lift from the \(r\)-fold cover of \(\mathrm{Sp}_{2n}\) to a tower of split even orthogonal groups \(\mathrm{SO}_{2k}\) with \(r\) odd, the Whittaker range consists of exactly \(r+1\) consecutive groups
\[
k=n-\frac{r-1}{2},\ n-\frac{r-3}{2},\ \dots,\ n+\frac{r-1}{2},
\]
assuming the Orbit Conjecture and the Descent Conjecture [2109.05099]. Outside this range the lift cannot be globally generic; at the central point \(k=n+\frac{r+1}{2}\), genericity is equivalent to genericity of the original cuspidal representation on the symplectic side; and at other points in the range nonvanishing of the Whittaker coefficient is characterized by explicit period integrals obtained through root exchange and Fourier expansion [2109.05099].

A further development places generalized Whittaker models inside the Ben-Zvi–Sakellaridis–Venkatesh framework of relative Langlands duality. The 2023 paper characterizes, for orthogonal and symplectic groups, which nilpotent orbits can arise from hyperspherical varieties and exhibits an infinite family of hook-type examples related by theta correspondence [2309.08874]. The 2024 sequel proves the corresponding local numerical conjecture for Plancherel density and, assuming the Lapid–Mao conjecture and local multiplicity one, a global period formula for a family of generalized Whittaker models on \(O_{2k}\) arising from hook-type nilpotent orbits [2401.06624]. In that setting, the local spectral decomposition of
\[
L^2(LU\backslash G,\chi_Y)
\]
is described as the theta-pushforward of the Whittaker–Plancherel measure on the dual symplectic group, and the global generalized Whittaker period is expressed in terms of an adjoint \(L\)-value, local correction factors, and normalized local period integrals [2401.06624].

## 5. Categorical, geometric, and parabolic incarnations

Generalized Whittaker models also admit a categorical reformulation. If a DG category \(\mathcal C\) carries an action of the loop group \(G((t))\), then its Whittaker model is defined by
\[
\mathrm{Whit}(\mathcal C)=\mathcal C^{N((t)),\chi},
\]
where \(\chi\) is a non-degenerate character [1811.02468]. In this setting there are both invariants and coinvariants,
\[
\mathcal C^{\mathcal LN,\chi},
\qquad
\mathcal C_{\mathcal LN,\chi},
\]
and a major theorem states that the pseudo-identity functor
\[
\mathrm{Ps\text{-}Id}:\mathrm{Whit}(\mathcal C)^{\mathrm{co}}\to \mathrm{Whit}(\mathcal C)
\]
is an equivalence [1811.02468]. For \(\mathcal C=\mathrm{Shv}(\mathcal LG/K_n)\), the local Whittaker category is compactly generated, stratified by \(\mathcal LN\)-orbits, and equivalent via Beauville–Laszlo gluing to a global Whittaker category on a level-structured Drinfeld compactification [1811.02468]. This is a categorical local–global theorem rather than a mere analogy.

A different geometric direction concerns parabolic Whittaker functions. For \(\mathfrak{gl}_{\ell+1}\), Gerasimov–Lebedev–Oblezin define Whittaker functions attached to a parabolic subgroup \(P\subset GL(\ell+1)\) as matrix elements of infinite-dimensional representations with parabolic left and right Whittaker vectors [1002.2622]. These functions are common eigenfunctions of commuting Hamiltonians of a parabolic quantum Toda chain, and in the maximal parabolic case \(GL(\ell+1)/P\cong\mathbb P^\ell\) the same function appears both as a type A equivariant topological sigma-model correlator on a disk and as a type B equivariant Landau–Ginzburg correlator, producing a mirror-symmetric realization of the parabolic Whittaker function [1002.2622].

Oblezin develops a related \(\mathrm{Gr}_{m,N}\)-Whittaker function by replacing the standard Cartan and standard nilpotent subalgebras of \(\mathfrak{gl}_N\) with parabolically adapted analogues \(\mathfrak h(m,N)\), \(\mathfrak n(m,N)\), and \(\mathfrak n_+(m,N)\) [1107.2998]. The resulting matrix element admits a Givental-type stationary phase integral representation, and the phase function reproduces the combinatorics of the Batyrev–Ciocan-Fontanine–Kim–van Straten toric degeneration of \(\mathrm{Gr}_{m,N}\), linking generalized Whittaker theory to quantum cohomology and total positivity [1107.2998].

These examples show that “generalized Whittaker model” is not restricted to one formalism. Depending on context, it can mean a quotient attached to a nilpotent orbit, a DG category cut out by \((\mathcal LN,\chi)\)-equivariance, or a matrix-element realization adapted to parabolic geometry. The common feature is the replacement of the single generic Whittaker character by more structured nilpotent, parabolic, or categorical data.

## 6. Infinite-dimensional Lie algebras and generalized Whittaker states

The terminology also extends to infinite-dimensional Lie algebras. For the planar Galilean conformal algebra \(\mathcal G\) and its universal central extension \(\widetilde{\mathcal G}\), a Whittaker module of type \(\phi\) is generated by a vector \(v\) satisfying
\[
xv=\phi(x)v
\qquad
(x\in \mathcal G^+ \text{ or } \widetilde{\mathcal G}^+),
\]
with universal modules
\[
M(\phi)=U(\mathcal G)\otimes_{U(\mathcal G^+)}\mathbf C_\phi,
\qquad
\widetilde M(\phi)=U(\widetilde{\mathcal G})\otimes_{U(\widetilde{\mathcal G}^+)}\mathbf C_\phi
\]
[2007.04046]. The paper classifies universal and generic Whittaker modules, proves that a generic module is irreducible if and only if \(\phi\) is nonsingular, determines all Whittaker vectors in the nonsingular case, and constructs explicit proper submodules in the singular case [2007.04046].

For the affine Lie algebra \(\widehat{\mathfrak{sl}}_2\) of type \(A_1^{(1)}\), non-degenerate Whittaker modules at noncritical level are irreducible, while at critical level one must quotient by a central character coming from the center of the vertex algebra \(V_{-2}(\mathfrak{sl}_2)\) to obtain irreducible modules [1409.5354]. The same paper uses vertex-algebraic and Wakimoto-type constructions to realize families of generalized Whittaker irreducible modules at critical level [1409.5354]. Here the generalized aspect is tied to the enlarged center and to the action of the derivation \(d\), which may be semisimple or free on irreducible modules with the same Whittaker function and the same central character [1409.5354].

In conformal-field-theoretic applications motivated by instanton counting, generalized Whittaker states are not strict coherent states. For asymptotically free \(\mathcal N=2\) theories with fundamental hypermultiplets, the defining relations for the relevant states in Verma modules can involve zero modes such as \(L_0\) or \(J_0^0\), rather than only positive annihilation operators [1203.1427]. In the \(SU(3)\) case with \(N_f=2\), the state satisfies a relation of the form
\[
\bigl(W_1-wL_0\bigr)\,|G_2,m_1,m_2\rangle=\lambda\,|G_2,m_1,m_2\rangle,
\]
and in the \(SU(2)\) case with a surface operator the affine current algebra condition involves \(J_0^0\) [1203.1427]. This suggests a broader module-theoretic usage of the term “generalized Whittaker,” in which the Whittaker condition is deformed by central or zero-mode operators rather than being given by a pure character of a nilpotent subalgebra.

Across these settings, generalized Whittaker models retain a common core: they encode representation-theoretic information through controlled equivariance against nilpotent, parabolic, or positive subalgebra data. What changes from one framework to another is the ambient category—smooth representations, automorphic forms, sheaf categories, principal-series modules, affine or conformal modules—not the underlying principle that Whittaker-type data should be organized by richer orbit or symmetry structures than the single generic character of the classical theory.

Source: https://www.emergentmind.com/topics/generalized-whittaker-models