Anisotropic Hybrid Modes in Wave Physics

• Anisotropic hybrid modes are direction-dependent eigenmodes caused by anisotropy, gyrotropy, and interfacial effects, resulting in mixed polarization states.
• They are modeled using effective tensor coefficients that capture complex coupling in systems like elastic plates, gyroelectromagnetic waveguides, and metasurfaces.
• These modes enable tunable dispersion and localization, facilitating advanced applications such as subdiffraction imaging, THz devices, and on-chip optoelectronics.

Searching arXiv for recent and foundational papers on anisotropic hybrid modes across wave physics. arXiv Search Query: all:"anisotropic hybrid modes" OR ti:"anisotropic hybrid" OR abs:"hybrid modes" anisotropic

Anisotropic hybrid modes (HMs) are direction-dependent eigenmodes in which the modal content is mixed by anisotropy, gyrotropy, interfacial coupling, periodicity, or nonreciprocity, so that propagation cannot be reduced to a single uncoupled polarization, field family, or localization mechanism. In the cited literature, the expression covers frequency-selected Bloch modes in elastic lattices, HE/EH waves in gyroelectromagnetic waveguides, hybrid TM–TE surface waves in anisotropic metasurfaces, plasmon–phonon and plasmon–polariton excitations in layered materials, and non-Hermitian states that are skin-localized along one axis and Anderson-localized along another (Lefebvre et al., 2016, Tuz et al., 2016, Saberi-Pouya et al., 2017, Kotov et al., 2019, Shang et al., 19 Jul 2025).

1. Terminology and range of usage

The term “hybrid” does not denote a single universal mechanism. In different subfields it refers to different kinds of coupling: longitudinal electric and magnetic fields in gyrotropic guides, TM–TE polarization mixing in anisotropic 2D conductors, coupled plasmons and substrate phonons in phosphorene heterostructures, LO/IF/TO admixtures in optical phonons of hexagonal crystals, or the coexistence of distinct localization mechanisms in nonreciprocal disordered lattices (Tuz et al., 2016, Saberi-Pouya et al., 2017, Kotov et al., 2019, Dyson et al., 2020, Shang et al., 19 Jul 2025).

Context	HM content	Anisotropy / hybridization mechanism
Elastic structured media	Frequency-selected Bloch modes	Local curvature and symmetry at special Brillouin-zone points
Gyroelectromagnetic waveguides	HE and EH guided waves	Gyrotropic $\hat\varepsilon$ and $\hat\mu$ couple $E_z$ and $H_z$
Few-layer metasurfaces and layered HMMs	Hybrid TM–TE surface waves, VPPs	Conductivity-tensor mixing, multilayer coupling, hyperbolic dispersion
Nonreciprocal lattices	Skin-Anderson HMs	Direction-dependent nonreciprocity plus disorder

This breadth of usage suggests that anisotropic HMs are best understood as a class of mode structures rather than as a single material platform. What unifies them is that anisotropy changes the local dispersion or constitutive coupling so strongly that the eigenmode acquires mixed character in a direction-selective way.

2. Generic mathematical structures

A recurrent feature is reduction of the full problem to an effective equation in which anisotropy enters through tensor coefficients. In elastic structured media, asymptotic high-frequency homogenisation factorizes the Bloch field near a symmetry point as

$$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$

with $U$ the standing-wave Bloch eigenmode and $f$ a slowly varying envelope. The envelope satisfies

$$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$

For square lattices with reflectional and rotational symmetry, the off-diagonal terms vanish, so the signs and relative magnitudes of $T_{11}$ and $T_{22}$ determine whether the effective medium is elliptic, hyperbolic, or strongly parabolic: $\hat\mu$0 gives elliptic behaviour, $\hat\mu$1 gives hyperbolic behaviour, and $\hat\mu$2 or vice versa gives highly directional parabolic behaviour (Lefebvre et al., 2016).

In longitudinally magnetized composite gyroelectromagnetic media, hybridization is encoded directly in the constitutive tensors,

$\hat\mu$3

so that the longitudinal components $\hat\mu$4 and $\hat\mu$5 obey coupled Helmholtz-type equations. The coupling terms contain $\hat\mu$6, showing that gyroelectric and gyromagnetic effects jointly generate the hybridization (Tuz et al., 2016).

For anisotropic metasurfaces, the analogous statement is that off-diagonal conductivity components mix p- and s-polarized waves. The monolayer surface-wave dispersion takes the form

$\hat\mu$7

so TM and TE sectors decouple only when $\hat\mu$8 (Kotov et al., 2019). Across these examples, anisotropic HMs are governed by tensorial coefficients whose signs, off-diagonal entries, or directional ratios determine modal class.

3. Waveguides and structured-media realizations

A canonical elastic realization is the pinned metallic plate studied in a doubly periodic array of clamped points on a thin Duraluminium plate. The experiment used a $\hat\mu$9, $E_z$0-thick plate with a periodic $E_z$1 array of clamped supports at $E_z$2 spacing, broadband piezoelectric excitation, and heterodyne laser interferometry. The reported fields show isotropic spreading at $E_z$3, a clear X-shaped pattern at $E_z$4, and a clear $E_z$5-shaped pattern at $E_z$6. In the HFH description, the X-shaped mode appears near $E_z$7 with $E_z$8 and $E_z$9, so the effective PDE is hyperbolic and the underlying local dispersion is saddle-like. The $H_z$0-shaped mode appears at $H_z$1 with approximately $H_z$2 and $H_z$3, so one principal coefficient dominates the other by orders of magnitude and the response is effectively parabolic (Lefebvre et al., 2016).

In circular metallic waveguides filled with a longitudinally magnetized composite gyroelectromagnetic medium, the guided modes are intrinsically hybrid because neither pure TE nor pure TM waves can propagate. The standard classification is into HE modes, for which $H_z$4, and EH modes, for which $H_z$5. The cited analysis emphasizes that the more robust identification is to start from the isotropic limit, where modes are TE or TM, and then turn on gyrotropy; TE-like modes evolve into HE modes and TM-like modes evolve into EH modes. Near dielectric and magnetic resonances, the dispersion can show reverse cutoffs, cutoff exchanges, normal and anomalous branches, looped or stepwise curves, and flattened dispersion caused by polarization redistribution across the waveguide cross-section (Tuz et al., 2016).

Modern numerical formulations make the same distinction. In one-layer eccentric cylindrical waveguides, a normalized scalar Helmholtz equation can decouple TE and TM modes after conformal transformation optics. In multilayer anisotropic cylindrical waveguides, that reduction fails, and a vectorial Helmholtz equation for $H_z$6 is required because transverse and longitudinal components remain coupled through anisotropy, multilayer interfaces, and, in the most general case, non-symmetric or non-Hermitian tensors. In that setting the eigenmodes are hybrid modes in the strict waveguide sense (Ribeiro, 2024).

A related anisotropy-driven effect appears in slab waveguides with type-II hyperbolic metamaterial cladding. There, lower-order TM modes with larger $H_z$7 become leaky when $H_z$8, while sufficiently high-order modes with smaller $H_z$9 remain guided. The result is a high-pass spatial-mode filter in which the surviving guided state can be a higher-order mode rather than the fundamental (Tang et al., 2016).

4. Collective, phononic, and polaritonic anisotropic HMs

In phosphorene on polar substrates, the HMs are coupled oscillations of 2D plasmons and substrate surface-optical phonons generated by the Fröhlich interaction. The anisotropy originates in the in-plane effective masses, approximately $$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$0 and $$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$1, so the $$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$2-direction is the light-mass direction and the $$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$3-direction is the heavy-mass direction. The directional factor

$$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$4

enters the plasmon frequency

$$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$5

and the monolayer hybrid branches satisfy

$$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$6

The modes are stronger along the light-mass direction, and the substrate strongly affects the spectrum: SiO$$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$7 has $$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$8, $$u(\mathbf{x})=f(\mathbf{x})\,U(\mathbf{x};\Omega_0),$$9, $U$0; h-BN has $U$1, $U$2, $U$3; and Al$U$4O$U$5 has $U$6, $U$7, $U$8, giving the strongest coupling among the three. Monolayers show three long-wavelength hybrid branches, whereas double layers show three acoustic and three optical hybrid branches, with rotation angle and interlayer spacing as tuning parameters (Saberi-Pouya et al., 2017).

In hexagonal semiconductors such as GaN and AlN, hybrid optical modes arise because optical lattice vibrations at interfaces must satisfy both mechanical and electrical boundary conditions. The general hybrid is a linear combination of a longitudinally polarized LO mode, an interface mode, and an interface TO mode. Dielectric and elastic anisotropy enter through $U$9 and directional LO/TO frequencies, yielding conditions such as

$f$0

and, in the quasi-cubic approximation,

$f$1

When lattice dispersion is retained, the TO component is generally required; in the extreme long-wavelength limit the hybrid reduces to LO + IF only, no fields are induced in the barrier, and there are no remote-phonon effects (Dyson et al., 2020).

A hyperbolic realization appears in topological-insulator/trivial-insulator superlattices. A five-period Bi$f$2Se$f$3/BIS structure (“5L-50nm”) supports up to three high-wavevector volume plasmon polariton modes, VPP1–VPP3, in the type-II $f$4 region. These are bulk high-$f$5 modes formed by coupling the surface plasmons at the TI interfaces and are excited in micro-ribbon resonators by the grating momentum $f$6. The reported mode indices range from 55 to 531 and the quality factors from 2.19 to 6.7; the paper states that the mode indices are $f$7 larger than in traditional HMMs while the quality factors remain comparable. The physical origin is attributed to the two-dimensional Dirac nature of the electrons occupying the TI surface states (Wang et al., 2022).

5. Dispersion topology, hyperbolicity, and geometric representations

Anisotropic HMs are often identified most clearly through the topology of their dispersion surfaces or iso-frequency contours. In the elastic plate example, a small carrier-frequency shift moves the same structure through elliptic, hyperbolic, and strongly anisotropic/parabolic regimes. The X-shaped real-space field is the direct signature of a saddle point in the local dispersion surface, whereas the $f$8-shaped field corresponds to very unequal local curvatures and near-parabolic transport (Lefebvre et al., 2016).

In few-layer anisotropic metasurfaces, the basic objects are hybrid TM–TE surface waves described by a generalized $f$9 transfer-matrix formalism. The cited work predicts hyperbolic plasmon-exciton polaritons in plasmon-exciton hybrids, hyperbolic acoustic waves with strong confinement in both out-of-plane and in-plane directions in uniaxial plasmonic bilayers, and elliptic and hyperbolic backward surface waves with negative group velocity on metal substrates. It also shows that the topology of the iso-frequency contours can be changed by substrate sign, spacer thickness, multilayer splitting into optical and acoustic branches, and twist angle in ultrathin bilayers. For twisted bilayers, the effective off-diagonal response can be generated by geometry alone, and the hyperbolic-to-elliptic transition becomes highly sensitive to the twist $$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$0 (Kotov et al., 2019).

A more extreme topological reorganization is described for anisotropic metamaterials without magnetoelectric coupling. There the plasmonic high-$$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$1 branch and the magnetic Bloch high-$$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$2 branch hybridize at finite but large $$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$3, producing anti-crossing splittings in the hyperbolic dispersion. In the strict $$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$4 limit, the medium is only bi-hyperbolic, but the finite-$$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$5 splitting can yield tri-hyperbolic-like or tetra-hyperbolic-like iso-frequency topologies. The splitting scales as

$$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$6

so it vanishes asymptotically but is decisive in the physically relevant finite-$$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$7 regime (Durach, 2020).

A geometric representation of anisotropic HMs is provided by the hybrid-order Poincaré sphere for inhomogeneous anisotropic media such as $$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$8-plates. The formalism uses two pole states with opposite circular polarizations but generally different orbital angular momenta $$T_{ij}(\Omega_0)\frac{\partial^2 f}{\partial x_i\partial x_j}+(\Omega_0^2-\Omega^2)f=0.$$9 and $T_{11}$0. Any state is written as

$T_{11}$1

and the Berry curvature is

$T_{11}$2

with geometric phase

$T_{11}$3

In that representation, latitude is controlled by retardation, longitude by initial axis orientation, and both the Berry curvature and the Pancharatnam-Berry phase are proportional to the total angular momentum (Yi et al., 2014).

6. Non-Hermitian, localization, and broader significance

The notion of anisotropic HMs has recently extended beyond polarization and branch mixing to localization physics. In the two-dimensional Hatano–Nelson model with nonreciprocal hoppings

$T_{11}$4

and complex onsite disorder, three classes of eigenstates appear when nonreciprocity and disorder compete: skin modes, Anderson localized modes, and hybrid modes. The HMs are states that are skin-localized in one direction but Anderson-localized in the orthogonal direction. Direction-resolved transfer matrices and essential Lyapunov exponents produce separate mobility-edge surfaces in the complex-energy plane, so a spectral region can exist in which one direction is skin-dominated while the other is disorder-dominated. At $T_{11}$5, the paper reports a reentrant $T_{11}$6 transition at $T_{11}$7 and $T_{11}$8 (Shang et al., 19 Jul 2025).

A broader plasma-theory analogue appears in anisotropic quark–gluon plasmas. There the gluon polarization tensor requires a nine-tensor basis, and anisotropy plus chirality generates a much richer set of real and imaginary collective branches than the isotropic or one-parameter-deformed case. The cited work emphasizes that the size and domain of imaginary solutions are enhanced by generalized anisotropy, and that even a very small chiral chemical potential is significantly magnified when anisotropy is present (Carrington et al., 2021). This suggests that “hybrid” in the anisotropic HM literature can also denote coupled tensor sectors that enlarge the mode content beyond the conventional longitudinal/transverse decomposition.

Applications emphasized across the cited literature include subdiffraction imaging, subwavelength focusing, waveguiding, negative refraction, enhanced sensing, THz emitters and absorbers, on-chip THz optoelectronics, tunable microwave/terahertz waveguides and compact resonators, and planar optical technologies based on few-layer metasurfaces and van der Waals heterostructures (Wang et al., 2022, Tuz et al., 2016, Kotov et al., 2019). A plausible implication is that anisotropic HMs are most consequential when a material platform permits fine control over tensor signs, off-diagonal couplings, layer orientation, or nonreciprocal strength, because those parameters determine whether the mode spectrum is elliptic, hyperbolic, parabolic, polarization-mixed, or direction-selectively localized.