Probing a Heavy Dark $Z$ Boson at Multi-TeV Muon Colliders: Leveraging the Optimized Recoil Mass Technique

Abstract: We investigate the discovery potential of multi-TeV muon colliders for a heavy dark $Z$ boson ($Z_{\rm D}$) with a mass above 1 TeV through the associated production channel $\mu^+\mu^- \to Z_{\rm D}\gamma$. This process enables precise $M_{Z_{\rm D}}$ reconstruction using the photon recoil mass ($m_{\rm recoil}$). Focusing on the $Z_{\rm D} \to jjX$ and $Z_{\rm D} \to e^+e^-$ decay modes, we present strategies for achieving high sensitivity to the kinetic mixing parameter $\varepsilon$ at 3, 6, and 10 TeV muon colliders with integrated luminosities of 1, 4, and 10 ab$^{-1}$ respectively, assuming $Z_{\rm D}$ decays exclusively into Standard Model particles. A key innovation is our optimized implementation of $M_{Z_{\rm D}}$-dependent cuts on $m_{\rm recoil}$, which accounts for the energy-dependent detector response. For heavier $Z_{\rm D}$, the associated photon becomes less energetic, leading to better photon energy resolution and thus enabling more stringent $m_{\rm recoil}$ cuts. This approach enhances $\varepsilon$ sensitivity for heavier $Z_{\rm D}$. Conversely, for lighter $Z_{\rm D}$, the lower-energy electron pair from $Z_{\rm D} \to e^+e^-$ enables tighter cuts on the invariant mass of the electron pair ($m_{ee}$), providing better sensitivity in the lighter mass regime. Combining these complementary $m_{\rm recoil}$- and $m_{ee}$-based selections with both $jjX$ and $e^+e^-$ channels, we achieve $\varepsilon$ sensitivity down to $O\left(10^{-3}\right)$ as $M_{Z_{\rm D}}$ approaches $\sqrt{s}$, substantially surpassing the reach of a 100 TeV proton-proton collider. Even if $Z_{\rm D}$ decays into dark-sector particles, the recoil mass method remains effective, establishing muon colliders as powerful facilities for exploring heavy dark sectors.