---
title: 'HIP Hessians: Direct Learning of Hessian Matrices'
url: https://www.emergentmind.com/topics/hip-hessians
type: topic
---

# HIP Hessians: Direct Learning of Hessian Matrices

HIP Hessians, in the sense of “Hessian Interatomic Potentials,” are a direct-learning framework for predicting molecular Hessian matrices from an SE(3)-equivariant graph neural network without using automatic differentiation, finite differences, or coupled-perturbed solvers [2509.21624]. The method targets the full molecular Hessian needed in transition-state search, vibrational analysis, geometry optimization, and zero-point energy corrections, and does so by constructing equivariant, symmetric \(3N\times 3N\) outputs from irreducible-representation features already present in message-passing architectures [2509.21624]. Within the broader landscape of learned Hessians, HIP differs from approaches that recover Hessians by differentiating a learned energy surface, such as NewtonNet-based transition-state optimization, where the Hessian is obtained analytically from a \(C^2\)-continuous neural potential trained only on energies and forces [2405.02247].

## 1. Concept, scope, and nomenclature

HIP is the acronym used for “Hessian Interatomic Potentials” in “Shoot from the HIP: Hessian Interatomic Potentials without derivatives” [2509.21624]. Its central claim is that Hessians can be predicted directly from a deep learning model in one forward pass, rather than derived from an energy model by second-order differentiation. The paper motivates this by the observation that molecular Hessians are computationally expensive and scale poorly with system size under both quantum-mechanical methods and neural-network differentiation pipelines [2509.21624].

The target application domain is molecular simulation and electronic-structure workflows in which second derivatives of the potential energy are operationally central. The paper explicitly validates the approach on transition-state search, accelerated geometry optimization, zero-point energy corrections, and vibrational analysis benchmarks [2509.21624]. This places HIP in the same problem family as recent work on learned Hessians for saddle-point optimization, where full Hessian information improves RS-PRFO-based transition-state searches relative to quasi-Newton updates [2405.02247].

The terminology is potentially ambiguous. In another paper, “HIP Hessians” refers to local layer-wise Hessians of neural networks, defined blockwise with respect to each layer’s parameters and used as diagnostics of optimization geometry, overfitting, and generalization [2510.17486]. In molecular ML, however, HIP denotes Hessian Interatomic Potentials [2509.21624]. The two usages are unrelated beyond the shared emphasis on second-order structure.

## 2. Hessian object and symmetry constraints

HIP predicts the molecular Hessian
\[
\mathbf{H}_{IJ}^{\alpha,\beta}=\frac{\partial^2 E}{\partial \mathbf{R}_I^{\alpha}\,\partial \mathbf{R}_J^{\beta}},
\]
where \(I,J=1,\dots,N\) index atoms and \(\alpha,\beta\in\{x,y,z\}\) index Cartesian components [2509.21624]. The output is therefore a real symmetric \(3N\times 3N\) matrix.

Two structural constraints organize the construction. First, the Hessian must satisfy symmetry,
\[
\mathbf{H}=\mathbf{H}^\top.
\]
Second, under a global rotation \(\mathbf{Q}\), each atom-pair block must transform as a Cartesian rank-2 tensor,
\[
\mathbf{H}_{I,J} \xrightarrow[]{\mathbf{Q}} \mathbf{Q}\,\mathbf{H}_{I,J}\,\mathbf{Q}^\top,
\]
and at the full-matrix level
\[
\mathbf{H} \xrightarrow[]{\mathbf{Q}} (\mathbf{I}_{N}\otimes \mathbf{Q})\,\mathbf{H}\,(\mathbf{I}_{N}\otimes \mathbf{Q})^\top.
\]
The paper emphasizes that HIP enforces these properties by construction rather than through penalty terms [2509.21624].

A notable conceptual point is that Hessians are treated differently from forces. The paper states that Hessians do not need to be conservative in the same sense as forces; they only need to be symmetric and transform correctly. This is the rationale for predicting Hessians directly rather than deriving them from a scalar energy model [2509.21624]. By contrast, differentiable-energy approaches infer Hessians from a smooth learned potential, as in NewtonNet, where smooth activations and a polynomial cutoff render the energy surface \(C^2\)-continuous so that forces and Hessians can be obtained analytically by automatic differentiation [2405.02247].

## 3. Equivariant construction from irreducible representations

HIP starts from an equivariant message-passing backbone; in the reported implementation the backbone is EquiformerV2 with four transformer layers [2509.21624]. The key observation is representation-theoretic: if the backbone provides equivariant features with angular-momentum channels up to \(l=2\), then those features can be assembled into Cartesian \(3\times 3\) Hessian blocks while preserving SE(3) equivariance and matrix symmetry [2509.21624].

The readout begins by forming atom-pair features through message passing,
\[
\mathbf{h}_{I,J,l,m,c}
= \mathbf{v}(\mathbf{h}^{(T)}_I,\mathbf{h}^{(T)}_J,\mathbf{r}_{I,J})
= \sum_{l_1,l_2} w_{l_1,l_2,l_3}(\|\mathbf{r}_{I,J}\|)
\left(
\mathbf{f}_{l_1}(\mathbf{h}_{I},\mathbf{h}_{J})
\otimes_{l_1,l_2}^{l_3}
\mathbf{Y}_{l_2}\!\left(\frac{\mathbf{r}_{I,J}}{\|\mathbf{r}_{I,J}\|}\right)
\right).
\]
These pair features are then projected to the compact irrep set \((1\times 0e + 1\times 1e + 1\times 2e)\),
\[
\tilde{\mathbf{h}}_{I,J,l,m}=\mathbf{W}_{l,c}\mathbf{h}_{I,J,l,m,c}.
\]
A Clebsch–Gordan tensor-product expansion reconstructs an intermediate \(3\times 3\) block,
\[
\mathbf{H}'_{I,J,m_1,m_2}
=
\sum_{l,m}
\mathbf{C}^{l,m}_{l_1=1,m_1,l_2=1,m_2}\,
\tilde{\mathbf{h}}_{I,J,l,m}.
\]
The final prediction is explicitly symmetrized,
\[
\mathbf{H}=\mathbf{H}'+\mathbf{H}'^\top.
\]
The paper identifies this final symmetrization as the mechanism enforcing \(\mathbf{H}=\mathbf{H}^\top\) [2509.21624].

The requirement of \(l=2\) features is not incidental. Because \(1\otimes 1\) decomposes into \(l=0,1,2\), irreps through \(l=2\) are needed to span all components of a Cartesian \(3\times 3\) tensor block. The paper states explicitly that irreps only up to \(l=1\) would be insufficient to represent the \(l=2\) content needed for a full Hessian readout [2509.21624]. This is the mathematical basis of the direct blockwise construction.

## 4. Supervision, datasets, and loss design

HIP is trained on explicit Hessian labels rather than on energies and forces alone [2509.21624]. The standard elementwise losses are
\[
\mathcal{L}_{\mathrm{MAE/MSE}}
=
\sum_{i,j}
\left|
\mathbf{H}_{i,j}-\mathbf{H}^{\mathrm{pred}}_{i,j}
\right|_{\mathrm{MAE/MSE}},
\]
but the main experiments augment this with a subspace loss over the lowest eigenmodes,
\[
\mathcal{L}_{\mathrm{sub}}
=
\sum_{i,j}
\left|
\mathbf{V}_{[:,:k]}^\top
\mathbf{H}^{\mathrm{pred}}
\mathbf{V}_{[:,:k]}
-
\mathbf{\Lambda}_{[:,:k]}
\right|_{i,j},
\]
leading to the combined objective
\[
\mathcal{L}
=
\mathcal{L}_{\mathrm{MAE/MSE}}
+
\alpha \mathcal{L}_{\mathrm{sub}}.
\]
The reported choice is \(k=8\), justified by the fact that the Hessian has 5 or 6 rigid-body zero modes and that the low-frequency subspace is crucial for ZPE, transition-state search, and frequency analysis [2509.21624].

The main training resource is the HORM dataset, described as the largest Hessian database used in the paper. It contains reactive molecular geometries with 5–30 atoms, sampled from Transition1x and RGD1, with Hessian, energy, and force labels recomputed at \(\omega\)B97X/6-31G\(*\) [2509.21624]. The training set includes 1,725,362 molecules from Transition1x and 60,000 from RGD1, with 50,844 Transition1x samples used for validation [2509.21624]. To isolate Hessian prediction from energy/force-model differences, the backbone is frozen and only the Hessian head is trained, so HIP-EquiformerV2 and the AD-based baseline share the same underlying energy/force model [2509.21624].

Within the broader ecosystem of Hessian-supervised molecular learning, HIP is complemented by dataset-building efforts such as Hessian QM9, which provides 41,645 molecules with equilibrium geometries, vibrational modes, vibrational frequencies, and numerical Hessian matrices in vacuum, water, THF, and toluene at the \(\omega\)B97X/6-31G\(*\) level [2408.08006]. That work showed that including Hessians in the loss of an E(3)-equivariant message-passing GNN reduced vibrational-frequency MAE from \(42.44\ \mathrm{cm}^{-1}\) to \(9.49\ \mathrm{cm}^{-1}\) for motions above \(400\ \mathrm{cm}^{-1}\) [2408.08006]. HIP takes a different step: it uses Hessian labels not merely to refine an energy model, but to learn Hessians directly [2509.21624].

## 5. Reported empirical performance

On the HORM-Transition1x validation set, HIP-EquiformerV2 is reported to outperform the AD-based EquiformerV2 baseline on all listed Hessian metrics while reducing per-molecule latency from \(633.0\) ms to \(38.5\) ms [2509.21624].

| Metric | HIP-EquiformerV2 | EquiformerV2 (AD) |
|---|---:|---:|
| Hessian MAE \((\mathrm{eV}/\text{\AA}^2)\) | 0.030 | 0.074 |
| Eigenvalue MAE \((\mathrm{eV}/\text{\AA}^2)\) | 0.063 | 0.242 |
| First-eigenvector cosine similarity | 0.870 | 0.541 |
| First-eigenvalue MAE \((\mathrm{eV}/\text{\AA}^2)\) | 0.130 | 0.324 |
| Time per molecule | 38.5 ms | 633.0 ms |

The text summarizes these validation gains as “2x lower Hessian MAE, 3.5x lower eigenvalue MAE, and 1.5x higher eigenvector cosine similarity” [2509.21624]. For speed and memory, the paper reports that direct Hessian prediction is \(10\)–\(74\times\) faster than AD depending on molecule size, at least \(78\times\) faster in batched prediction, and \(2\)–\(3\times\) lower in memory usage on small molecules with 5–30 atoms [2509.21624]. The batched-AD disadvantage is attributed to the fact that AD effectively treats a batch as one larger problem, so Hessian memory scales quadratically with batch size [2509.21624].

Downstream results are similarly reported in Hessian-dependent tasks. For geometry optimization, using HIP Hessians in exact second-order RFO gives convergence in the fewest steps in the median case, and HIP-initialized BFGS performs best among the hybrid methods; finite-difference and AD Hessians are said to frequently fail to converge in this setting [2509.21624]. For zero-point energy corrections, HIP-EquiformerV2 attains ZPE MAE \(0.0004\) eV and \(\Delta\)ZPE MAE \(0.0016\) eV, with standard deviations \(0.0003\) and \(0.0018\), respectively [2509.21624]. For transition-state search in the ReactBench workflow, GSM success is identical between HIP and AD versions of the same backbone because GSM uses only energies and forces, but improvements appear in RS-P-RFO refinement and Hessian-based frequency analysis [2509.21624]. In the main table, HIP-EquiformerV2 achieves 92% frequency-analysis accuracy for classifying extrema, compared with 71%–82% for the AD baselines [2509.21624].

The ablation on the loss function further emphasizes the role of low-mode supervision. The MAE+subspace loss yields 750 TS successes, 705 RFO convergences, and 698 cases passing both, versus 740/693/683 for plain MAE and 718/669/659 for MSE [2509.21624]. For frequency analysis, MAE+subspace achieves 93% true positive rate, 6% false positive rate, 7% false negative rate, 94% true negative rate, and 92% overall accuracy [2509.21624]. These results are aligned with the paper’s claim that the low-frequency subspace, rather than uniform elementwise accuracy alone, is decisive for many downstream chemical tasks.

## 6. Vibrational analysis, transition states, and relation to other Hessian-learning strategies

The vibrational-analysis pipeline reported for HIP removes the 5 or 6 rigid-body modes by mass weighting and Eckart projection before computing frequencies, ZPE, and the number of negative eigenvalues [2509.21624]. The appendix details the construction: center-of-mass coordinates, mass weighting
\[
\widetilde{\mathbf{H}}=\mathbf{M}^{-1/2}\mathbf{H}\mathbf{M}^{-1/2},
\]
followed by translation and rotation vectors, orthonormalization, and projection onto the vibrational subspace [2509.21624]. This makes the subspace loss operationally consistent with the evaluation procedures used for spectroscopy and transition-state diagnostics.

HIP is best understood relative to two neighboring strategies. The first is differentiable-energy learning, exemplified by NewtonNet for transition-state optimization, where the model is trained on energies and forces, uses smooth activations and a polynomial cutoff to remain \(C^2\)-continuous, and supplies analytic Hessians by automatic differentiation at every optimization step [2405.02247]. That approach reduced optimization steps by about \(2\times\) relative to quasi-Newton optimization and reduced total gradient calls by nearly \(3\times\), while making Hessian evaluation at least three orders of magnitude faster than DFT analytical Hessians [2405.02247]. The second strategy is explicit Hessian supervision of an energy model, as in Hessian QM9, where second-derivative labels improve local PES curvature and vibrational frequencies across solvent environments [2408.08006]. HIP departs from both by removing the requirement that Hessians be obtained from a learned scalar potential [2509.21624].

A plausible implication is that direct Hessian predictors and differentiable-energy Hessian generators occupy complementary niches. Direct prediction avoids the \(O(N^2)\) Hessian-vector-product burden of AD Hessians and the \(O(N^5)\) cost of analytic or finite-difference quantum-chemistry Hessians, while differentiable-energy models preserve exact derivative consistency with a learned scalar energy surface [2509.21624; 2405.02247]. The available data do not claim equivalence between these design philosophies, but they do show that both can materially improve second-order chemistry workflows.

## 7. Implementation details, limitations, and open questions

The reported HIP implementation uses EquiformerV2 with four layers, 128 sphere channels, 4 attention heads, 64-dimensional attention channels, 128-dimensional FFN hidden size, SiLU activations, a Gaussian distance basis of size 512, cutoff radius 12 Å, cutoff Hessian 12 Å, and \(L_{\max}=4\) spherical harmonics with \(M_{\max}=2\); the Hessian head has three Hessian-specific layers [2509.21624]. Training is performed on a single H100 GPU for roughly six days using AdamW with learning rate \(5\times 10^{-4}\), batch size 128 for training and 256 for validation, gradient clipping at 0.1, StepLR decay with step size 10 and gamma 0.85, AMSGrad, zero weight decay, and 300 epochs with a limit of 1600 training batches per epoch, described as corresponding to about 35 full epochs [2509.21624]. The transition-state workflows use pysisyphus for RS-RFO, RS-P-RFO, and IRC, and ReactBench for the benchmark setup [2509.21624].

The paper also states several limitations. HIP is trained only on relatively small organic molecules because DFT Hessian labels are expensive to obtain, and scaling to larger systems, materials, biomolecules, or proteins is left for future work [2509.21624]. The reported models train only the Hessian head with a fixed backbone rather than in an end-to-end fashion, and the authors explicitly expect improvements from joint training of energies, forces, and Hessians, longer training, and additional hyperparameter tuning [2509.21624]. Locality is built into the head through an interaction cutoff, so the method relies on the empirically and theoretically supported sparsity of molecular Hessians arising from localized electronic interactions [2509.21624]. Within the cutoff the pairwise construction has \(O(N^2)\) memory and compute, but the paper states that for larger systems the effective scaling becomes closer to \(O(N)\) because of sparsity [2509.21624].

The codebase and model weights are reported as open sourced at `https://github.com/BurgerAndreas/hip` [2509.21624]. This operational detail matters because HIP is presented not only as a modeling idea but as a concrete replacement for derivative-based Hessian generation in downstream molecular workflows. Within the evidence provided, its defining proposition is that Hessians need not remain a secondary quantity derived from energies: they can be the primary prediction target of an equivariant molecular model [2509.21624].

Source: https://www.emergentmind.com/topics/hip-hessians