---
title: Adaptive Sampling CI for Electronic Structure
url: https://www.emergentmind.com/topics/adaptive-sampling-configuration-interaction-asci
type: topic
---

# Adaptive Sampling CI for Electronic Structure

Adaptive Sampling Configuration Interaction (ASCI) is a selected configuration interaction (SCI) algorithm designed to efficiently approximate the full configuration interaction (FCI) solution to the electronic structure problem, with emphasis on scalability to large active spaces and extensibility to correlated electronic structure and dynamical observables. The method iteratively constructs a compact variational wave function by identifying and retaining only the most important Slater determinants from the exponentially large Hilbert space. ASCI is a fully deterministic method that enables chemically accurate calculations in active spaces previously intractable for exact diagonalization and provides a robust framework for integration into multiconfigurational and embedding electronic structure approaches [1912.08379, 1808.02049, 1807.00821].

## 1. Variational Ansatz and Determinant Selection

The ASCI approach formulates a variational CI wave function as
$$
|\Psi\rangle = \sum_I C_I |D_I\rangle,
$$
where the determinants $\{|D_I\rangle\}$ define the variational subspace $S$ and are selected for their large contributions to the CI expansion. The associated variational energy is given by
$$
E_{\mathrm{var}} = \langle \Psi | \hat{H} | \Psi \rangle = \sum_{IJ} C_I H_{IJ} C_J,
$$
with Hamiltonian matrix elements $H_{IJ}$ computed between determinants. Determinant selection, central to the ASCI scheme, exploits a first-order perturbative estimate derived from the CI eigenvalue equation,
$$
C_i = \frac{\sum_{j\neq i} H_{ij} C_j}{H_{ii} - E},
$$
providing a ranking metric
$$
A_i = \frac{\sum_{j\in S} H_{ij} C_j}{H_{ii} - E_{\mathrm{var}}},
$$
to identify external determinants most likely to significantly lower the energy upon adding them to the variational subspace. Iterative pruning and growth of $S$ using this score ensures that the most important correlation effects are efficiently captured [1912.08379, 1808.02049].

## 2. Iterative Workflow, Search, and Hamiltonian Construction

The ASCI workflow consists of the following key steps:

1. **Ranking and selection of reference determinants**: Retain the top $c$ determinants in $S$ by $|C_j|$ as "core" parents for excitation generation.
2. **Search space generation**: Produce all singly and doubly excited determinants from the core parents.
3. **Scoring and ranking**: Compute $A_i$ for each generated determinant, discarding those below a cutoff.
4. **Variational subspace update**: Merge $S$ with the top $t$ ranked candidates (by $|A_i|$) to form an expanded subspace $S_{k+1}$.
5. **Diagonalization**: Construct and diagonalize the Hamiltonian in $S_{k+1}$ to obtain new coefficients and energy.
6. **Convergence**: Repeat the search-diagonalize cycle until $E_{\mathrm{var}}$ converges or $|S|$ reaches a target $N_{\mathrm{det}}$ [1912.08379, 1807.00821].

Efficient Hamiltonian construction exploits data structures such as dynamic bit masking and residue arrays to identify connected determinant pairs rapidly and reduce computational bottlenecks [1807.00821].

## 3. Deterministic Second-Order Perturbation (PT2) Correction

Residual correlation energy missing from the truncated CI expansion is accounted for using second-order Epstein-Nesbet perturbation theory,
$$
E_{\mathrm{PT2}} = \sum_{i\notin S} \left|\sum_{j\in S} H_{ij} C_j\right|^2 / (E_{\mathrm{var}} - H_{ii}),
$$
where the sum is over external determinants linked to $S$ by single or double excitations. Deterministic evaluation exploits partial summation, constraint partitioning (triplet/quadruplet indices), and fast sorting algorithms (including hash-based compression) for high throughput and perfect scaling on multi-node or GPU architectures. For large-scale models, this delivers orders-of-magnitude speed-up compared to stochastic PT2 approaches (e.g., SHCI), while providing arbitrarily small statistical error [1808.02049, 1807.00821].

The FCI limit can be reliably estimated by extrapolating $E_{\mathrm{var}} + E_{\mathrm{PT2}}$ to $E_{\mathrm{PT2}}\to 0$ over several $N_{\mathrm{det}}$ [1912.08379, 2103.09972].

## 4. Orbital Optimization and CASSCF Integration (ASCI-SCF)

ASCI can serve as an FCI-solver in CASSCF-like multiconfigurational approaches for large active spaces, enabling efficient self-consistent field (SCF) optimization of the orbital basis ("ASCI-SCF"). The standard double-loop scheme consists of:

- **Outer loop**: Orbital optimization using variational ASCI energy $\nabla_\Delta E_{\mathrm{var}}$, typically via BFGS quasi-Newton steps with diagonal Hessian preconditioning.
- **Inner loop**: For fixed orbitals, repeat the ASCI variational/selection cycle to update the determinant list and coefficients.
- **Periodic determinant refresh**: Every $m$ orbital steps, re-optimize the determinant list to adapt to changing orbital character.

Key distinctions from exact CASSCF arise because the ASCI variational space is not invariant under active-active orbital rotations, producing numerous local extrema. Mitigation strategies include starting from natural orbitals, staged growth of the $N_{\mathrm{det}}$ parameter, spin-state cycling, and selection by minimum variational energy [1912.08379, 2103.09972].

Analytic energy gradients and Z-vector (Lagrangian) methods enable efficient geometry optimization and electronic property evaluation at near-CASSCF accuracy for active spaces with 30–50 orbitals [2103.09972].

## 5. Parallelization and Computational Scaling

Distributed memory parallelization of ASCI leverages memory-efficient constraint partitioning, static load balancing, and block-row storage for the Hamiltonian and SpMV operations. The ASCI search is parallelized by dividing constraints (e.g., triplet indices) among processors, and collective quickselect algorithms efficiently extract the global top-ranked determinants after local partial scoring. The dominant cost at scale is the Hamiltonian construction; the parallel Davidson diagonalization step achieves high efficiency, with weak scaling limits set mainly by synchronization and load imbalance in nonzero block distribution. Benchmark calculations demonstrate variational ASCI calculations with up to $3\times 10^8$ determinants on 16,384 cores at $>95\%$ parallel efficiency for systems such as Cr$_2$(24e,30o) [2303.05688].

## 6. Applications and Performance Benchmarks

ASCI and ASCI-SCF have enabled multiconfigurational calculations in active spaces (orbital, electron pairs) inaccessible to conventional methods:

- **Periacenes and PAHs**: Active spaces of up to (52e,52o); chemically accurate singlet-triplet gaps and electronic structure up to the 6-periacene ($\Delta E_{ST}\sim8$ kcal/mol), with wall times of $80$–$350\,$s per SCF iteration on 24 CPU cores; analysis confirmed biradical but not strong polyradicaloid character [1912.08379, 2103.09972].
- **Iron Porphyrin**: Balanced active spaces (40e,42o); ASCI-SCF energies lower than HCISCF with fewer determinants, ground-state and excited-state splittings in quantitive agreement with experiments [1912.08379].
- **G1 Test Set, Cr$_2$, F$_2$, C$_2$**: ASCI+PT2 achieves $<1\,$mHa error for atomization energies and energies, with PT2 correction and natural orbital rotations further accelerating convergence relative to alternative SCI schemes [1808.02049, 1807.00821].
- **DMFT and Dynamical Simulations**: As an impurity solver in DMFT, ASCI enables simulations of cluster models (e.g., $3\times3$ clusters with 17–24 baths) at a cost several orders of magnitude lower than prior CI-based approaches; accurate Green's functions and self-energies are obtained with a single or two-layer zero-state augmentation [1711.04771].
- **Time-dependent Propagation**: The TD-ASCI extension combines the static selection with a short iterative Lanczos algorithm for unitary propagation of the CI wave function, enabling the computation of dipole autocorrelation functions and absorption spectra to within $\pm0.05$ eV of EOM-CCSDT(T) accuracy using $p=30\text{--}60$ Krylov vectors and up to $2\times 10^6$ determinants [2411.07615].

## 7. Algorithmic Innovations and Future Challenges

ASCI algorithms have introduced several innovations, including:

- Sorting-based determinant selection, memory-efficient search constraints, residue array and dynamic bit-masking Hamiltonian construction, hash-based PT2 evaluation, and scalable parallelization approaches [1807.00821, 1808.02049, 2303.05688].
- Deterministic PT2 correction and extrapolation to the FCI limit, enabling robust energy estimates without stochastic error.
- Analytic gradients and Z-vector implementation for geometry optimization at the ASCI-SCF-PT2 level [2103.09972].
- Extensions to time-dependent propagation for dynamical observables [2411.07615].

Remaining challenges include integration of dynamical correlation beyond PT2 (e.g., multireference perturbation theory, coupled-cluster methods), more robust orbital optimization strategies for excited states, further reduction of computational cost (block-sparse tensors, advanced pruning), and optimization for exascale hardware and GPU acceleration [1912.08379, 2103.09972, 2303.05688].

---

**Key References:**

- "CASSCF with Extremely Large Active Spaces using the Adaptive Sampling Configuration Interaction Method" [1912.08379]
- "An efficient deterministic perturbation theory for selected configuration interaction methods" [1808.02049]
- "Modern Approaches to Exact Diagonalization and Selected Configuration Interaction with the Adaptive Sampling CI Method" [1807.00821]
- "A Parallel, Distributed Memory Implementation of the Adaptive Sampling Configuration Interaction Method" [2303.05688]
- "Near-Exact CASSCF-Level Geometry Optimization with a Large Active Space using Adaptive Sampling Configuration Interaction Self-Consistent Field Corrected with Second-Order Perturbation Theory (ASCI-SCF-PT2)" [2103.09972]
- "Real-time propagation of adaptive sampling selected configuration interaction wave function" [2411.07615]
- "Dynamical Mean-Field Theory Simulations with the Adaptive Sampling Configuration Interaction Method" [1711.04771]

Source: https://www.emergentmind.com/topics/adaptive-sampling-configuration-interaction-asci