---
title: Hybrid Analogue-Digital CIM System
url: https://www.emergentmind.com/topics/hybrid-analogue-digital-compute-in-memory-system
type: topic
---

# Hybrid Analogue-Digital CIM System

A hybrid analogue–digital compute-in-memory (CIM) system is a heterogeneous architecture that integrates analogue in-memory compute engines—typically based on non-volatile or SRAM/DRAM-based crossbars for massive parallelization of multiply-accumulate (MAC) operations—with digital processors, such as CPUs, digital compute-in-memory (DCIM) subarrays, or digital logic for task orchestration, data movement, control, and high-precision computation. This architecture enables simultaneous exploitation of the ultra-high energy/area efficiency of analogue MAC computation and the flexibility, accuracy, and programmability of digital logic and memory, targeting modern neural network inference and training workloads.

## 1. System-Level Architecture

Hybrid analogue–digital CIM systems adopt a tightly-coupled architecture in which digital processing cores (e.g., RISC-V or ARM clusters) share memory resources and interconnect with one or more analogue in-memory compute accelerators (IMA) or analogue crossbar arrays. Shared resources allow for high-bandwidth, low-latency data exchange, mutual exclusion via locks, and concurrent job scheduling between analogue and digital domains. A canonical example consists of:
- An 8-core RISC-V cluster and an analogue IMA, both accessing a shared 512 kB tightly-coupled data memory (TCDM) via a low-latency interconnect.
- The IMA itself is hierarchical, comprising a control FSM, 3D-strided address generators, digital input layer (DAC buffers), the analogue compute core (e.g., PCM crossbar with DAC/ADC), and digital output layer (ADC buffers).
- The number of master ports on the TCDM interconnect (Nload/Nstore) can be varied at design time to trade area and performance.
- The hybridization appears both at the SoC system level and down to individual memory macro design, where e.g., the upper bits of a word are processed digitally and lower bits analogically in a split-domain macro [2508.17562][2411.06079].

This partitioning supports flexible workload mapping and minimizes data-movement bottlenecks, with all processing phases tightly synchronized by software through control/status registers, done flags, and optional interrupts [2109.01404][2212.02872][2205.10042].

## 2. Dataflow Partitioning and Integration Strategies

Workload mapping in hybrid CIM systems is highly workload-aware, with the analog in-memory core typically offloaded the high-arithmetic-intensity portions of the neural network, such as dense/pointwise convolutions or fully-connected layers, while digital cores or DCIM structures handle elements with poor analogue utilization, such as depthwise separable convolutions, low-rank/batch-norm updates, non-linear activation functions, and control flow [2109.01404][2212.02872][2411.06079][2205.10042].

Hybrid partitioning can be static—e.g., all 1×1 convolutions sent to the analogue CIM, depthwise convolutions executed by CPU cores—or dynamic with more sophisticated runtime or compiler-based orchestration. Analog-to-digital interfaces are realized via integrated DACs/ADCs, digital input/output buffers, and lock-step sequencers for synchronized operation:
- Input tiles are streamed into the IMA via 3D-strided access engines or pulse-width-modulated wordlines.
- Outputs are quantized by ADCs (variable precision, typically 4–8 bits) and streamed back into the TCDM or digital registers, where further processing can occur.

Multiple jobs can be pipelined or burst loaded by prefetching configuration and stride registers, reducing the effective non-computation cycle overhead [2109.01404].

## 3. Mathematical Performance Models and Efficiency Metrics

Key metrics for hybrid CIM systems are throughput, energy efficiency, and area utilization. Formally:

- GOPS: $GOPS = W / T_\mathrm{total}$
- Energy efficiency: $\eta = (W / T_\mathrm{total}) / P_\mathrm{total}$ (TOPS/W)
- Area efficiency: $\alpha = GOPS / (A_\mathrm{digital} + A_\mathrm{IMA})$

where $W$ is the number of MACs, $T_\mathrm{total}$ system time, $P_\mathrm{total}$ total power, and $A_\mathrm{digital}$/$A_\mathrm{IMA}$ digital/analog area. For a PCM crossbar of $M \times N$ size, up to $M$ dot-products of length $N$ can be completed per 70 ns analog cycle [2109.01404][2212.02872].

Efficiency scaling is determined by the mapping and utilization. Analogue core utilization is optimal for dense layers with high fan-in/out but drops dramatically for low-channel-count depthwise or separable convs, leading to a trade-off between area and throughput per layer. Area efficiency can reach up to $\sim 20$ GOPS/mm² for hybrid mappings compared to $4$–$8$ for pure digital, and energy efficiency exceeding $2$ TOPS/W [2109.01404].

## 4. Hybrid Compute-in-Memory Microarchitectures

Hybrid architectures manifest both at the macro design and the system orchestration level. Notable structures include:
- **Bit-sliced macros**: Upper (MSB) bits computed by DCIM (popcount or adder trees), lower (LSB) bits in charge-domain or time-domain ACIM cells with shared SAR ADC [2508.17562][2411.06079]. Final output is merged via digital addition and shifting.
- **ADC-Less hybrids**: Replace bulky high-resolution ADCs with ternary/binary comparators, quantization-aware training, and a digital in-memory adder/subtractor tree for scaling and accumulation, leveraging the inherent sparsity for clock/energy gating [2403.13577].
- **Storage-hybrid cells**: Integration of non-volatile (e.g., RRAM) and CMOS paths within a single bit-cell, enabling analog compute on power rails and preserving digital SRAM read/write [2510.15904].
- **Task-level split**: Assigning pointwise convolution to IMA and depthwise to digital cores results in up to $3 \times$ throughput, $3 \times$ energy efficiency, and $2$–$3 \times$ area reduction compared to full-IMA mapping for full MobileNetV2 workloads [2109.01404].

A selection of published efficiency/throughput values is provided below.

| Configuration         | Throughput (GOPS) | Energy Eff. (TOPS/W) | Area Eff. (GOPS/mm²) |
|-----------------------|-------------------|----------------------|----------------------|
| SW only               | 4.4               | 0.85                 | 4.2                  |
| IMA (ima8)            | 12.9              | 1.8                  | 7.9                  |
| IMA (ima16)           | 13.5              | 1.5                  | 6.1                  |
| Hybrid (1x1→IMA, DW→SW)| 13.2             | 2.55                 | 19.7                 |

[2109.01404]

## 5. Example Applications, Trade-Offs, and Bottlenecks

Hybrid architectures are particularly advantageous for convolutional and transformer-based DNNs, where workload heterogeneity precludes a one-domain-fits-all solution:
- **Dense/pointwise layers** fully utilize analogue crossbar parallelism, leading to $>30\times$ speedup over digital cores for 1x1 convolution.
- **Depthwise/separable layers** are mapped to digital cores due to suboptimal crossbar mapping, avoiding up to $3\times$ area penalty and yielding overall $3\times$ speedup for networks like MobileNetV2 [2109.01404].
- **Attention accelerators** prune $\sim 75\%$ of tokens in analogue CIM, passing only the informative subset for accurate digital refinement, achieving $14.8$ TOPS/W in analog core and $1.65$ TOPS/W at SoC level with $<0.4\%$ accuracy drop [2409.04940].

Key system trade-offs include:
- **Throughput ceilings** due to streaming bottlenecks at memory interface, beyond $4$–$8$ ports is diminishing return.
- **Analog non-idealities** (variability, IR drop, precision limitations) requiring algorithm-hardware co-design, retraining, or compensation [2212.02872][2109.01404].
- **Design complexity**: Co-ordination of multiple hardware units, heterogeneity in software toolchains, partitioning support, calibration, and runtime orchestration.
- **Conversion/auxiliary overhead**: SAR ADCs and auxiliary digital circuits can dominate energy and latency, demanding conversion-efficient SAR/Flash hybrids, or even ADC-less approaches with sparse quantization [2307.03863][2403.13577].

## 6. Design Challenges and Mitigation Strategies

Frequent obstacles are the limited ADC/DAC bandwidth, process-induced analog variability, calibration requirements, and poor analog utilization for certain structure types or data patterns. Solutions include:
- **Dynamic partitioning**: Saliency- or inference-aware allocation of MAC bits to digital or analog domains, e.g., on-the-fly boundary setting via OSE in OSA-HCIM [2411.06079].
- **Calibration and drift compensation**: One-time per-ADC calibration, global rescaling of MVM output, hardware-in-the-loop finetuning, and device-aware retraining to address non-idealities and weight drift [2212.02872][2502.07212].
- **Exploiting algorithmic robustness**: By careful assignment of critical bits (MSB) to digital, overall accuracy is preserved even at moderate SNR/CNR in the analog domain. For transformers, this boundary must ensure CSNR $\geq 30$ dB [2411.06079].
- **Architectural scaling**: Array tiling, pipelined hybrid conversion (collaborative digitization), and 3D stacking for large-model support [2307.03863].
- **SRAM stability & overhead**: Hybrid cell designs avoid area increase by leveraging back-end integration or time-multiplexed analog/digital operation modes [2510.15904][2508.17562].

## 7. Outlook and Future Research Directions

Hybrid analogue–digital CIM systems represent a converged path toward maximizing the compute-in-memory paradigm for DNN inference and training, achieving synergy between analog efficiency and digital precision/flexibility. Research directions include:
- Dynamic, input-aware partitioning at runtime or via compiler, possibly guided by saliency, quantization-awareness, or workload profiling.
- Ultra-dense, precision-adaptable macros supporting 8–12+ b fixed/floating point via hierarchical hybrid slicing [2508.17562][2502.07212].
- Extension of the hybrid paradigm to on-the-fly continual learning, training, and secure machine unlearning by co-located digital LoRA branches [2601.10037].
- Enhanced system integration with memory-immersed ADC/DAC, pipelined conversion, and crossbar-in-loop digital support for further efficiency scaling [2307.03863].
- Technology scaling toward sub-10 nm nodes and integration of novel devices (e.g., high-TMR STT-MRAM, fine-grained RRAM) for larger, more flexible hybrid arrays [2110.03937][2510.15904].

The hybrid analogue–digital CIM approach is central to bridging the energy-precision-flexibility trade space required for next-generation edge and server AI accelerators, as formalized and demonstrated across multiple recent experimental and simulation studies [2109.01404][2212.02872][2403.13577][2411.06079][2508.17562][2502.07212][2510.15904][2205.10042][2307.03863][2409.04940][2601.10037].

Source: https://www.emergentmind.com/topics/hybrid-analogue-digital-compute-in-memory-system