---
title: Coherent Co-Packaged Optics (CPO)
url: https://www.emergentmind.com/topics/coherent-co-packaged-optics-cpo
type: topic
---

# Coherent Co-Packaged Optics (CPO)

Coherent co-packaged optics (CPO) refers to the integration of coherent optical transceivers—capable of both amplitude and phase encoding—directly alongside high-speed digital ASICs at the package or module level. By leveraging silicon photonic devices and sophisticated electronic DSP engines, coherent CPO provides Tb/s-scale, spectrally efficient, and ultra-low-latency communication, facilitating the disaggregation of memory and compute in next-generation AI and data center systems. This technology targets orders-of-magnitude improvements in bandwidth density and per-bit energy consumption compared to conventional pluggable optics, addressing interconnect bottlenecks in AI/ML scaling, high-radix switching, and petabit-class system fabrics.

## 1. Fundamental Principles of Coherent Co-Packaged Optics

Coherent CPO leverages both the amplitude and phase of the optical carrier by employing IQ-modulation formats such as QPSK and QAM (16-QAM, 64-QAM), often with dual-polarization multiplexing for increased spectral efficiency. At the receiver, a coherent receiver architecture based on a 90° optical hybrid mixes the incoming signal $E_{\rm sig}(t) = A_{\rm sig}(t) e^{j(\omega_c t + \phi_{\rm sig}(t))}$ with a local oscillator $E_{\rm LO}(t) = A_{\rm LO} e^{j(\omega_c t + \phi_{\rm LO}(t))}$, yielding in-phase and quadrature (I/Q) photocurrents. This configuration enables the recovery of both amplitude and phase, essential for high-order modulation and advanced digital impairments compensation, including chromatic dispersion and polarization mode dispersion [2303.01744].

Spectral efficiency for an $M$-ary format is given by $\eta = \frac{\log_2 M}{T_s}$ in [bit/s/Hz], and for dual polarization, $\eta_{\rm DP} = \frac{2\log_2 M}{T_s}$. Example: 16-QAM at $32\,\rm GBd$ yields $8\,\rm b/s/Hz$ spectral efficiency.

Laser phase noise (linewidth $\Delta\nu$) introduces phase variance over a given symbol duration $T_s$, as $\sigma_\phi^2 = 2\pi \Delta\nu T_s$. This requires robust digital carrier phase estimation (CPE) algorithms in the receiver DSP to keep residual phase error within operational margins.

## 2. High-Density Integration, Bandwidth Density, and Shoreline Scaling

A central metric for CPO is shoreline (beachfront) bandwidth density: the aggregate throughput per mm of chip edge interfacing directly with optical I/O. IBM's OTV-1 CPO modules employ a silicon-photonic die (PIC) flip-chip bonded to an ASIC, with optical I/O fanned through a molded polymer waveguide array at $50\,\mu\rm m$ pitch, greatly exceeding conventional fiber-array pitches of $127–250\,\mu\rm m$ [2412.06570]. This enables:

- 20 fibers/mm at 50 μm pitch, versus ≈8 fibers/mm for standard pluggables.
- Effective beachfront density $D_\mathrm{f,eff} = N_\lambda / p$, where $N_\lambda$ is WDM channel count and $p$ is pitch.
- Bandwidth density $DB = D_{\mathrm{f,eff}}\times R_b$, e.g., $4/0.05\,\mathrm{mm}\times0.1\,\mathrm{Tbps} = 8\,\mathrm{Tbps/mm}$, scaling to $>10\,\mathrm{Tbps/mm}$ at $<20\,\mu\rm m$ pitch.

Insertion loss per channel is kept to $\leq 2$ dB, with best channels at $1.2$ dB, and crosstalk $<30$ dB at $18.4\,\mu\rm m$ channel spacing [2412.06570].

Vertical integration is addressed by high-density evanescent couplers, such as overlapping inverse double-taper structures enabling $<0.13\,\rm dB$ insertion loss, $>300\,\rm nm$ bandwidth, and $<\pm2.8\,\mu\rm m$ lateral and $<\pm2.7\,\mu\rm m$ vertical $1\,\rm dB$ alignment tolerance [2206.09125].

## 3. Modulation Formats, Transceiver Architectures, and Building Blocks

High-order modulation and multiplexing are core to CPO performance. MRA-MZMs and RAMZI transmitters leveraging microring modulators (MRMs) are enabling technologies:

- Microring-assisted MZMs (MRA-MZMs) demonstrate $V_\pi L \approx 1.08\,\rm V\cdot cm$, $f_{\rm EO}\approx 40\,\rm GHz$, and energy-per-bit $<10\,\mathrm{fJ/bit}$ for QPSK and $<6\,\mathrm{fJ/bit}$ for 16-QAM [2509.20584].
- C2PO (Coherent Co-packaged Optics using offset-QAM-16) transmitters employ phase-constant amplitude modulation via RAMZI structures, enabling 400 Gb/s per $\lambda$ at 9.65 dBm laser power, with 10–100$\times$ less photonic area than conventional MZI-based QAM transmitters, and DSP-free carrier phase recovery due to the constant-envelope offset-QAM constellation [2506.12160].
- QD frequency comb lasers with mode-locked architectures deliver $>6$ lines at 100 GHz spacing, enabling $>1$ Tb/s over a single fiber and projected $>10$ Tb/s with polarization multiplexing and extended WDM [2509.20584].

The integration of modulators, balanced photodiodes, advanced DSP engines (for equalization, CPE, and soft-decision FEC), and high-speed electrical drivers is achieved within $<1$ mm electrical paths, minimizing signal degradation and I/O energy.

## 4. Packaging, Coupling, and Reliability Engineering

Co-packaged modules adopt advanced assembly approaches for thermal and mechanical stability, electrical and optical co-integration, and minimized loss:

- Polymer waveguide fans-out interface optical channels from PIC edge to standard SMF arrays via adiabatic tapers, achieving low-loss, high-reliability attachment [2412.06570].
- Thermal integrity is ensured via co-integration with thermoelectric coolers and heat spreaders to stabilize modulator resonances under adjacent ASIC power densities. Resonance shifts on silicon photonics ($\sim 0.1\,\rm nm/K$) necessitate active feedback control for high-order WDM and dense MRM arrays.
- All OTV-1 modules passed rigorous JEDEC standards (thermal cycling, damp-heat, high/low temp storage) with channel IL shifts $\leq 0.25$ dB after stress [2412.06570].
- Vertical couplers facilitate multi-tier stacking within co-packaged designs, enabling substantially higher port counts via fine I/O pitch ($<10\,\mu\rm m$) and tolerance for passive assembly [2206.09125].

Key trade-offs involve alignment (sub-$100\,\rm nm$ for <20 μm pitch), crosstalk, and thermal expansion management [2412.06570].

## 5. Energy Efficiency, Performance Metrics, and Latency

CPO targets sub-1 pJ/bit energy budgets, enabled by:

- Short electrical link lengths across the chip/package interface, eliminating the dominant copper PCB trace losses of traditional board-level optics [2412.06570, 2303.01744].
- Photonic devices (MRMs, MRA-MZMs) with $5–10\,{\rm fJ/bit}$ modulation energy [2509.20584, 2506.12160].
- Shared local oscillator sources for multiple coherent channels, exploiting WDM and polarization multiplexing to maximize per-port throughput.

Performance metrics for typical CPO systems:

| Metric            | Near-Term Value          | Next-Gen Value           |
|-------------------|-------------------------|--------------------------|
| Bandwidth/lane    | 400 Gb/s (16-QAM @32GBd)| 800 Gb/s–1 Tb/s (64-QAM @64–75GBd)|
| Beachfront density| 6× vs. pluggables (~10 Tb/s/mm target) | >10 Tb/s/mm  |
| Energy/bit        | Sub-1 pJ/bit            | $<0.1$ pJ/bit projected  |
| Pre-FEC BER       | $<10^{-6}$              | Post-FEC $<10^{-15}$     |
| Latency           | $<100$ ns (DSP, <1 m opt)| total $<300$ ns/hop     |

The combination of high parallel optical port count, low insertion loss, and low electrical and optical path latency is critical to meeting synchronous AI workload requirements, such as maintaining round-trip latencies $<10\,\mu$s to prevent compute starvation in distributed learning [2303.01744].

## 6. System-Level Implications: Disaggregated AI and Petascale Interconnects

Coherent CPO enables system architectures previously precluded by copper or intensity-modulation optics:

- Disaggregated memory and compute: Direct RDMA over coherent links, bypassing local HBM and reducing software overhead by $\sim2\,\mu$s per transaction [2303.01744].
- High-radix circuit-switched topologies: Reconfigurable fat-tree or mesh networks with microsecond reconfiguration, each node equipped with multiple CPO ports [2303.01744].
- Scaling laws: For $M$ accelerators and $K$ memory pools, required port count per device $P\geq\lceil K/M \rceil$ and package edge density $>1$ Tb/s/mm to yield aggregate $>10$ Tb/s per GPU.
- AI training: Fivefold improvement in throughput and elimination of inter-GPU link stalls when using CPO over copper or board-level optics [2412.06570].

A plausible implication is that CPO-based fabrics will become indispensable for memory-coherent exascale AI systems as the marginal performance benefit from transistor scaling further diminishes.

## 7. Outlook, Challenges, and Trade-Offs

While CPO demonstrates substantial readiness for deployment, several challenges must be addressed:

- Resonator stability and wavelength control become complex at high WDM channel counts; per-ring feedback and temperature control are essential [2509.20584].
- Thermal crosstalk in densely packed modulators (MRMs, MRA-MZMs) requires isolation strategies [2509.20584].
- Extending fine-pitch assembly and beachfront density to $<20\,\mu$m pitch mandates alignment tolerances below standard passive assembly processes [2412.06570].
- Insertion loss of packaging (fiber coupling, vertical interconnects) must approach $<1$ dB/facet for energy budgets and system margin [2412.06570, 2206.09125].
- Advanced modulation schemes (offset-QAM, DSP-free CPE) can further reduce per-bit DSP energy and circuit complexity while preserving robustness [2506.12160].

Current research trajectories include comb-driven multi-Tb/s transmitters [2509.20584], further MRM/RAMZI integration [2506.12160], and scaling vertical coupler density [2206.09125], outlining a roadmap to package-scale, petabit-class coherent optical interconnects.

---

**References:**
- [2303.01744] Next-generation Co-Packaged Optics for Future Disaggregated AI Systems
- [2412.06570] Next generation Co-Packaged Optics Technology to Train & Run Generative AI Models in Data Centers and Other Computing Applications
- [2509.20584] Comb-Driven Coherent Optical Transmitter for Scalable DWDM Interconnects
- [2206.09125] High Density Vertical Optical Interconnects for Passive Assembly
- [2506.12160] C2PO: Coherent Co-packaged Optics using offset-QAM-16 for Beyond PAM-4 Optical I/O

Source: https://www.emergentmind.com/topics/coherent-co-packaged-optics-cpo