Papers
Topics
Authors
Recent
Search
2000 character limit reached

PhysEDA: Physics-Aware Learning Framework for Efficient EDA With Manhattan Distance Decay

Published 11 May 2026 in cs.LG | (2605.10547v1)

Abstract: Electronic design automation (EDA) addresses placement, routing, timing analysis, and power-integrity verification for integrated circuits. Learning methods -- attention (Transformer) and reinforcement learning (RL) -- have recently emerged on EDA tasks, yet face two common bottlenecks: vanilla attention's quadratic complexity limits scaling, and data-scarce models overfit statistical noise and amplify weak long-range correlations against the underlying physics. We observe that EDA tasks share a physical prior -- pairwise electrical and routing interactions decay exponentially along Manhattan distance -- and integrate it as a unified inductive bias into both architecture and training. We propose PhysEDA, comprising two components Physics-Structured Linear Attention (PSLA) folds the separable Manhattan decay into the linear-attention kernel as a multiplicative bias, reducing complexity from quadratic to linear; Potential-Based Reward Shaping (PBRS) constructs a physical potential from the same kernel, providing dense reward signal under sparse RL while preserving the optimal policy via the policy-invariance theorem. Across three EDA scenarios -- decoupling-capacitor placement, macro placement, and IR-drop prediction -- PhysEDA improves zero-shot cross-scale transfer by 56.8% and achieves 14x inference speedup with 98.5% memory savings on 100x100 grids; PBRS adds another 10.8% in sparse-reward DPP.

Authors (1)

Summary

  • The paper introduces a framework that integrates a physics-inspired Manhattan decay prior into attention mechanisms to regularize spatial interactions in EDA tasks.
  • It leverages Physical-Structured Linear Attention (PSLA) and Potential-Based Reward Shaping (PBRS) to reduce complexity and alleviate reward sparsity in reinforcement learning.
  • Experimental results show significant improvements in placement cost, inference speed, and generalization across varying grid sizes and low-data regimes.

PhysEDA: Physics-Aware Learning for Efficient EDA with Manhattan Distance Decay

Introduction and Motivation

"PhysEDA: Physics-Aware Learning Framework for Efficient EDA With Manhattan Distance Decay" (2605.10547) presents a unified framework that directly incorporates physical principles—specifically, the exponential decay of pairwise electrical and routing interactions along the Manhattan (L1) distance—into both the architecture and learning process for electronic design automation (EDA) tasks. The motivation arises from three core bottlenecks in state-of-the-art EDA learning methods: (1) the quadratic complexity of standard attention restricts scalability, (2) the lack of physical priors leads to overfitting in data-scarce regimes, and (3) RL formulations for EDA suffer severe reward sparsity, impeding convergence.

The central insight is that many chip-design tasks share a separable, direction-specific, exponential Manhattan-decay prior. This prior is encoded in PhysEDA at two levels:

  • Physics-Structured Linear Attention (PSLA): A linear-attention module incorporating the decay as a learnable multiplicative bias, reducing complexity from quadratic to linear and regularizing spatial structure.
  • Potential-Based Reward Shaping (PBRS): The same kernel defines a potential function for reward shaping in RL, ensuring policy invariance while improving learning efficiency under sparse reward. Figure 1

    Figure 1: PhysEDA architecture overview: a shared Manhattan-decay kernel modulates linear attention (PSLA), shapes RL reward (PBRS), and is evaluated on three EDA tasks.

PSLA: Physics-Structured Linear Attention

Physical Derivation and Mathematical Formulation

The exponential decay of pairwise interactions along Manhattan distance is justified both empirically and via the on-chip PDN's transmission-line mesh model, yielding impedance decay as:

Ztr(i,j)exp(αxxixjαyyiyj)|Z_{\mathrm{tr}}(i,j)| \propto \exp(-\alpha_x|x_i - x_j| - \alpha_y|y_i - y_j|)

PSLA encodes this prior into the linear attention kernel via multiplicative, position-dependent bias terms:

PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}

with DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i), DK[j]=exp(+αxxj+αyyj)D_K[j] = \exp(+\alpha_x x_j + \alpha_y y_j), and αx,αy\alpha_x, \alpha_y as learnable parameters (per head, per layer).

While prior efficient attention methods (e.g., Linformer, FAVOR+, CosFormer, ALiBi) target generic sequence structure or 1D positional relationships, PSLA is unique in encoding a 2D, physically-motivated, learnable decay directly tied to the chip's spatial coordinates.

Representational and Computational Advantages

PSLA ensures that, even with scarce data, the spatial attention weights respect the Manhattan decay characterized by semiconductor physics, mitigating overfitting to spurious long-range dependencies. Practically, PSLA's complexity is O(Ld2)\mathcal{O}(Ld^2), enabling scaling to chip-sized grids (L104L \gg 10^4), while conventional quadratic attention fails due to prohibitive memory and latency demand. Figure 2

Figure 2: PhysEDA’s delta performance across scenarios and speedup as sequence length increases—showing accuracy gains rise with data scarcity and PSLA’s linear scaling.

PBRS: Potential-Based Reward Shaping

RL-based chip design faces extreme reward sparsity, especially in sequential tasks such as decoupling capacitor placement (DPP), where only terminal states yield rewards computed via full PDN simulation. PBRS counteracts this by augmenting rewards with the change in a shaped potential, Φ\Phi:

R(s,a,s)=R(s,a,s)+γΦ(s)Φ(s)R'(s, a, s') = R(s, a, s') + \gamma \Phi(s') - \Phi(s)

Choosing Φ\Phi as a sum of Manhattan-decayed interactions ensures that intermediate steps receive dense, physically meaningful feedback. Critically, the policy-invariance property of PBRS ensures that the optimal policy is unchanged—only the speed of learning is affected.

Empirically, PBRS adds up to 10.8% gain in RL for sparse-reward DPP scenarios. Figure 3

Figure 3

Figure 3: DPP RL with PBRS. As grid scales from PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}0 to PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}1, PSLA's accuracy gain rises from 1.5% to 49.1%, demonstrating the dependence on spatial data insufficiency.

Experimental Results Across EDA Tasks

Decoupling Capacitor Placement (DPP)

  • Supervised: On PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}2 grids, PSLA achieves 5.5% lower (better) placement cost than the quadratic-complexity DevFormer. Competing linear-attention approaches without the physical prior underperform.
  • Reinforcement Learning: As grid size increases, PSLA’s gain over vanilla RL (w/o PBRS) jumps from 1.5% (PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}3) to 49.1% (PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}4); PBRS further extends this to 65.2% combined gain.
  • Zero-Shot Transfer: Training on small grids and evaluating on larger grids, PSLA displays only a marginal drop in performance compared to catastrophic failure of learned embeddings, a 56.8% relative improvement.

Macro Placement (ChiPFormer)

  • Decision Transformer Pretraining: Replacing standard attention with PSLA reduces HPWL by up to 12.0% after 300 epochs.
  • RL Fine-tuning: PBRS logit bias achieves a 5.4% additional improvement. Notably, hard architectural priors (PSLA) may restrict RL exploration compared to soft constraints (PBRS).

IR-Drop Prediction (CircuitNet)

  • In-distribution: PSLA marginally underperforms UNet (PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}5), indicating that when data suffices, manual spatial priors may restrain model flexibility.
  • Cross-domain/architecture: PSLA outperforms the baseline by 5.3%–5.4% Pearson correlation, with consistent win rates (12/15, 11/15), demonstrating its value under severe distribution shift/data scarcity. Figure 4

Figure 4

Figure 4: CircuitNet cross-design generalization, where PSLA-UNet outperforms baseline by +5.3% and wins 12 out of 15 cross-seed tests.

Efficiency Gains

PSLA’s architectural design brings significant computational benefits:

  • DPP Encoder: At PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}6 grid size, PSLA delivers a 14× inference speedup and 98.5% memory savings over softmax attention. For PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}7, PSLA is the only scalable option.
  • ChiPFormer: Memory drops by 94% for the attention layer (PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}8GB to PSLA(Q,K,V)=(ϕ(Q)DQ)[(ϕ(K)DK)V](ϕ(Q)DQ)(ϕ(K)DK)1\mathrm{PSLA}(Q,K,V) = \frac{(\phi(Q)\odot D_Q)[(\phi(K)\odot D_K)^\top V]}{(\phi(Q)\odot D_Q)(\phi(K)\odot D_K)^\top \mathbf{1}}9MB), with marginal overhead in latency.
  • CircuitNet: Minimal overhead for attention-light regimes. Figure 5

    Figure 5: DPP encoder inference efficiency versus sequence length; PSLA maintains flat scaling, while softmax becomes intractable for large DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)0.

Analysis of the Prior’s Impact and Interpretability

The benefit of PSLA and PBRS monotonically increases as data becomes insufficient to recover spatial structure from examples alone. In data-rich settings, the prior’s effect fades; in highly data-scarce, transfer, or extrapolation regimes, the prior dominates performance gains.

Ablations validate that PSLA’s effect comes from the physically meaningful, learnable decay—it is not replicable by generic position encoding or by using an improper decay metric.

The learned DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)1 parameters are interpretable as inverse physical length-scales, and adapt per scenario, head, and layer, evidencing the flexibility and task-adaptiveness of the approach. Figure 6

Figure 6: Attention heatmaps visualizing effect of DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)2; larger DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)3 yields more local attention reflecting strong prior, while small DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)4 recovers uniform attention under rich data.

Figure 7

Figure 7: Divergence of per-head DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)5 parameters during training demonstrates adaptation to spatial anisotropy and specialization.

Figure 8

Figure 8: Learned DQ[i]=exp(αxxiαyyi)D_Q[i] = \exp(-\alpha_x x_i - \alpha_y y_i)6 values on cross-domain CircuitNet transfer settings reflect anisotropy and correlate with data sufficiency, collapsing in data-rich regimes as the Bayesian “prior-fades-as-data-grows” prediction suggests.

Theoretical and Practical Implications

PhysEDA’s approach exemplifies the impact of integrating domain-specific physical structure into neural architectures and training protocols. Architecturally, it enables previously infeasible scaling with direct memory and latency savings while maintaining or improving accuracy. Algorithmically, it enhances generalization and sample efficiency, particularly in low-data, cross-scale, and transfer scenarios common in chip design.

Practically, these results suggest that similar physical or domain priors could be systematically injected into models for other structured engineering problems—beyond EDA, potentially encompassing areas such as CFD, structural optimization, and even graph-structured bioinformatics—where spatial decay, locality, or invariant properties can be encoded in a tractable, learnable way.

Open directions for further research include:

  • Implementing an exact, symmetric Manhattan decay via bidirectional prefix-sum decomposition in linear attention to improve non-causal encoder settings.
  • Extending the physical prior to model other spatial correlations, such as parasitic capacitance, signal integrity, and clock network phenomena.
  • Evaluating the approach on broader classes of EDA tasks and other physics-driven domains.

Conclusion

PhysEDA introduces a compelling physics-aware learning paradigm for EDA, integrating a unified Manhattan-decay prior into attention mechanisms and RL reward shaping. Its gains are pronounced in data-scarce, cross-domain, and scaling-challenged scenarios, with demonstrated improvements in accuracy, generalization, and computational efficiency across multiple EDA benchmarks. The work highlights the strategic value of leveraging physical knowledge in AI design for engineering applications, with broad implications for the scalability and transferability of deep learning in scientific domains.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 4 likes about this paper.