---
title: Physics-Informed CoKriging
url: https://www.emergentmind.com/topics/physics-informed-cokriging
type: topic
---

# Physics-Informed CoKriging

Physics-informed CoKriging (CoPhIK) is a rigorous multifidelity surrogate modeling framework that fuses physical knowledge from computational models, typically in the form of low-fidelity stochastic simulators, with sparse high-fidelity observations using Gaussian-process-based CoKriging. By embedding partial physics or conservation laws directly into the prior statistics of the Gaussian process, CoPhIK systematically achieves improved data-model convergence, reduces hyperparameter search, and preserves the physical structure of the system up to quantifiable error bounds. The framework generalizes across applications in uncertainty quantification, inverse problems, and scientific machine learning, demonstrating robust accuracy even when the underlying physics models are misspecified.

## 1. Mathematical Foundation of Physics-Informed CoKriging

The canonical CoPhIK methodology is grounded in the autoregressive multifidelity modeling paradigm. Given a low-fidelity stochastic simulator $u_L(x; z)$ (with parameter $z$) and a limited set of high-fidelity data $u_H(x)$, the goal is to construct a high-fidelity surrogate that leverages both data modalities.

The core autoregressive relation is
$$
Y_H(x) = \rho\, Y_L(x) + Y_d(x),
$$
where:
- $Y_L(x)$ is the low-fidelity process, modeled as a Gaussian process $\mathcal{GP}(\mu_L(x), k_L(x, x'))$.
- $Y_d(x)$ is a discrepancy process, $\mathcal{GP}(\mu_d(x), k_d(x, x'))$, independent of $Y_L$.
- $\rho$ is a scaling parameter.

Crucially, in CoPhIK and its bifidelity extensions, the low-fidelity mean $\mu_L$ and covariance $k_L$ are not generic forms with tunable hyperparameters, but are estimated directly from a (potentially large) ensemble of stochastic physics-based simulations. This makes the process "physics-informed" as it decouples GP prior specification from data-intensive maximum-likelihood training.

Given training data $\{\mathbf{y}_L, \mathbf{y}_H\}$ (at locations $X_L, X_H$), the block covariance and prior mean are
$$
\mathbf{C} =
\begin{bmatrix}
C_L & \rho\, C_L \\
\rho\, C_L & \rho^2 C_L + C_d
\end{bmatrix}, \quad
\boldsymbol{\mu} = [\mu_L(X_L);\, \rho\, \mu_L(X_H) + \mu_d(X_H)],
$$
where $C_L$ and $C_d$ are kernel matrices.

The posterior mean and variance at a test point $x^*$ are given by
$$
\hat{y}_H(x^*) = \mu_H(x^*) + [\rho\, c_L(x^*),\, c_d(x^*)] \cdot \mathbf{C}^{-1}
\begin{bmatrix}
y_L - \mu_L(X_L) \\
y_H - \rho\, \mu_L(X_H) - \mu_d(X_H)
\end{bmatrix},
$$
$$
s_H^2(x^*) = \rho^2 k_L(x^*, x^*) + k_d(x^*, x^*) - [\rho\, c_L(x^*),\, c_d(x^*)] \mathbf{C}^{-1} [\rho\, c_L(x^*);\, c_d(x^*)].
$$

Only the discrepancy kernel and $\rho$ typically require hyperparameter optimization, often by marginal likelihood maximization [1811.09757][1812.02919][2106.09188].

## 2. Construction of Physics-Informed Low-Fidelity Priors

The construction of physics-informed low-fidelity priors distinguishes CoPhIK from conventional multifidelity GPR methods. For a stochastic simulator $u_L(x; z)$ sampled over parameters $z \in I_z$, the empirical mean and covariance are:
$$
\mu_L(x) = \frac{1}{M} \sum_{m=1}^{M} u_L^m(x), \qquad
k_L(x, x') = \frac{1}{M-1} \sum_{m=1}^M [u_L^m(x) - \mu_L(x)][u_L^m(x') - \mu_L(x')],
$$
where $u_L^m(x)$ denotes the $m$-th low-fidelity realization.

For settings where direct high-fidelity simulation is computationally infeasible, a bifidelity (approximation-theory-based) approach can be utilized. Here, a small subset $M_H \ll M_L$ of high-fidelity runs, identified via a pivoted Cholesky or greedy selection on the low-fidelity Gram matrix, is used to construct an interpolation mapping $I_L^H$. This yields "bifidelity" samples
$$
u_B^m(x) = I_L^H(u_L^m)(x),
$$
from which $\mu_L$, $k_L$ are estimated as above by replacing $u_L^m$ with $u_B^m$ [1812.02919].

This bifidelity embedding enables the low-fidelity GP to capture salient features of the high-fidelity manifold with minimal direct computational cost.

## 3. Enforcement and Quantification of Physical Constraints

A distinctive feature of physics-informed CoKriging is the explicit quantification of adherence to physical constraints. Consider a deterministic linear operator $\mathcal{L}$ (e.g., Laplacian, mass conservation), and suppose each high-fidelity realization satisfies $\mathcal{L} u_H(x;z) = g(x)$.

Theorem 2.3 in [1812.02919] states the predictive posterior mean $\hat{y}_B(x)$ (from bifidelity-accelerated CoPhIK) satisfies
$$
\|\mathcal{L} \hat{y}_B(x) - g(x)\| \leq \varepsilon \left[ 1 + 2 S_H \sqrt{\frac{M}{M-1}} \|\mathbf{C}_H^{-1}\|_2 \|y - \mu_H\|_2 \right] + M_\mathcal{L}(C_1 \delta_1 + C_2 \delta_2),
$$
where $\varepsilon$ quantifies the MC error of physical residuals, $\delta_1$, $\delta_2$ bound bifidelity approximation error, $M_\mathcal{L}$ is the operator norm, and $S_H$ is the empirical standard deviation at observation locations.

Thus, the model "inherits" the physical law up to explicit, data-driven error bounds, with no requirement for exact physical model fidelity [1811.09757][1812.02919].

## 4. Algorithmic Workflow and Training Procedures

The practical implementation of CoPhIK involves:

1. **Sampling the Low-Fidelity Model:** Generate a large Monte Carlo ensemble from the physics-based model (e.g., 0D battery ODEs [2106.09188], stochastic PDE [1811.09757], or spectral discretizations [1812.02919]).

2. **Constructing the Empirical GP:** Compute $\mu_L$ and $k_L$ by empirical averaging. In the bifidelity regime, use $u_B^m(x)$ as constructed above.

3. **CoKriging Model Assembly:** Specify the two-level GP structure:
    - Low-fidelity: $Y_L(x) \sim \mathcal{GP}(\mu_L(x), k_L(x,x'))$
    - Discrepancy: $Y_d(x) \sim \mathcal{GP}(\mu_d(x), k_d(x,x'))$, often $k_d$ stationary, $\mu_d$ typically zero.
    - High-fidelity: $Y_H(x) = \rho Y_L(x) + Y_d(x)$

4. **Hyperparameter Fitting:** Estimate $\rho$, $k_d$ (and $\mu_d$ if not set to zero) via marginal likelihood maximization on the residuals $y_H - \rho \mu_L(X_H)$.

5. **Prediction:** Given a new input, evaluate the predictive mean and variance via the closed-form CoKriging formulas.

6. **Active Learning (Optional):** Sequentially select new high-fidelity points for maximal variance reduction using the current GP posterior predictive variance [1811.09757].

This approach is efficient: empirical statistics from thousands of MC simulations define the prior, and only a low-dimensional discrepancy kernel requires optimization.

## 5. Illustrative Applications and Performance Analysis

### Surrogate Modeling for Physical Systems

- **Redox Flow Batteries:** CoPhIK models the charge-discharge curve using a zero-dimensional ODE as the low-fidelity source and lab experiments as high-fidelity data. With $N_{\mathrm{MC}}=1000$ low-fidelity samples and as few as 1-3 high-fidelity points per cycle, CoPhIK achieves $\ell_2$ errors as low as $1.1 \times 10^{-4}$–$4.4 \times 10^{-4}$ V and $R^2 \approx 0.99$, outperforming both physics-only and data-only GPR across varied parameterizations [2106.09188].

- **Branin Function and Heat Transfer:** For the stochastic Branin function and steady-state heat transfer PDEs, bifidelity-accelerated CoPhIK attains relative errors of $10^{-3}$–$10^{-2}$, nearly matching standard CoPhIK at a fraction of high-fidelity cost, while standard Kriging errors remain $O(10^{-1})$–$O(1)$ [1812.02919].

- **Kuramoto–Sivashinsky Equation:** For chaotic PDEs, bifidelity CoPhIK provides the best overall waveform fit, although with higher error ($\approx 8.2\%$) due to large bifidelity approximation error $\delta$ [1812.02919].

### Sensitivity and Robustness

CoPhIK is robust to low-fidelity model misspecification. Even substantial (order-of-magnitude) errors in the low-fidelity physical parameters are compensated by the data-driven discrepancy process, ensuring predictive accuracy and physical consistency [2106.09188].

### Efficiency

Empirical construction of the low-fidelity GP eliminates the need for expensive kernel hyperparameter search in $k_L$. Training CoPhIK surrogates, even with large MC-generated prior statistics, requires seconds to minutes and no deep learning pretraining [1812.02919][2106.09188].

Table: Summary of Representative Application Results

| Scenario                         | High-Fi Points | CoPhIK Error | Kriging Error   |
|-----------------------------------|---------------|--------------|----------------|
| Redox Flow Battery [2106.09188]   | 1–3 per cycle | $0.0001$–$0.0004$ V | $>$0.01 V (data-only) |
| Stoch. Branin [1812.02919]        | 8             | $10^{-3}$–$10^{-2}$ | $O(10^{-1})$   |
| Heat Transfer [1812.02919]        | 6–14          | $<$5%        | $>$27%         |

## 6. Extensions and Related Physics-Informed Kriging Approaches

Recent developments extend the physics-informed Kriging paradigm to other domains and learning architectures. Examples include:

- **Physics-Guided Increment Training (PGITS):** For spatio-temporal kriging in air quality inference, PGITS integrates physics (advection-diffusion PDE) into graph convolutional structures and loss functions. The dynamic graph generation module fuses diffusion and advection kernels, and the overall loss combines supervised, pseudo-label, and physical continuity constraints [2503.09646]. This generalizes the idea of physics-informed priors to implicit-graph structures in deep learning contexts.

- **Active Learning and Experimental Design:** CoPhIK enables efficient active-data selection by maximizing the GP posterior variance, accelerating convergence to target prediction accuracy with minimal high-fidelity samples [1811.09757].

- **Preservation of Physics:** Both empirical and theoretical results confirm that CoPhIK posterior means satisfy linear physical laws up to explicit error bounds, dominated by MC error and approximation error intrinsic to the bifidelity embedding [1812.02919][1811.09757].

## 7. Common Misconceptions and Limitations

A frequent misconception is that the quality of the CoPhIK surrogate is strictly limited by the fidelity of the physics model. In practice, the presence of the data-driven discrepancy GP allows significant correction for systematic bias: even largely misspecified low-fidelity priors can yield highly accurate predictions when sufficient (but still sparse) high-fidelity data are available [2106.09188].

However, the bifidelity acceleration may incur significant approximation error ($\delta_1, \delta_2$) if the mapping from low to high-fidelity is highly nonlinear or if the selected high-fidelity snapshots are not representative. In such scenarios, accuracy is slightly degraded relative to the full (non-bifidelity) approach, as observed in the Kuramoto–Sivashinsky example [1812.02919].

Finally, the framework as presently formulated is most theoretically robust for linear physical operators and linear autoregressive relations, with generalization to nonlinear physics and deep-learning kernels an ongoing area of active research.

---

**Key References:**  
- "Physics-Informed CoKriging: A Gaussian-Process-Regression-Based Multifidelity Method for Data-Model Convergence" [1811.09757]  
- "When Bifidelity Meets CoKriging: An Efficient Physics-Informed Multifidelity Method" [1812.02919]  
- "Physics-informed CoKriging model of a redox flow battery" [2106.09188]  
- "Inductive Spatio-Temporal Kriging with Physics-Guided Increment Training Strategy for Air Quality Inference" [2503.09646]

Source: https://www.emergentmind.com/topics/physics-informed-cokriging