---
title: Quantile Conformal Prediction
url: https://www.emergentmind.com/topics/quantile-conformal-prediction
type: topic
---

# Quantile Conformal Prediction

Quantile conformal prediction denotes conformal procedures in which a quantile model, a quantile-regression calibration rule, or a generalized quantile of nonconformity scores determines the prediction set threshold. In its canonical scalar form, it combines conditional quantile estimation with split conformal calibration: the quantile model supplies input-dependent lower and upper bounds, while the conformal step restores finite-sample marginal coverage under exchangeability. Across the literature, the same quantile-based logic is extended to group-conditional calibration, localized spatial and temporal calibration, multivariate score distributions, differentially private thresholding, distribution shift, missing covariates, and online multi-level prediction sets [1905.03222] [2503.00220] [2501.18991].

## 1. Core construction and the nested-set formulation

A canonical construction is Conformalized Quantile Regression (CQR). In split conformal form, one fits lower and upper conditional quantile estimators,
\[
\hat q_{\alpha/2}(x), \qquad \hat q_{1-\alpha/2}(x),
\]
on a training split, then computes calibration scores
\[
E_i=\max\Big\{\hat q_{\alpha/2}(X_i)-Y_i,\ Y_i-\hat q_{1-\alpha/2}(X_i),\ 0\Big\}.
\]
If there are \(n\) calibration points, the conformal correction is the \(\left\lceil (n+1)(1-\alpha)\right\rceil\)-th smallest score, and the prediction interval is
\[
C(x)=\Big[\hat q_{\alpha/2}(x)-\hat q,\ \hat q_{1-\alpha/2}(x)+\hat q\Big].
\]
This construction preserves the heteroscedastic shape learned by quantile regression and adds a single global slack sufficient for marginal validity [1905.03222].

The same construction admits a nested-set interpretation. Starting from
\[
\mathcal{F}_t(x)=\big[\widehat q_{\alpha/2}(x)-t,\ \widehat q_{1-\alpha/2}(x)+t\big],
\]
one defines the induced score
\[
r(x,y)=\inf\{t:\, y\in \mathcal{F}_t(x)\}
      =\max\big\{\widehat q_{\alpha/2}(x)-y,\ y-\widehat q_{1-\alpha/2}(x)\big\}.
\]
Calibration then selects the empirical \((1-\alpha)\)-quantile of the \(r_i\)’s and returns \(C(x)=\mathcal{F}_{Q_{1-\alpha}}(x)\). This formulation makes explicit that quantile conformal prediction is a calibration problem for a nested family of candidate sets, not merely a residual-thresholding heuristic [1910.10562].

Several later methods retain this basic architecture but modify the quantile-estimation stage. A non-crossing variant jointly estimates \((\hat f_1,\hat f_2)\) with the ReLU penalty
\[
V(f_1,f_2;x)=\max\{f_1(x)-f_2(x),0\},
\]
then conformalizes via
\[
E_i=\max\{\hat f_1(X_i)-Y_i,\; Y_i-\hat f_2(X_i)\},
\qquad
\hat C(X_{n+1})=
\left[
\hat f_1(X_{n+1})-Q_{1-\alpha},
\;
\hat f_2(X_{n+1})+Q_{1-\alpha}
\right].
\]
The penalty suppresses quantile crossing without changing the population target because the true ordered quantiles already satisfy the constraint [2210.10161].

## 2. Validity notions, conditional ambitions, and impossibility results

The fundamental guarantee in standard quantile conformal prediction is marginal validity. Under exchangeability of the calibration points and the test point,
\[
\mathbb P\bigl\{Y_{n+1}\in C(X_{n+1})\bigr\}\ge 1-\alpha,
\]
with no requirement that the quantile regression model be correct, homoscedastic, or well specified [1905.03222]. This guarantee is finite-sample and distribution-free, but it is unconditional over the covariates.

A persistent misconception is that quantile conformal prediction provides exact conditional coverage. The cited works state the opposite: exact distribution-free conditional coverage is impossible in broad nonparametric settings without trivial or infinite-length sets, so standard CQR is best understood as combining exact marginal validity with conditional-like adaptivity inherited from the quantile model [1905.03222] [2503.00220].

Recent work sharpens the intermediate notion of sample-conditional validity. For the split-conformal threshold set
\[
\widehat C_n(x)=\{y:s(x,y)\le \widehat\tau_n\},
\]
Vovk’s result is stated as
\[
\mathbb P\Bigl(\mathbb P(Y_{n+1}\in \widehat C_n(X_{n+1})\mid P_n)\ge 1-\alpha-\gamma\Bigr)
\ge 1-e^{-2n\gamma^2}.
\]
The same work studies covariate-dependent thresholds of the form
\[
\widehat h_n(x)=\langle \widehat\theta_n,\phi(x)\rangle,
\qquad
\widehat C_n(x)=\{y\in\mathcal Y:\ s(x,y)\le \widehat h_n(x)\},
\]
where \(\widehat\theta_n\) is obtained by held-out quantile regression,
\[
\widehat\theta_n \in \arg\min_\theta \frac1n\sum_{i=1}^n \rho_\alpha(\langle\theta,\phi(X_i)\rangle-S_i).
\]
This yields approximate weighted or group-conditional coverage at essentially minimax-optimal rates, up to logarithmic factors [2503.00220].

Group-conditional calibration is an especially concrete instance. In crop and weed classification, Adaptive Prediction Sets (APS) are calibrated separately by group, or equivalently through quantile regression on group indicators. With APS conformity scores \(E_i\), the group-specific threshold is modeled by a regression such as
\[
Q_{E | \{M_L, M_S\}}(1 - \alpha)
=
\beta_0
+
\beta_{A} \mathds{1}_{\{M_L = A \}}
+
\beta_{sunny} \mathds{1}_{\{M_S = sunny \}}
+
\beta_{A,sunny} \mathds{1}_{\{M_L = A \}} \mathds{1}_{\{M_{S} = sunny \}}.
\]
This reformulates group-wise conformal calibration as a single quantile-regression problem over metadata-defined strata [2308.15094].

## 3. Learning better quantiles inside the conformal pipeline

A major strand of work keeps the conformal wrapper fixed but improves the quantile learner. The non-crossing deep quantile method already noted enforces ordered lower and upper quantiles and derives non-asymptotic excess-risk bounds at the optimal nonparametric rate for the Hölder class, with polynomial rather than exponential dependence on input dimension in the prefactor [2210.10161].

A second strand targets the calibration objective itself. “Colorful Pinball Conformal Prediction” introduces the Mean Squared Conditional Error,
\[
\mathrm{MSCE}=\mathbb E\big[(\pi(X)-(1-\alpha))^2\big],
\]
and derives a density-weighted surrogate for quantile regression:
\[
\mathbb E_{X,Y}\!\left[f_{S\mid X}(q_\tau(X))\,\rho_\tau\!\big(\hat q_\tau(X),S(X,Y)\big)\right].
\]
The weight is estimated by finite differences from auxiliary quantiles,
\[
\hat w(x)=\frac{2\delta}{\hat q_{\tau+\delta}(x)-\hat q_{\tau-\delta}(x)},
\]
using a three-headed network with monotone Softplus offsets. The conformal stage is then applied to residuals \(R_j=S_j-\hat q_\tau(x_j)\), producing
\[
\mathcal C_\alpha(x)=\{y:S(x,y)\le \hat q_\tau(x)+\hat\gamma\}.
\]
This directly refines the quantile engine underlying conformal prediction rather than altering the final rank argument [2512.24139].

A third line modifies the meaning of the quantile target. In calibrated quantile prediction for Growth-at-Risk, conformal prediction is used to estimate a one-sided lower quantile rather than a two-sided interval. With
\[
E_t=\hat Q(\alpha,X_t)-Y_t,
\]
the conformalized lower quantile is
\[
\widehat Q^{\,\text{CQR}}(\alpha,x)=\hat Q(\alpha,x)-Q_E(1-\alpha),
\]
and the central guarantee is
\[
\mathbb{P}\{Y_{n+1}\le \hat Q(\alpha,x)-Q_E(1-\alpha)\}\le \alpha.
\]
This turns conformal calibration into a direct tool for quantile estimation, especially in tail-risk settings such as GaR and VaR [2411.00520].

An alternative distributional route begins from an estimated conditional CDF rather than separate lower and upper quantiles. Distributional conformal prediction defines PIT ranks
\[
U_t:=F(Y_t,X_t),
\]
or their estimated analogues, and conformalizes \(\psi(U_t)\), with baseline score \(\psi(u)=|u-1/2|\). Because ranks are Uniform\((0,1)\) and independent of \(X_t\) under the true conditional CDF, the method targets approximate conditional validity under consistent conditional-distribution estimation and admits a shape-adjusted score
\[
\psi_*(y,x)=\left|F(y,x)-b(x,\alpha)-\frac{1-\alpha}{2}\right|
\]
for shorter intervals under skewness [1909.07889].

## 4. Localization, structure, and adaptive calibration

Standard CQR uses one global conformal slack, and later work repeatedly identifies this as the main source of residual non-adaptivity. An “improved conformalized quantile regression” method replaces the single global correction with cluster-specific conformal corrections. Features are weighted by permutation importance,
\[
X^{*}_{\cdot j} = X_{\cdot j}\, I_j,
\]
clustered by k-means, and each cluster receives its own calibration quantile \(\hat q^{(i)}\), yielding
\[
\hat C_{1-\alpha}(\mathbf{x})=
\Big[
\hat Q_{\alpha/2}(\mathbf{x})-\hat q^{(i)},
\;
\hat Q_{1-\alpha/2}(\mathbf{x})+\hat q^{(i)}
\Big].
\]
The purpose is to approximate group-balanced or region-specific uncertainty under heteroscedasticity [2207.02808].

Density-Calibrated Conformal Quantile Regression (CQR-d) makes the local/global trade-off continuous rather than discrete. It computes the global score quantile \(Q^g\), a local \(k\)-nearest-neighbor quantile \(Q^l(x)\), a density proxy
\[
\rho(x)=\frac{1}{\frac{1}{k}\sum_{i\in N_k(x)} \|x-X_i\| },
\]
and weights
\[
w^l(x)=1-\frac{1}{1+\rho(x)}, \qquad w^g(x)=1-w^l(x).
\]
The combined correction is
\[
Q^c(x,\lambda)=\bigl(w^l(x)\,Q^l(x)+w^g(x)\,Q^g\bigr)\lambda,
\]
with \(\lambda^*\) chosen numerically on the calibration set. The resulting interval,
\[
\hat C_\alpha(X_j) =
\left[
\hat q_{\alpha/2}(X_j)-\hat Q_j^c(X_j,\lambda^*),
\;
\hat q_{1-\alpha/2}(X_j)+\hat Q_j^c(X_j,\lambda^*)
\right],
\]
has guaranteed marginal coverage at level \(1-\alpha-\epsilon\), where \(\epsilon\) is the numerical optimization tolerance [2411.19523].

Localized quantile regression also appears in domain-specific forms. Localized Spatial Conformal Prediction (LSCP) fits residual quantiles from neighborhood features,
\[
\tilde X(s_i) = (\hat{\varepsilon}(s_j))_{j\in N(s_i)},
\qquad
\tilde Y(s_i)=\hat{\varepsilon}(s_i),
\]
and returns
\[
\hat{C}_{n}(X(s_{n+1})) =
\left[
\hat f(X(s_{n+1}))+\hat Q_n(\beta^*),
\;
\hat f(X(s_{n+1}))+\hat Q_n(1-\alpha+\beta^*)
\right],
\]
with \(\beta^*\) chosen to minimize interval width. Its theory replaces i.i.d. assumptions with stationarity and spatial mixing and establishes finite-sample bounds on the conditional coverage gap together with asymptotic conditional coverage [2412.01098].

Temporal Quantile Adjustment (TQA) alters not the score but the queried calibration quantile over time. It sets
\[
a_{i,t}=\alpha-\hat\delta_{i,t},
\]
using a history-dependent rank predictor and then constructs the usual conformal interval at the adjusted level. The method targets simultaneous cross-sectional and longitudinal performance: standard conformal is recovered when \(\hat\delta_{i,t}\equiv 0\), whereas TQA uses within-series temporal information to widen or narrow the queried quantile [2205.09940].

A related localized view appears in Conformalized Unconditional Quantile Regression (CUQR), where the output is both a prediction interval and a relevance subgroup \(\widehat{\mathcal S_n(x)}\), and the guarantee is localized to that subgroup:
\[
\mathbb{P}\!\left(Y \in \widehat C_n(X)\mid X \in \widehat{\mathcal S_n(x)}\right)\ge 1-\alpha.
\]
Here the nested candidate intervals are built from recentered influence functions of residual quantiles rather than from conditional quantile regression [2304.01426].

## 5. Multivariate, vector-valued, and generalized quantiles

Quantile conformal prediction is not restricted to scalar scores. Optimal Transport-based Conformal Prediction replaces the usual scalar nonconformity score with a multivariate score \(S_i=s(X_i,Y_i)\in\mathbb{R}_+^d\) and defines vector ranks through Monge–Kantorovich transport. With reference vectors
\[
U_i=\frac{i}{n}\theta_i,
\]
the discrete assignment
\[
\sigma_n=\arg\min_{\sigma\in P_n}\sum_{i=1}^n \|S_i-U_{\sigma(i)}\|^2
\]
induces vector ranks \({}_n(S_i)=U_{\sigma_n(i)}\) and the quantile region
\[
\mathcal Q_n(\beta)=\left\{s:\|{}_n(s)\|\le \frac{\lceil \beta n\rceil}{n}\right\}.
\]
The conformal set is then the preimage
\[
C_\alpha(x)=\{y:\ s(x,y)\in \mathcal Q_n((1+\tfrac1n)\alpha)\}.
\]
Under exchangeability and \(\lceil \alpha(n+1)\rceil\le n\),
\[
\alpha \le \mathbb P\!\left(Y_{\rm test}\in C_\alpha(X_{\rm test})\right)\le \alpha+\frac{2}{n+1}.
\]
The method yields flexible, potentially non-convex prediction regions in multi-output regression and multiclass classification [2501.18991].

A semiparametric multivariate construction models the joint CDF of vector scores
\[
F(s)=\mathbb P[S_1\le s_1,\dots,S_d\le s_d]
\]
through empirical marginals and a nonparametric vine copula,
\[
\hat F(s)=\hat C\big(\hat F_1(s_1),\dots,\hat F_d(s_d)\big).
\]
The relevant threshold is the generalized multivariate quantile
\[
F^{-1}(p)=\inf\{s\in\mathbb R^d: F(s)\ge p\},
\]
and the paper derives an influence-function correction,
\[
\psi_P(\tilde s)=
\frac{(1-\alpha)-\mathbbm 1[\tilde s\preccurlyeq g]}{\|\nabla F(g)\|_2^2}\nabla F(g),
\]
to improve the plug-in estimate of the joint \(1-\alpha\) quantile. The resulting conformal set is asymptotically exact rather than finitely exact [2411.02114].

Distributional conformal prediction provides a scalar-output but generalized-quantile perspective. By conformalizing estimated PIT ranks rather than residuals, it produces intervals from conditional distribution models such as quantile regression and distribution regression, and can recover asymmetric “shape-adjusted” intervals of the form
\[
\left[Q(b(x,\alpha),x),\ Q(b(x,\alpha)+1-\alpha,x)\right].
\]
This suggests that quantile conformal prediction includes not only residual-quantile calibration but also calibration of rank-based surrogates for the conditional distribution [1909.07889].

## 6. Privacy, distribution shift, missing data, and online quantile tracking

In differentially private conformal prediction, the calibration quantile itself becomes the protected object. P-COQS computes the split-conformal threshold with a noisy binary search. If \(r=\left\lceil (1-\alpha)(n_{\text{cal}}+1)\right\rceil\), then the ordinary threshold \(\hat q=s_{[r]}\) is replaced by a DP estimate \(q^{\text{DP}}\) obtained by repeated noisy counts,
\[
\text{NoisyRC}([a,\text{mid}],\mathcal S) = \operatorname{card}\!\left(\mathcal S\cap[a,\text{mid}]\right) + \mathcal N\!\left(0,\frac{\lceil\log_2((b-a)/\delta)\rceil}{2\rho}\right).
\]
The resulting prediction set
\[
\mathcal C^{\text{DP}}(X_{\text{test}})=\left\{Y\in\mathcal Y:s(X_{\text{test}},Y,\hat f)\le q^{\text{DP}}\right\}
\]
satisfies the approximate finite-sample bound
\[
1-\alpha-\frac{\tau}{n_{\text{cal}}+1}
\le
\mathbb P\!\left(Y_{\text{test}}\in \mathcal C^{\text{DP}}(X_{\text{test}})\right)
\le
1-\alpha+\frac{\tau+1}{n_{\text{cal}}+1}.
\]
The privacy–coverage trade-off appears explicitly through the quantile rank error \(\tau\) [2507.12497].

Under distribution shift, Weighted Quantile Loss-scaled Conformal Prediction (WQLCP) modifies the calibration quantile with reconstruction-loss-based weights,
\[
w(x_j) \propto \frac{\mathcal{L}_{\text{cal}}(x_j)}{\mathcal{L}_{\text{test}}(x_i)+\epsilon},
\]
and computes the weighted threshold
\[
\hat{q} = \inf\left\{ q : \sum_{j=1}^n w(x_j)\,\mathbb{I}\{s_j \le q\} \ge (1-\alpha)\sum_{j=1}^n w(x_j) \right\}.
\]
This extends score scaling by a VAE reconstruction loss into a weighted quantile-calibration rule intended to reflect a shifted test distribution [2505.19587].

Missing covariates create a different failure mode: standard conformal prediction on imputed data remains marginally valid because symmetric imputation preserves exchangeability, but coverage can vary strongly across missingness patterns. Missing Data Augmentation (MDA) addresses this by recalibrating with artificially re-masked calibration points and targets mask-conditional validity,
\[
\mathbb{P}\!\left( Y^{(n+1)}\in \widehat C_\alpha(X^{(n+1)},m) \;\middle|\; M^{(n+1)}=m \right)\ge 1-\alpha.
\]
In the CQR version, the interval keeps the usual form
\[
\widehat C_\alpha(x) =
\left[
\hat q_{\alpha/2}(x)-\widehat Q_{1-\tilde\alpha},
\;
\hat q_{1-\alpha/2}(x)+\widehat Q_{1-\tilde\alpha}
\right],
\]
but the calibration set is modified to mimic the test mask exactly or through a nested masking rule [2306.02732].

In online settings, quantile conformal prediction becomes a quantile-tracking problem. For a single level,
\[
q_{t+1}(1-\alpha)=q_t(1-\alpha)-\eta_t\bigl(\alpha-\err_t(\alpha)\bigr),
\]
while recent work tracks an entire monotone vector \((q_{t,1},\dots,q_{t,K})\) simultaneously so that the prediction sets are nested across coverage levels. The proposed exponentiated-gradient and projected-gradient algorithms enforce \(q_{t,1}\ge q_{t,2}\ge\cdots\ge q_{t,K}\), thereby coupling online conformal prediction to non-crossing quantile estimation over the full risk spectrum [2605.12668].

## 7. Applications and empirical regularities

Quantile conformal prediction has been used both as a methodological template and as an application-specific workflow. In Svalbard temperature forecasting, the pipeline combines quantile gradient boosting at \(\tau=0.60\) with adaptive conformal prediction. After forming residuals
\[
r_t = y_t - \hat{y}_t,
\]
an AR(1) model,
\[
r_t = \phi_0 + \phi_1 r_{t-1} + \epsilon_t,
\]
is used to whiten the residuals, and quantile random forests estimate case-specific lower and upper score quantiles. The final adaptive interval is
\[
\bigl[ \hat q_{\alpha/2,\,(T+1)}(C) + \hat y_{T+1},\  \hat q_{1-\alpha/2,\,(T+1)}(C) + \hat y_{T+1} \bigr].
\]
This is explicitly described as very close in spirit to quantile conformal prediction or conformalized quantile regression [2510.23976].

In macro-financial risk analysis, conformalized lower quantiles materially improve calibration. The Growth-at-Risk study reports that conformalization improves calibration especially at extremal quantiles and formalizes the lower-tail statement
\[
\mathbb{P}\{Y_{n+1}\le \hat Q(\alpha,x)-Q_E(1-\alpha)\}\le \alpha,
\]
which is directly interpretable as a calibrated tail-risk guarantee under exchangeability [2411.00520].

In agricultural image classification, group-specific APS thresholds estimated by quantile regression stabilize coverage across environmental strata defined by metadata such as location and sky conditions. The paper contrasts this with marginal APS, whose overall coverage is near target but whose subgroup coverage varies substantially [2308.15094].

Across the broader literature, a consistent empirical pattern is reported. Standard CQR usually achieves coverage close to nominal and often shorter intervals than ordinary split conformal in heteroscedastic settings [1905.03222]. Non-crossing and density-aware variants seek sharper intervals or better conditional behavior without abandoning the final conformal step [2210.10161] [2411.19523] [2512.24139]. Localized spatial, temporal, and subgroup methods report tighter or more uniform calibration within their target structures, at the cost of added assumptions, additional modeling, or approximate rather than exact finite-sample guarantees [2412.01098] [2205.09940] [2304.01426]. Multivariate generalizations replace scalar score thresholds by vector quantile regions, and constrained regimes such as privacy, shift, missingness, and online prediction modify the quantile-calibration stage itself rather than the basic conformal logic [2501.18991] [2507.12497] [2505.19587] [2306.02732] [2605.12668].

A plausible implication is that “quantile conformal prediction” is best understood not as a single algorithm, but as a family of conformal procedures whose defining operation is the estimation, calibration, or generalization of a quantile threshold. What remains invariant is the conformal role of that threshold: it is the interface between an adaptive score model and a coverage guarantee.

Source: https://www.emergentmind.com/topics/quantile-conformal-prediction