---
title: Quantile Regression Averaging (QRA) Overview
url: https://www.emergentmind.com/topics/quantile-regression-averaging-qra
type: topic
---

# Quantile Regression Averaging (QRA) Overview

Quantile Regression Averaging (QRA) is a probabilistic forecasting framework that converts a collection of point forecasts into conditional quantile forecasts by treating those point forecasts as regressors in a quantile regression. For a quantile level \(\tau\in(0,1)\), QRA models the conditional \(\tau\)-quantile as a linear or affine combination of forecast inputs, with coefficients estimated by minimizing the quantile check loss; repeating this across a grid of quantile levels yields quantile curves, prediction intervals, and an empirical representation of the predictive distribution [2402.07559] [2405.11372]. In a broader model-averaging sense, the same logic has been extended from ensembles of point forecasts to ensembles of quantile models, factor-augmented quantile autoregressions, complete subsets of regressors, functional quantile models, and semiparametric marginal quantile components [2010.12263] [2003.03299] [2310.01970] [1809.01364].

## 1. Formal definition and conceptual scope

In its classical forecasting form, QRA starts with \(K\) individual point forecasting models producing \(\hat{y}_t^{(1)},\dots,\hat{y}_t^{(K)}\). For each quantile level \(\tau\), QRA specifies
\[
Q_{y_t}(\tau \mid X_t) = \beta_0^{(\tau)} + \sum_{k=1}^{K} \beta_k^{(\tau)} \hat{y}_t^{(k)},
\]
or, in vector form,
\[
Q_{y_t}(\tau \mid X_t) = X_t^\top \beta^{(\tau)},
\]
where \(X_t=(1,\hat{y}_t^{(1)},\dots,\hat{y}_t^{(K)})\) and \(\beta^{(\tau)}\) is quantile-specific [2405.11372]. In electricity price notation, with hourly day-ahead prices \(P_{h,t}\) and point-forecast vector \(\hat{\mathbf{P}}_{h,t}\), the same idea is written as
\[
\hat{q}_{P_{h,t}}(\alpha) = \hat{\mathbf{P}}_{h,t}^{\top}\mathbf{w}_{\alpha},
\]
with a separate weight vector \(\mathbf{w}_{\alpha}\) for each \(\alpha\in(0,1)\) [2402.07559].

This classical definition treats point forecasts as explanatory variables and estimates quantile-specific combination weights. The literature also uses the same model-averaging logic in a broader sense. In factor-augmented quantile autoregressions, model-specific quantile forecasts \(\hat{Q}^{(m)}_{y_{t+1}}(\tau)\) are combined as
\[
\hat{Q}_{y_{t+1}}(\tau)(w)=\sum_{m=1}^{M} w_m(\tau)\,\hat{Q}^{(m)}_{y_{t+1}}(\tau),
\]
with \(w(\tau)\) on the unit simplex [2010.12263]. In semiparametric high-dimensional conditional quantile prediction, the target conditional quantile \(Q_{\tau}(Y\mid X)\) is approximated by an affine combination of one-dimensional marginal quantile regression functions,
\[
m_{\tau}(X)\approx w_0+\sum_{j=1}^{p_n} w_j\,m_{\tau j}(X_j),
\]
so that the “base forecasters” are marginal quantile components rather than distinct forecasting models [1809.01364]. This suggests that QRA is not limited to forecast ensembles in the narrow time-series sense; it is a general quantile model averaging principle.

## 2. Estimation, loss functions, and probabilistic output

The canonical estimation problem uses the quantile check loss
\[
\rho_{\tau}(u)=u(\tau-\mathbf{1}_{\{u<0\}}),
\]
and fits a separate quantile regression for each \(\tau\) by solving
\[
\min_{\beta}\sum_t \rho_{\tau}(y_t-X_t^\top\beta).
\]
Equivalent formulations in the electricity-price literature write the same objective in piecewise form with asymmetric absolute deviations [2402.07559] [2405.11372]. In baseline QRA, quantiles are therefore estimated independently: for each selected \(\tau\), there is a distinct coefficient vector \(\beta^{(\tau)}\).

Once the regressions are fitted, QRA produces a discrete set of conditional quantiles
\[
\{\hat{Q}_{y_t}(\tau_m)\}_{m=1}^{M},
\]
which define prediction intervals and an approximate predictive distribution. Common examples include a 50% interval from \(\tau=0.25\) and \(\tau=0.75\), a 70% interval from \(\tau=0.15\) and \(\tau=0.85\), and a 90% interval from \(\tau=0.05\) and \(\tau=0.95\) [2405.11372]. In electricity-price applications, running QRA on a dense grid such as \(\alpha=0.001,\dots,0.999\) is used to describe the full predictive distribution and derive risk measures such as Value-at-Risk [2402.07559].

A known issue is quantile crossing: independently estimated quantiles may violate monotonicity, so that a lower nominal quantile exceeds a higher one. In one implementation of Smoothing Quantile Regression Averaging, after obtaining predictions of the 99 percentiles, the results are sorted independently for each day and hour [2302.00411]. This indicates that standard separate-quantile QRA does not itself guarantee a coherent quantile function. A related development is Bayesian joint quantile autoregression, which supplies a quantile function that avoids crossing of the regression across quantiles; although it is not presented as QRA, it addresses a core structural problem that also arises in QRA systems [2305.19080].

## 3. Variants, regularization, and structural modifications

The contemporary QRA literature contains a large family of variants that preserve the basic forecast-combination structure while modifying the regressors, the loss, or the regularization.

| Method | Core modification | Source |
|---|---|---|
| QRM | Quantile Regression on Mean, using the row mean of point predictions as a single regressor | [2405.11372] |
| FQRA / FQRM | PCA-based factor versions of QRA and QRM | [2405.11372] |
| sFQRA / sFQRM | Standardized factor variants using row standardization before PCA | [2405.11372] |
| LQRA | L1-regularized QRA with \(\lambda\|\beta\|_1\) penalty | [2405.11372] |
| SQRA / SQRM | Smoothed QRA variants using kernel density estimation in the loss | [2405.11372] |
| iQRA | Isotonic QRA with stochastic order constraints and nonnegative coefficients | [2507.15079] |
| ERA | Expectile regression averaging, replacing quantile loss by asymmetric squared loss | [2402.07559] |

Baseline QRA is linear quantile regression on point forecasts. QRM reduces dimensionality by averaging the point forecasts first and then fitting a one-regressor quantile regression. FQRA and FQRM use Principal Component Analysis on the point-prediction matrix to extract factors, thereby addressing multicollinearity and reducing dimensionality; the standardized variants apply row-wise standardization before PCA to improve comparability and numerical stability [2405.11372]. In a related but distinct large-panel setting, a hybrid Factor-QRA approach uses PCA on a panel of 673 point forecasts and then performs quantile regression on the extracted factors or on a factor-based point forecast, with the number of factors chosen by BIC [2303.08565].

Regularization enters most directly through LQRA and iQRA. LQRA adds an L1 penalty,
\[
\hat{\beta}^{(\tau)}=\arg\min_{\beta}\sum_t \rho_{\tau}(y_t-X_t^\top\beta)+\lambda\|\beta\|_1,
\]
to perform feature selection among base models [2405.11372]. Isotonic Quantile Regression Averaging (iQRA) instead imposes stochastic order constraints through nonnegative coefficients, using isotonic regularization to improve forecast accuracy, reliability, and computational costs; the paper states that isotonic regularization decreases the complexity of the quantile regression problem and offers a hyperparameter-free approach to variable selection [2507.15079]. This suggests a structural alternative to explicit penalization.

Smoothing Quantile Regression Averaging replaces the non-smooth check loss by a kernel-smoothed objective,
\[
\sum_{d,h}\left[H\,\phi\!\left(\frac{P_{d,h}-X_{d,h}\beta_q}{H}\right)+\left(q-\Phi\!\left(\frac{P_{d,h}-X_{d,h}\beta_q}{H}\right)\right)\big(P_{d,h}-X_{d,h}\beta_q\big)\right],
\]
with bandwidth \(H\) selected by a rule of thumb [2302.00411]. A distinct line of work proposes Expectile Regression Averaging (ERA), which mirrors QRA’s forecast-averaging structure but replaces the quantile loss with asymmetric squared loss [2402.07559].

## 4. High-dimensional, semiparametric, and functional generalizations

Beyond forecast ensembles, QRA has been generalized to high-dimensional and semiparametric settings in which the “candidate models” are not separate forecasting engines but structured quantile components. In “Semiparametric model averaging for high dimensional conditional quantile prediction,” the target conditional quantile is approximated by an affine combination of one-dimensional marginal quantile regression functions,
\[
m_{\tau}(X)\approx w_0+\sum_{j=1}^{p_n} w_j m_{\tau j}(X_j),
\]
where each \(m_{\tau j}(x_j)=Q_{\tau}(Y\mid X_j=x_j)\) is estimated by local linear quantile regression and the weights \(w_j\) are estimated by penalized quantile regression with SCAD [1809.01364]. The procedure is explicitly two-stage: first estimate marginal quantile functions nonparametrically, then estimate sparse model weights by minimizing
\[
Q_n(w)=\sum_{i=1}^n \rho_{\tau}\!\left(Y_i-w_0-\sum_{j=1}^{p_n}w_j\hat m_j(X_{ij})\right)+n\sum_{j=1}^{p_n} p_{\lambda}(|w_j|).
\]
This is mathematically a QRA structure in which the base quantile forecasters are marginal quantile functions rather than external point forecasts [1809.01364].

Functional data-driven quantile model averaging extends the same idea to functional linear quantile regression. Candidate models are indexed by the number of retained functional principal components \(J_n\), each candidate producing
\[
\hat{Q}_{\tau,J_n}(X_0)=\hat a_{J_n}+\sum_{j=1}^{J_n}\hat b_{j,J_n}\hat\xi_{0j},
\]
and the averaged predictor is
\[
\hat{Q}_{\tau}(X_0,\mathbf{w})=\sum_{J_n\in\mathcal{J}} w_{J_n}\hat{Q}_{\tau,J_n}(X_0),
\]
with weights chosen by K-fold cross-validation under the quantile loss [2310.01970]. The paper proves asymptotic optimality of the selected weights in terms of minimizing the excess final prediction error when all candidate models are misspecified, and consistency when the true regression relationship belongs to the candidate set [2310.01970].

Other model-averaging formulations broaden QRA still further. Complete Subset Averaging for quantile regressions considers all submodels of a fixed size \(k\), averages them with equal weights, and selects \(k\) by leave-one-out cross-validation; the resulting predictor is
\[
\widehat{Q}_{\mathrm{CSA}}(\tau\mid x;k)=\frac{1}{M}\sum_{m=1}^{M} x_{(m,k)}^{\top}\widehat{\Theta}_{(m,k)},
\]
where \(M=\binom{K}{k}\) [2003.03299]. Jackknife Model Averaging for Composite Quantile Regression instead averages across candidate models while pooling multiple quantile levels in a composite quantile objective; it uses delete-one cross-validation to estimate model weights and proves asymptotic optimality in minimizing out-of-sample composite final prediction error [1910.12209]. In macroeconomic factor-augmented quantile autoregressions, model-specific quantile forecasts are averaged using equal weights, AIC, BIC, QRIC, or jackknife weights, with latent factors estimated by principal components from a large panel [2010.12263]. These developments indicate that QRA has become a general frequentist model-averaging framework for quantile-based prediction.

## 5. Applications in electricity price forecasting and related domains

In electricity price forecasting, QRA is described as “the golden standard in probabilistic approaches to predict energy prices” [2405.11372]. Its appeal is tied to the structure of electricity markets: prices are highly volatile, exhibit spikes and heavy tails, and are affected by seasonality and fundamentals, while probabilistic forecasts are required for risk management and trading [2405.11372] [2402.07559]. QRA is therefore routinely used to combine ARX-type models, spike-transformed models, weekly-mean models, and variants based on different variance-stabilizing transformations [2402.07559] [2302.00411].

Empirical studies show both the strengths and the limits of the method. In one comparison on German day-ahead electricity prices, with asinh transformation applied beforehand, QRA achieved an overall pinball score of \(2.00\), coverage at 5% of \(7.54\%\), and coverage at 95% of \(91.78\%\); the corresponding ERA results were \(1.98\), \(5.26\%\), and \(94.28\%\), respectively [2402.07559]. The same study reports that quantile-based methods produce prediction intervals that are too narrow, with QRA tending to under-estimate tail risk relative to expectile-based approaches [2402.07559]. A smoothing-based refinement, Smoothing Quantile Regression Averaging, is evaluated on German and Spanish electricity markets using data covering the COVID-19 pandemic and the Russian invasion of Ukraine; it is reported to lead to profit increases of up to \(3.5\%\) on average compared to a benchmark strategy based solely on point forecasts [2302.00411].

Hybrid factor-based extensions have also been evaluated from both statistical and economic perspectives. A probabilistic forecasting study for German EPEX SPOT and the Polish Power Exchange proposes a hybrid Factor-QRA approach and finds that the newly proposed method outperforms literature benchmarks in terms of empirical coverage and the Christoffersen test for conditional coverage [2303.08565]. The same work evaluates forecasts through a trading strategy using probabilistic price predictions to optimize the operation of an energy storage system and concludes that there is a need for the economic evaluation of forecasts in addition to statistical measures [2303.08565]. More recently, Isotonic Quantile Regression Averaging is reported to consistently outperform state-of-the-art postprocessing methods in terms of both reliability and sharpness, while producing well-calibrated prediction intervals across multiple confidence levels and offering a hyperparameter-free approach to variable selection [2507.15079].

Software support has become part of the QRA ecosystem. The Python package ReModels implements baseline QRA together with QRM, FQRA, FQRM, sFQRA, sFQRM, LQRA, SQRA, and SQRM, and also provides dataset acquisition, variance-stabilizing transformations, point-forecast computation, and probabilistic forecast evaluation [2405.11372]. This suggests that QRA is no longer only a methodological idea but also a reproducible workflow for electricity-market forecasting research.

## 6. Theoretical properties, evaluation criteria, and limitations

A major strand of the literature studies QRA through asymptotic optimality, sparsity, and oracle-type results. In semiparametric high-dimensional conditional quantile prediction, the SCAD-penalized weight estimator is shown to be consistent as \(p_n\to\infty\), to recover the zero weights with probability approaching 1, and to satisfy an oracle-type asymptotic normality result for the active weights [1809.01364]. In factor-augmented quantile autoregression, QRIC-based and jackknife weights are motivated by minimizing quantile-specific forecast loss, and for UK GDP growth these approaches outperform equal weights and AIC/BIC on coverage and final prediction error, whereas for CPI inflation a naive QAR(1) outperforms all model averaging methodologies [2010.12263]. In complete subset averaging, the selected subset size is asymptotically optimal in the sense of Li (1987), even when all candidate models are misspecified [2003.03299]. In functional quantile model averaging, K-fold cross-validation weights are asymptotically optimal for the excess final prediction error, and consistency is obtained when the true model belongs to the candidate set [2310.01970]. In composite quantile regression, delete-one cross-validation weights yield asymptotic optimality in minimizing out-of-sample composite final prediction error [1910.12209].

The evaluation of QRA forecasts is correspondingly quantile-centric. Proper scoring rules include the pinball loss and its aggregated versions [2402.07559] [2405.11372]. Interval calibration is assessed by coverage probabilities, Average Empirical Coverage (AEC), empirical coverage, and average coverage error, together with Kupiec and Christoffersen tests for conditional coverage [2405.11372] [2303.08565]. Comparative predictive ability is often examined with Diebold–Mariano or related tests [2402.07559]. In model-averaging theory, final prediction error and excess final prediction error provide the formal risk criteria under which asymptotic optimality is established [2310.01970].

Several limitations recur across the literature. Separate quantile fitting can produce quantile crossing [2405.11372]. QRA’s effectiveness is limited by the quality and diversity of the underlying point forecasts [2405.11372]. Computational cost rises with the number of quantiles, rolling calibration windows, and regularized variants, especially in high-dimensional settings [2405.11372] [1809.01364]. Bandwidth choice matters in kernel-based smoothing and in semiparametric marginal quantile estimation [2302.00411] [1809.01364]. In electricity markets, structural regime changes and evolving renewable penetration can weaken the informativeness of historical residual structures [2405.11372]. More specialized extensions address additional complications: semiparametric model averaging for high-dimensional quantile regression with nonignorable missingness uses a two-phase scheme combining semiparametric likelihood-based estimation for the missing mechanism with a semiparametric weighting procedure for quantile model averaging, and proves asymptotic optimality under complex missingness conditions [2509.00464].

Future directions suggested in the literature include ultra-high dimensional extensions with screening or dimension reduction before quantile averaging, alternative penalties such as MCP or adaptive SCAD/LASSO, time-series dependence and dynamic QRA, Quantile Regression Forest, Quantile Regression Neural Network, and broader benchmarking against distributional neural networks and conformal prediction intervals [1809.01364] [2509.00464] [2405.11372]. This suggests that QRA is best understood not as a single fixed algorithm, but as a family of quantile model averaging methods whose central object is the weighted combination of conditional quantile forecasts under quantile-consistent loss.

Source: https://www.emergentmind.com/topics/quantile-regression-averaging-qra