---
title: Risk-Averse Storage Arbitrage Model
url: https://www.emergentmind.com/topics/risk-averse-analytical-storage-arbitrage-model
type: topic
---

# Risk-Averse Storage Arbitrage Model

Searching arXiv for the central paper and closely related risk-averse storage arbitrage work.

First, I’ll retrieve the main paper by arXiv id 2512.06600, then a few adjacent papers on CVaR, conformal risk control, and robust/chance-constrained storage arbitrage to ground the article.

Searching for the main paper and related storage arbitrage research on arXiv.

Main query: 2512.06600

Related queries: "risk-averse storage arbitrage CVaR", "conformal storage arbitrage", "chance-constrained storage arbitrage"

Risk-averse analytical storage arbitrage models are formulations of energy storage self-scheduling in which arbitrage decisions over time are coupled to explicit controls on downside profit risk, reserve adequacy, or opportunity-cost uncertainty. In recent arXiv literature, the topic includes stochastic, online inventory optimization with chance-constrained terminal state of charge (SoC), CVaR-based self-scheduling, robust max–min dispatch under uncertainty sets, dynamic quantile-based risk measures in Markov decision processes, and conformal controllers that adjust conservativeness online without distributional assumptions [2512.06600][2212.00209][2501.08472][1509.01920][2511.01032].

## 1. Formal problem class and core storage dynamics

A central formulation treats energy storage arbitrage as a **stochastic, online inventory optimization** problem over a horizon \(t=1,\dots,T\). The storage chooses charge \(c_t\), discharge \(d_t\), and SoC \(e_t\) under uncertain electricity prices \(\boldsymbol{\lambda}_t\), with intertemporal dynamics, power limits, and an explicit reliability constraint on terminal SoC [2512.06600]. A representative model is
\[
\begin{aligned}
\max_{e,c,d}\quad  & \mathbb{E}_{\boldsymbol{\lambda}}\Bigg[\sum_{t=1}^T \boldsymbol{\lambda}_t (d_t - c_t)\Bigg] \\
\text{s.t.}\quad  & e_{0} = e_0 \\
& e^{\min} \le e_t \le e^{\max}, \quad \forall t \\
& e_t = \hat{\eta} e_{t-1} - \frac{d_t}{\eta_d} + c_t \eta_c, \quad \forall t \\
& 0 \le d_t \le P,\quad 0 \le c_t \le P,\quad \forall t \\
& \mathbb{P}_{\boldsymbol{\lambda}}\{ e_{\tau} \in \mathcal{E}^{\ell} \} \ge 1 - \epsilon,\quad \forall \tau \in \mathcal{T}^{\rm target}.
\end{aligned}
\]
Here \(e_t\) is SoC, \(P\) is the maximum charge/discharge rate, \(\eta_c,\eta_d\) are charge/discharge efficiencies, \(\hat\eta\) is the self-discharge factor, and \(\mathcal{E}^{\ell}=[\ell^{\min},\ell^{\max}]\) is a target SoC band for reliability [2512.06600].

The same intertemporal structure also appears in analytical convex-control models in which the net addition to storage is written as \(x_t(S)=S_t-\rho S_{t-1}\), with capacity constraints \(0\le S_t\le E\), rate bounds \(-P_o\le x_t\le P_i\), and convex cost functions \(C_t(x)\) that can encode bid–ask spreads, inefficiencies, and market impact [1406.3653]. In that setting, the arbitrage problem is posed as
\[
\min_S \sum_{t=1}^T C_t\big(S_t-\rho S_{t-1}\big),
\]
which is equivalent to profit maximization up to sign convention [1406.3653]. A related stochastic dynamic programming formulation writes a Bellman recursion
\[
Q_{t-1}(e_{t-1}\mid \lambda_t)
=
\max_{b_t,p_t}
\Big\{
\lambda_t(p_t-b_t)-c p_t + V_t(e_t\mid \lambda_t)
\Big\},
\]
with \(V_t(e_t\mid\lambda_t)=\mathbb{E}[Q_t(e_t\mid\lambda_{t+1})\mid\lambda_t]\), thereby making the marginal value of energy explicit in the control law [2108.06000].

Within this problem class, “risk-averse” does not remove arbitrage; it reweights arbitrage against future reliability value, adverse price realizations, or tail-loss exposure. The resulting model remains an intertemporal control problem, but the terminal or continuation value of stored energy is no longer determined by expected price spread alone.

## 2. Principal risk-aversion mechanisms

A first mechanism is the **chance-constrained terminal SoC**. In the reachability formulation, the requirement
\[
\mathbb{P}_{\boldsymbol{\lambda}}\{ e_T \in [\ell^{\min},\ell^{\max}] \} \ge 1-\epsilon
\]
makes the reliability level explicit: smaller \(\epsilon\) implies higher reliability and more conservative arbitrage [2512.06600]. The same paper uses a sample-average approximation with binary scenario indicators \(w_k\), so that at least a fraction \(1-\epsilon\) of scenarios must remain in the target band.

A second mechanism is the **stopping-time reward**. To discourage myopic discharge before critical hours, a binary stopping indicator \(z_t\) is introduced, with monotonicity \(z_t\ge z_{t-1}\) and charging/discharging disabled after stopping. The objective includes
\[
\sum_{t=1}^{T} \hat r_t z_t,
\]
or, to pay only at the stopping time,
\[
\sum_{t=1}^T \hat r_t (z_t-z_{t-1}),
\]
so that earlier reserve-preserving behavior sacrifices arbitrage profit but receives higher reward [2512.06600]. This makes reliability an economically interpretable incentive rather than only an administrative hard constraint.

A third mechanism is the **SoC range target penalty**. In reinforcement learning form, the terminal reward is penalized when \(e_{T+1}\notin\mathcal E^\ell\) by a piecewise quadratic term with factor \(\rho>0\); in the differentiable dispatch layer, the penalty becomes \(\rho\|e_T-e^{\rm target}\|^2\), which is convex quadratic and suitable for backpropagation [2512.06600]. These are soft reliability constraints: violating the target SoC costs profit.

A fourth mechanism is **CVaR on stochastic profit**. In risk-averse self-scheduling, the decision vector includes charge, discharge, SoC, a VaR threshold \(\zeta\), and auxiliary variables \(z^\omega\), with
\[
\underset{z^{\omega}, \zeta}{\text{maximize}}
\quad
\mathcal{R}_{\alpha}(\boldsymbol{x})
\coloneqq
\zeta - \frac{1}{1-\alpha} \sum_{\omega \in \Omega} \pi^{\omega} z^{\omega}
\]
subject to
\[
\zeta - z^{\omega} \leq \sum_{k \in \mathscr{K}} \lambda_{k}^{\omega} \big(p_k^{d} - p_k^{c}\big), \quad z^{\omega} \ge 0.
\]
This is the Rockafellar–Uryasev linear programming representation of CVaR of profits and directly penalizes the worst \((1-\alpha)\) tail of outcomes [2212.00209].

A fifth mechanism is **robust feasibility**. In joint arbitrage and ancillary service bidding, the operator chooses a schedule and capacity bids that must remain feasible for all regulation signals \(u\) in an uncertainty set \(\mathcal U\). The risk-averse requirement is operational feasibility for all \(u\in\mathcal U\), which protects against SoC violations or non-delivery under worst-case activation patterns allowed by market rules [2510.10856].

Taken together, these formulations show that risk aversion in storage arbitrage is not limited to a single metric. In the cited models it appears as chance constraints on SoC, stopping incentives, terminal penalties, CVaR of profits, and robust worst-case feasibility.

## 3. Analytical control structure and dynamic programming

The analytical core of storage arbitrage is the marginal value of stored energy. In convex-control formulations, there exists a shadow-price sequence \(\mu_t^*\) such that \(x_t(S^*)\) minimizes
\[
C_t(x)-\mu_t^* x
\]
over feasible \(x\), while complementary slackness links \(\mu_t^*\) to the capacity boundaries [1406.3653]. When \(0<S_t^*<E\), the shadow price evolves deterministically; when the store is at 0 or \(E\), the shadow price can kink. The same line of work proves that the optimal management decision depends only a finite, and typically short, time horizon [1307.0800][1406.3653]. This finite-horizon locality is analytically important because it limits how far ahead uncertainty must be represented with high fidelity.

In stochastic dynamic programming, prices can be modeled as a Markov process with discretized price nodes and transition matrices. Under variable charge and discharge efficiencies, the value-to-go function is approximated as piecewise linear in SoC, and the derivative of the Q-function admits an explicit threshold structure: very low prices induce full charging, intermediate prices create partial charging or idling, and sufficiently high prices induce partial or full discharge [2108.06000]. This preserves computational tractability while keeping the physical SoC dynamics and efficiency dependence explicit.

Risk-averse dynamic programming generalizes the Bellman operator by replacing expectation with a one-step risk mapping. In a finite-horizon MDP, the objective can be written as a **dynamic quantile-based risk measure**,
\[
\min_{\pi\in\Pi} \rho_0^\alpha\Bigl( C_1^\pi + \rho_1^\alpha\bigl( C_2^\pi + \cdots + \rho_{T-1}^\alpha(C_T^\pi)\cdots \bigr)\Bigr),
\]
where the one-step mappings include VaR and CVaR as quantile-based risk measures [1509.01920]. The corresponding Bellman equations preserve a state–action value function, but the continuation value becomes a tail-sensitive functional rather than a linear expectation.

A complementary steady-state MDP formulation places CVaR on the distribution of stage costs induced by the stationary occupancy measure \(x_{tsa}\). The resulting mean–risk model is bilinear in the occupancy variables and the VaR threshold \(\eta\), but admits both a DC reformulation and an exact global method based on the structural result that an optimal \(\eta^*\) equals one of finitely many stage-cost values [2601.02207]. This is analytically notable because it converts a seemingly nonconvex risk-averse control problem into a sequence of linear programs.

The common analytical pattern is therefore clear: SoC remains the endogenous inventory state, prices remain exogenous uncertainty, and risk aversion enters through the continuation operator or terminal value. What changes is not the intertemporal nature of arbitrage, but the valuation rule applied to future scenarios.

## 4. Learning-based and distribution-free risk-aware formulations

Recent work embeds the analytical dispatch problem inside end-to-end learning. In the reachability framework, a predictor outputs both a center \(\hat\lambda_t(x)\) and an uncertainty set \(\mathcal U_\theta(x)\), while the dispatch layer solves
\[
f(r,\lambda)=
\max_{c,d,e,z,g}
\sum_{t=1}^{T}\lambda_t P(d_t-c_t)
+\sum_{t=1}^{T} r_t z_t
+\rho \|e_T-e^{\rm target}\|^2
\]
subject to relaxed stopping logic \(z_t\in[0,1]\), SoC bounds, and linear dynamics [2512.06600]. Conformal calibration of residuals provides finite-sample coverage of price realizations, and gradients are propagated through the dispatch layer by implicit differentiation. In this setting, risk aversion is tuned by the stopping reward sequence \(\{r_t\}\), the SoC penalty weight \(\rho\), and the uncertainty set design.

A distinct distribution-free approach constructs conformal prediction intervals for real-time prices and then samples multiple price paths within those intervals. For each sampled path, a deterministic arbitrage problem is solved; the controller charges only if all scenarios agree on charging, discharges only if all scenarios agree on discharging, and otherwise idles [2412.07075]. The method is explicitly conservative: it only acts when directional agreement holds across plausible price scenarios. Under a good forecaster, the aggressive mode earns \$8,170.12 with total purchases \$4,438.98, compared with \$8,284.20 and \$12,936.43 for the point-forecast policy; this is described as about 34% of the point-forecast’s purchases [2412.07075].

An online conformal controller extends this logic to value-function uncertainty. The controller builds a symmetric prediction set around the forecast marginal value \(\hat q_t\), modifies the analytical charge/discharge thresholds accordingly, and updates a conformal control variable \(\gamma_t\) by
\[
\gamma_{t+1}=\gamma_t+\rho(\varepsilon-\ell_t),
\]
where the loss \(\ell_t\) is based on either prediction error or value error [2511.01032]. Because online profit loss feedback is unobservable, the paper establishes that a temporal difference error serves as a measurable proxy. The resulting controller proves bounded long-term risk with convergence guarantees in temporal difference error, which further effectively manages risk exposure in potential profit losses [2511.01032].

These learning-based models do not replace analytical arbitrage structure; they parameterize it. The decision rule still depends on SoC dynamics, continuation values, and threshold comparisons, but the uncertainty representation is learned, calibrated, or updated online rather than fixed ex ante.

## 5. Reported trade-offs between profit, variance, and reliability

The empirical literature consistently reports a profit–risk trade-off rather than a single dominant operating point. In the reachability study, the same 24-hour case is solved by scenario-based sample-average approximation (SAA), DQN, and end-to-end learning, with target band \([5,7]\) MWh and target SoC \(e^{\rm target}=6\) MWh [2512.06600].

| Method | Illustrative operating point | Reported risk effect |
|---|---|---|
| SAA | \(c=0\$/\text{hr}\): profit \(\approx 97.6\$\) | deviation \(\approx 45\%\) |
| SAA | \(c\in[3,7]\) | std dev reduces to \(\sim 25\%\) |
| DQN | \(c=0\$/\text{hr}\): profit \(\approx \$161\) | std dev \(\approx 94\%\) |
| DQN | \(c>12\$/\text{hr}\) | \(\tau=1\) hr; std deviation \(\sim 0.1\%\) |
| E2E | \(c=0\$/\text{hr}\): profit \(\approx \$0\) | strong robustness |
| E2E | \(c\in[1,6]\): profit \(\approx \$130\) | std dev \(\approx 3\%\) |
| E2E | \(c\in[7,15]\) | std dev \(\approx 1\%\); coverage above 94% |

These results show reduced profit variance under E2E, consistent stopping times, and high reliability of SoC [2512.06600]. They also show that a stopping reward can change the feasible operating region itself, not merely re-rank otherwise identical schedules.

Across uncertainty-set models, efficient frontiers highlight the tradeoff between risk and profit. Robust and chance-constrained optimization approaches are both used, but robust strategies perform better in risk management across varying levels of conservativeness, especially under highly volatile market conditions [2501.08472]. In that study, risk is operationalized as the number of days with negative realized profit per year, and the uncertainty budget \(\Gamma\) or confidence level \(1-\epsilon\) acts as the control knob moving the strategy along the frontier [2501.08472].

A recurring policy interpretation is that non-response to strong price signals need not indicate malfunction or weak incentives. In stochastic self-scheduling on Australian market data, risk-averse storage resources tend to have a myopic operational perspective, that is, they typically engage in near-term price arbitrage and chase only few extreme price spikes and troughs, thus remaining idle in several time periods with markedly high and low prices [2212.00209]. This is consistent with the reachability motivation that, without accounting for the future reliability value of stored energy, batteries may discharge too early or fail to preserve reserves during critical hours [2512.06600].

## 6. Assumptions, controversies, and extension paths

The current analytical literature makes several simplifying assumptions. In the reachability model, the battery is a single storage asset with simple linear SoC dynamics, no degradation, no cycle limits, and no network constraints or multi-node interactions [2512.06600]. Critical hours \(\mathcal T^{\rm target}\) are assumed known ex ante, often reduced to \(\{T\}\), and the chance constraint is imposed only on final SoC rather than on a multi-stage reliability event [2512.06600]. In end-to-end learning, the stopping variable \(z_t\) is relaxed to \([0,1]\), which approximates but does not exactly reproduce binary stopping [2512.06600].

Another limitation is the treatment of uncertainty. Some formulations use historical scenarios, some assume normal or lognormal approximations, some use i.i.d. training samples, and some use conformal sets without a structural price model [2501.08472][2412.07075]. This has led to a mild methodological controversy over whether risk should be represented probabilistically, robustly, or distribution-free. The literature does not resolve this by declaring one universal metric; instead, it shows that the choice depends on the operational question. Reliability of terminal SoC, worst-case market feasibility, tail profit loss, and long-run calibration error are distinct objects.

Extensions now move in three main directions. One direction is richer risk modeling. A tri-objective newsvendor framework for capacity reservation under non-normal uncertainty jointly maximizes expected profit, minimizes CVaR tail loss, and minimizes maximum regret over candidate non-normal distributions; in stylized log-NMVM experiments with matched mean and variance, a moment-matched normal policy over-reserves capacity by up to 1.337 units [2607.05372]. This suggests that reduced-form pre-commitment layers can be attached to multi-period arbitrage when the key decision is how much capacity to withhold for an uncertain future window.

A second direction is degradation-aware and multi-service coordination. A degradation-infused energy portfolio allocation framework embeds a closed-form marginal degradation profile into a multi-battery, multi-market dispatch problem and equips the portfolio formulation with a CVaR-based mechanism to bring risk-averseness against uncertainty in market prices [2411.01506]. In that setting, arbitrage is no longer evaluated only against price spreads or SoC reachability, but against long-run asset wear and fair allocation of coalition profit.

A third direction is explicit operator-risk quantification and predictive control. The reachability paper suggests future work toward predictive control with stopping rewards, extending stopping-reward design to quantify operator’s risk more explicitly, and applying the framework to other time-series dynamics and resilience attributes [2512.06600]. A plausible implication is that the analytical storage arbitrage model is increasingly becoming a modular object: a physical inventory model, a risk operator, and a learned or calibrated uncertainty representation, all coupled through the marginal value of energy.

Source: https://www.emergentmind.com/topics/risk-averse-analytical-storage-arbitrage-model