---
title: Finite-Horizon Joint Power Allocation (FHJPA)
url: https://www.emergentmind.com/topics/finite-horizon-joint-power-allocation-fhjpa
type: topic
---

# Finite-Horizon Joint Power Allocation (FHJPA)

Finite-Horizon Joint Power Allocation (FHJPA) denotes a class of stage-dependent wireless control problems in which power variables are optimized jointly over a known and finite set of decision epochs, rather than by a stationary infinite-horizon rule or by purely myopic slot-wise maximization. In the specific sense used by "Secure Energy Efficient Wireless Transmission: A Finite v/s Infinite-Horizon RL Solution" [2508.02447], FHJPA is the backward-induction policy that jointly allocates the source transmit power and the destination jamming power in an energy-harvesting wiretap system so as to maximize average secrecy energy efficiency over a fixed transmission horizon. Related finite-horizon formulations in the literature include joint optimization of wireless power transfer duration and uplink power allocation [1902.04566], hard-deadline scheduling and power control in downlink cellular systems [1705.02068], and adaptive distributed power allocation with terminal constraints under channel uncertainty in cognitive radio networks [1302.1396]. Taken together, these works place FHJPA within the broader theory of finite-horizon stochastic control for wireless systems with causality, deadline, interference, and battery constraints.

## 1. Finite-horizon formulation and defining characteristics

The defining feature of FHJPA is that the number of decision epochs is known in advance and finite. In the secrecy-energy-efficiency formulation, communication occurs over slots
$$
k \in \mathcal{K} = \{0,1,\ldots,K-1\},
$$
each of duration $T_s$, and the optimal rule is explicitly stage dependent because the value of preserving energy changes as the terminal slot approaches [2508.02447]. The same finite-horizon logic appears in the wirelessly powered-device formulation, where the horizon is $t=1,2,\dots,T$ and the controller must decide both when to stop harvesting and how to allocate battery energy over the remaining uplink slots [1902.04566].

A finite-horizon model is used when the control problem is inherently time-limited. In the secrecy setting, the finite-horizon formulation is described as most appropriate when the number of decision epochs is known and the system is non-stationary across stages; by contrast, infinite-horizon reinforcement learning assumes an unending or unknown lifetime and yields stationary policies that can be inaccurate when $K$ is small or fixed [2508.02447]. In the hard-deadline cellular setting, the long-term objective is coupled to a per-slot service horizon because each real-time packet arriving in slot $k$ must be fully transmitted within that same slot or is dropped, making the slot-level decision effectively a finite-horizon deadline-constrained control problem [1705.02068].

The “joint” aspect is not unique to any single system architecture. Depending on the formulation, it can refer to jointly selecting source and jammer powers [2508.02447], jointly optimizing energy-harvesting stopping time and uplink power allocation [1902.04566], jointly handling scheduling, power allocation, and admission control under deadline constraints [1705.02068], or jointly allocating power across primary and secondary users while regulating interference and SIR tracking over a finite horizon [1302.1396].

## 2. Markov decision structure in the canonical FHJPA algorithm

In the secrecy-energy-efficiency setting, FHJPA is formulated as a finite Markov decision process with finite state and action spaces [2508.02447]. The state at slot $k$ is
$$
s^{(k)}= \left( G_{SD}^{(k)}, G_{SE}^{(k)}, G_{DD}^{(k)}, G_{DE}^{(k)}, B_S^{(k)}, B_D^{(k)} \right),
$$
where the channel gains are quantized into finite channel-state sets and the battery levels are quantized into finite battery-state sets. The action is the power pair
$$
a^{(k)} = \left(P_S^{(k)}, P_D^{(k)}\right),
$$
selected from a finite power set, so the action space contains $N_A=M^2$ possible actions.

The feasible-action constraint is battery-causal:
$$
P_S^{(k)}T_s \le B_S^{(k)}, \qquad P_D^{(k)}T_s \le B_D^{(k)}.
$$
State transitions factor into Markov channel transitions and battery transitions driven by harvested-energy arrivals. Because the channel power gains for $SD$, $SE$, $DD$, and $DE$ evolve as a first-order Markov process and the energy arrivals are Bernoulli, the overall system admits an explicit transition kernel [2508.02447].

FHJPA computes the optimal policy by backward induction. At the terminal slot,
$$
V(s^{(K-1)})= \max_{a^{(K-1)}\in U(s^{(K-1)})} R(s^{(K-1)},a^{(K-1)}),
$$
and for earlier slots,
$$
V(s^{(k)})= \max_{a^{(k)}\in U(s^{(k)})} \left[ R(s^{(k)},a^{(k)}) + \sum_{s'\in\mathcal{S}} \mathbb{P}(s'|s^{(k)},a^{(k)})V(s') \right].
$$
The optimal decision rule $d^*(s^{(k)})$ is the maximizer of the same Bellman expression. The policy is computed offline over the entire horizon, stored in a lookup table, and then used online by observing the current state, reading off the optimal action, transmitting and jamming accordingly, and updating batteries through the harvesting dynamics [2508.02447].

This stage-indexed Bellman recursion is the core distinction between FHJPA and stationary infinite-horizon methods. The value function depends on the remaining lifetime, so the same physical state can induce different power actions at different stages.

## 3. Objective, secrecy model, and energy-harvesting constraints

In the canonical FHJPA paper, the network contains an energy-harvesting source $S$, an energy-harvesting full-duplex destination $D$, and a passive eavesdropper $E$ [2508.02447]. The source always has data to transmit. The destination simultaneously receives the source signal and emits artificial jamming, which improves secrecy but creates residual self-interference. The cancellation factor satisfies $0 \le \alpha \le 1$, with $\alpha=0$ corresponding to perfect cancellation and $\alpha=1$ to no cancellation.

The secrecy rate is defined per slot as
$$
C_S^{(k)} = \max\{C_D^{(k)} - C_E^{(k)}, 0\},
$$
with
$$
C_D^{(k)} = W \log_2(1+\gamma_D^{(k)}), \qquad C_E^{(k)} = W \log_2(1+\gamma_E^{(k)}).
$$
The destination and eavesdropper SINRs are
$$
\gamma_D^{(k)} = \frac{G_{SD}^{(k)} P_S^{(k)}}{\alpha G_{DD}^{(k)} P_D^{(k)} + WN_0}, \qquad
\gamma_E^{(k)} = \frac{G_{SE}^{(k)} P_S^{(k)}}{G_{DE}^{(k)} P_D^{(k)} + WN_0}.
$$
These expressions expose the central coupling: increasing $P_D^{(k)}$ degrades the eavesdropper but also harms the legitimate receiver through residual self-interference.

The optimization target is the average secrecy energy efficiency,
$$
\eta_E = \mathbb{E}\!\left[ \frac{1}{K}\sum_{k=0}^{K-1} \frac{C_S^{(k)}T_s}{(P_S^{(k)}+P_D^{(k)})T_s} \right],
$$
and the per-slot reward is the secrecy energy-efficiency ratio. The batteries have finite capacities $B_S^{\max}$ and $B_D^{\max}$, and harvested-energy arrivals are Bernoulli:
$$
\mathbb{P}[H_S^{(k)} = E_S] = p,\quad \mathbb{P}[H_S^{(k)} = 0] = 1-p,
$$
$$
\mathbb{P}[H_D^{(k)} = E_D] = q,\quad \mathbb{P}[H_D^{(k)} = 0] = 1-q.
$$
Battery evolution is clipped by capacity, so excess harvested energy is discarded when the maximum is reached [2508.02447].

An important interpretive point follows directly from the stated objective: FHJPA is designed to maximize secrecy energy efficiency, not raw secure throughput. The paper therefore also reports the expected total transmitted secure bits,
$$
\mu = \mathbb{E}\!\left[\sum_{k=0}^{K-1} C_S^{(k)}T_s\right],
$$
and notes that FHJPA is not always the best under that metric because higher-power policies can transmit more secure bits while reducing energy efficiency [2508.02447].

## 4. Structural results in related finite-horizon power-allocation literature

Finite-horizon joint power allocation is not restricted to secrecy problems. The literature exhibits several recurring structures: threshold stopping, closed-form per-slot power laws, deadline-induced inversions of standard water-filling behavior, and adaptive dynamic programming under model uncertainty.

| Work | Joint decision variables | Structural result |
|---|---|---|
| [1902.04566] | EH stopping time $T_0$ and uplink power allocation $\alpha(t)$ | Threshold rule for stopping EH; closed-form $\alpha^*(t)$ |
| [1705.02068] | Scheduling, power allocation, admission control | Lambert-$W$ power for RT users; water-filling-like power for NRT users |
| [1302.1396] | PU/SU power allocation over a finite horizon | Distributed ADP with SIR tracking and UUB error bounds |

In the wirelessly powered-device model, the horizon is partitioned into an energy-harvesting period and an information-transmission period. The controller decides when to stop harvesting and begin transmitting, then allocates a fraction $\alpha(t)\in[0,1]$ of the current battery energy during each uplink slot [1902.04566]. The dynamic program yields two structural results: all remaining energy is used in the final slot, $\alpha(T)=1$, and the optimal harvesting stop rule is threshold based, with
$$
\text{Stop EH if } E(t)\ge \gamma(t).
$$
A key lemma establishes that the future-value term $Q(t)$ is monotonically decreasing in $t$, which underpins the threshold structure. This implies that the battery threshold is higher earlier in the horizon and lower near the deadline.

In the hard-deadline downlink problem, the power law depends sharply on traffic class [1705.02068]. For non-real-time users, the optimal power is water-filling-like:
$$
P_i^*(k)=\min\left\{\left(\frac{Q_i(k)}{X(k)}-\frac{1}{h_i(k)}\right)^+,\,P_{\max}\right\},
$$
which is increasing in channel quality. For real-time users, the power law has a Lambert-$W$ form and is monotonically decreasing in channel gain. The paper attributes this inversion to the hard-deadline service model: the controller is not opportunistically maximizing bits over time, but rather delivering a fixed packet within the slot under the drift objective.

In the enhanced cognitive-radio formulation, the finite horizon is $k=0,1,\dots,N-1$ and the objective is SIR tracking with power minimization under channel uncertainty [1302.1396]. The controller is distributed and model-free, the value function is parameterized linearly in unknown quantities, and the parameter update is driven by Bellman equation residual error and terminal constraint estimation error. The resulting closed-loop guarantees are stated in terms of uniformly ultimately bounded SIR errors.

## 5. Performance, complexity, and comparison with alternative policies

The FHJPA paper compares the finite-horizon policy against a low-complexity greedy algorithm (GA) and an infinite-horizon joint power allocation method (IHJPA) [2508.02447]. GA maximizes only the immediate reward in each slot,
$$
a^{(k)}= \arg\max_{a^{(k)}\in U(s^{(k)})} R^{(k)}(s^{(k)},a^{(k)}),
$$
whereas IHJPA uses an infinite-horizon discounted formulation and stationary policy iteration. For fairness, the mean effective horizon of IHJPA is taken as
$$
K = \frac{1}{1-\Gamma}.
$$

The reported computational complexities are:
- FHJPA planning phase: $\mathcal{O}\big((K-1)N_S^2N_A\big)$
- FHJPA transmission phase: $\mathcal{O}(K)$
- GA transmission phase: $\mathcal{O}(KN_A)$
- IHJPA planning phase: $\mathcal{O}\!\left(\frac{N_A^{N_S}}{N_S}\right)$
- IHJPA transmission phase: $\mathcal{O}(K)$

The paper explicitly reports that FHJPA takes $16.6$ percent less computational time than IHJPA [2508.02447]. In the tested settings, FHJPA achieves the highest average secrecy energy efficiency. GA can approach FHJPA when the source battery has sufficient energy, and the reported trend is that increasing $E_S$ or the harvesting probability $p$ brings GA closer to FHJPA. The performance gap between FHJPA and IHJPA decreases as $K$ grows, because the infinite-horizon approximation becomes more accurate for longer operational lifetimes.

The related finite-horizon literature reports complementary performance characterizations. The hard-deadline downlink algorithm satisfies the average power constraint, the RT QoS constraints, and NRT queue stability, while achieving average NRT sum throughput within a bounded gap of optimal,
$$
\sum_i R_i \ge \sum_i R_i^* - \frac{C_1}{LB},
$$
and simulations indicate average complexity close to linear in the number of RT users [1705.02068]. The cognitive-radio FH-AODPA results show fast SIR convergence, lower energy consumption than competing methods, Bellman residuals and terminal constraint errors close to zero, and robustness to channel variations without requiring explicit channel knowledge [1302.1396].

## 6. Conceptual distinctions and scope of the term

Several misconceptions are ruled out by the cited formulations. First, finite-horizon joint power allocation is not synonymous with greedy control. FHJPA explicitly values future energy availability through the Bellman recursion, whereas GA ignores future value and can therefore be suboptimal except in regimes where abundant source energy makes myopic control nearly sufficient [2508.02447].

Second, finite-horizon joint power allocation is not equivalent to a single metric or a single network topology. The objective may be expected throughput in a wirelessly powered uplink [1902.04566], NRT sum throughput under RT hard deadlines [1705.02068], SIR tracking with power minimization under channel uncertainty [1302.1396], or average secrecy energy efficiency with joint source and jammer control [2508.02447]. This suggests that FHJPA is best understood as a family of finite-horizon stochastic control formulations rather than a single universally fixed algorithm.

Third, “joint” does not require centralized global optimization over identical user roles. In one case, jointness refers to a stopping time and a power-allocation sequence [1902.04566]; in another, to joint RT/NRT scheduling, power, and admission control [1705.02068]; in another, to coordinated PU/SU power control in coexistence mode [1302.1396]; and in the secrecy setting, to the simultaneous choice of source transmit power and destination jamming power [2508.02447].

Finally, finite-horizon control does not preclude analytically tractable structure. The literature contains threshold rules, closed-form per-slot power expressions, Lambert-$W$ solutions, water-filling-like policies, and distributed adaptive dynamic programming. A plausible implication is that the main difficulty in FHJPA is not finite horizon per se, but the interaction between finite horizon and the particular physical constraints—battery causality, hard deadlines, interference coupling, or uncertain dynamics—that determine whether the solution is closed form, lookup-table based, or adaptively learned.

Source: https://www.emergentmind.com/topics/finite-horizon-joint-power-allocation-fhjpa