---
title: 'NARFIMA: Neural ARFIMA Forecasting'
url: https://www.emergentmind.com/topics/narfima
type: topic
---

# NARFIMA: Neural ARFIMA Forecasting

Searching arXiv for NARFIMA and closely related ARFIMA/SARFIMA papers to ground the article.
NARFIMA denotes **Neural AutoRegressive Fractionally Integrated Moving Average**, a hybrid forecasting framework that combines the long-memory representation of ARFIMA with the nonlinear approximation power of a neural network, while flexibly incorporating exogenous causal variables [2509.06697]. Within the broader fractionally integrated modeling family, NARFIMA inherits the central ARFIMA mechanism—the fractional differencing operator \((1-B)^d\)—used to represent slowly decaying dependence, and extends it by modeling nonlinear residual structure left after an ARFIMA-type fit [1208.1728; 2509.06697]. In this sense, NARFIMA belongs to the ARFIMA family of long-memory models, but differs from standard linear formulations by explicitly targeting nonlinearity and covariate-driven effects.

## 1. Definition and position within the fractionally integrated family

The classical ARFIMA\((p,d,q)\) process is defined by
\[
\Phi(B)y_t=\Theta(B)(1-B)^{-d}\varepsilon_t,
\]
where \(\Phi(B)\) and \(\Theta(B)\) are the AR and MA polynomials, \(B\) is the backward shift operator, and \((1-B)^{-d}\) is the fractional differencing or fractional integration operator [1208.1728]. The key role of \(d\) is to allow fractional differencing, which produces slowly decaying autocorrelations and long-range dependence when \(d>0\) [1208.1728]. The same long-memory mechanism appears across related formulations, including nonseasonal ARFIMA, seasonal SARFIMA, and spatial sp-ARFIMA, though the interpretation of the fractional parameter depends on the domain and operator being fractionally powered [1206.2425; 2309.06880].

NARFIMA extends this family in two ways. First, it is formulated in an ARFIMAx style, allowing exogenous variables. Second, it adds a neural network residual component to capture nonlinear structure left after ARFIMA fitting [2509.06697]. The resulting logic is a two-stage procedure: fit a linear long-memory model with exogenous predictors, compute residuals, and then feed lagged series values, lagged residuals, and covariates into a neural network to model nonlinearities [2509.06697]. A plausible implication is that NARFIMA should be understood less as a replacement for ARFIMA than as a hybrid architecture built on top of ARFIMA’s fractional dependence structure.

## 2. Fractional differencing and the long-memory mechanism

The fractional differencing operator is the mathematical core inherited by NARFIMA from ARFIMA. In the ARFIMAx stage of the neural model, it is written as
\[
(1 - B)^d = \sum_{v = 0}^{\infty} \frac{\Gamma(v - d)B^v}{\Gamma(-d)\Gamma(v+1)},
\]
with \(d \in (0,0.5)\) in the cited NARFIMA application [2509.06697]. In the broader ARFIMA literature, the same operator is expressed via the binomial expansion
\[
(1-B)^{-d}=\sum_{j=0}^{\infty}\frac{\Gamma(j+d)}{\Gamma(j+1)\Gamma(d)}B^j
\]
or, equivalently, through generalized binomial coefficients [1208.1728]. This slow coefficient decay is the mathematical source of long memory [1208.1728].

The spectral interpretation is equally central. For ARFIMA models, the spectral density is
\[
f(\lambda)=\frac{\sigma^2}{2\pi}\left(2\sin \frac{\lambda}{2}\right)^{-2d} \frac{|\Theta(e^{-i\lambda})|^2}{|\Phi(e^{-i\lambda})|^2},
\]
which makes the low-frequency singularity explicit: when \(d>0\), the spectrum is highly concentrated near frequency \(0\), corresponding to strong low-frequency persistence [1208.1728]. In time-domain terms, the autocovariances decay hyperbolically rather than exponentially [1206.2425; 1208.1728]. For general fractionally differenced processes, the low-frequency behavior can also be written as a short-memory spectral factor multiplied by a fractional singularity at the origin, reinforcing that the long-range dependence is driven by the fractional operator itself [1203.6140].

This long-memory interpretation remains the foundation of NARFIMA. The neural extension does not replace fractional integration; rather, it supplements it when residual nonlinear structure remains after ARFIMA-type fitting [2509.06697].

## 3. Model architecture and formal specification

The ARFIMAx stage used in NARFIMA is specified as
\[
\left(1 - \sum_{i = 1}^{\tilde{p}} \tilde{\phi}_i B^i\right) \left(1 - B\right)^d y_t
= \tilde{\mu} + \sum_{j = 1}^r \tilde{\pi}_j B X_{j,t}
+ \left(1 + \sum_{k = 1}^{\tilde{q}} \tilde{\theta}_k B^k\right)\epsilon_t,
\]
where \(B\) is the backshift operator, \(d \in (0,0.5)\), \(\epsilon_t\) is white noise, \(\tilde{p}\) and \(\tilde{q}\) are AR and MA orders, and \(\tilde{\phi}_i,\tilde{\theta}_k,\tilde{\pi}_j,\tilde{\mu}\) are coefficients [2509.06697]. The ARFIMAx fit produces forecasts \(\hat y_t^{ARFIMA}\), from which residuals are computed:
\[
e_t = y_t - \hat{y}_t^{ARFIMA}.
\]
The cited work emphasizes that these residuals still contain nonlinear structure [2509.06697].

The neural stage is a **single hidden-layer feed-forward network** that takes as inputs \(p\) lagged exchange rate values, \(q\) lagged ARFIMAx residuals, and one lag of each of the \(r\) exogenous variables [2509.06697]. Its generic one-step-ahead forecast is
\[
\hat{y}_{t+1} = f\left(y_t,y_{t-1},\ldots,y_{t-p+1},e_t,e_{t-1},\ldots,e_{t-q+1},X_{1,t},X_{2,t},\ldots,X_{r,t}\right).
\]
With skip connections, the network is written as
\[
\begin{aligned}
\hat{y}_{t+1} &= \mu_0 + \sum_{l=1}^k \mu_l \; \sigma\Bigg( \tilde{\alpha}_{l} + \sum_{i=1}^p \beta_{i,l} \; y_{t-i+1} + \sum_{j = 1}^q \gamma_{j,l} \; e_{t-j+1} + \sum_{m = 1}^r \delta_{m,l} \; X_{m,t} \Bigg) \\
&\quad + \sum_{u=1}^p \phi_{u} \; y_{t-u+1} + \sum_{v=1}^q \eta_{v} \; e_{t-v+1} + \sum_{w=1}^r \zeta_{w} \; X_{w,t}.
\end{aligned}
\]
Here \(k\) is the number of hidden nodes, \(\sigma(\cdot)\) is the activation function, \(\tilde{\alpha}_l,\beta_{i,l},\gamma_{j,l},\delta_{m,l}\) are input-to-hidden weights, \(\mu_l\) are hidden-to-output weights, \(\phi_u,\eta_v,\zeta_w\) are skip-connection weights, and \(\mu_0\) is a bias [2509.06697]. The hidden layer learns nonlinear interactions, while the skip path preserves linear or autoregressive effects directly [2509.06697]. This suggests that NARFIMA is structurally a “linear + nonlinear” hybrid, with the long-memory linear backbone retained rather than absorbed into a purely neural architecture.

## 4. Theoretical properties and probabilistic interpretation

The theoretical analysis in the cited NARFIMA work focuses on a simplified NARFIMA\((1,1,k)\) process,
\[
y_t = f(y_{t-1}, e_{t-1}, \Theta) + \varepsilon_t,
\]
with
\[
f(y_{t-1}, e_{t-1}, \Theta) = \psi_1 y_{t-1}+\psi_2 e_{t-1}+ \beta_0 + \sum_{i=1}^{k}\beta_i \, G\left(\phi_{i,1}y_{t-1}+\phi_{i,2} e_{t-1}+\mu_i\right),
\]
and its equivalent state-space or Markov form [2509.06697]. The paper proves that the NARFIMA\((1,1,k)\) process is **geometrically ergodic** and therefore **asymptotically stationary**, under assumptions including a stationary ARFIMA residual process with \(0<d<1/2\), a bounded and Lipschitz neural activation, controllability of the linear part, innovations with a strictly positive continuous density and finite variance, and contraction of the skip-connection weights [2509.06697].

The proof strategy treats the process as a Markov chain on \(\mathbb{R}^2\), establishes forward accessibility, irreducibility, and a Foster–Lyapunov drift condition using
\[
V(y)=1+y^2,
\]
and then invokes the standard conclusion that irreducibility plus geometric drift imply geometric ergodicity [2509.06697]. The corollary states that the process is asymptotically stationary [2509.06697].

These results place NARFIMA in a distinctive position relative to classical ARFIMA. Standard ARFIMA theory emphasizes stationarity, causality, invertibility, spectral density, and asymptotic covariance behavior in linear Gaussian settings [1208.1728]. NARFIMA preserves the fractionally integrated residual foundation but adds nonlinear dynamics under boundedness and contraction conditions [2509.06697]. A plausible implication is that its theoretical guarantees are not generic consequences of fractional differencing alone; they depend critically on how the neural component is constrained.

## 5. Relation to ARFIMA variants and neighboring model classes

NARFIMA is part of a larger ecosystem of fractionally integrated models, several of which extend ARFIMA in orthogonal directions. Seasonal ARFIMA or SARFIMA introduces a second fractional operator,
\[
\nabla = (1-B)^d(1-B^s)^D,
\]
thereby allowing long memory at both the zero frequency and the seasonal frequency [1206.2425]. In the cited environmental application, the full model is
\[
\text{SARFIMA}(p,d,q)\times(P,D,Q)_s,
\]
with GARCH-type innovations used to model time-varying volatility [1206.2425]. The resulting SARFIMA-GARCH specification differs from standard ARFIMA by adding seasonal fractional integration and conditional heteroscedasticity [1206.2425].

Spatial sp-ARFIMA transports the same fractional-integration idea into spatial econometrics by replacing the time backshift with a spatial weights matrix. Its core form,
\[
({I} - {B}_1)^d {Y}  =  {\alpha} + ({I} - {B}_2)\varepsilon,
\]
makes \(d\) a control on the range and shape of spatial spillovers rather than temporal long memory in the usual sense [2309.06880]. This shows that “ARFIMA-type” no longer denotes a single temporal model class, but a broader methodology centered on fractional powers of dependence operators.

NARFIMA differs from these extensions in emphasis. SARFIMA-GARCH enriches the linear stochastic structure by seasonality and heteroscedasticity [1206.2425]. Sp-ARFIMA generalizes the operator from temporal lags to spatial weights [2309.06880]. NARFIMA, by contrast, retains the temporal ARFIMA core but adds a neural residual layer and exogenous inputs [2509.06697]. This suggests that the defining innovation of NARFIMA is not a new fractional operator, but a new way of combining fractional integration with nonlinear function approximation.

## 6. Empirical applications, performance evidence, and implementation

The principal empirical application described for NARFIMA concerns monthly spot exchange rates for Brazil, Russia, India, and China from January 1997 to October 2023, with exchange rates drawn from FRED and macro covariates from FRED and policyuncertainty.com [2509.06697]. The candidate predictors considered are Global Economic Policy Uncertainty, U.S. Equity Market Volatility, U.S. Monetary Policy Uncertainty, Geopolitical Risk, WTI oil price growth rate, short-term interest rates, short-term interest rate differentials, and CPI inflation and inflation differentials [2509.06697]. A nonlinear Granger causality test is used to select exogenous variables, and the variables found to be consistently causal for BRIC exchange rates are GEPU, US EMV, US MPU, oil price growth, and country-specific short-term IRD [2509.06697].

The study uses six rolling forecast horizons—1, 3, 6, 12, 24, and 48 months—and evaluates models using MAPE, SMAPE, MAE, MASE, and RMSE [2509.06697]. NARFIMA is compared against 16 benchmark models: Naïve, AR, ARIMAx, ARFIMAx, ETS, SETAR, TBATS, GARCH, BSTSx, ARNNx, DeepAR, NBeatsx, NHiTSx, DLinearx, NLinearx, and TSMixerx [2509.06697]. The reported conclusion is that across most horizons and countries, NARFIMA is the best or second-best model, and often decisively best; it is especially strong for Brazil, dominates at several horizons for Russia, is often best for China, and is less dominant for India, whose series is described as more linear [2509.06697]. Multiple Comparisons with the Best and Murphy diagrams are also reported to support statistical superiority or strong competitiveness across horizons, especially on RMSE, MAE, MAPE, and SMAPE [2509.06697].

The paper further reports a residual-selection ablation in which ARFIMAx residual feedback is replaced by residuals from ARIMAx, BSTSx, or Naïve, plus a residual-free variant akin to ARNNx; the stated result is that NARFIMA with ARFIMAx residuals performs best [2509.06697]. This directly supports the claim that the fractional long-memory stage is not incidental but central to the hybrid model’s performance.

Implementation is provided in the **`narfima` R package** [2509.06697]. The cited two-stage implementation fits ARFIMAx using `arfima` from the R `forecast` package and then trains a single-hidden-layer neural network using `nnet::nnet` [2509.06697]. The hyperparameters \(p\), \(q\), \(k\), and `skip` are tuned using time-series cross-validation minimizing RMSE, with \(k \le 5\) to avoid overfitting; one-step-ahead forecasts come directly from the trained model, while multi-step forecasts are recursive [2509.06697]. The paper also reports that ARFIMAx residual nonlinearity is verified using the Terasvirta test and the BDS test, motivating the neural stage [2509.06697].

## 7. Limitations, cautions, and interpretive issues

A major caution about the broader ARFIMA family comes from the analysis of FARIMA brittleness. That work argues that fractionally differenced processes are mathematically atypical among long-range dependent processes because they are extremely close to fractional Gaussian noise in a precise sense [1203.6140]. The paper formalizes this through spectral, autocovariance, and variance-time-function results, including
\[
\gamma_H(n)=\gamma_H^*(n)+O(n^{2H-4})
\]
and
\[
\omega_H(n)=\omega_H^*(n)+D+o(1),
\]
with a bounded remainder in the variance time function [1203.6140]. Its central warning is that this closeness property is not robust to additive noise, so conclusions based on unperturbed FARIMA asymptotics may fail when realistic noise is present [1203.6140].

For NARFIMA, this caution is directly relevant because its long-memory backbone is still generated primarily by fractional differencing [2509.06697; 1203.6140]. The brittleness argument does not invalidate NARFIMA, but it does imply that one should not treat fractionally differenced models as generic surrogates for all long-memory behavior [1203.6140]. A plausible implication is that the added nonlinear layer in NARFIMA may improve empirical forecasting without automatically resolving the asymptotic sensitivity associated with the fractional differencing core.

A second interpretive issue concerns terminology. The provided sources explicitly define NARFIMA as **Neural AutoRegressive Fractionally Integrated Moving Average** in the 2025 exchange-rate study [2509.06697]. Earlier sources discuss ARFIMA and related extensions, but do not define “NARFIMA” as a separate model class [1302.6324]. Accordingly, NARFIMA should be distinguished from the generic idea of nonlinear or augmented ARFIMA-type modeling. In the supplied literature, the term is specifically attached to the hybrid neural–ARFIMA framework with exogenous variables, residual feedback, conformal prediction intervals, and Markov-chain-based stationarity analysis [2509.06697].

Finally, the empirical literature surrounding ARFIMA variants indicates that different extensions address different departures from the basic linear long-memory model: seasonality and volatility clustering in SARFIMA-GARCH [1206.2425], spatial spillover geometry in sp-ARFIMA [2309.06880], and nonlinear residual structure with exogenous drivers in NARFIMA [2509.06697]. This suggests that NARFIMA is best understood not as the universal next step beyond ARFIMA, but as one specialized response to the joint presence of long memory, nonlinearity, and external covariate effects.

Source: https://www.emergentmind.com/topics/narfima