Temporal Basis Function Models

• Temporal Basis Function Models are a class of techniques that represent time-dependent dynamics using a low-dimensional basis expansion with varying coefficients.
• They flexibly implement either fixed or learned temporal bases to enable interpolation, forecasting, and smoothing within both regression and state-space frameworks.
• TBFMs have been applied in neural stimulation, dynamic scene rendering, and speech recognition, offering computational efficiency and enhanced interpretability.

Searching arXiv for the specified TBFM-related papers and nearby literature. Temporal Basis Function Models (TBFMs) are a family of models in which temporal structure is represented by a basis expansion, so that observed dynamics are expressed through a comparatively small set of basis functions together with coefficients, weights, or latent scores that vary across trials, channels, spatial locations, or time. Across the literature, this idea appears in several mathematically distinct forms: fixed basis functions with time-varying coefficients for density extrapolation (Krempl et al., 2019), learned temporal bases with state-dependent weights for neural stimulation forecasting (Bryan et al., 21 Jul 2025), temporal radial basis functions over delayed speech windows (0912.3917), shared temporal bases for dynamic scene rendering (Xing et al., 2021), and learned smooth functional bases inside Bayesian dynamic linear models for multivariate functional time series (Kowal et al., 2014). A broader statistical perspective treats temporal autocorrelation models as regression models built from basis functions, connecting first-order mean specifications and second-order covariance specifications (Hefley et al., 2016). Closely related continuous-time trajectory models in movement ecology use time-indexed kernels and reduced-rank covariance parameterizations, although they are framed as stochastic integral equation or process convolution models rather than explicitly as TBFMs (Hooten et al., 2016).

1. Conceptual definition and model family

At the most general level, a TBFM represents temporal dependence through basis functions rather than through unrestricted per-time-point parameters. In the general basis-function view, an unknown dependence function can be approximated as

$\eta(x) \approx \sum_{j=1}^{m} \alpha_j f_j(x),$

or, in matrix form,

$$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$

with $\mathbf{Z}$ the basis matrix and $\boldsymbol{\alpha}$ the coefficient vector (Hefley et al., 2016). In temporal settings, the columns of $\mathbf{Z}$ are temporal basis vectors, and temporal autocorrelation can be represented either explicitly in the mean or implicitly through an induced covariance (Hefley et al., 2016).

A recurring TBFM pattern is that temporal variation is concentrated in a low-dimensional coefficient process while the basis functions remain fixed or are learned jointly with the model. In Temporal Density Extrapolation (TDX), the static density model

$f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$

is extended to

$f(x|t)=\sum_{j=1}^M \gamma_j(t)\phi_j(x),$

so the basis functions $\phi_j(x)$ stay fixed while the weights $\gamma_j(t)$ evolve over time (Krempl et al., 2019). In Temporal-MPI, a time-instance MPI is synthesized by linear combination of learned temporal bases and spatially varying coefficients, rather than by storing a separate MPI for every frame (Xing et al., 2021). In the 2025 neural stimulation work, future multichannel responses are predicted as weighted sums of learned temporal basis functions, with the trial-specific weights inferred from the recent neural history or “runway” (Bryan et al., 21 Jul 2025).

This common structure makes TBFMs a modeling strategy rather than a single formalism. Some instantiations use fixed bases and dynamic coefficients; others learn the bases themselves. Some are primarily discriminative, as in vowel classification with temporal radial basis functions (0912.3917); others are generative or state-space-based, as in the Multivariate Functional Dynamic Linear Model (MFDLM) (Kowal et al., 2014). A plausible implication is that “TBFM” is best understood as a unifying representation principle: temporal complexity is compressed into a basis space whose dimensionality is small relative to the native temporal representation.

2. Canonical mathematical forms

Several canonical formulations recur across the literature. In functional time series, the MFDLM writes the observation equation as

$$Y_t^{(c)}(\tau) = \sum_{k=1}^K f_k^{(c)}(\tau)\beta_{k,t}^{(c)} + \epsilon_t^{(c)}(\tau),$$

where the $$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$0 are factor loading curves (FLCs) and the $$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$1 are dynamic factor scores (Kowal et al., 2014). The model is therefore a basis expansion in function space with time-varying coefficients, but unlike a standard TBFM the basis is learned from the data and constrained to be smooth and orthonormal (Kowal et al., 2014).

In temporal density extrapolation, the fixed basis expansion is paired with a temporal model on the coefficients. After an isometric log-ratio transform, the weight coordinates satisfy

$$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$2

and the valid compositional weights are recovered by

$$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$3

yielding a density at arbitrary times inside or outside the training window (Krempl et al., 2019). Here, the temporal model is explicitly in the coefficient trajectories rather than in the basis functions themselves.

Temporal-MPI uses a different factorization. The dynamic MPI is decomposed into a low-frequency color field $$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$4, temporal basis functions $$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$5, and spatial coefficients $$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$6, with the time-instance MPI defined by

$$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$7

$$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$8

This is explicitly a temporal basis-function decomposition: one compact representation spans the entire video, and an MPI for any time instant is synthesized on demand (Xing et al., 2021).

In the closed-loop neural stimulation setting, the TBFM predicts the future trajectory for channel $$\boldsymbol{\eta} \equiv \mathbf{Z}\boldsymbol{\alpha},$$9 as

$\mathbf{Z}$0

where $\mathbf{Z}$1 contains the temporal basis functions produced from the stimulation descriptor and $\mathbf{Z}$2 contains channel-specific, trial-specific basis weights inferred from the runway (Bryan et al., 21 Jul 2025). This representation avoids recurrent unrolling and yields a direct multistep forecast.

The temporal radial basis function (TRBF) architecture implements the same idea in delayed input space. Its hidden centers span delayed MFCC windows, with center dimension

$\mathbf{Z}$3

and hidden block size

$\mathbf{Z}$4

provided $\mathbf{Z}$5 (0912.3917). In this case, the basis functions are Gaussian radial units defined over temporal windows, so the basis-function interpretation is over delayed acoustic segments rather than over future response trajectories.

3. Basis construction, learning, and regularization

A major axis of variation among TBFMs is whether the basis is fixed, prescribed, or learned. The ecological basis-function treatment emphasizes that temporal basis vectors may come from eigen decomposition of an AR(1) correlation matrix, kernel functions centered at temporal knots, splines, or compactly supported local bases (Hefley et al., 2016). In that formulation, the basis is often derived from the assumed correlation structure and may be treated as explicit regressors or as a factorization of the covariance matrix.

The MFDLM develops learned smooth bases by representing each factor loading curve with a B-spline expansion,

$\mathbf{Z}$6

using cubic B-splines and the roughness penalty

$\mathbf{Z}$7

The corresponding penalized objective is

$\mathbf{Z}$8

The paper then diagonalizes the penalty matrix and reparameterizes the basis so that the prior is diffuse on constant and linear components and Gaussian with precision $\mathbf{Z}$9 on nonlinear components (Kowal et al., 2014). The smoothing parameters are random, ordered as $\boldsymbol{\alpha}$0, and learned within the posterior (Kowal et al., 2014). This makes basis estimation part of the inferential hierarchy rather than a separate tuning step.

Temporal-MPI also learns the temporal basis from data, but via neural parameterization rather than splines. The color and alpha bases are generated by time-conditioned MLPs acting on a time encoding $\boldsymbol{\alpha}$1, while separate MLPs produce the spatial coefficients from a positional encoding of the spatial coordinate $\boldsymbol{\alpha}$2 (Xing et al., 2021). The model jointly learns the temporal basis and coefficients under a rendering reconstruction loss,

$\boldsymbol{\alpha}$3

The paper explicitly notes that coefficient sparsity is ignored for this task (Xing et al., 2021).

In the 2025 neural stimulation work, the basis functions are generated from the stimulation descriptor by an MLP, while the basis weights are estimated from the runway by an affine function (Bryan et al., 21 Jul 2025). The model is trained jointly with an $\boldsymbol{\alpha}$4 prediction loss plus Frobenius-norm regularization on the basis-weight estimator design matrix,

$\boldsymbol{\alpha}$5

The paper also discusses forward stagewise additive modeling (FSAM) as an alternative means of learning bases incrementally, with the stated effect that the first basis often captures much of the state-dependent component and later bases capture more of the common stimulation response (Bryan et al., 21 Jul 2025).

By contrast, TDX fixes the basis functions and focuses all temporal learning on the coefficient trajectories (Krempl et al., 2019), while TRBF uses Gaussian kernels with receiving field $\boldsymbol{\alpha}$6 and incremental Dynamic OLS to build hidden center blocks automatically (0912.3917). These variants indicate that TBFMs can regularize either the basis, the coefficients, or both, depending on the scientific target and computational constraints.

4. Statistical, state-space, and covariance interpretations

One of the most important theoretical points is that TBFMs can be understood through both mean-structure and covariance-structure representations. In the ecological autocorrelation formulation, the first-order model is

$\boldsymbol{\alpha}$7

where $\boldsymbol{\alpha}$8 is an explicit temporal process in the linear predictor (Hefley et al., 2016). If

$\boldsymbol{\alpha}$9

then integrating over the random effects yields the second-order covariance model

$\mathbf{Z}$0

Using spectral decomposition,

$\mathbf{Z}$1

the first-order and second-order views become equivalent (Hefley et al., 2016). This makes TBFMs a bridge between regression-based random-effects modeling and structured covariance modeling.

The movement-ecology framework offers a closely related continuous-time interpretation. There, the latent trajectory is generated through a stochastic integral equation

$\mathbf{Z}$2

with covariance

$\mathbf{Z}$3

Finite-rank approximation gives

$\mathbf{Z}$4

which the paper describes as a reduced-rank method analogous to low-rank process convolution in spatial statistics (Hooten et al., 2016). Although not labeled as a TBFM, this is strongly aligned with the same representation principle: temporal dependence is mediated by a basis matrix whose columns are behaviorally interpretable kernels.

The MFDLM extends this logic into a Bayesian multivariate state-space setting. The full model,

$\mathbf{Z}$5

embeds a learned functional basis inside a hierarchical dynamic linear model with multivariate dependence and optional regression structure (Kowal et al., 2014). This formulation is explicitly designed to accommodate functional, time dependent, and multivariate components jointly.

Taken together, these papers show that TBFMs can be viewed as reduced-rank temporal process models. This suggests that what differs across domains is less the principle of temporal basis expansion than the particular inferential role of the latent coefficients: random effects in autocorrelation models, state-dependent predictors in stimulation models, or factor scores in functional time series.

5. Representative domain-specific instantiations

The literature documents TBFM-style modeling in speech recognition, functional time series, density extrapolation, dynamic scene rendering, ecology, and closed-loop neuroscience.

Domain	Representative model	Characteristic basis structure
Speech recognition	TRBF (0912.3917)	Gaussian radial units over delayed MFCC windows
Functional time series	MFDLM (Kowal et al., 2014)	Learned smooth orthonormal FLCs with dynamic scores
Ecological time series	Basis-function autocorrelation models (Hefley et al., 2016)	Temporal basis vectors in mean or covariance
Animal movement	FMM / stochastic integral equation framework (Hooten et al., 2016)	Time-indexed kernels and reduced-rank convolution bases
Density forecasting	TDX (Krempl et al., 2019)	Fixed density bases with time-varying compositional weights
Dynamic view synthesis	Temporal-MPI (Xing et al., 2021)	Learned global temporal bases with spatial coefficients
Neural stimulation	TBFM for closed-loop control (Bryan et al., 21 Jul 2025)	Learned temporal response bases with state-dependent weights

In speech recognition, TRBF was developed for vowel classification on a subset of six TIMIT vowel phonemes using MFCC features from 16 kHz speech with 25 ms Hamming windows, 20 ms analysis step, and 13 MFCC features per frame (0912.3917). The architecture uses blocks of hidden neurons matched to delayed temporal windows, with Dynamic OLS incrementally adding entire hidden center blocks (0912.3917). Reported performance was 98.06 percent in training and 90.13 in test (0912.3917).

In multivariate functional data analysis, the MFDLM was illustrated on multi-economy yield curve data and rat local field potential signals (Kowal et al., 2014). In the yield application, the first few learned common basis functions resembled level, slope, and curvature, while a fourth captured an additional higher-order shape (Kowal et al., 2014). In the local field potential application, the functions were spectra over frequency indexed by time bin, so the common FLCs became a learned basis for time-varying spectral shape (Kowal et al., 2014).

In density estimation, TDX was designed for gradual monotonous changes in a distribution and evaluated on synthetic drift scenarios, Lending Club data, and pollution data (Krempl et al., 2019). The model extrapolates the coefficient trajectories rather than the density directly, enabling interpolation and forecasting at unseen time points (Krempl et al., 2019).

In dynamic scene modeling, Temporal-MPI treats a video as a shared temporal subspace plus spatial coefficients and a low-frequency static component (Xing et al., 2021). Once the time-instance MPI is synthesized, rendering follows ordinary MPI warping and alpha compositing (Xing et al., 2021).

In neural engineering, the 2025 TBFM work models single-trial stimulation-evoked dynamics in two rhesus macaques using $\mathbf{Z}$6ECoG-recorded LFPs across 40 sessions (Bryan et al., 21 Jul 2025). The goal is spatiotemporal forward prediction under stringent requirements on training time, sample efficiency, and loop latency (Bryan et al., 21 Jul 2025).

6. Empirical behavior, computational properties, and interpretability

A repeated rationale for TBFMs is that reduced-rank temporal representations can improve efficiency without discarding the dominant dynamical structure. In the ecology review, basis-function approaches are described as useful for large data sets because one can work with an $\mathbf{Z}$7 basis matrix rather than an $\mathbf{Z}$8 covariance matrix, with the further warning that too many basis vectors can overfit and too few can underfit (Hefley et al., 2016). The same paper stresses that ignoring temporal autocorrelation can underestimate uncertainty; in the bobwhite quail example, adding an AR(1)-type autocorrelation structure widened the confidence interval on the trend substantially even though the point estimate changed only slightly (Hefley et al., 2016).

The movement paper emphasizes feasibility for large telemetry data through reduced-rank covariance, Rao–Blackwellization, Sherman–Morrison–Woodbury identities, and parallelizable RJMCMC/BMA over candidate basis types and warp fields (Hooten et al., 2016). Its first-order basis functions are behaviorally interpretable, with tail-up, tail-down, Gaussian, Brownian motion, and integrated Brownian motion kernels linked to memory, perception, symmetric smoothing, or path roughness (Hooten et al., 2016).

Temporal-MPI frames efficiency and compactness as central outcomes. For a 24-frame sequence, it reports 481 MB storage, stated to be 11× smaller than 3DMaskVol21, and 0.008 s/frame rendering time for $\mathbf{Z}$9, with MPI generation around 0.002 s (Xing et al., 2021). On the Nvidia Dynamic Scenes dataset, the reported averages are SSIM 0.859, PSNR 24.87, and LPIPS 0.196, with ablations showing that removing either the low-frequency component or the high-frequency temporal basis severely degrades performance (Xing et al., 2021). These results support the paper’s interpretation that the low-frequency explicit MPI and the learned temporal bases are complementary components.

The neural stimulation TBFM emphasizes translationally relevant runtime properties. The model is described as sample efficient, rapid to train (2–4min in the abstract; average training times reported as about 2–5 minutes), and low latency (0.2ms in the abstract; compiled CPU inference about 0.115 ms for 164 ms forecasts, uncompiled about 0.174 ms) (Bryan et al., 21 Jul 2025). Using the first 5k pulse pairs for training, it achieved time-domain test $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$0 for a 164 ms prediction horizon, compared with $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$1 for AE-LSTM and $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$2 for LSSM (Bryan et al., 21 Jul 2025). It beat LSSM on all 40 sessions and AE-LSTM on 32 of 40 sessions (Bryan et al., 21 Jul 2025). The same work reports that every session had at least one channel with significant state dependence and that 97.4% of channels showed significant state dependence at 95% confidence, while a state-agnostic TBFM performed dramatically worse, with mean test $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$3 versus $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$4 for the state-dependent model (Bryan et al., 21 Jul 2025).

Interpretability is another recurring theme. In the MFDLM, interpretability is enhanced by smooth splines, orthonormality, ordering by smoothness, and the possibility of common bases across outcomes (Kowal et al., 2014). In the neural stimulation TBFM, FSAM is proposed as a way to obtain more interpretable bases (Bryan et al., 21 Jul 2025). In the movement framework, interpretability is built directly into the kernel design through behavioral semantics (Hooten et al., 2016). This suggests that TBFMs are especially attractive when the basis elements themselves correspond to meaningful temporal motifs, scales, or response shapes.

7. Limitations, misconceptions, and current directions

A common misconception is that all TBFMs use fixed temporal bases. The literature does not support that view. TDX fixes the basis functions and models the coefficient trajectories (Krempl et al., 2019), but the MFDLM explicitly states that “we allow our basis functions $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$5 to be estimated from the data” (Kowal et al., 2014), Temporal-MPI jointly learns temporal bases and coefficients (Xing et al., 2021), and the neural stimulation TBFM learns temporal basis functions from the stimulation descriptor (Bryan et al., 21 Jul 2025).

Another misconception is that basis-function models are necessarily simplistic or purely linear. The evidence is mixed and domain-specific. TRBF combines Gaussian radial basis functions with temporal delay structure and Dynamic OLS rather than full backpropagation (0912.3917). Temporal-MPI uses learned bases generated by MLPs and therefore is nonlinear in its parameterization even though frame synthesis is linear in the basis values and coefficients (Xing et al., 2021). The neural stimulation TBFM uses an affine basis-weight estimator, but the basis generator itself is an MLP and the overall mapping is state-dependent (Bryan et al., 21 Jul 2025).

Limitations are also domain-specific. TDX is explicitly intended for gradual, monotonic drift and is not designed for abrupt concept shifts, highly oscillatory or seasonal drift, repeated back-and-forth changes, or distributions with little or no drift (Krempl et al., 2019). Temporal-MPI is trained per scene, is limited by GPU memory, degrades as sequence length increases unless model capacity is increased, and is most appropriate for forward-facing scenes where layered 2.5D representation is reasonable (Xing et al., 2021). The ecology review warns that temporal basis vectors can create hidden multicollinearity; in the time-series example, $f(x)=\sum_{j=1}^M \gamma_j \phi_j(x)$6 between year and the second eigen basis vector (Hefley et al., 2016). The movement framework requires careful temporal warping to preserve temporal order and avoid folding (Hooten et al., 2016). In closed-loop stimulation, the 2025 paper presents simulation-based control rather than real-time human or animal closed-loop deployment, although it demonstrates finite control set model predictive control style tasks with mean AUC values of 0.704 and 0.721 for raw time-domain data in two demonstrations (Bryan et al., 21 Jul 2025).

Current directions in the literature point toward learned shared temporal subspaces, joint learning of basis and dynamics, and deployment-driven efficiency. The MFDLM extends standard basis expansions by adding multivariate hierarchical dependence and full Bayesian inference with constrained spline basis estimation (Kowal et al., 2014). Temporal-MPI uses a shared temporal subspace to preserve MPI’s fast compositing while adding dynamic variation (Xing et al., 2021). The 2025 stimulation paper positions TBFMs as a practical middle ground between linear state-space models and expressive but slow recurrent neural networks, with an explicit focus on training time, sample efficiency, and inference latency (Bryan et al., 21 Jul 2025). A plausible implication is that the modern TBFM literature is increasingly shaped by application constraints: whether the priority is uncertainty quantification, control latency, rendering speed, or interpretable behavioral structure determines how the temporal basis is parameterized and how its coefficients are inferred.