---
title: 'TimeOmni-1: Unified Multimodal Time Series Reasoning'
url: https://www.emergentmind.com/topics/timeomni-1
type: topic
---

# TimeOmni-1: Unified Multimodal Time Series Reasoning

TimeOmni-1 is a unified reasoning model for multimodal time series understanding, introduced together with the Time Series Reasoning Suite (TSR-Suite) to formalize and operationalize time series reasoning in large language models [2509.24803]. In the formulation associated with the model, time series reasoning is decomposed into four atomic tasks spanning three fundamental capabilities: perception, extrapolation, and decision-making. The framework couples a lightweight multimodal front end to a pretrained base LLM, uses chain-of-thought supervision and reinforcement learning with task-grounded rewards, and is evaluated under both in-distribution and out-of-distribution settings. The stated motivation is that existing multimodal time series datasets mostly remain at the level of surface alignment and question answering, whereas TSR-Suite and TimeOmni-1 are designed around tasks that genuinely require time series reasoning [2509.24803].

## 1. Conceptual scope and problem setting

TSR-Suite defines four atomic tasks that together span three fundamental reasoning capabilities over time series: perception through scenario understanding and causality discovery, extrapolation through event-aware forecasting, and decision-making through deliberation over perception and extrapolation [2509.24803]. The underlying problem setting is expressed with observed series
$X=\{x^{(m)}_{1:T}\}_{m=1}^{M}$,
auxiliary textual context $C$, a reasoning trace $R$, and final answer $y$, under the schema
$$(R,y)\sim p_\theta(R,y\mid X,C)=p_\theta(R\mid X,C)\,p_\theta(y\mid R,X,C).$$

This formulation places reasoning traces inside the model’s output space rather than treating them as auxiliary annotations only. A plausible implication is that the framework is intended not merely to classify or regress from time series, but to model an explicit reasoning process over numerical observations and textual context.

The four tasks are specified as follows.

| Capability | Task | Formal output |
|---|---|---|
| Perception | Scenario Understanding | $y\in\{1,\dots,K\}$ |
| Perception | Causality Discovery | $y\in\{\text{“1→2”},\text{“2→1”},\text{“no-causal”}\}$ |
| Extrapolation | Event-aware Forecasting | $\hat{x}_{t+1:t+H}$ |
| Decision-making | Deliberation | $a^*=\arg\max_{a\in A}U(a\mid X,C)$ |

For scenario understanding, the model receives a single series $x_{1:T}$ and candidate labels $\{s_1,\dots,s_K\}$, and selects
$$y=\arg\max_i p_\theta(s_i\mid x_{1:T},C).$$
For causality discovery, the task is framed as binary classification or directional prediction over two or more series, with the model inferring $x^{(i)}\to x^{(j)}$ if $i$ causes $j$, or $R=\varnothing$ if there is no direct causal link. For event-aware forecasting, the model predicts the next $H$ steps from history $x_{1:t}$ and an event sequence $e_{1:t'}$ described in $C$:
$$\hat{x}_{t+1:t+H}=\arg\max_{z\in\mathbb{R}^H} p_\theta(z\mid x_{1:t},C).$$
For deliberation, the task combines series, textual constraints, and a discrete action space $A$ to select
$$a^*=\arg\max_{a\in A}U(a\mid X,C),$$
where $U$ is an expected utility such as profit derived via internal forecasting and causal reasoning [2509.24803].

A common misconception is that TimeOmni-1 is primarily a forecasting model. The task design indicates otherwise: forecasting is only one of four atomic tasks, and the suite explicitly treats perception and decision-making as coequal targets of training and evaluation [2509.24803].

## 2. TSR-Suite dataset and annotation pipeline

TSR-Suite is described as the first comprehensive time series reasoning suite that supports not only thorough evaluation but also the data pipeline and training of time series reasoning models [2509.24803]. It contains more than 23K samples; the detailed overview gives the more specific figure of 23 605 total QA pairs assembled across 10 domains, with 2.3 K high-quality, human-guided chains and 23 K overall samples for training and evaluation [2509.24803].

The data curation process is hierarchical. Raw-data assembly across 10 domains yields 23 605 total QA pairs. In Step 1, an LLM Analyzer plus structured templates produces approximately 1 000 “easy” chain-of-thought seeds. In Step 2, human review of hard cases adds approximately 1 300 expert-verified chain-of-thought traces. The result is a 2.3 K human-verified subset, augmented with the remaining 21 K auto-labeled pairs for model development [2509.24803].

The design of the suite is significant because it ties task formalization, annotation, training, and evaluation into a single framework. This suggests that TSR-Suite is not only a benchmark but also an end-to-end data substrate for supervised and reinforcement learning over time series reasoning traces. The emphasis on “human-guided hierarchical annotation” indicates that the curated subset is intended to provide higher-fidelity reasoning supervision than purely synthetic chain-of-thought generation.

Another common misunderstanding is that the benchmark measures only answer accuracy. In fact, the framework also tracks whether a response is structurally valid. Evaluation first filters for valid responses, defined through Success Rate (SR), the fraction of outputs from which a well-formed `<answer>` can be extracted; only then are task-specific metrics computed on valid cases [2509.24803].

## 3. Model architecture and input–output interface

TimeOmni-1 extends a pretrained base LLM, with Qwen2.5-Instruct given as an example, using a lightweight multimodal front end [2509.24803]. The time-series and text modalities are embedded separately:
$$f_{TS}(X)\in\mathbb{R}^{H\times d},\qquad f_{\text{text}}(C)\in\mathbb{R}^{L\times d},$$
with a simple instantiation
$$f_{TS}(X)=PE(XW_{TS}+b_{TS}),\qquad f_{\text{text}}(C)=\text{TokenEmbed}(C)+PE_{\text{text}}.$$

Fusion is implemented by prepending the series embedding as a soft prefix to the text embedding and passing the concatenation through $T$ shared Transformer cross-attention layers:
$$Z^0=[f_{TS}(X);f_{\text{text}}(C)],$$
$$Z^\ell=\text{TransformerLayer}_\ell(Z^{\ell-1}),\quad \ell=1\dots T.$$
The final $Z^T$ tokens are then fed into the original LLM decoder stack [2509.24803].

The output interface is standardized across tasks. TimeOmni-1 is trained to produce
```text
<think>…chain of thought…</think>
<answer>…final answer…</answer>
```
For Tasks 1, 2, and 4, the answer is a single token such as option A/B/C. For Task 3, the answer is a list $[\hat{x}_{t+1},\dots,\hat{x}_{t+H}]$. These templates are enforced during both supervised fine-tuning and reinforcement learning via the format reward [2509.24803].

This unified decoder is methodologically important. Rather than using separate heads per task, all four tasks share the same decoder and reward. The detailed overview states explicitly that the tasks are interleaved within each batch, encouraging the model to learn transferable temporal priors across perception, extrapolation, and decision-making. A plausible implication is that the architecture treats task transfer as a core design goal rather than a byproduct.

## 4. Optimization pipeline and reward design

TimeOmni-1 is trained in two major stages atop a pretrained LLM: supervised fine-tuning (SFT) followed by reinforcement learning with task-grounded rewards [2509.24803].

In Stage I, the objective is to inject time-series reasoning priors via high-quality chain-of-thought traces. The loss is
$$\mathcal{L}_{SFT}(\theta)=-\frac{1}{N}\sum_i \log p_\theta(R_i,y_i\mid X_i,C_i),$$
where $(X_i,C_i,R_i,y_i)$ come from the 2.3 K human-verified subset, augmented with the remaining 21 K auto-labeled pairs. The reported hyperparameters are learning rate $1\times10^{-5}$, batch size $1$ with accumulation $32$, and $1$ epoch, using BF16, FlashAttention, and ZeRO-3 fine-tuning [2509.24803].

In Stage II, the model is optimized with group relative policy optimization (GRPO). From each $(X,C)$, the method samples $M$ trajectories $\{(R_j,y_j)\}$ under $\pi_\theta$, groups them, and assigns the advantage
$$A_j=R(R_j,y_j)-\text{mean}_{k\in\text{group}}(R(R_k,y_k)).$$
The policy update uses a clipped PPO-style loss plus a KL penalty to the reference SFT policy $\pi_{\theta_{\text{ref}}}$ [2509.24803].

The reward design combines structural and task-grounded components. The format reward is
$$R_{\text{format}}=
\begin{cases}
1, & \text{if output matches } \langle think\rangle \dots \langle/think\rangle \langle answer\rangle \dots \langle/answer\rangle\\
0.1, & \text{otherwise.}
\end{cases}$$
For discrete tasks, the correctness reward is
$$R_{\text{disc}}=\mathbf{1}_{\hat{y}=y}.$$
For forecasting, the overview defines
$$MAE=\frac{1}{H}\left\|\hat{x}_{t+1:t+H}-x_{t+1:t+H}\right\|_1,$$
and
$$R_{\text{seq}}=0\ \text{if length mismatch, else}\ \exp(-\alpha\cdot MAE)+R_{\text{count}},$$
where $R_{\text{count}}=0.1$ if $H$ is correct and $\alpha=0.1$. The overall reward is
$$R=\lambda R_{\text{format}}+(1-\lambda)R_{\text{task}},\qquad \lambda=0.1.$$

The Stage II optimization details are GRPO with clip $\epsilon=0.2$, KL weight $\beta=0.04$, learning rate $1\times10^{-6}$, batch size $128$ with minibatches $32$, $3$ epochs, $M=8$ trajectories per update, and sampling temperature $0.7$ [2509.24803].

The training pipeline encodes a specific view of reasoning: chain-of-thought supervision is used to bootstrap temporal priors, and RL is used to refine “genuine reasoning.” That phrasing comes from the ablation summary and should be read as a claim about the observed effect of the training stages rather than a general definition of reasoning [2509.24803].

## 5. Evaluation protocol, baselines, and reported results

Evaluation is carried out under both in-distribution and out-of-distribution splits [2509.24803]. After filtering for valid responses using Success Rate, the framework computes Accuracy for Tasks 1, 2, and 4 as
$$ACC=\frac{\#\text{correct}}{\#\text{valid}},$$
and Mean Absolute Error for Task 3 as
$$MAE=\frac{1}{H}\sum | \hat{x}-x |.$$

The reported baselines include proprietary LLMs such as GPT-4.1, open-source LLMs such as Llama-3.1, Mistral, and Qwen2.5, and time-series-specialized systems including Time-MQA, ChatTS, and Time-R1 [2509.24803].

The detailed overview lists the following key quantitative results. For Causality Discovery (Task 2, ID), TimeOmni-1 ACC is 69.3% versus 28.7% for GPT-4.1. For Scenario Understanding (Task 1, ID), TimeOmni-1 ACC is 90.7% versus 85.5% for GPT-4.1. For Event-aware Forecasting (Task 3, OOD SR), TimeOmni-1 SR is 82.3% versus 76.1% for GPT-4.1, corresponding to a gain of 6.2 percentage points. For Decision Making (Task 4, OOD), TimeOmni-1 ACC is 58.9% versus 27.8% for GPT-4.1 [2509.24803].

The abstract reports a partially different set of headline figures: TimeOmni-1 “significantly improves causality discovery accuracy (64.0% vs. 35.9% with GPT-4.1)” and “raises the valid response rate by over 6% compared to GPT-4.1 on the event-aware forecasting task” [2509.24803]. The discrepancy reflects different reported evaluation slices in the supplied materials rather than a single unified table. An objective reading is therefore that the paper consistently claims improvement over GPT-4.1, while the exact comparison point depends on the split and metric summary being quoted.

The out-of-distribution generalization claim is explicit. The overview states that TimeOmni-1 holds strong OOD performance across all four tasks, often improving over GPT-4.1 by 20–30 percentage points in causality and decision-making, and raising valid-response rates by 5–10 points on forecasting. This should be interpreted as a summary statement of the reported empirical pattern rather than a replacement for the task-specific metrics above [2509.24803].

## 6. Ablations, interpretation, and naming ambiguity

The ablation studies compare Stage 1 SFT, answer-only SFT, and joint RL, as well as single-task versus multi-task joint training [2509.24803]. The reported conclusions are that CoT-based SFT is essential to bootstrap temporal priors, RL further refines genuine reasoning, and joint multi-task training yields consistent gains, summarized as “train-once, use-across-tasks.” These findings position the model as a unified temporal reasoning system rather than a collection of task-specific adapters.

In interpretive terms, TimeOmni-1 embodies a specific research program in which reasoning with time series is treated as multimodal inference over numerical observations, textual context, and latent reasoning traces. The use of a shared decoder, shared reward, and interleaved training batches suggests an attempt to learn transferable temporal priors that can be reused across classification, directional inference, forecasting, and utility-based action selection. This suggests that the system is meant to generalize across task families, not merely across datasets within a single task.

There is, however, a naming ambiguity in the supplied arXiv materials. The paper explicitly titled “TimeOmni-1: Incentivizing Complex Reasoning with Time Series in Large Language Models” concerns time-series reasoning [2509.24803]. By contrast, detailed summaries attached to two lunar timing papers use the designation “TimeOmni-1” for a cislunar timekeeping or Lunar Coordinate Time framework, including references to TCL, LCRS, six time scales, sub-picosecond synchronization, and lunar Positioning, Navigation and Timing architectures [2509.08871]; [2507.22145]. Those usages belong to a different technical context. A reasonable editorial distinction is therefore to reserve the primary sense of *TimeOmni-1* for the time-series reasoning model of [2509.24803], while noting that the same label appears elsewhere in the supplied material in connection with relativistic cislunar timing systems.

Within the time-series reasoning literature represented here, the central significance of TimeOmni-1 is that it links benchmark design, hierarchical chain-of-thought annotation, multimodal prefix-style fusion, and task-grounded RL into a single framework for perception, extrapolation, and decision-making over time series [2509.24803].

Source: https://www.emergentmind.com/topics/timeomni-1