---
title: 'ULTRA-HSTU: Generative Transduction Model'
url: https://www.emergentmind.com/topics/ultra-hstu
type: topic
---

# ULTRA-HSTU: Generative Transduction Model

ULTRA-HSTU is a large-scale sequential transduction architecture designed for generative recommendation systems, with a primary focus on handling high-cardinality, ultra-long user histories in streaming recommendation tasks. By integrating modeling, input construction, attention sparsification, and system-level co-optimization, ULTRA-HSTU achieves unprecedented parameter scale, efficiency, and recommendation quality in industry-scale deployments [2402.17152][2602.16986].

## 1. Generative Sequential Transduction Reformulation

ULTRA-HSTU reconceptualizes recommendation as a fully generative, autoregressive sequence transduction problem. Unlike traditional Deep Learning Recommendation Models (DLRMs) that rely on pointwise scoring over engineered dense/sparse feature sets and emit <user,item,label> triplets, ULTRA-HSTU encodes the entire user interaction history as a unified sequence of tokens: $<$Content₀, Action₀, Content₁, Action₁, …$>,$ interleaved with categorical side-features

Source: https://www.emergentmind.com/topics/ultra-hstu