---
title: Heterogeneous User Modeling (HUM)
url: https://www.emergentmind.com/topics/heterogeneous-user-modeling-hum
type: topic
---

# Heterogeneous User Modeling (HUM)

to=arxiv_search.search  微信公众号天天中彩票json
{"query":"id:2410.11377 OR id:2406.10586 OR id:1711.06632 OR id:2507.04626 OR id:2412.11127","max_results":10,"sort_by":"relevance"}
to=arxiv_search.search 娱乐赚钱json
{"query":"id:2110.07181 OR id:2207.11776 OR id:2104.14200 OR id:2502.18968 OR id:2602.07333 OR id:2510.14788","max_results":10,"sort_by":"relevance"}
to=arxiv_search.search  彩神争霸是不是json
{"query":"2410.11377","max_results":5,"sort_by":"relevance"}
Across recent literature, heterogeneous user modeling denotes a family of methods that represent users through multiple heterogeneous signals rather than a single homogeneous profile. Those signals include typed behavior logs, graph relations, temporal regimes, cross-domain histories, demographic cues, interruption events, and inferred dialogue profiles; the resulting models are used for recommendation, profiling, personalization, human–robot interaction, and user simulation [1711.06632] [2110.07181] [2410.11377] [2502.18968]. A common theme is that user state is treated as structured and multi-source: different behaviors, times, scenarios, or agents expose different aspects of preference, and effective modeling depends on preserving those distinctions long enough to support target-aware prediction or adaptation.

## 1. Scope and formal foundations

A notable feature of HUM is that its basic representational unit varies by application. In recommendation-oriented work, the user is often represented as a heterogeneous history of typed interactions. ATRank formalizes a user as
\[
U=\{(a_j,o_j,t_j)\mid j=1,2,\ldots,m\},
\]
where \(a\) is behavior type, \(o\) is the acted-on object, and \(t\) is timestamp; the history is then partitioned into behavior groups \(G=\{bg_1,\ldots,bg_n\}\) according to target object type [1711.06632]. In graph-based profiling, the user is instead a node in a typed relational structure,
\[
\mathcal{G}=(\mathcal{V},\mathcal{E},\mathcal{A},\mathcal{R}),
\]
with semantics carried by node types, relation types, and meta-relations \(\langle \tau(s),\phi(e),\tau(t)\rangle\) [2110.07181]. In dialogue simulation, the user becomes an inferred profile \(P_i\) extracted from dialogue and used to condition future turns [2502.18968]. In human–robot interaction, heterogeneity may be operationalized more narrowly through demographic assignment and online interruption channels rather than a rich latent state [2410.11377].

This diversity of formalizations is not incidental. It reflects a broader methodological point: HUM is less a single model class than a design principle stating that user variability should be represented in the same semantic form as the downstream task. Typed logs support recommendation, typed edges support profiling, text profiles support simulation, and symbolic demographic-plus-interruption state supports adaptive HRI. A related interventional extension appears in HMUM, where heterogeneity is expressed through treatment sensitivity
\[
\tau_r^k(x_i)=\mathbb{E}(y_{ir}^k\mid t_i=k,x_i)-\mathbb{E}(y_{ir}^0\mid t_i=0,x_i),
\]
and dynamic response weights \(w_{ir}\), shifting HUM toward personalized strategy activation rather than classical preference representation [2511.18997].

| Paradigm | User state | Representative papers |
|---|---|---|
| Multi-behavior sequence | Typed user–object–time history | [1711.06632], [2207.11776] |
| Heterogeneous graph | Node in multi-relational schema | [2110.07181], [1910.02450] |
| Path-centric representation | Set of typed user–item paths | [2505.05989] |
| Temporal latent state | Interest state plus persistence | [2104.14200], [2412.11127] |
| Textual/profile-based | Prompt-compressed or inferred profile | [2507.04626], [2502.18968], [2602.07333] |
| Interactive adaptation | Demographic cue plus online feedback | [2410.11377], [2406.10586] |

## 2. Multi-behavior representation learning

A central line of HUM research models users from heterogeneous behavior histories while avoiding premature aggregation. ATRank is an early attention-based formulation in which each behavior group has its own encoder
\[
u_{ij}=emb_i(o_j)+lookup_i^t(bucketize_i(t_j))+lookup_i^a(a_j),
\]
after which behaviors are projected into a common space, then into multiple latent semantic spaces, and finally processed by self-attention and target-conditioned vanilla attention [1711.06632]. The crucial point is that the model does not produce one fixed user embedding and stop; it preserves behavior-level representations until the target is known. On the Ali multi-behavior dataset, the best AUCs were obtained by ATRank-all2one, reaching \(0.6825\) for Item, \(0.6297\) for Query, and \(0.8725\) for Coupon, directly supporting the claim that cross-type behavioral history improves target prediction [1711.06632].

HUBS extends this logic from typed logs to a broader multi-source user state. It learns four representations—profile, habit, future trend, and social influence—and uses one context-aware LSTM per support behavior type, with context entering the input, forget, and output gates rather than being concatenated crudely [2207.11776]. Behavior-type hidden states are projected into multiple latent semantic spaces,
\[
\bm{h}_{m,n,\lVert_l}=\bm{W}_{m,l}\bm{h}_{m,n},
\]
summed within each facet, and then aggregated over time with facet-specific attention conditioned on demographic representation. This design treats cross-behavior relations as multi-faceted rather than one-dimensional. In experiments, full HUBS outperformed JMBS on all three tasks, reaching PAP MSE \(12.80\), PNBB MSE \(22.71\), and PLFD Macro-F1 \(0.9652\) [2207.11776].

These models share a substantive HUM assumption: different behavior types should remain structurally distinct before fusion. ATRank does so through group-specific encoders and semantic subspaces; HUBS does so through type-specific recurrent encoders and facet-specific projections. In both cases, heterogeneity is not only in the raw data but in the representation geometry itself.

## 3. Graph and path-centric user modeling

Graph-based HUM treats user state as relationally induced rather than purely sequential. RHGN models user profiling as semi-supervised node classification on a directed heterogeneous graph and introduces relation-aware message passing,
\[
M\text{-}head^i(s,e,t)=F_M^i(H^l[s])W_{\phi(e)}^{MSG},
\]
together with relation-aware attention,
\[
\alpha\text{-}head^i(s,e,t)=\left(K^i(s)W_{\phi(e)}^{ATT}Q^i(t)^T\right)\cdot\frac{1}{\sqrt{d}},
\]
so that both message content and attention weight depend on interaction type [2110.07181]. This matters because click, purchase, favorite, shopping cart, and side-information relations are not interchangeable evidence for age or gender. RHGN achieved the best results on both JD and Alibaba; on JD, Age-F1 rose to \(33.95\), and on Alibaba, RHGN reached Gender-F1 \(77.73\) and Age-F1 \(29.60\) [2110.07181].

A path-centric variant appears in "Modeling Multi-Hop Semantic Paths for Recommendation," where the user is represented through multi-hop typed paths between user and item, such as user-item-category, user-item-brand, and user-user-item [2505.05989]. Candidate paths are filtered using path frequency and local mutual information, then encoded sequentially with a GRU,
\[
h_t=\mathrm{GRU}(h_{t-1},[e_{v_t};e_{r_t}]),
\]
and finally fused by path-level additive attention into a target-specific representation \(\mathbf{z}_{u,i}\). On Amazon-Book, the method reached HR@10 \(=0.7137\), Recall@10 \(=0.4982\), and Precision@10 \(=0.4417\), outperforming MF, NeuMF, GCN-Rec, and HIN-PathRank [2505.05989].

An earlier heterogeneous-information-network approach, TPathMine, frames mobile users through three node types—User, App, and Type—and four meta-paths: \(U\!-\!A\!-\!U\), \(U\!-\!T\!-\!U\), \(U\!-\!A\!-\!T\!-\!A\!-\!U\), and \(U\!-\!T\!-\!A\!-\!T\!-\!U\) [1910.02450]. Its main innovation is to replace binary relations with click counts to represent preference intensity and to learn meta-path weights with support vector regression. In age-group prediction, TPathMine consistently outperformed HetPathMine; with 50% labeled users, accuracy reached \(83.6\) versus \(75.21\) for HetPathMine [1910.02450].

Taken together, these models show three distinct graph-centric HUM strategies: relation-aware message passing, path-instance composition, and weighted meta-path propagation. All reject the assumption that user similarity is a single untyped adjacency.

## 4. Temporal heterogeneity and state persistence

Temporal HUM departs from the view that time is a single scalar feature. TimelyRec explicitly separates two temporal mechanisms: periodic preference and evolving preference [2104.14200]. Its Multi-Aspect Time Encoder personalizes time-slot embeddings by user, applies gradual attention to nearby slots to capture slight irregularity, and adaptively combines month, day-of-week, date, and hour. Its Time-Aware History Encoder then weights recent interactions by similarity between their temporal patterns and the target time. The resulting model jointly learns
\[
T^u(t)
\]
for periodic structure and
\[
H^u(t)=\sum_{j=1}^{l} c_j^u(t) I_{i_j^u}(t)
\]
for evolving preference. The paper also introduces item-timing recommendation, where the system must predict both what to recommend and when. Across datasets, TimelyRec reported improvements of up to \(43.08\%\) on item recommendation and \(57.26\%\) on item-timing recommendation [2104.14200].

A more explicit state-space treatment appears in "Modeling the Heterogeneous Duration of User Interest in Time-Dependent Recommendation," which replaces HMM-style geometric persistence with a hidden semi-Markov model whose state-specific duration distribution is
\[
D_{k,d}=P(D_t=d\mid Z_t=k),
\]
with maximum duration \(M\) and nonparametric form [2412.11127]. The hidden state is a latent interest regime, and the key claim is that users differ not only in what state they occupy but in how long they remain there. The model combines duration-aware latent dynamics with negative-binomial count emission and multinomial item allocation, learned by EM. HSMM significantly outperformed HMM on all metrics and datasets, with relative improvement over HMM stated as roughly \(15\%\)–\(55\%\); in Last.fm, about \(37\%\) of users were reported to follow a U-shaped duration distribution [2412.11127].

These papers model different kinds of temporal heterogeneity. TimelyRec distinguishes periodic versus recent-event-driven mechanisms at the representation level. HSMM distinguishes latent interest persistence patterns at the probabilistic state level. Both imply that recency alone is too primitive a proxy for temporal user state.

## 5. LLM-native, cross-domain, and cross-scenario HUM

Recent HUM work has increasingly become LLM-native. In "Heterogeneous User Modeling for LLM-based Recommendation," the user history is serialized as item titles across domains and passed to a shared LLM encoder with the prompt “Compress the following description about the user or item into the last token:” plus a dedicated \([USER]\) token [2507.04626]. The model uses contrastive learning, masks some target-domain items during training to force cross-domain knowledge extraction, and introduces domain importance scores
\[
DI_i=\frac{\mathcal{L}(d_i,\theta)}{\sum_j \mathcal{L}(d_j,\theta)}
\]
to mitigate the domain seesaw phenomenon. Across six Amazon domains, HUM achieved the best performance in nearly all cases; for example, in Books it reached R@10 \(=0.0667\), versus \(0.0513\) for RecFormer and \(0.0497\) for LLM-Rec [2507.04626].

A production-oriented variant appears in "High Fidelity Textual User Representation over Heterogeneous Sources via Reinforcement Learning," where heterogeneous member evidence
\[
q=\{\text{profile attributes},\ \text{professional content},\ \text{job search actions},\ \text{search queries in jobs page}\}
\]
is compressed by a 1.7B LLM actor into a short textual synopsis optimized by reinforcement learning [2602.07333]. The objective is
\[
\max_{\theta}\ \mathbb{E}_{q}\ \mathbb{E}_{o\sim \pi_\theta(\cdot\mid q)}[R(o\mid q)],
\]
with reward derived from downstream engagement prediction plus length and format penalties. On validation ROC-AUC, the pointwise-reward textual summary reached \(0.769\), compared with \(0.743\) for the baseline and \(0.745\) for the embedding baseline; in online A/B testing on Job Search ranking, the deployed system improved CTR by \(+1.48\%\) and Job Applications by \(+1.2\%\) [2602.07333].

Cross-scenario HUM is developed further in RED-Rec, which formalizes a unified sequence
\[
S_u=\{(i_1,a_1,s_1,t_1),\ldots,(i_{|S_u|},a_{|S_u|},s_{|S_u|},t_{|S_u|})\}
\]
over homefeed, advertisements, and search, and then mixes recent scenario-specific subsequences by a 2-D dense mixing policy before Transformer-style user encoding and learnable multi-interest querying [2510.14788]. Its retrieval loss is NCE over cosine similarity, and its multi-interest training uses clustering plus Hungarian matching to prevent interest collapse. Offline, 2-D mixing outperformed timestamp sorting, naive combination, and 1-D variants; online, RED-Rec produced \(+0.8864\%\) total ADVV and \(+0.3401\%\) overall Cost in ad recall [2510.14788].

This line of work shifts HUM away from latent ID spaces alone and toward semantic compression, shared text or LLM encoders, and scenario-aware unification. The common pattern is that heterogeneity is preserved during encoding but compressed into a deployment-efficient representation.

## 6. Interactive, demographic, and agent-conditioned HUM

In interactive systems, HUM often appears as adaptation under user control rather than only prediction. "A Framework for Adapting Human-Robot Interaction to Diverse User Groups" models stable heterogeneity through a learned age-group classifier and dynamic heterogeneity through online interruptions [2410.11377]. The system uses Silero VAD, Faster Whisper ASR, GPT-3.5 as a dialogue bridge, and PyCRAM planning; age is inferred at each turn, averaged over the last five interactions, and used to modulate response verbosity. The bridge is summarized by
\[
R,C,P = LLM(U,S\mid prompts),
\]
where \(U\) contains utterance and age, \(S\) contains symbolic robot state, \(R\) is the response, \(C\) the command, and \(P\) target object properties. The framework reached \(97.8\%\) binary age-classification accuracy on Common Voice and end-to-end task success of \(75.33\%\) and \(86.00\%\) in the two scenarios, but its practical HUM evaluation was limited because only three users participated and none were older adults [2410.11377].

A conceptually different interactive formulation is "How personality and memory of a robot can influence user modeling in Human-Robot Interaction," which argues that the same user may be modeled differently by different robots because the robots themselves differ in personality and memory [2406.10586]. The user model is
\[
UM_{ur}=\{(Property_1,Value_{1u},Probability_{1r}),\ldots,(Property_n,Value_{nu},Probability_{nr})\},
\]
so remembrance probability depends on robot \(r\). Using Big Five weights, the paper instantiates RoboTech, SunnyBot, and MindStorm and applies a threshold rule: if \(Probability\geq 0.7\), the property is remembered; otherwise it is forgotten. The contribution is conceptual rather than empirical, but it introduces agent-induced heterogeneity into HUM: personalization varies because the model-building agent varies [2406.10586].

Dialogue simulation extends this idea to inferred implicit profiles. USP extracts objective facts and subjective characteristics from dialogue, conditions user-turn generation on the resulting profile, and then applies reinforcement learning with cycle consistency so that a profile recovered from generated dialogue remains close to the target profile [2502.18968]. On conversation-level evaluation, USP achieved Sem-Sim \(65.39\), Style-Sim \(46.23\), AVA \(38.77\), and r-DPC \(64.05\), compared with \(48.87\), \(10.15\), \(11.26\), and \(55.66\) for ProfileGPT(4o); ESR also dropped from \(32\) to \(10\) [2502.18968]. Here HUM is neither demographic classification nor static preference embedding, but dialogue-level latent user reconstruction with explicit inter-user diversity and intra-user consistency objectives.

## 7. Evaluation, limitations, and open questions

HUM is evaluated under markedly different protocols depending on what “user model” is taken to mean. Recommendation papers emphasize AUC, HR@\(K\), Recall@\(K\), Precision@\(K\), NDCG, AUUC, and QINI; profiling papers use Accuracy and Macro-F1; HRI papers use module accuracy, interaction success, repetition rate, and interruption robustness; simulation work introduces authenticity, diversity, consistency, and dialogue-profile metrics such as Sem-Sim, Style-Sim, AVA, DPC, and ADV [1711.06632] [2110.07181] [2410.11377] [2502.18968]. A related causal-interventional line, HMUM, evaluates heterogeneous treatment sensitivity and dynamic metric valuation rather than classical preference representation, reporting industrial gains such as \(+0.044\%\) APP usage time at Ranking and \(+0.073\%\) at Edge Rerank [2511.18997].

Across the literature, recurring limitations are specific and substantial. Many systems model only one stable user attribute, or a narrow set of behavior types, or a fixed set of scenarios. The HRI framework models age only as a binary category and lacks older participants in deployment testing [2410.11377]. The robot-personality paper is conceptual, with hand-assigned remembrance probabilities and no empirical study [2406.10586]. TPathMine depends on handcrafted meta-paths and click counts as a coarse proxy for preference intensity [1910.02450]. HSMM models duration heterogeneity at the state level rather than through user-specific duration parameters [2412.11127]. LLM-based recommender HUM still restricts training histories to length 10 and treats temporal dynamics as future work [2507.04626]. Reinforcement-learned textual summaries can drift toward evaluator-optimized language, making reward hacking a practical concern [2602.07333].

Fairness, privacy, and stereotyping also recur. Age and private attributes are inferred from behavior or speech in several papers, yet direct treatment of demographic bias, consent, and representational harm is often limited [2410.11377] [1910.02450]. Personality-conditioned memory can distort neutral affect into positive or negative encodings, which raises risks for trust and appropriateness [2406.10586]. Textual user summarization optimized on engagement can privilege predictive sufficiency over faithful or user-endorsed representation [2602.07333]. These concerns suggest that HUM is not only a modeling problem but a governance problem.

A plausible synthesis is that the field is converging on a layered view of users: heterogeneous behaviors, relations, times, scenarios, and profiles are all informative, but none is sufficient alone. The most mature systems therefore separate heterogeneous evidence channels, learn or preserve their distinct semantics, and then perform target-aware fusion late in the pipeline. What remains unresolved is how to make such models simultaneously richer, more longitudinal, more causal, and more accountable.

Source: https://www.emergentmind.com/topics/heterogeneous-user-modeling-hum