Skip to content
Preprint

IntHQ: Task-Interactive Hierarchical Query on Dual-Stream Representations for Generative Recommendation

Aug 2026 · 0 citations · 44 references
Computer Science

TL;DR

This work proposes IntHQ, a multi-task generative recommender with three components, each alleviating one collapse, and proposes Task-Interactive Modeling (TIM), a multi-task generative recommender with explicit cross-task interaction.

Abstract

Multi-task learning over heterogeneous data is fundamental to modern recommendation, while generative models are emerging as the backbone of next-generation recommenders. However, the integration of multi-task learning into the generative paradigm remains largely unexplored. Existing multi-task recommenders, in both discriminative and generative paradigms, extract task-relevant features from a single task-agnostic representation and wire tasks into a predefined conversion funnel. We show that this scheme is inherently prone to a threefold collapse. Source collapse, where task-specific signals are injected late and diluted in the shared latent space. Relational collapse, where task dependencies are either implicitly absorbed by the backbone or statically fixed by predefined funnels. Hierarchical collapse, where tasks depend on features at different scales and shift across training stages. We propose IntHQ, a multi-task generative recommender with three components, each alleviating one collapse. Dual-Stream Decoupling (DSD) injects task identity into computation stream early and separates the shared context stream from the task-specific stream, alleviating signal dilution. Task-Interactive Modeling (TIM) replaces the predefined funnel with explicit cross-task interaction, letting each task condition on the realized outcomes of its predecessors with learned, input-adaptive strength. Hierarchical Querying (HQ) lets each task gather multi-scale information across different layers at different training stages. In offline evaluations, IntHQ consistently outperforms competitive encoder backbones under four representative task-head configurations. Deployed in production on Amap, serving hundreds of millions of users for travel recommendation, IntHQ yields a 1.60\% relative UVCTR lift.

View source

Similar papers

Preprint Sep 2026

Task-Blind No MORE: Multi-Task Information Flow in Unified Ranking Backbones

Industrial ranking models for recommendation have scaled feature interaction and sequence modeling separately; recent architectures such as HyFormer and MixFormer unify both in a stackable backbone. Real-world recommender systems, however, nearly always require multi-task learning, yet existing unified architectures co...

Yu-Chen Wang, Feng-Nan Niu, Qing Tan et al. · 0 citations
Book Open access Sep 2026

Embedding Subspace Partitioning for Dynamic Multi-Objective Retrieval

Modern industrial recommender systems must optimize across competing objectives, balancing semantic relevance with business metrics such as engagement and revenue. While bi-encoders dominate large-scale retrieval due to their efficiency, they collapse these heterogeneous signals into a single static embedding space. Th...

Shao-Bo Zhang, Alice Leung, Yun-Xiang Ren et al. · 0 citations
Preprint Sep 2026

TGR: Advancing Industrial Recommendation from Generative-Paradigm Ranking toward Unified Generation and Reasoning

TGR (Tencent Generative Recommendation), an industrial framework that advances recommendation toward the generative paradigm along three coupled directions, is presented, which is deployed across Tencent production surfaces serving hundreds of millions of users.

T. Cheng, Hao-Nan Hu, Bei-Bei Kong et al. · 0 citations
Conference Aug 2026

SeRel-LightFM: Bridging Semantic and Relational Representations for Sparse Hybrid Recommendation

Data sparsity remains a major obstacle for recommender systems because conventional collaborative filtering methods rely heavily on observed user–item interactions and often fail to exploit richer semantic and relational signals. To address this limitation, we propose SeRel-LightFM, a knowledge-aware hybrid recommendat...

M. Pham, V. Vu, Hung-Nghiep Tran · 0 citations
Sep 2026

X-Rec Technical Report

Recent advances in generative modeling have reshaped recommender systems by formulating recommendation as a next-item generation problem. Existing retrieval approaches primarily follow two paradigms: user-to-item (U2I) methods represent user context using one or a few deterministic embeddings, which limits the ability...

Cheng-Lei Shen, Chen-Zhe Huang, Dong Jiang et al. · 1 citation
Conference Open access Sep 2026

Bridging the Semantic Gap: Leveraging LLMs for Hierarchical Interest Evolution in Sequential Recommendation

The Hierarchical Semantic Interest Evolution Network (HSIEN), a novel generative-discriminative framework that significantly alleviates modality misalignment and enhances CTR prediction performance through feature complementarity, is proposed.

Yi-Fan Cao, Rui Wu, Xiang Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.