Skip to content

Bridging the Structural Gap: Adapting Autoregressive Generation for Recommendation

Jul 2026 · arXiv.org · Vol abs/2607.21028 · 1 citation · 52 references
Computer Science

TL;DR

BARGE is proposed, which employs Item Context-Aware Attention (ICA) to restore item-level structure during encoding, and Hierarchical Path Reranking (HPR) together with Dual-Path Decoding (DPD) to suppress semantic drift from two complementary angles during decoding.

Abstract

Generative Recommendation (GR) has emerged as a new paradigm for sequential recommendation, in which a representative line of work encodes items into hierarchical semantic IDs via residual quantization and predicts the IDs token by token. However, this generative formulation still exhibits structural gaps with respect to the recommendation task: flattening multi-token IDs into a single sequence destroys item-level structure, and the inconsistency between training and inference over a hierarchical codebook gives rise to semantic drift. To bridge these two gaps, we propose BARGE, which employs Item Context-Aware Attention (ICA) to restore item-level structure during encoding, and Hierarchical Path Reranking (HPR) together with Dual-Path Decoding (DPD) to suppress semantic drift from two complementary angles during decoding. Extensive experiments and analytical studies on public benchmarks and a large-scale offline test demonstrate that BARGE achieves superior recommendation performance. An online A/B test on a Tencent platform yields improvements of 0.60% in click-through rate, 1.34% in click unique visitors, and 1.70% in total reading time, confirming the practical value of BARGE in industrial-scale recommendation.

View source

Similar papers

Jul 2026

Grevo: A Unified Generative Recommendation Framework with Evolutionary Item Indexing

Grevo is a unified Generative recommendation framework with evolutionary item indexing, which treats the SID assignment itself as an evolvable discrete variable that adapts to behavioral feedback rather than as a tokenizer to be trained.

Huanjie Wang, Liwei Guan, Zekai Sun et al. · 0 citations
Book Jul 2026

Topology-Aware Tokenization for Generative Recommendation

Topology-Aware Tokenization (TopoTok) is proposed, an item tokenization framework that preserves item relational structure throughout the quantization hierarchy and effectively alleviates topology distortion and consistently outperforms state-of-the-art tokenizers.

Yao-Kun Liu, Yi-Fan Liu, Zhenrui Yue et al. · 0 citations
Book Open access Aug 2026

ReSOT: Re-balance Semantic ID with Optimal Transport for Generative Recommendation

ReSOT is proposed, a unified framework that Re-balances Semantic ID learning via Optimal Transport for GR and provides a principled tokenization scheme that preserves relational structure while assigning codes in a collision-aware and semantics-consistent manner.

Renwu Geng, Yi-Ming Xu, Fengxin Li et al. · 0 citations
Book Jul 2026

Beyond Fixed Depths and Widths: Optimizing Textual Decoding Tries in LLM-based Generative Recommendation

This work introduces BONSAI : Branching-Optimized Node Structure for Adaptive Identifiers, a novel framework that co-designs textual term IDs and their underlying decoding trie that satisfies two desirable properties for a highly performant trie.

Jing-Zhe Liu, Han-Bing Wang, Ji-Liang Tang et al. · 0 citations
Book Open access Aug 2026

Collaborative Memory Augmentation for Generative Recommendation

Empirical evaluations demonstrate that OMEGA significantly outperforms existing advanced GR models, validating the potential of external memory as a complement to the generative paradigm.

Enze Liu, Zhen Tian, W. Zhao · 1 citation
Book Open access Aug 2026

Hierarchical Residual Policy Optimization for Generative Recommendations

Hierarchical Residual Policy Optimization (HRPO), a post-training framework that converts item-level outcomes into dense, token-aligned learning signals for conservative token-wise improvement, is proposed.

Kaifeng Guo, Yiming Yang, Jingtong Gao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.