DTAMLP, an all-MLP framework combining weight fusion and FFT-based filtering, is validated on Diginetica and RetailRocket, and ablations confirm the two mechanisms contribute complementary, non-redundant improvements.
Abstract
This paper reports two empirical findings on session-based recommendation (SBR), unified in a single model, DTAMLP. First, existing time-aware and GNN-based models (e.g., TiSASRec, SR-GNN) treat every click-time interval as equally informative, even though very short dwell times often reflect accidental clicks carrying little preference signal -- a phenomenon we call sporadic noise. We show that a lightweight, plug-and-play weight fusion module, blending a model's attention weight with a threshold-capped time-interval weight, can be inserted into such models with almost no architectural change and yields a consistent accuracy gain; we view this as the most directly verifiable contribution of this work. Second, we revisit an under-explained observation from FMLP-Rec, where a learnable frequency-domain filter on item embeddings improves accuracy, and offer a possible explanation: time-domain behavior mixes several entangled psychological preferences, and a frequency-domain view may let a model separate and down-weight such preference noise more naturally -- an interpretive conjecture rather than a proven mechanism. Building on both insights, DTAMLP, an all-MLP framework combining weight fusion and FFT-based filtering, is validated on Diginetica and RetailRocket. While this system-level design reflects the state of the field circa 2023 rather than a state-of-the-art claim, ablations confirm the two mechanisms contribute complementary, non-redundant improvements.
Transformer-based models have become the cornerstone of sequential recommendation, yet they are often perceived either as rigid engineering recipes or as a collection of disconnected architectures. This tutorial demystifies these systems by centering on a provocative guiding question: “What is not sequential recommenda...
J. Lichtenberg, A. V. Petrov· Proceedings of the 20th ACM...· 0 citations
LLM-based sequential recommenders increasingly train user/item encoders with in-batch InfoNCE negatives inherited from contrastive learning—convenient, but it silently caps the negative pool at batch size rather than catalog size whenever encoder cost bounds the batch. We report an early finding: a 15-negative in-batch...
Younggue Bae· Proceedings of the 20th ACM...· 0 citations
Large-scale recommenders increasingly adopt the sequential generative recipe behind large language models, bringing the Transformer into recommendation along with design choices made for text, including Rotary Position Embedding (RoPE). In language models, RoPE encodes token indices for relative position reasoning, but...
Yang Liu, Noel Loo, Ali Khanafer et al.· 0 citations
PALRec is proposed, a parameter-preserving augmentation framework that equips an LLM with recommendation capabilities while keeping its original parameters fixed and consistently outperforms fully fine-tuned counterparts in recommendation accuracy while preserving the LLM’s pre-trained knowledge.
Hyunsoo Na, Minseok Gang, Sang-goo Lee et al.· ACM Transactions on Informat...· 0 citations
The Fusion of Layer-wise Exits for Sequential Recommendation (FLEXRec), a discriminative framework that enhances compact LLMs while retaining scalable full-corpus ranking and achieves state-of-the-art accuracy among competing methods while remaining highly efficient.
Xurong Liang, Tong Chen, Q. Nguyen et al.· 0 citations
Semantic ID (SID) based generative recommendation represents each item as a sequence of discrete tokens, and recommends by generating the SID of the item a user would like to interact with. Both dominant paradigms in this domain generally pay for generation token by token: autoregressive models decode the tokens left-t...
Zhuo Cai, Shou-Jin Wang, Pei-Lin Zhou et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.