The results suggest that frozen embedding-based recommendation could be a viable option, particularly when considering the cost/performance ratio, however, model and method selection should be evaluated against domain-specific tasks and protocols, rather than being based on general intuitions about scaling, general-purpose benchmark scores, or even leave-one-out validation methods.
Abstract
This research provides deep insights into the capabilities of encoder models, offering a unique, controlled benchmark of over 20 state-of-the-art models. The aim is to analyze the viability of a potentially advantageous recommender architecture that capitalizes on the progress made in natural language processing (NLP) without the drawbacks of more advanced deep learning models or generative decoder-only large language models. We present a zero-shot recommender architecture used in a training-free setting. In this setting, item embeddings are aggregated into weighted user profiles and scored by cosine similarity against the full candidate pool. This approach makes use of state-of-the-art encoder language models in a frozen, inference-only, context-free state. We employed a temporal evaluation designed to simulate the cold-start problem, ordering user interactions over time and progressively revealing later interactions. We also used three contrasting datasets with specific challenges, as well as baseline methods of similar complexity and resource demands, such as collaborative filtering or content-based TF-IDF methods. For our recommendation task, we also compared the local large language model with the encoder models in a limited experiment. Our results suggest that frozen embedding-based recommendation could be a viable option, particularly when considering the cost/performance ratio. However, model and method selection should be evaluated against domain-specific tasks and protocols, rather than being based on general intuitions about scaling, general-purpose benchmark scores, or even leave-one-out validation methods.
PALRec is proposed, a parameter-preserving augmentation framework that equips an LLM with recommendation capabilities while keeping its original parameters fixed and consistently outperforms fully fine-tuned counterparts in recommendation accuracy while preserving the LLM’s pre-trained knowledge.
Hyunsoo Na, Minseok Gang, Sang-goo Lee et al.· ACM Transactions on Informat...· 0 citations
Support Vector Generation is introduced, a kernel-based framework that converts a frozen language model into an interpretable, training-free classifier for zero-and few-shot learning and suggests that SVG offers a viable path toward efficient, interpretable NLP systems under compute constraints.
SODA, a plug-and-play alignment framework that adopts a BPR-style contrastive objective to align recommender representations with target-side distributional representations against negative ones, is developed and demonstrated that SODA consistently strengthens diverse generative recommendation architectures.
Zi-Qiu Xue, Ding-Xian Wang, Yi-Meng Bai et al.· Proceedings of the 20th ACM...· 0 citations
This work introduces Giga-Embeddings, a family of text embedding models designed to combine strong retrieval quality with efficient serving, and trains the compact model using a dimension-agnostic objective that aligns teacher and student similarity distributions.
Egor Kolodin, Egor Krasnoperov, Evgeniy Kosarev et al.· 0 citations
In recent years, multimodal models and large language models (LLMs) have been increasingly applied to click-through rate (CTR) prediction, owing to their ability to extract recommendation-relevant information from raw content and thereby alleviate the long-standing issue of collaborative signal sparsity. Existing parad...
Zi-Yun Chen, Yu-Han Wang, Hong-Hao Li et al.· Proceedings of the 20th ACM...· 0 citations
BaLEEN (Biasing with Latent Encoded Entities), a lightweight, hypernetwork-based framework for dynamic contextual adaptation without fine-tuning the underlying ASR model, is proposed.