Skip to content
Open access

Encoder Language Models for Zero-Shot Recommender Systems: Cross-Domain and Cross-Lingual Evaluation

Sep 2026 · Computers · 0 citations · 48 references

TL;DR

The results suggest that frozen embedding-based recommendation could be a viable option, particularly when considering the cost/performance ratio, however, model and method selection should be evaluated against domain-specific tasks and protocols, rather than being based on general intuitions about scaling, general-purpose benchmark scores, or even leave-one-out validation methods.

Abstract

This research provides deep insights into the capabilities of encoder models, offering a unique, controlled benchmark of over 20 state-of-the-art models. The aim is to analyze the viability of a potentially advantageous recommender architecture that capitalizes on the progress made in natural language processing (NLP) without the drawbacks of more advanced deep learning models or generative decoder-only large language models. We present a zero-shot recommender architecture used in a training-free setting. In this setting, item embeddings are aggregated into weighted user profiles and scored by cosine similarity against the full candidate pool. This approach makes use of state-of-the-art encoder language models in a frozen, inference-only, context-free state. We employed a temporal evaluation designed to simulate the cold-start problem, ordering user interactions over time and progressively revealing later interactions. We also used three contrasting datasets with specific challenges, as well as baseline methods of similar complexity and resource demands, such as collaborative filtering or content-based TF-IDF methods. For our recommendation task, we also compared the local large language model with the encoder models in a limited experiment. Our results suggest that frozen embedding-based recommendation could be a viable option, particularly when considering the cost/performance ratio. However, model and method selection should be evaluated against domain-specific tasks and protocols, rather than being based on general intuitions about scaling, general-purpose benchmark scores, or even leave-one-out validation methods.

Read PDF

Similar papers

#large language models Review Open access Sep 2026

PALRec: Large Language Model-Based Sequential Recommendation with Parameter-Preserving Augmentation

PALRec is proposed, a parameter-preserving augmentation framework that equips an LLM with recommendation capabilities while keeping its original parameters fixed and consistently outperforms fully fine-tuned counterparts in recommendation accuracy while preserving the LLM’s pre-trained knowledge.

Hyunsoo Na, Minseok Gang, Sang-goo Lee et al. · 0 citations

Support Vector Generation: Kernelizing Zero-Shot Classifiers from Pre-Trained Language Models

Support Vector Generation is introduced, a kernel-based framework that converts a frozen language model into an interpretable, training-free classifier for zero-and few-shot learning and suggests that SVG offers a viable path toward efficient, interpretable NLP systems under compute constraints.

Shohei Ohsawa · 0 citations
Book Open access Feb 2026

Distribution-Level Contrastive Supervision for Generative Recommendation

SODA, a plug-and-play alignment framework that adopts a BPR-style contrastive objective to align recommender representations with target-side distributional representations against negative ones, is developed and demonstrated that SODA consistently strengthens diverse generative recommendation architectures.

Zi-Qiu Xue, Ding-Xian Wang, Yi-Meng Bai et al. · 0 citations
Preprint Aug 2026

Giga-Embeddings: Mixture-of-Experts Encoders for High-Throughput Text Embeddings

This work introduces Giga-Embeddings, a family of text embedding models designed to combine strong retrieval quality with efficient serving, and trains the compact model using a dimension-agnostic objective that aligns teacher and student similarity distributions.

Egor Kolodin, Egor Krasnoperov, Evgeniy Kosarev et al. · 0 citations
Book Open access Sep 2026

Do We Really Need LLMs to Augment All? A Selective Augmentation Framework with Lightweight Language Models for Multimodal CTR Prediction

In recent years, multimodal models and large language models (LLMs) have been increasingly applied to click-through rate (CTR) prediction, owing to their ability to extract recommendation-relevant information from raw content and thereby alleviate the long-standing issue of collaborative signal sparsity. Existing parad...

Zi-Yun Chen, Yu-Han Wang, Hong-Hao Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.