The RecSys Challenge 2026 focuses on the evolving landscape of music discovery, where static recommendation lists are being replaced by dynamic, conversational interactions. As users increasingly interact with AI through natural language, there is a critical need for systems that can seamlessly integrate Natural Langua...
Seungheon Doh, Sergio Oramas, B. Sguerra et al.· Proceedings of the 20th ACM...· 1 citation
This paper presents the RecSys Challenge 2026 challenge task, dataset, evaluation protocol, and official results, and identifies limitations of the benchmark and evaluation protocol, including single-ground-truth relevance and teacher-forced evaluation of synthetic dialogues.
Seungheon Doh, Sergio Oramas, B. Sguerra et al.· Proceedings of the Workshop...· 0 citations
This paper presents the first user study to empirically assess the reliability of LLM-as-a-judge for evaluating CRS responses, and finds that LLM-based judges exhibit moderate positive alignment with human assessments and outperform all reference-based baselines.
Seungheon Doh, B. Sguerra, Sergio Oramas et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
