Oct 2026· Proceedings of the Workshop on the ACM RecSys Challenge· 1 citation· 23 references
TL;DR
This paper describes the solution submitted by team Hallucinated to the ACM RecSys Challenge 2026, based on the TalkPlayData conversational music recommendation dataset, which addresses the ranking task with a classic multi-stage pipeline that combines a diverse pool of candidate generators, Reciprocal Rank Fusion, and a learned XGBoost reranker.
Abstract
This paper describes the solution submitted by team Hallucinated to the ACM RecSys Challenge 2026, based on the TalkPlayData conversational music recommendation dataset. The Challenge poses a dual task: at every turn of a multi-turn dialogue, a system must both (i) rank the most relevant music tracks from the catalogue and (ii) generate a natural language assistant response justifying the recommendation. We address the ranking task with a classic multi-stage pipeline that combines a diverse pool of candidate generators, Reciprocal Rank Fusion, and a learned XGBoost reranker, with validation subsets shaped to resemble the Blind data and tuning objectives that favour stable performance under distribution shift. The response generation task is handled by a multi-stage local Large Language Model pipeline, optimised for lexical diversity. The complete code and data are available at https://github.com/remaplab/recsys-challenge-2026-music-crs for reproducibility.
This diagnostic compares the full pipeline with reciprocal-rank fusion, ablate per-retriever features, and decompose ranking error into retrieval misses, reranking exclusions, and ranks-2–20 ordering loss and complement the leaderboard result with a diagnostic that fits on Train and evaluates the official Devset.
Ryohei Wakatsuki· Proceedings of the Workshop...· 1 citation
The RecSys Challenge 2026 Music-CRS (TalkPlay) task formalizes this as two coupled sub-problems: given dialogue history and user context, retrieve a ranked list of the top-20 tracks from the full, unrestricted catalog, and generate a response that justifies the recommendation while sustaining conversational coherence.
Simran Sundrani, Mohan Bhambhani· Proceedings of the Workshop...· 1 citation· ⚡1
This paper presents the RecSys Challenge 2026 challenge task, dataset, evaluation protocol, and official results, and identifies limitations of the benchmark and evaluation protocol, including single-ground-truth relevance and teacher-forced evaluation of synthetic dialogues.
Seungheon Doh, Sergio Oramas, B. Sguerra et al.· Proceedings of the Workshop...· 0 citations
We present suryaaseran1, our conversational music recommender for the TalkPlayData Challenge (ACM RecSys 2026) that treats each dialogue turn’s user reactions as a preference-elicitation signal for both retrieval and ranking. The dataset’s goal-progress feedback is delayed by one turn and includes rejected tracks logge...
Suryaa Veerabathiran Seran· Proceedings of the Workshop...· 1 citation· ⚡1
Team npatta01’s submission to the RecSys Challenge 2026 conversational music recommendation task is described and failure cases from the submitted run show extracted constraints the pipeline could not enforce.
Nidhin Pattaniyil, Semih Yagli, Tanwir Zaman· Proceedings of the Workshop...· 1 citation· ⚡1
We describe the PoliBaJukebox submission to the ACM RecSys Challenge 2026 on conversational music recommendation over the TalkPlayData 2 corpus. Our system implements a modular two-stage pipeline: a first stage retrieves candidates from the full track catalog using ten heterogeneous sources, fuses them with weighted Re...
Andrea Lops, Nicola Cipriani, Gabriele Colapinto et al.· Proceedings of the Workshop...· 1 citation
Related blog posts
Microsoft Research Blog· microsoft.comOct 12, 2026
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026