Zhong-Ru Chen

RPCBench: A Benchmark for Proactive Premise Critique in LLM-based Recommendation

RPCBench, a benchmark for evaluating Recommender-Premise Critique: the ability to detect, diagnose, and properly handle faulty premises in natural-language recommendation requests, is introduced and a fine-grained evaluation framework that measures proactive detection, error localization, post-detection handling strate...