ORCA: Evaluating LLMs on Data Science Code Translation
ORCA is introduced, a comprehensive benchmark with two complementary settings: ORCA-MAIN, which comprises 1,600 carefully curated grounding-level tasks across 3 representative domains: Data Querying, Data Manipulation, and Deep Learning; and ORCA-PROJECT, which contains 200 translation tasks over complete data science...
Xiao-Long Li, Jin-Yang Li, Bo-Wen Qin et al.
· 0 citations