Skip to content

Author

Andrew Rabinovich

4 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing

It is shown that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants, and it is shown that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants.

Ilija Subasic, Brett Levert, Andrew Rabinovich et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing

LLM-as-a-Judge has become a standard for evaluating large language models, yet most approaches implicitly assume that a single judge prompt functions as a stable evaluation instrument. Prior work has primarily explored deliberate prompt modifications such as scoring rubrics, role descriptions, or chain-of-thought reaso...

Ilija Subasic, Brett Levert, Andrew Rabinovich et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SWE-Clar: Can Coding Agents Clarify Incomplete Client Requirements and Deliver Greenfield Software?

SWE-Clar, a benchmark grounded in real, high-value client commissions to evaluate requirement clarification and code implementation in this setting, comprises 100 tasks based on real software development jobs on Upwork, each with at least US\$4,000 in total payments.

Jia-Lei Li, Ding-Xian Wang, Xiao-Yan Zhao et al. · 0 citations

Reinforcement Learning with Decomposed Subtasks

This work introduces Reinforcement Learning with Decomposed Subtasks (RLDS), whose core is Subtask-Decomposed Advantage Estimation (SDAE), a replacement for the scalar GRPO advantage that splits trajectory reward into per-subtask shares on a fixed taxonomy, computes a group-relative advantage per subtask, and distribut...

Mattie Terzolo, Mikolaj Sacha, Ayan Sinha et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.