Optimal Design for Active Preference Learning with Biased LLM Judges
Nuisance-Adjusted Optimal Design is proposed, a comparison-selection strategy that prioritizes policy-relevant target information after nuisance adjustment and uses the Frank-Wolfe algorithm for optimization and establishes a sharp conditional local asymptotic minimax lower bound on policy risk and construct an estimat...