Yarin Bar

Truncate Bad, Upweight Good: BoN-Style Distillation via Rank-Based Classification

This work proposes TUP: a Truncate-bad, Upweight-good Policy that removes low-ranked completions from the support and reweights only the retained upper tail with a tunable sharpness, and shows that TUP is competitive with strong offline alignment baselines.