Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMs
This work describes the near-optimal region, the set of allocations within a specified tolerance of peak performance, which is wide even for small tolerances, widens with model scale, and transfers reliably from small proxy models to large target models.
Jingtan Wang, A. Verma, Xiaoqiang Lin et al.
· 0 citations