Curriculum Sampling for RLOO Fine-Tuning on Countdown
This project investigates whether curriculum-based sampling can improve RLOO training by concentrating updates on prompts that are expected to be most informative and suggests a fundamental tradeoff between concentrating updates on potentially informative prompts and maintaining broad coverage of the training distribution.
Catherine Zhang, Nora Menon
· 0 citations