Junwon Ko

Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training

Direct Diversity Optimization is presented, an offline post-training method that combines Divergence-Tree Collection with the Reference-Relative Target-Odds Objective (RTO) and achieves the strongest task success and successful strategy coverage among the compared post-training methods across BabyAI, BabaIsAI, and WebS...