When Better Turns Do Not Make Better Agents: Diagnosing the Gap Between Next-Turn Metrics and Workflow Success
It is found that SFT consistently improves text-turn success, and that overall next-turn success increases for every model under gold-history evaluation, but these improvements do not transfer to autonomous workflow execution.
Md Tahmid Rahman Laskar, Xue-Yong Fu, Gundeep Singh et al.
· 1 citation
· ⚡1