KV-streams is proposed, a plug-and-play strategy compatible with any compaction strategy that substantially increases throughput while showing no evidence of hindering performance, and is shown to be an efficient and lightweight plug-and-play addition to any post-training pipeline.
Emiliano Penaloza, Dane Malenfant, Dheeraj Vattikonda et al.· 0 citations
Retrospection-Only Fine-Tuning (ROFT), a minimal online procedure designed to isolate the effect of explanation-only training on subsequent behavior, is studied, showing that learning to explain can also improve learning to do and motivating further study of explanation-to-action transfer.
Jonathan Light, C. Cui, Jeonghye Kim et al.· 0 citations
An LLM agent framework, JAZ, is built to explore the extent to which a minimal harness that is little more than the agent loop itself can accomplish tasks these specialized systems are built for.
Zhe-Ning Li, Joshua Liu, M. Vukelic et al.· arXiv.org· 1 citation
We present FrogNano, a 4B coding agent designed to tackle software engineering (SWE) tasks efficiently and effectively, even under resource-constrained environments. It is post-trained exclusively via RL on around 1,500 SWE environments with synthetic tasks. A key ingredient for improving performance is an online task...
Minseon Kim, Zheng-Yan Shi, Emiliano Penaloza et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.