Foundation models are typically trained in stages: pretraining, midtraining, supervised fine-tuning (SFT), and reinforcement learning (RL), with changes in both data and learning algorithms. We show that this algorithmic separation is not fundamental. By deriving suitable RL objectives as maximum-likelihood fitting to...
Yu-Da Song, Alvin Zhang, Fahim Tajwar et al.· 0 citations
AgentOdyssey is introduced, a novel evaluation framework that procedurally generates open-ended text games with rich entities, world dynamics, and long-horizon tasks and proposes a multifaceted evaluation methodology that measures not only game progress but also offers diagnostic tests on world knowledge acquisition, e...
This work introduces harness learning, which trains a proposer model to revise a solver's harness using execution feedback, and formulate this process as meta-learning over executable programs, with harness revisions playing the role of weight updates in gradient-based adaptation.
Alvin Zhang, Xue-Chen Liu, Zi-Xuan Wang et al.· arXiv.org· 0 citations
Together, these results show that composing complementary mechanisms substantially improves long-horizon memorization beyond what any individual mechanism achieves.
Zhe-Yuan Zhang, Alvin Zhang, Daniel Khashabi et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.