Training LLM agents with reinforcement learning (RL) is bottlenecked by environments, which must provide verifiable rewards, support long-horizon interaction, and scale cheaply. Existing approaches rely on costly human-curated data or on LLM-generated environments that risk hallucinations and benchmark contamination. W...
Anmol Kabra, Swathi Saravana Selvam, Albert Gong et al.· 0 citations
Experiments show that MoRE consistently achieves lower perplexity and stronger downstream performance than standard MoEs and state-of-the-art weight-sharing architectures at matched compute and parameter budgets, with only minimal modifications to existing MoE implementations.
Eric S. Qiu, U. U. Acikalin, Justin Lovelace et al.· 1 citation
Kevo is a co-evolving framework that jointly learns to construct a structured knowledge base and reason over it for knowledge-intensive question answering, which leads to larger, better-connected knowledge structures with higher answer reachability, while also improving compositional factual reasoning and controllabili...
Ryan Thomas Noonan, Lin-Xi Zhao, Meng-Han Xu et al.· 0 citations
This work proposes continuous-query LMLM (CO-LMLM), where the KB pairs continuous keys with textual knowledge values, a significant departure from prior reliance on relational KB and queries, which outperforms prior LMLMs and vanilla LLMs in both perplexity and factual precision.
Yair Feldman, Lin-Xi Zhao, Nathan Godey et al.· 0 citations
Optizing Your Sampling (OYS), which instead treats timestep selection as a black-box optimization problem, optimizing the target metric directly with Bayesian optimization, improves both simple and sophisticated samplers such as Euler and DPM-Solver++.
Travis Zhang, Christian K. Belardi, Justin Lovelace et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.