Existing large language model (LLM) based multi-agent systems have been shown to scale poorly, and we identify three problems: reading burden that grows with the group, useful information diluted by shared work of unknown quality, and fragility to failed agents. We argue that the problems are largely due to agent-centr...
Zhen-Ting Qi, Zhuo-Kai Zhao, Ru-Lin Shao et al.· 0 citations
Despite rapid progress in automating scientific research, generating promising and well grounded research solutions remains a central challenge. We isolate research ideation as a standalone task and build our solution on the intuition that a challenge in one field can often be addressed by a mechanism that solved an an...
Jia-Rui Liu, Ren-Jie Tao, Yi-Wei Liao et al.· 0 citations
Context Language Models are introduced, language models that natively manage their own context and can be steered with natural-language instructions evolved through a standard skill-optimization loop, improving held-out accuracy by up to 35.9 points on a context-management task while reducing compute.
Ru-Lin Shao, Shannon Zejiang Shen, J. Yin et al.· 0 citations
This work introduces ConfQA, a fine-tuning strategy that reduces hallucination rates from 20-40% to below 5% across multiple factuality benchmarks, and proposes ConfRAG, a triggering strategy that invokes RAG only when the model responses with unsure.
Switch Distillation is proposed, a simple mid-training objective that distills on tokens where the teacher is confident, using teacher predictive entropy as a lightweight routing signal, and otherwise falls back to cross-entropy, which consistently outperforms existing distillation objectives across teacher sizes.
Jacqueline He, Howard Yen, S. Li et al.· 0 citations
Anchored Decoding is proposed, a plug-and-play inference-time method for suppressing verbatim copying that enables decoding from any risky LM trained on mixed-license data by keeping generation in bounded proximity to a permissively trained safe LM.
Jacqueline He, J. Hayase, Wen-tau Yih et al.· arXiv.org· 0 citations
This work introduces S-EMBER (Streaming Egocentric Memory Benchmark for Episodic Retrieval), a large-scale benchmark comprising 3,141 videos totaling 388 hours of organic activity captured via Ray-Ban Meta smart glasses that establishes a hardware-authentic foundation for developing grounded, reliable episodic memory i...
Xiaodong Wang, Xuanyi Zhao, Pedro Rodriguez et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.