Agent skills use past experience and current observations to guide decisions and actions on related tasks. This experience is retained in skill state, whose reuse can amortize inference-time reasoning and environment interaction. When environment changes, parts of this state can become outdated while others remain usef...
Ömer Faruk Akgül, Shu-Li Jiang, Yu-Ting Zhang et al.· 0 citations
Pixel-based language models process rendered text without relying on a fixed subword vocabulary, offering a promising approach to noisy and multilingual inputs. However, their practical value depends on whether they can be reliably adapted to downstream tasks. To this end, we systematically examine this question throug...
Hao-Wen Tang, Wei Xia, Rao-Yuan Zhao et al.· 0 citations
Coding agents are typically provided end-to-end behavioral specifications that the code they produce should satisfy, such as tests and input--output examples. How many such specifications must a developer provide, and which ones, for the agent to produce the developer's intended program? We argue that this cannot be de...
Aditya Golatkar, Alessandro Achille, Renos Zabounidis et al.· 0 citations
The proposed EDRM (Entropy Dynamics-based Reasoning Manifold), a lightweight routing framework whose default heuristic requires no router training, supports selective reasoning based on early decoding signals and demonstrates the potential of entropy-based control for efficient LLM inference.
Wei Xia, Haoqing Wang, Zhi-Hong Deng et al.· 2 citations
Test-time context optimization adapts frozen language models through textual feedback, but ordinary conditional generation provides no separate control over how strongly to reinforce the distributional changes induced by a context update. We introduce EMO, a training-free framework inspired by expectation--maximization...
This work systematically compares six causal structures, eight latent representations, and four training objectives, covering popular design choices in existing WAMs, to provide a systematic understanding of how core design choices affect world-action modeling and what principles can guide the development of future WAM...
Mixture-of-Experts (MoE) language models suffer from large parameter counts, which create a significant memory bottleneck. Expert pruning is the most direct approach for reducing this parameter count, yet existing methods make pruning decisions for each expert independently, and assume experts'contributions are purely...
Alex M. Tseng, Prannay Kaul, L. Zancato et al.· arXiv.org· 2 citations
FaithEyes, a multi-agent self-judging framework that uses a VLM to judge whether each process image helps answer the question and designs a multi-agent framework where the model itself serves as a subagent to judge the tool calls from the main agent, eliminating any dependence on external models at inference.