When one AI agent tells another that "the tests passed" or "a person approved this refund", the receiver has only the sender's word. A2A and MCP authenticate the channel, but the sender is the party in doubt, so a prompt-injected agent can launder fabricated facts and authority through a multi-agent system. We present...
This work introduces Critic-Guided Synthetic Experience (CGSE) generation in world models, using the world model as a local transition generator, leveraging critic guidance to choose actions inside that model to generate synthetic experiences offline.
Jorge Penim de Freitas, Christos Ziakas, Alessandra Russo· 0 citations
Tactus is presented, a textile-integrated sensing glove that co-optimizes three design pillars: a thin, conformal 3D-knit form factor, strategically placed capacitive tactile sensors at manipulation-relevant regions informed by empirical contact studies, and IMU-fused pose tracking that maintains accuracy through the h...
Li Guan, Rachael Granberry, Sahar A. Aseeri et al.· 0 citations
Large language model agents have begun to carry out laboratory measurements, but their scientific conclusions are useful only if they hold up under scrutiny. Demonstrating this requires controlled studies because models are stochastic and the context a model is given steers its conclusions. Here we introduce HERA, an a...
Zachary W. Gomez, N. Bittner, Jordan T. McCourt et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Reinforcement fine-tuning has become an effective post-training paradigm for improving the reasoning ability of large language models, but it remains sample-inefficient when the training distribution is mismatched to the model's current capability. In group-relative objectives such as Group Relative Policy Optimization...
Balatro, a 2024 roguelike deckbuilder, presents three difficulties that have historically derailed reinforcement learning methods: a 3,000-action state-dependent action space, horizons of several hundred decisions with sparse rewards, and pervasive stochasticity in both card draws and shop generation. Published RL resu...
What computational role does overparameterisation play during learning? Information-plane analyses suggest that neural networks can traverse representations substantially more complex than those required by their final predictors. We explore when this transient complexity serves a computational purpose by comparing the...
Ryan Singh, Miguel De Llanza, Christopher L. Buckley· 0 citations
On-policy distillation (OPD) is increasingly adopted in the post-training of large language models. However, a stronger teacher may fail to improve the student. Prior work attributes this to a lack of new knowledge, but what that knowledge is remains unclear. We show that OPD learns not only \textit{how to branch}, i.e...
Shiping Yang, Chuanqi Tang, Hossein Hajimirsadeghi et al.· 0 citations
Compositional generalization remains a persistent limitation of transformer language models: even when a model learns to combine known facts correctly in-distribution (ID), the same compositional mechanism may fail when applied to out-of-distribution (OOD) knowledge. We investigate this compositionality gap in a contro...
While vast literature on high-dimensional data visualization is available, there are not many works regarding the visualization of feature scorers and their results. Feature scorers are algorithms that assign numerical importance to each feature of multi-dimensional datasets. These importance scores can be used in seve...
Bruno Iochins Grisci, Mario Inostroza-Ponta, M\'arcio Dorn· 0 citations
This paper establishes a connection between the full gradient and min-min dynamics between the GFlowNet and a decoupled sampler, showing that the sampler reduces observed violations by avoiding high-error regions.
Pedro Dall'Antonia, Daniel Csillag, Diego Mesquita· 0 citations
Fast and accurate models for AC power flow (ACPF) are increasingly important as modern electrical grids require more frequent system analyses. Graph neural networks (GNNs) naturally exploit electrical grid topology, yet the effects of architectural design choices on predictive performance remain poorly understood given...
Federico Clerici, Ferran Bohigas-Daranas, Hamid Latif-Mart\'inez et al.· 0 citations