Early successes on agentic robotics point to a potential paradigm shift toward using coding agents to control robots. Existing robotics benchmarks are built around visuomotor policy learning, leaving it open whether coding agents can reliably control diverse robots under physical-world constraints. We therefore introdu...
Kang-Rui Wang, Qineng Wang, Chang-He Chen et al.· 0 citations
Jais 3 is presented, a fleet of six open, Arabic-centric agentic language models ranging from 0.9B to 375B parameters, with particularly strong agentic capabilities and Arabic instruction following, and far fewer hallucinations.
Team Ifm, Hao-Nan Li, Hadi Abdine et al.· 0 citations
Predicting the effects of individual and combined perturbations is central to identifying context-specific vulnerabilities and designing targeted interventions. Yet learning gene representations that integrate functional relationships with cellular state and transfer across perturbation tasks remains challenging. Here,...
Nicholas Ho, E. Xing, Jian Ma· bioRxiv· 0 citations
This study examines how spatial inequities shape urban livability by integrating scalable artificial intelligence methods with community-based insights and demonstrates that spatial inequities are both visible in the physical streetscape and embodied in daily life.
A. L. Favarão Leão, Yi Wang, B. Banda et al.· Journal of urban health· 0 citations
Looped language models reuse physical Transformer blocks across logical depth, but established architectures entangle recurrence placement, input injection, and recurrent state organization. We isolate these axes in models trained from scratch at matched parameter scale, logical depth, and token budgets, and then test...
Benhao Huang, Chu-Fan Shi, Jun-Lin Chen et al.· 4 citations
Muon controls weight updates through the RMS movement of a linear layer's output. This implicitly treats the linear output as a proxy for the full module, including the nonlinearity that follows. This proxy can be misleading for softmax, where the RMS shift in activations does not faithfully measure the change in the o...
Aditya Somasundaram, Charles Guille-Escuret, Alexander Moreno et al.· 0 citations
Multimodal large language models (MLLMs) struggle with spatial, embodied, physical, and temporal reasoning. We hypothesize that these failures reflect a shared deficit in visual transition reasoning, and test whether this capability can serve as a shared training primitive, one that different models can learn from diff...
Zhe-Yu Fan, Yue Zhang, Ming-Kai Deng et al.· 0 citations
This work improves the two components of training that shape these fixed points: the depth prior and input injection, and learns the prior from prediction feedback, with an entropy term that keeps it broad.
Fluorescence microscopy reveals where proteins localize, but only a limited number of proteins can be imaged in the same cell; generating these images from amino-acid sequence and the cell's morphological context enables in silico localization of unimaged proteins. The two conditions, however, play asymmetric roles: mo...
Sazan Mahbub, Caleb N. Ellington, E. Xing· 0 citations
Muon motivates designing optimizer geometry around the function of each parameter block and uses the spectral norm for hidden linear layers. For the language-model head, the spectral norm is not a faithful measure of functional change. Softmax removes shared logit shifts, whereas the spectral norm can assign arbitraril...
Aditya Somasundaram, Charles Guille-Escuret, Alexander Moreno et al.· 0 citations
WM-VLM is introduced, which equips a pretrained VLM with a lightweight world model branch for generating intermediate visual states and suggests that internal world models offer a promising path toward VLMs that reason in both language and visual space.
GProj (gauge projection), which restores the zero sum after the cast with two rank-one corrections per row, and cuts the remaining median query/key gradient errors from 219%/13% to 0.34%/0.37%, on par with FP32 attention, for 4.7% more time per training step.
Jun-Lin Chen, Daize Dong, Huan-Wei Di et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.