A large-scale empirical study reimplementing 19 high-impact multimodal methods across nine diverse datasets with up to 23 modalities argues for a shift in focus for multimodal learning: away from the pursuit of architectural novelty and toward methodological rigor.
Tillmann Rheude, R. Eils, B. Wild· arXiv.org· 5 citations
We develop a finite-dimensional sensitivity framework for studying stability in learning systems whose states include representations, parameters, and update variables. The central object is the \emph{Learning Stability Profile}, a collection of directional sensitivity operators that records how perturbations in inputs...
Large language model (LLM) agents -- LLMs that dynamically interact with an environment over long horizons -- have become an increasingly important area of research, enabling automation in complex tasks involving tool-use, web browsing, and dialogue with people. In the absence of expert demonstrations, training LLM age...
Joey Hong, Kang Liu, Zhan Ling et al.· 0 citations
Artificial intelligence increasingly guides decisions in safety-critical settings, yet neural networks can remain overconfident when confronted with ambiguous observations or unfamiliar inputs. Bayesian neural networks quantify such uncertainty by replacing every weight with a probability distribution, but sampling man...
F. Br\"uckerhoff-Pl\"uckelmann, H. Borras, S. U. Hulyal et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual incentives can undermine collective welfare. While reinforcement learning (RL)...
Dereck Piche, Mohammed Muqeeth, Milad Aghajohari et al.· 0 citations
We study latent geometry as an explicit component of representation quality in data-scarce learning. For an encoder (\phi), we define (Q_{\beta,\gamma}(\phi)=I(\phi(X);Y)-\beta\mathcal C(\phi)-\gamma d_{\mathrm{int}}(\phi)), combining task-relevant information with penalties for curvature and intrinsic latent dimension...
This work model ward escalation decisions using a multi-action restless multi-armed bandit model and develops Multi-action Index Learning and Optimization Policy (MILOP) as a computational solution approach, which trains a neural network to generate a high-quality index policy using a decision-focused learning approach...
Himadri S. Pandey, M. Mai, N. Muthu et al.· 2 citations
We present a unified theoretical framework for analyzing the stability and consistency of Physics-Informed Neural Networks (PINNs), grounded in operator coercivity, variational formulations, and non-asymptotic perturbation theory. PINNs approximate solutions to partial differential equations (PDEs) by minimizing residu...
Slim attention shrinks the context memory size by 2x for transformer models with MHA (multi-head attention), which can speed up inference by up to 2x for large context windows.
Slim attention is an exact, mathematically identical implementation of the standard attention mechanism and therefore doesn't compromise mode...
Nils Graef, Kayvan Zahiri, Andrew Wasielewski· 0 citations
We study the noise-free Gaussian Process (GP) bandits problem, in which the learner seeks to minimize regret through noise-free observations of the black-box objective function lying on the known reproducing kernel Hilbert space (RKHS). Gaussian process upper confidence bound (GP-UCB) is the well-known GP-bandits algor...
Fine-tuning pre-trained Large Language Models (LLMs) for downstream tasks using First-Order (FO) optimizers presents significant computational challenges. Parameter-Efficient Fine-Tuning (PEFT) methods address these by freezing most model parameters and training only a small subset. However, PEFT often underperforms co...
Reza Shirkavand, Peiran Yu, Qi He et al.· 0 citations
A Latent Reasoning framework in Continuous space (LARC), which alleviates the token-level bottleneck by reasoning over continuous hidden states and achieves state-of-the-art performance on GenEval and demonstrates clear test-time scaling behavior.
Byungwoo Jeon, Yoonwoo Jeong, Hyunseok Lee et al.· 0 citations
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
MIT News · Artificial Intelligence· news.mit.eduOct 28, 2026
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
MIT News · Artificial Intelligence· news.mit.eduOct 27, 2026
Prabha Jha used her experience with MIT Open Learning’s program for senior executives to develop AI solutions for her employer, Verizon, and to write a book.