While reinforcement learning (RL) successfully enhances reasoning in large language models, its role in fostering compositional generalization (the ability to synthesize novel skills from known components) is often conflated with mere length generalization. To this end, we study what RL post-training teaches about skil...
Simon Park, Simran Kaur, Sanjeev Arora· 0 citations
Mixture-of-experts (MoE) models often exceed a single accelerator's memory capacity. Offloading experts to host memory creates a severe PCIe I/O bottleneck because data-dependent routing keeps transfers on the critical path. We present Specter, an inference system that uses quantization to combine speculative decoding...
Wenfeng Wang, Xiaofeng Hou, Xinfeng Xia et al.· 0 citations
An adversarial game in which the discriminator tightens this bound and the generator maximizes it is formulated, and it is shown that, under balanced class priors, the population game is equivalent to minimizing total variation between the data and generator distributions.
Mohammadreza Tavasoli Naeini, Ali Bereyhi, Morteza Noshad et al.· 0 citations
Reliable value estimation serves as the cornerstone of reinforcement learning (RL) by evaluating long-term returns and guiding policy improvement, significantly influencing the convergence speed and final performance. Existing works improve the reliability of value function estimation via multi-critic ensembles and dis...
Shan Zhong, Shutong Ding, He Diao et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Partial observability is a notorious challenge in reinforcement learning (RL), due to the need to learn complex, history-dependent policies. Recent empirical successes have used privileged expert distillation--which leverages availability of latent state information during training (e.g., from a simulator) to learn and...
Yuda Song, Dhruv Rohatgi, Aarti Singh et al.· 0 citations
Estimating the tangent spaces of a data manifold is a fundamental problem in geometric data analysis. The standard approach, Local Principal Component Analysis (LPCA), struggles in high-noise settings due to a critical trade-off in choosing the neighborhood size. Selecting an optimal size requires prior knowledge of th...
Dhruv Kohli, Sawyer J. Robertson, Gal Mishne et al.· 0 citations
Estimating the energy use of virtual servers is difficult because physical power interfaces and privileged host counters are typically accessible only on the underlying physical host. We investigate a machine learning approach that predicts the CPU-package power attributable to an individual virtual server from system...
Equation discovery is a fundamental learning task for uncovering the underlying dynamics of complex systems, with wide-ranging applications in areas such as brain connectivity analysis, climate modeling, gene regulation, and physical simulation. However, many existing approaches rely on accurate derivative estimation a...
Critical heat flux (CHF) marks the onset of boiling crisis in light-water reactors, defining safe thermal-hydraulic operating limits. To support Phase II of the OECD/NEA AI/ML CHF benchmark, which introduces spatially varying power profiles, this work compiles and digitizes a broad CHF dataset covering both uniform and...
Reece Bourisaw, Reid McCants, Jean-Marie Le Corre et al.· 0 citations
This work shows that, when there is a quadratic gap in computational resources between attacker and defender, every learnable classification task admits either a transferable attack or an adversarial defense, and proves a stronger result that implies this failure.
Greg Gluch, S. Goldwasser, Anastasiia Struss· 1 citation
Policy gradient methods are among the most successful approaches for solving challenging reinforcement learning problems. Despite their empirical success, many state-of-the-art policy gradient algorithms for discounted problems estimate update directions using a sampling distribution that differs from the discounted st...
Weizhen Wang, Xinzhe Zhou, Jianping He et al.· 0 citations
Predicting post-intervention distributions from observational data is central to many scientific and decision-making problems, but remains challenging due to causal ambiguity, restrictive modeling assumptions, and the lack of amortization across tasks. We introduce ACTIVA, a transformer-based conditional variational au...
Andreas Sauter, Saber Salehkaleybar, Frank van Harmelen et al.· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
MIT News · Artificial Intelligence· news.mit.eduOct 28, 2026
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
MIT News · Artificial Intelligence· news.mit.eduOct 27, 2026
Prabha Jha used her experience with MIT Open Learning’s program for senior executives to develop AI solutions for her employer, Verizon, and to write a book.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.