Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

CTIA-ODE: Continuous-Time Inter-Variable Attention for Long-Term Time Series Forecasting

Although multivariate time series forecasting has broad application prospects, effectively incorporating exogenous variables remains challenging. Prevailing discrete-time architectures often impose rigid temporal alignment across heterogeneous variables, which may limit their ability to capture continuously evolving ex...

Chengyi Pan, Huangqimei Zheng, Hao Xue · 0 citations
#machine learning Preprint Oct 2026

MAPLE: A Multi-Axis Parametric Knowledge Extraction Lens for LLM Evaluation

LLMs absorb vast knowledge from training data, yet their inherently probabilistic nature offers no guarantee that this knowledge will surface in their outputs. To bridge this gap, Knowledge Extraction Enhancement (KEE) techniques such as activation steering, decoding adjustments, and prompting modify inference, potenti...

Minsuh Joo, Youna Kim, Choonghyun Park et al. · 0 citations
#machine learning Preprint Oct 2026

When Does Depth Help? Understanding Layerwise Inference in Tabular Foundation Models

Transformer-based tabular foundation models (TFMs) achieve state-of-the-art performance on small to medium-sized tabular prediction tasks while processing diverse inputs through a shared stack of layers. Recent layerwise analyses identify strong predictive performance in early TFM representations and substantial overla...

Wen-Wen Gong, Hao-Tian Gu, Zhen Yang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

VaryST: Generalizable Spatio-Temporal Forecasting Beyond the Closed-World Setting

Spatio-temporal forecasting is fundamental to many real-world systems, yet deployment environments are inherently varying: temporal distributions may evolve, spatial domains may change, and observation availability may shift from training conditions. Existing models are often tightly coupled to their training environme...

Shengnan Guo, Jinjun Cheng, Xiaowei Mao et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Efficient contextual partial monitoring with general function approximation

We study finite stochastic partial monitoring (PM) games with side information, a paradigm of sequential learning with partial feedback. On each round $t \in [T]$, both player and environment observe a context and player chooses an action and environment simultaneously chooses an outcome. The player neither observes th...

Kapilan Balagopalan, Hao Qin, Kwang-Sung Jun et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Asymptotically Exact Negative Guidance of Diffusion Models via Positive-Unlabeled Learning

Negative guidance of diffusion models generates samples that avoid an undesired condition, specified either by reference samples or by a conditional score alongside an unconditional model. Existing methods inject repulsive terms derived from local information at each sample, so the resulting sampler does not target an...

Hirohane Takagi, Masashi Sugiyama · 0 citations
#machine learning Preprint Oct 2026

Reinforcement Learning via Advantage Guidance

Reinforcement learning (RL) holds the promise of learning a policy that can outperform what is shown in the data. However, in practice, such systems suffer from instability and hyperparameter sensitivity. In contrast, supervised learning provides a stable and scalable training objective, but is fundamentally limited by...

Zhi-Yuan Zhou, Sergey Levine · 0 citations
#machine learning Preprint Oct 2026

Learning Who Benefits Most: Multi-Treatment Causal Ranking for Population Health Stratification

Population health stratification frameworks, such as the Italian DM77, organize patients by clinical need and care pathways but offer limited guidance on which care changes to prioritize under constrained resources. We present PROMETHEUS (Proactive Resource Optimization through Multi-treatment Effect-based Targeting in...

Rocco Zaccagnino, M. Girolamo, Alberto Lombardi et al. · 0 citations
#machine learning Preprint Oct 2026

From Global to Tail Convergence: Dynamics of $\alpha$-Stable Score-Based Generative Models

A non-asymptotic convergence analysis for scale-preserving $\alpha$-stable generative dynamics, covering both compactly supported and power-law targets, identifies tail-index matching as a principled mechanism behind the ability of stable generative models to capture extreme events.

Ianis Hammani, Claire Boyer · 0 citations
#machine learning Preprint Oct 2026

Learning to Compute Is Not Learning to Retain or Reuse in Looped Transformers

In in-context Mealy-machine execution, where a simulator supplies intermediate targets and exact counterfactuals for hidden-state interventions,Looped transformers compute by applying one block repeatedly, so they can run for more loops than they were trained with.

Pei-Long Zhou, Hong-Tao Zhang, Yu-Long Huang et al. · 0 citations
#machine learning Preprint Oct 2026

CAST: History-Adaptive Spectral Clipping for LLM Pretraining

This work introduces CAST (Clipping with Adaptive Scales and Thresholds), a history-adaptive extension of SSC that achieves lower training and mean validation losses than nine gradient-processing baselines, with the fewest relative gradient spikes.

Jia-Cheng Li, Jian-Chao Tan, Ke-Feng Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

ProtModernBERT: Compute-Efficient Protein Language Modeling

Large protein language models provide a powerful framework for learning sequence-function relationships and guiding experimental design. However, architectural improvements are underexplored, especially in low-compute regimes of relevance for resource-constrained research laboratories. We show that the training cost fo...

Alberto Martínez, Natalia Flechas Manrique, Llorenç Espinosa-Portalés et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.